You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Nov 22, 2022. It is now read-only.
Summary:
While using fp16 during MLM training there's a weird bug during metric reporting that causes a division by zero failure while computing the training speed (an example is below). Preventing this failure by adding a small value to the denominator.
Example: f136667996
Reviewed By: chenyangyu1988
Differential Revision: D17293910
fbshipit-source-id: 880213cbbe9f88d63126fc487e44a705c1ed459a
0 commit comments