Precision

[anicolson]

Hi,

I was wondering what precision these models were trained at? Float32? Float16? Bfloat16? With mixed precision?

Thanks.

[Andy1621]

Mixed precision~

[anicolson]

Thanks! Was it mixed precision with float16 or bfloat16?

[Andy1621]

float16~