AI & Machine Learning
MXFP8 MoE Training: 1.3x Speedup, But Skepticism Lingers
MXFP8 just turbocharged MoE training by 30% on massive GB200 setups. Equivalent quality to BF16? Sure. But let's poke holes in the hype.