# Reproducible MFU optimization techniques

Most large-scale training operates at 35–45% MFU—well below hardware potential. By benchmarking Llama 3.1 (8B–405B) on NVIDIA Blackwell GPUs, Lambda's AI engineers identified the root causes and built a reproducible framework to close them.

The result: MFU above 60%, a 25%+ improvement over the industry baseline, with no architectural changes and every configuration fully documented for your use.

[Download whitepaper](https://lambda.ai/llama-3-1-blackwell-mfu-benchmarks#contact)

## 2.11x

MFU uplift for Llama 70B on 16x NVIDIA HGX B200

## 60%+

Peak MFU achieved vs. 35–45% industry norm

## 8B–405B

Parameter range benchmarked on Llama 3.1 models, no architecture changes

## Download the whitepaper

Please review our [privacy policy](/content/legal/privacy-policy/index.html) for more information.