# The Lambda Deep Learning Blog

Published on June 9, 2026  
by Chuan Li and Ksenia Anske  
**[Building at the speed of research: Lambda at CVPR 2026](https://lambda.ai/blog/lambda-at-cvpr-2026)**  
Every year, CVPR draws the researchers defining what AI can see, understand, and act on. This year in Denver, more than 9,000 attendees showed up with over ...

Published on April 23, 2026  
by Chuan Li  
**[ICLR 2026: 12 papers on making AI systems reliable, efficient, and secure](https://lambda.ai/blog/iclr-2026-12-papers)**  
A 7B agent that beats GPT-4o. Lossless weight compression that speeds up inference by 177%. An arena where 23 teams battled across 103,000 adversarial rounds. ...

Published on December 15, 2025  
by Chuan Li  
**[From bigger models to better intelligence: what NeurIPS 2025 tells us about progress](https://lambda.ai/blog/neurips-2025-from-bigger-models-to-better-intelligence)**  
NeurIPS has always been a mirror: it doesn’t just reflect what the community is building, it reveals what the community is starting to believe. In 2025, that ...

Published on December 20, 2023  
by Chuan Li  
**[Benchmarking ZeRO-Inference on the NVIDIA GH200 Grace Hopper Superchip](https://lambda.ai/blog/benchmarking-zero-inference-on-the-nvidia-gh200-grace-hopper-superchip)**  
This blog explores the synergy of DeepSpeed’s ZeRO-Inference, a technology designed to make large AI model inference more accessible and cost-effective, with ...

.png)
Published on November 21, 2023  
by Chuan Li  
**[Unleashing the power of Transformers with NVIDIA Transformer Engine](https://lambda.ai/blog/unleashing-the-power-of-transformers-with-nvidia-transformer-engine)**  
In this blog, Lambda showcases the capabilities of NVIDIA’s Transformer Engine, a cutting-edge library that accelerates the performance of transformer models ...

Published on October 12, 2023  
by Chuan Li  
**[DeepChat 3-Step Training At Scale: Lambda’s Instances of NVIDIA H100 SXM5 vs A100 SXM4](https://lambda.ai/blog/deepchat-3-step-training-at-scale-nvidia-h100-sxm5-vs-a100-sxm4)**  
GPU benchmarks on Lambda’s offering of the NVIDIA H100 SXM5 vs the NVIDIA A100 SXM4 using DeepChat’s 3-step training example.

.png)
Published on August 24, 2023  
by Chuan Li  
**[How FlashAttention-2 Accelerates LLMs on NVIDIA H100 and A100 GPUs](https://lambda.ai/blog/flashattention-2-lambda-cloud-h100-vs-a100)**  
This blog post walks you through how to use FlashAttention-2 on Lambda Cloud and outlines NVIDIA H100 vs NVIDIA A100 benchmark results for training GPT-3-style ...

Published on March 14, 2023  
by Chuan Li  
**[How To Use mpirun to Launch a LLaMA Inference Job Across Multiple Cloud Instances](https://lambda.ai/blog/how-to-use-mpirun-to-launch-a-llama-inference-job-across-multiple-cloud-instances)**

.png)
Published on December 1, 2022  
by Chuan Li  
**[Hugging Face x Lambda: Whisper Fine-Tuning Event](https://lambda.ai/blog/hugging-face-lambda-whisper-fine-tuning-event)**  
Lambda is thrilled to team up with Hugging Face, a community platform that enables users to build, train, and deploy ML models based on open source code, for a ...

Published on October 31, 2022  
by Chuan Li  
**[NVIDIA GeForce RTX 4090 vs RTX 3090 Deep Learning Benchmark](https://lambda.ai/blog/nvidia-rtx-4090-vs-rtx-3090-deep-learning-benchmark)**  
Available October 2022, the NVIDIA® GeForce RTX 4090 is the newest GPU for gamers, creators, students, and researchers. In this post, we benchmark RTX 4090 to ...

Published on October 5, 2022  
by Chuan Li  
**[NVIDIA H100 Tensor Core GPU - Deep Learning Performance Analysis](https://lambda.ai/blog/nvidia-h100-gpu-deep-learning-performance-analysis)**  
We have seen groundbreaking progress in machine learning over the last couple of years. At the same time, massive usage of GPU infrastructure has become key to ...

Published on August 26, 2022  
by Chuan Li  
**[Multi node PyTorch Distributed Training Guide For People In A Hurry](https://lambda.ai/blog/multi-node-pytorch-distributed-training-guide)**

Published on June 3, 2022  
by Chuan Li  
**[Setting Up A Kubernetes Run:AI Cluster on Lambda Cloud](https://lambda.ai/blog/setting-up-a-runai-cluster-on-lambda-cloud)**  
If you're interested in training the next large transformer like DALL-E, Imagen, or BERT, a single GPU (or even single 8x GPU instance!) might not be enough ...

Published on February 28, 2022  
by Chuan Li  
**[Best GPU for Deep Learning in 2022 (so far)](https://lambda.ai/blog/best-gpu-2022-sofar)**  
TLDR

Published on November 30, 2021  
by Chuan Li  
**[NVIDIA A40 Deep Learning Benchmarks](https://lambda.ai/blog/nvidia-rtx-a40-benchmarks)**  
NVIDIA® A40 GPUs are now available on Lambda Scalar servers. In this post, we benchmark the A40 with 48 GB of GDDR6 VRAM to assess its training performance ...
