The Lambda Deep Learning Blog

RTX A6000 Deep Learning Benchmarks

Published on January 4, 2021 by Michael Balaban
Lambda is now shipping RTX A6000 workstations & servers. In this post, we benchmark the RTX A6000's PyTorch and TensorFlow training performance. We compare ...

1, 2 & 4-GPU NVIDIA Quadro RTX 6000 Lambda GPU Cloud Instances

Published on October 29, 2020 by Remy Guercio
Starting today, you can now spin up virtual machines with 1, 2, or 4 NVIDIA® Quadro RTX™ 6000 GPUs on Lambda's GPU cloud. We’ve built this new general purpose ...

Lambda Echelon – a turn key GPU cluster for your ML team

Published on October 6, 2020 by Stephen Balaban
Introducing the Lambda Echelon. Lambda Echelon is a GPU cluster designed for AI. It comes with the compute, storage, network, power, and support you need to ...

Deep Learning Hardware Deep Dive – RTX 3090, RTX 3080, and RTX 3070

Published on September 14, 2020 by Michael Balaban
Check out the discussion on Reddit 288 upvotes, 95 comments

GPT-3 A Hitchhiker's Guide

Published on July 20, 2020 by Michael Balaban
The goal of this post is to guide your thinking on GPT-3. This post will:

OpenAI's GPT-3 Language Model: A Technical Overview

Published on June 3, 2020 by Chuan Li

NVIDIA A100 GPU Benchmarks for Deep Learning

Published on May 22, 2020 by Stephen Balaban
Lambda customers are starting to ask about the new NVIDIA A100 GPU and our Hyperplane A100 server. The A100 will likely see large gains on models like ...

Cutting the cost of deep learning — Lambda Cloud 8-GPU V100 instances

Published on May 13, 2020 by Remy Guercio
With most (if not all) machine learning and deep learning researchers and engineers now working from home due to COVID-19, we’ve seen a massive increase in the ...

How to Transfer Data to Lambda Cloud GPU Instances

Published on May 3, 2020 by Remy Guercio
You can now use Lambda Cloud High Speed Filesystems to permanently store data on the Lambda Cloud. Click here to learn how to use Lambda Cloud Filesystems.

Getting Started Guide — Lambda Cloud GPU Instances

Published on May 3, 2020 by Remy Guercio
This guide will walk you through the process of launching a Lambda Cloud GPU instance and using SSH to log in. While we offer both a Web Terminal and Jupyter ...

Hyperplane-16 InfiniBand Cluster Total Cost of Ownership Analysis

Published on April 7, 2020 by Stephen Balaban
In this post, we'll walk through using our Total Cost of Ownership (TCO) calculator to examine the cost of a variety of Lambda Hyperplane-16 clusters. We have ...

Choosing the Best GPU for Deep Learning in 2020

Published on February 18, 2020 by Michael Balaban
State-of-the-art (SOTA) deep learning models have massive memory footprints. Many GPUs don't have enough VRAM to train them. In this post, we determine which ...

Training Neural Networks in Record Time with the Hyperplane-16

Published on December 19, 2019 by Chuan Li

Setting up a Mellanox InfiniBand Switch (SB7800 36-port EDR)

Published on October 30, 2019 by Stephen Balaban
The desired end-state of this tutorial, a running subnet manager on your switch. This tutorial will walk you through the steps required to set up a Mellanox ...

TensorFlow 2.0 Tutorial 01: Basic Image Classification

Published on October 1, 2019 by Chuan Li
TensorFlow 2 is now live! This tutorial walks you through the process of building a simple CIFAR-10 image classifier using deep learning. In this tutorial, we ...