Load balancing options - Technical Help - DeepTalk - Deep Learning Community
Load balancing options
Post by cdellinger on Jul 20, 2024
For a scenario where there are multiple LambdaLabs servers, what is recommended for having them sit behind a load balancer? My use case is one where I want at least two LambdaLabs servers handling on-demand requests and I would like to have a low-latency load balancer to evenly distribute the requests across the servers.
105 views