How can I maximize speed on Lambda GPU instances?

post by Justin6626 on Dec 9, 2024

I am trying to train a reinforcement learning model in Pytorch. I tried a GH200 instance earlier, and now I am trying an 8xH100 instance, and I am finding it unexpectedly slow. Are there any techniques that I can use to take better advantage of the GPU’s capabilities? I am wondering particularly if there are any changes I can make to the environmental variables, or special Pytorch techniques that I should use.

157 views

post by cody_b on Dec 10, 2024

Can you specify in greater detail what you mean by the training is slow? If you have log files, that might help with troubleshooting the issue.