Background jobs die after 2 hours - Technical Help - DeepTalk - Deep Learning Community

Background jobs die after 2 hours

post by kyle on Aug 15, 2023

I am experiencing a strange problem. When I run

nohup python my_script.py > my_out.out & the program stops executing after about 2-3 hours. There are no errors and I cannot find anything in the system logs.

A coworker suggested something about the kernel having a background program timeout. Anyone experience something similar and have a fix?

502 views