There was a fatal hardware failure (smells burned). I moved all bots to another machine. They are all running again but it will take a while for the bots to catch up.