Power outage

解決済み 2021年08月06日 17:12 PDT

All the compute nodes are now back in production, and all services have been restored.

監視中 2021年08月05日 13:52 PDT

Most services have been restored, you can now login and submit jobs again.

Some compute nodes and auxiliary services are still being worked on, they should come back up soon.

原因確定 2021年08月05日 08:00 PDT

Earlier this morning, we had a breaker trip while facilities was going over a switching procedure. Power has been restored now. We’ve started working on bringing services back.
Sherlock is still mostly unavailable at this time.

検証中 2021年08月05日 06:44 PDT

It looks like we lost power in at least portions of the datacenter, investigations are underway.