This incident has been resolved.
Jul 18, 20:19 EDT
The Discord Bot Node Emergency Maintenance has been finished and we are currently monitoring the node for any other issues.
Jul 18, 19:55 EDT
Upload is finished. Rebooting NA3
Jul 18, 19:47 EDT
Now Transferring Backup back to NA3 from NA2 and NA1
Jul 18, 19:38 EDT
Currently resetting up na3.
Jul 18, 19:21 EDT
We are now reinstalling NA3
Jul 18, 18:42 EDT
Currently the Discord Bot Node (NA3) had a Raid misconfiguration that wasn't noticed until after we released the node to production.
We will be making a huge backup of all services on the node and storing them on our extra node to make sure we do not lose it.
After that we will reinstall the node with the correct raid configuration. This should only take a few hours.
Jul 18, 18:19 EDT
We identified an issue with some of our servers where the raid is using all the storage on our servers. We are working to get this resolved
Jul 18, 18:11 EDT