Info Database Maintenance And Issues

During the process of exporting the database to move it to a different server something caused few files to get reset (it's still unclear what caused this) which made the database unuseable in that state.

After multiple hours of troubleshooting I loaded a backup and started to start the servers again but then I noticed the data was outdated. When I took a closer look at the backup configuration I noticed that it was creating a backup of a old database.

Now I'm trying to recover the current database so we hopefully don't need to use the old backup. This is very time consuming and it's unclear how long it will take but it can take days.


Update: I was able to recover few tables now and going to try to do the same for all other tables.

Update 2: All tables have been recovered and exported on the recovery server, everything is now being imported into the live database on the main server. Once imported we will see if stuff is missing or broken.

Updated 3: Import completed and I couldn't see any issues or errors so far. Few servers are back online without any databases errors. Once your server is back online feel free to join and report any issues which a related to this database incident.
I don't expect any required proxy or database restarts but if issues show up then I will have to execute restarts or go back into maintenance.

Final Note

• AbandonedRestoration: Few servers were running on the backup of the old database which didn't have the up to date absence entries, this might have caused to get player bases to reset. I permanently saved a backup of each server before the incident so we will be able to restore them. If yours got reset because of this then please create a support thread or ticket and we will restore the base for you.
• Votes: If you voted while the database was offline then you will not receive the tokens for it as it directly saves the votes to the database and doesn't cache them. Thank you for voting though.
• Shop: If you purchased a server upgrade, patron rank or anything else during this incident then it might not have applied it to your account. If this is the case for you then please reach out to us with a support thread or ticket and we will make sure it gets added to your account.

 

Yikes. What would happen if we had to revert to the old backup? Would servers get rolled back as a result, or is the database a separate entity from the server files?

 

I do not envy the responsibility you have. Take you time bro do it right we will be here to break it again once it's fixed haha