119354-t4-hour-hotfix-that-didnt-happen

Content
{| style="width: 100%;"

When has Carbine kept to what they say? They contradict themselves frequently  :blink: But i'd rather they put things back instead of rushing through it and releasing it with even more bugs like they did with drop 3. Im crossing my fingers and hoping the server latency on Jabbit was one of the issues they were trying to resolve. Im not sure how much more of that i can take before i rage quit and delete the client from my PC.


 * }
 * }

{| style="width: 100%;"

I agree completely. I haven't had the pleasure of working in the games industry, but I used to work for a software company that ran cloud servers for its multitude of clients. And I can tell you, new software versions were the most nightmarish part of the job. You can have the best testing software out there, the most dedicated QA team, the best devs and support staff. All that doesn't matter, inevitably something will slip through and you'll end up with a totally FUBAR live server. The important thing is what you do next. Carbine did what I consider to be the best actions. They put in a new patch but there were major unexpected issues, so they spent some time trying to fix them and when they couldn't they put the old build back in. I don't get why people are asking about a "rollback" because that's pretty much exactly what they did. In a rollback situation you either replace the build (sometimes manually from the command line if the server is a total goner, had some fun sleepless nights with that) or go full wipe and restore a backup. The former is the most common because it's the easiest, the latter is  the nuclear option you only use when you have to because your servers are down for as long as it takes to replace the image as well as all user data. With our company's relatively simple client data and servers hosted in the same building that would be a few hours for a largish client with a few thousand machines, for a product like Wildstar I wouldn't be surprised if that took them down for a day or more. And that's assuming the backup just magically appeared a minute after the server went down for the hotfix, otherwise you're also looking at potentially hours of lost progress for players. I'm not saying it wasn't an annoying situation, I wanted to play too for the last two or three hours of it. Heck, I wouldn't even argue if people wanted a free day or two of playtime because of it, the devs are big boys and I'm sure they understand the irritation it caused to players with tight schedules or shift workers (myself included). I'm just saying don't assume there is some magic "solve everything" button that works on a massive sharded server setup like theirs. Remember that they wanted everything fixed as quick as possible too, they're not going to make extra work for themselves for no reason.


 * }
 * }