DEFCON launches, everything explodes

The forum with all your Introversion News!
User avatar
Chris
Introversion Staff
Introversion Staff
Posts: 1172
Joined: Sat Nov 25, 2000 7:28 pm
Location: Cambridge, UK
Contact:

DEFCON launches, everything explodes

Postby Chris » Wed Oct 04, 2006 11:56 am

On Friday 29th September Introversion Software launched it's third game DEFCON to an eager online crowd, and in the five days since that time we've been busy repairing everything that exploded. The last few days have been full of some serious ups and downs, and its about time we let everyone know what happened.

Launch day was basically an exercise in fire control. Someone remarked it kind of felt like manning a nuclear submarine deep underwater, trying to find a safe way to surface and deliver your payload while enemy carriers dropped depth charges on you from above (I suspect they’d been playing Defcon a bit too much.) Most of our web servers went down about an hour before launch time of 6pm GMT, and it took us quite a while to get things back up and running. The basic problem was simply that our services were totally overloaded. By the time our website was back up (minus forums since they were eating CPU power) the game client had already been released via various mirrors like FilePlanet, and of course the Steam version had gone live on schedule. We emailed activation keys out to all of our customers and pointed them at the available mirrors, and eventually got the main site back up and running. Suddenly users could click on our Download button directly, and we just sat and watched as the numbers went through the roof.

For the first time ever, Introversions bandwidth usage was measured in Terabytes.

The public service that lists all Defcon games is called the MetaServer, and it runs on a powerful dedicated server with a superfast internet connection. Hundreds and hundreds of game servers started springing up all around the world, peaking at about 2,000 simultaneous games on the night of the 29th. We’d stress tested the MetaServer in advance but were not prepared for this volume of usage. Our custom bit of software was having to handle 30,000 incoming messages every minute, meaning if you spend longer than 2 miliseconds thinking about one request you end up backlogging. This caused us all kinds of problems – steam authentication was failing, users couldn’t get server lists a lot of the time, and often the lists they received were out of date and contained servers that had long since shut down. We worked hard on improvements pretty much all night, fixing the worst of the problems and improving the performance. Some of these problems still affect the MetaServer now, although to a much less severe degree, and we’re still working on daily improvements.

Saturday and Sunday involved a typically massive Introversion meeting in the Flying Hamster (our codename for the Flat in Hamstead). Much was discussed, wine was consumed, and the entire company was restructured. We’ve been operating under a model we put together in 2002 when we had just 3 employees and only one project in development, and that model hasn’t been holding up well with our recent expansions. We agreed on the immediate development priorities – MetaServer optimisation, Mac Defcon, the first of many support patches for Defcon, and a couple of other top secret projects that we will announce in due course.

There is one other story of note from that weekend. Due to a fairly major communications failure, our internet service provider dismantled our web server on Sunday morning while it was still live. I have never personally heard so many swear words uttered in such a short period of time. This is just one of those crazy things that only happens when your website is the busiest it has ever been, and led to about six hours of downtime while we transferred the entire Introversion website to another server. What can we say, shit happens.

Monday was the Defcon Launch Party. We were slightly worried about topping the Darwinia launch party (which was essentially a really good house party in the Flying Hamster), but we’re not worried about that anymore. The Defcon Launch Party was awesome fun, and took place in the Cabinet War Rooms in Whitehall, London. For those that don’t know, the War Rooms are basically a series of underground bunkers and control rooms built by Churchill during the second world war - an extremely atmospheric venue, and I’d guess we peaked at around 150 guests. Here’s the Invite:

Image

We had four player Defcon running on laptops at one end of the room, with the game projected on the wall for guests to watch. The laptops had Internet access so we had loads of guests logging in from outside to watch. At the other end of the room we had Wargames projected onto the wall. We had three DJs playing music all night (the same DJs as the Darwinia launch party) and all the key Introversion staff wore RAF uniforms. It was a very cool party that we won’t forget quickly. A big thank you goes out to everyone who came to the party, and we hope you enjoyed it as much as we did.

Image

If you have some pictures of the party on your cameras, please send them to us! Please email them to defconlaunchparty@googlemail.com. If you could reduce them to sensible file sizes first, we’d appreciate it. 1024x768 is more than enough resolution per picture.

Sales of Defcon since launch have been excellent, with about one third choosing to buy from us and get their free boxed copy, and two thirds opting for the convenience of the Steam version. It’s looking like Defcon is going to be our best selling game yet. We’ve got a truly massive backlog of boxed copies to send out, so please accept our apologies if it takes slightly longer than normal. Interestingly, sales of Darwinia and Uplink have also come up quite a lot, with many customers choosing to buy pretty much everything we sell in a single transaction. This makes us very happy  We’ve produced a soundtrack CD and a couple of posters, and they’ll soon be added to the store with more details at the time.

We’re amazed that people have begun to mod the game already, despite Defcon having pretty limited modding ability to start with. We’re planning to improve on this with future patches. So far most of the mods have been graphical changes, but we’re confident some new maps will start to appear soon. We’re going to open up a couple of new Forum channels : one for defcon mods to be advertised and discussed, and another for people to discuss ideas for improvements that can be made to the game. The core gameplay is going to remain locked down now, but there is lots of room for expansion of the core idea.

Finally, we should mention the reviews. It’s looking like we’re picking up 80 – 85% in most reviews, which we’re thrilled by. There are loads to choose from and many more on the way, but we’d particularly like to direct readers to the PC Gamer review in the UK (87% and the MUST BUY award), and the Eurogamer review (8/10).

Thanks!
Last edited by Chris on Wed Oct 04, 2006 12:11 pm, edited 1 time in total.
holdmykidney
level1
level1
Posts: 27
Joined: Mon Jul 31, 2006 3:38 pm

Postby holdmykidney » Wed Oct 04, 2006 12:02 pm

As I stated in my own humble little review over at fragLANd, I took the server downtime on Friday night in good humour, as a practical demonstration of the popularity you folks have accrued over the last four years or so.

My congratulations for bucking industry trends and doing something really unique!
Zarkow
level4
level4
Posts: 550
Joined: Tue Apr 18, 2006 2:54 pm
Contact:

Postby Zarkow » Wed Oct 04, 2006 12:16 pm

As we knew, if the servers go down on launchday it's a good sign. Otherwise it would be a sign of low interest or way too much hardware and broadband bought in - and that wouldn't be good the comming months - since traffic on the launch-day are many-many times more then a normal day 1 week after launch, where everything is supposed to work fine. And I think it will.

Thanks for the write-up, great to see developers taking the time to to really communicate out what happends around the game/service.

Now we are just looking forward to a 'launch-post mortem' a few weeks down the line. :D
User avatar
Hmuda
level3
level3
Posts: 317
Joined: Mon Apr 21, 2003 11:01 pm
Location: Szeged, Hungary

Postby Hmuda » Wed Oct 04, 2006 12:24 pm

I must say: congratulations.

I'm eagerly looking forward to the launch party photos (Vic looks pretty in that uniform ;) ).

By the way: can we see the official number of pre-orders of IV-store and Steam separately? It would be good to see just how far you guys made it by pre-orders.

And lastly: can't wait for the 4th IV game. I'm sure you won't let us down as you never did. :)
User avatar
dobbie
level1
level1
Posts: 17
Joined: Thu Sep 28, 2006 1:18 pm

Postby dobbie » Wed Oct 04, 2006 2:07 pm

yay! ;) I took the probs in stide, and I've seen much worse. Took about an hour to get into the first MP game, but that's not too bad :P Glad to hear things are going well - you deserve it!
Mas Tnega
level5
level5
Posts: 7898
Joined: Sat Mar 02, 2002 11:54 pm
Location: Edinburgh
Contact:

Postby Mas Tnega » Wed Oct 04, 2006 3:14 pm

1. Defcon wasn't the only thing being projected on that screen.
2. One laptop was used to taunt all the wonderful people on #defcon.
3. Goatse had so much of a presence, you might as well call it a gatecrasher!

Don't you just love the more long-standing members of the IV community?
User avatar
xander
level5
level5
Posts: 16869
Joined: Thu Oct 21, 2004 11:41 pm
Location: Highland, CA, USA
Contact:

Postby xander » Wed Oct 04, 2006 3:35 pm

Mas Tnega wrote:Don't you just love the more long-standing members of the IV community?

Heh.

Chris wrote:...Mac Defcon...

\o/

Seriously, though, congratulations. I can't wait for Updefwinia.

xander
TheSquire
level3
level3
Posts: 306
Joined: Sun Apr 16, 2006 5:47 am

Postby TheSquire » Wed Oct 04, 2006 4:53 pm

xander wrote:
Chris wrote:...Mac Defcon...

\o/

Seriously, though, congratulations. I can't wait for Updefwinia.

xander

Sounds like Mac Defcon will be developed inhouse. So there might be hope I won't have to buy it separately after all....
Montyphy
level5
level5
Posts: 6747
Joined: Tue Apr 19, 2005 2:28 pm
Location: Bristol, England

Postby Montyphy » Wed Oct 04, 2006 7:03 pm

Mas Tnega wrote:3. Goatse had so much of a presence, you might as well call it a gatecrasher!


GOATSED!
Uplink help: Check out the Guide or FAQ.
Latest Uplink patch is v1.55.
User avatar
ScareyedHawk
level5
level5
Posts: 1156
Joined: Wed Sep 17, 2003 10:14 pm
Location: Västerås, Sweden

Postby ScareyedHawk » Wed Oct 04, 2006 7:06 pm

Montyphy wrote:
Mas Tnega wrote:3. Goatse had so much of a presence, you might as well call it a gatecrasher!


GOATSED!


i lol'd.


Who is that, anyway?
User avatar
xander
level5
level5
Posts: 16869
Joined: Thu Oct 21, 2004 11:41 pm
Location: Highland, CA, USA
Contact:

Postby xander » Wed Oct 04, 2006 7:23 pm

TheSquire wrote:Sounds like Mac Defcon will be developed inhouse. So there might be hope I won't have to buy it separately after all....

No. ASW have already confirmed that they are publishing Defcon.

xander
Montyphy
level5
level5
Posts: 6747
Joined: Tue Apr 19, 2005 2:28 pm
Location: Bristol, England

Postby Montyphy » Wed Oct 04, 2006 9:01 pm

ScareyedHawk wrote:
Montyphy wrote:
Mas Tnega wrote:3. Goatse had so much of a presence, you might as well call it a gatecrasher!


GOATSED!


i lol'd.


Who is that, anyway?


NeoThermic
Uplink help: Check out the Guide or FAQ.

Latest Uplink patch is v1.55.
User avatar
mibias
level5
level5
Posts: 1487
Joined: Sun Apr 16, 2006 9:54 am
Location: Denmark

Postby mibias » Wed Oct 04, 2006 9:10 pm

hmm... what does goatse mean anyways :?: ...
User avatar
Soaps
level1
level1
Posts: 62
Joined: Sun Oct 01, 2006 10:08 pm

Postby Soaps » Wed Oct 04, 2006 9:16 pm

mibias wrote:hmm... what does goatse mean anyways :?: ...


good question, those english and their crazy made up words!
User avatar
xander
level5
level5
Posts: 16869
Joined: Thu Oct 21, 2004 11:41 pm
Location: Highland, CA, USA
Contact:

Postby xander » Wed Oct 04, 2006 9:19 pm

mibias wrote:hmm... what does goatse mean anyways :?: ...

Once upon a time, there was a shock site called goatse.cx . It may not have been the best, but it was one of the first. It was a link that you would put into things, and hope that naive people would click. They would then see a disturbing image. Modern day equivelents might be something like tubgirl, or moid (both of which, by the way, you should never click. ever.).

xander

Return to “Introversion News”

Who is online

Users browsing this forum: No registered users and 7 guests