Scaling Rails

Last Wednesday we hosted a Newzwag classroom for a group of 25 Ruby developers who came to eat delicious pizza, drink beer, and learn how we scaled Rails. I personally had a lot of fun putting together the presentation and hosting the guys that showed up.

I presented an overview talk about database gotchas, and how to load test a session-based app. Daniel talked about his unique implementation of memcached as a temporary data store and bulk write mechanism.

The presentations were informed by all of our hands-on experience adapting our write-heavy quiz from it's capacity of 200 simultaneous users all the way up to 30,000 simultaneous users (a 25x efficiency upgrade!). Rails does scale, and just like any other app, requires custom software and hardware solutions to match a project's needs. Throwing hardware at it is the first solution, but analyzing each and every bottleneck all adds up.

We fully intended to record the whole event, but alas we were video camera-challenged... sorry!

Here's a link to the talks on Slideshare, click to download the pdf file.

Links from the talks:

• Active Record Extensions
• Detailed DB Logging
• Ebb (lightweight web server)
• God (Monitoring)
• Gruff Graphs
• Jmeter
• Magic Multi Connections
• Seattle.rb's Memcache Client
• Thin (lightweight web server)

If you have any questions, post 'em up in the comments.

Newzwag <3 Ruby

Josh, our Lead Developer, has volunteered to talk and host The SF Ruby Meetup Group right here at our Maiden Lane headquarters tomorrow night. Daniel thinks he's off the hook, but he'll be there, too. The subject of the meeting will be Scaling Rails in which he'll talk about our experience (and by this I mean our development team) scaling our quiz during the 2008 Beijing Olympics.

BTW: I was really tempted to write "I <3 Rubyes" as the headline but I guess I'll leave that for a custom print t-shirt. :)

A Vote of Confidence

Big day in the U.S. today ... The whole world is paying attention to what may be the most important presidential election in recent history. Though at this time the race is not over, it's clear that the Internet has played a central role the 2008 campaign and positions itself as a big (huge) winner. It's possible that this view from our San Francisco-based office is slightly subjective, but there is no doubt that the access to real-time information and mobile devices have encouraged people to participate, speak up, act, share, link, comment, connect.

We're happy to be part of this.

In the past month, our 2008 Elections Quiz has gotten noticed in a few client sites around the States: The Detroit Free Press, The Washington Times and the Miami Herald. Across sites, more than 10,000 new player accounts have been created... People from different party lines have given our quiz their vote of confidence by playing for hours at a time and for more than 30 minutes on average. No, we're not kidding. :)

We've been checking out our stats between the sites running the Election Quiz and it's interesting to note that though Democrats overall beat out Republicans on the Detroit Free Press and the Miami Herald sites in percentage of answers correct, percentage-wise Republicans on the Washington Times site beat out all groups on all sites.

In terms of questions, most of you did not know that Harry Truman (and not George Bush) had the lowest approval ratings in the history of the US presidency. Give 'em hell, Harry's rating was all of 22%, compared to Dubya's 24% from this September. The hardest question was that William Taft fared the worst in seeking re-election. The guy only had 8 electoral votes in 1912!

Many of the most difficult questions were historical trivia, but fun tidbits from the candidates, like Joe Biden claiming to never have had a drink, proved fairly difficult as well. Though a few questions were answered correctly by all users, there weren't any questions that all of you got wrong (rats!).

No one got all 50 buttons, but "mark b," an Independent immortalized on Mount Rushmore on the Detroit Free Press came the closest with 49.