We've been up and running on SFGate.com for months, and in early May Newzwag's News, Sports and Entertainment quizzes went live on Freep.com, the website of the Detroit Free Press. And the hits keep coming!
The Newzwag General News Quiz has gone live on the San Francisco Chronicle's website, SF Gate. It joins our Entertainment and Sports quizzes, which kicked off at SF Gate in February. All three can be accessed down at the botton of the SF Gate front page, near Sudoku!
All three operate under the same rules and principles as our Deadline quiz on Facebook and our news quizzes elsewhere: pile up points, move up through the levels, challenge your friends, and show everyone who's the brainiac here.
You'll see a jump in the number of questions based on movies, music, hoops ... well, yeah, entertainment and sports. And we have some crossover among quizzes, so you'll sometimes see the same question across platforms. Heck, that gives you a chance to rack up extra points cheap! So play 'em all!
Our development team set up a commenting system for our quiz(zes) outside of Facebook (sorry Deadliners ...). It's currently on our "general" news quiz, but it will also be a feature on our Entertainment Quiz and Sports Quiz (coming soon!). The commenting system allows users to comment on individual questions. There was quiet a bit of thought put into how long comments should be and how we'd manage foul-mouthed $*#(@^%)!#%.
Censoring user comments happens on every major news site, though strategies differ. Other than b****, f*** and a**, is there really a consensus on what is horrible enough to be censored out? For example, the NYT mobile app used to censor out the word "gay," but we left it in. And you b****** are so clever, you'll find hundreds of ways around our censoring anyhow. (BTW, we settled for using $&#(*!) symbols for our bleeping, instead of asterisks)
Currently, the general news quiz can be found on newstrust.net. We didn't get too many comments, and surprisingly(!) few obscene ones. There were even a couple instances where users responded to each other's comments.
We were hoping for feedback on the news quiz, and we got some. A user complained about there being too many entertainment questions, while another user asked "why not call this 'sports quiz'?"
We love the feedback (... really, we do). We scaled back the number of sports and entertainment questions in the general quiz (very similar to the Deadline quiz), sticking to only big events (freebie: yes, the Super Bowl will be in BOTH quizzes).
Sometimes, we get user complaints about being too US-centric. About a year ago, when we really dove into the news quiz as a product, we tried to scale back our US questions and remove sports coverage. But as a company, we've really come to grips with the understanding that you really can't please everyone, and our target market is mostly in North America.
We definitely aren't trying to alienate anyone. There have been more US-based questions, mostly because of the US election/inauguration; now that they're over, the flood of Obamarama questions should slow and lead to slightly fewer US questions.
It's that time of year agaaain! From Dec. 20-31, we'll be releasing 10 questions a day into our news quiz looking back at notable events of 2008. That's 12 months of goodness totaling 120 questions.
For anyone disconnecting over the holidays, the year in review questions will stay live through Jan. 5.
Last Wednesday we hosted a Newzwag classroom for a group of 25 Ruby developers who came to eat delicious pizza, drink beer, and learn how we scaled Rails. I personally had a lot of fun putting together the presentation and hosting the guys that showed up.
I presented an overview talk about database gotchas, and how to load test a session-based app. Daniel talked about his unique implementation of memcached as a temporary data store and bulk write mechanism.
The presentations were informed by all of our hands-on experience adapting our write-heavy quiz from it's capacity of 200 simultaneous users all the way up to 30,000 simultaneous users (a 25x efficiency upgrade!). Rails does scale, and just like any other app, requires custom software and hardware solutions to match a project's needs. Throwing hardware at it is the first solution, but analyzing each and every bottleneck all adds up.
We fully intended to record the whole event, but alas we were video camera-challenged... sorry!
Here's a link to the talks on Slideshare, click to download the pdf file.
Links from the talks:
If you have any questions, post 'em up in the comments.
Thanks to Daniel, there will be a new world order on our quiz's leaderboard. In his own words (mostly), here's how our new play skill rating will work:
Currently, we rank players by the total number of points earned. After seeing the results of our different trials online, it was obvious that a major problem with using the total number of points was that it is largely dependent on the number of questions answered. It would only be an accurate comparison between users that have answered a similar number of questions.
Other flawed measures: Point average and percent correct -- both ignore the difficulty of a question and percent correct ignores how fast a question is answered.
Our new skill rating addressees all of these problems. Similar to the Elo rating system, our skill rating system takes into account a number of factors to determine how good a player is at answering questions.
The system works something like this:
Each player starts with a skill rating of 1500. Whenever a player answers a question, their current skill rating is compared to the difficulty rating of the question (which is determined by how other people answered the same question) to determine what the expected score for this particular user answering this particular question is. This predicted score is then compared to the score the player actually earned, and the player's rating is adjusted up or down depending on if the player scores higher or lower than expected.
For those of you who are interested in the actual formula:
To determine the expected score:
P = Player's rating before answering the question
Q = The questions difficulty rating
Expected score = 1 / (1 + 10^((Q-P)/800))
The adjustment to the players rating is made with the following equation:
P = Players original rating
E = expected score
S = actual score
K = a scaler that is dependent on the number of questions a player has answered: it ranges from 25 for new players to 10 for players who have answered a lot of questions.
New player rating = P + K(S - E)
Josh, our Lead Developer, has volunteered to talk and host The SF Ruby Meetup Group right here at our Maiden Lane headquarters tomorrow night. Daniel thinks he's off the hook, but he'll be there, too. The subject of the meeting will be Scaling Rails in which he'll talk about our experience (and by this I mean our development team) scaling our quiz during the 2008 Beijing Olympics.
BTW: I was really tempted to write "I <3 Rubyes" as the headline but I guess I'll leave that for a custom print t-shirt. :)
More quiz features coming soon...
We've added a couple of new features to our development pipeline. They include commenting and question rating, allowing players to comment on a particular question/ answer/ topic and also allowing them to rate questions up or down, like or not like respectively. The first will help users connect with each other as comments will link to user profiles. The latter will allow our hard-working editors and our algorithms to serve better questions in the future. Until then, we'll keep you in the loop.
Big day in the U.S. today ... The whole world is paying attention to what may be the most important presidential election in recent history. Though at this time the race is not over, it's clear that the Internet has played a central role the 2008 campaign and positions itself as a big (huge) winner. It's possible that this view from our San Francisco-based office is slightly subjective, but there is no doubt that the access to real-time information and mobile devices have encouraged people to participate, speak up, act, share, link, comment, connect.
We're happy to be part of this.
In the past month, our 2008 Elections Quiz has gotten noticed in a few client sites around the States: The Detroit Free Press, The Washington Times and the Miami Herald. Across sites, more than 10,000 new player accounts have been created... People from different party lines have given our quiz their vote of confidence by playing for hours at a time and for more than 30 minutes on average. No, we're not kidding. :)
We've been checking out our stats between the sites running the Election Quiz and it's interesting to note that though Democrats overall beat out Republicans on the Detroit Free Press and the Miami Herald sites in percentage of answers correct, percentage-wise Republicans on the Washington Times site beat out all groups on all sites.
In terms of questions, most of you did not know that Harry Truman (and not George Bush) had the lowest approval ratings in the history of the US presidency. Give 'em hell, Harry's rating was all of 22%, compared to Dubya's 24% from this September. The hardest question was that William Taft fared the worst in seeking re-election. The guy only had 8 electoral votes in 1912!
Many of the most difficult questions were historical trivia, but fun tidbits from the candidates, like Joe Biden claiming to never have had a drink, proved fairly difficult as well. Though a few questions were answered correctly by all users, there weren't any questions that all of you got wrong (rats!).
No one got all 50 buttons, but "mark b," an Independent immortalized on Mount Rushmore on the Detroit Free Press came the closest with 49.
Our 2008 Election Quiz is gaining some exposure (very mucho muy welcome) as it goes live in the Sunshine State at the Miami Herald. It's great timing as Florida takes center stage heading into the final week of the presidential campaign.
Newzwag is a San Francisco-based company funded by Agence France-Presse (AFP). We develop technologies and ideas that bring one of the world's richest news resources to the rapidly evolving world of social media.
The lowdown on Motown ... Newzwag goes live on Freep.com
We're out of the gate at SF Gate!
We let you comment. Now we ...
Loading...
