Subscribe for daily, weekly or monthly web hosting news updates by email!

Scaling Technology On-The-Fly

By Paul Hirsch on January 23, 2009

Tuesday was an historic day in the U.S., the day President Obama assumed the duties of the Oval Office. Most of us set aside everything and tuned in as Barack Obama was sworn into office, thinking little of our work lives and professional responsibilities. However, a few people spent that time attempting to support an insane surge in Web traffic, and there were casualties!

The New York Times reported on this issue in its article Online Video of Inauguration Sets Records. Many viewers were denied access to Web streams due to systems overload, and the numbers clearly indicate why. During a nine hour period of time, CNN provided more than 21.3 million video streams, at one time supporting 1.3 million concurrent connections. Akamai's not crying any tears for CNN; they fed seven million+ concurrent streams, which they report is a record day. As you can see in the article, there were more than a few problems associated with these traffic levels.

As I read this article, it occurred to me that this same problem is relevant to Web hosting customers of all sizes. The Slash Dot effect is well documented, and is the stuff of nightmares for Webmasters and server admins alike. It's one thing to plunk down a few hundred bucks for more capacity any given day, week or month; no one likes to do it, but most SMBs can weather a traffic storm without too much difficulty. It's another thing entirely to have to plan for and fund an unprecendented traffic surge for a single day. Even with months of planning time and every indication that Web traffic would be this high or higher, networks were still underprepared, which leads me to believe the answer isn't as simple as "throw more money at the problem."

Frankly, I'm at a loss to come up with a better plan for scaling technology on-the-fly in situations such as these. Coming from the Web design world, I would love to hear from some hosting professionals on this matter. How to you prepare for traffic you cannot anticipate, and how do you handle the economics of scaling to these extremes over such short periods of time? Please share your thoughts!

RSS Paul Hirsch is a moderator on WebHostingTalk.com, the largest Web hosting community on the Internet, and he is a founder and Core Team member of the International Web Developers Network (IWDN). He is co-owner of Studio1337, a Web design and development company located in Akron/Canton, Ohio, West. Ha... (Read full bio)

OLDER: Tier1 Hosting Summit Photos on the WHIR | NEWER: Where did all the free email go???

Comment anonymously or log into your WHIR account

Logging in allows enhanced commenting features (such as external linking) in news, features, blogs and more.

User:

Pass:

(reset password)

Don't have an account yet? Register now!


 

Read Back Issues of WHIR Magazine

October 2009 - Web Hosting's All Star Team
This has been, for us, one of the most interesting, exciting and challenging build-ups to an issue of the magazine yet, Web Hosting's All Star Team. The balloting process was our first experiment with a kind of user participation we're planning to do a lot more with in the months to come. We had thousands of ballots submitted, with hundreds of write-in suggestions and a demonstration of user engagement that has us feeling super positive about the project.
About This Issue | Read Digital Edition

July 2009 - What am I Worth?
One of the interesting luxuries of working on a project like the printed WHIR magazine is that it allows us to play with things like our point of view from one issue to the next. In recent months we've been giving added attention to the kind of practical and applicable advice aimed at smaller hosts and resellers. This issue carries on with that point of view, asking, in our cover story, "what am I worth?" It's a complicated question without a clear-cut answer.
About This Issue | Read Digital Edition

May 2009 - The Blueprint for a Small Web Host
I was a little surprised by how difficult it became to see this idea through. We set out to assemble a blueprint for a small hosting business, but butted up pretty quickly against the general impossibility of covering all the territory that was out there to be covered. The basic constraints of a printed magazine, and the less-than-infinite amount of time we had available forced us to face the fact that we could never produce an exhaustive guide to starting a hosting company.
About This Issue | Read Digital Edition

Read more WHIR Magazine back issues