Downtime Leaves UK Census Visitors Hanging Adam Eisner, theWHIR.com
January 9, 2001 - A severe underestimation of expected traffic levels crippled a highly anticipated British government Web site only hours after it had officially launched.
On January 2, Britain's Public Record Office (PRO) unveiled a Web site (census.pro.gov.uk) featuring the complete results of the government's 1901 census, only to have the site immediately come under heavy pressure due to an overwhelming amount of traffic.
After numerous failed attempts to handle the traffic load, the site was taken offline until it could be equipped with the hardware and connectivity required to cope with traffic demands.
Britain first decided to publish the results of its 1901 census online in 1998 - a task that would require the government to digitize 32 million names from about 1.5 million pages of data. Realizing it was a far too difficult task to handle alone, the PRO awarded a 10 year, £7m contract to QinetiQ, a government-owned IT firm, in 1998 to help digitize the census and develop a corresponding Web site. The resulting site allowed users to search the census by name, address, institution or place and view the digitized document for a small fee. Results were pulled from an Oracle database that required more than 100GB of disk space and that worked in tandem with an image library featuring more than 400GB of pictures.
For the site's hosting and connectivity requirements, QinetiQ turned to British Telecom. Designed to handle up to 1.2 million hits per day, the site reportedly attracted 1.2 million hits an hour on a regular basis while it was online. The site received 30 million hit requests on opening day alone as a steady barrage of traffic flooded the site. When visitor traffic from one geographic region began to subside, traffic from another area would increase, resulting in a steady and overwhelming stream of visitors.
BT currently operates a global network featuring 54,000 route kilometers of fiber that connect 275 cities, 20 countries and 200 access nodes.
When problems initially arose, the PRO tried various measures to keep the site up and running, including adding servers, optimizing images to reduce bandwidth consumption, and limiting the number of users allowed on the site at one time. The site was finally taken down earlier this week.
An updated statement on the census Web site says its "widely reported" difficulties were due to "overwhelming public interest and demand", which "exceeded our expectations by a factor of 20."
The site also called for assistance from visitors to get the site up and running again. "Continual attempts to access the site by using the browser 'Refresh' button only compounds our problems and we would be grateful if you could avoid doing this," the site reads. "We are grateful for the patience you have already shown, as we know that many of you have felt frustrated." In the meantime, users were encouraged to continue their research by using records available at libraries across the country.
The site is expected to re-launch early next week. While demand for the site's information will subside eventually, the site will likely be re-launched with significantly more servers and network capacity in place.
Read Back Issues of WHIR Magazine
October 2009 - Web Hosting's All Star Team
This has been, for us, one of the most interesting, exciting and challenging build-ups to an issue of the magazine yet, Web Hosting's All Star Team. The balloting process was our first experiment with a kind of user participation we're planning to do a lot more with in the months to come. We had thousands of ballots submitted, with hundreds of write-in suggestions and a demonstration of user engagement that has us feeling super positive about the project.
About This Issue | Read Digital Edition
July 2009 - What am I Worth?
One of the interesting luxuries of working on a project like the printed WHIR magazine is that it allows us to play with things like our point of view from one issue to the next. In recent months we've been giving added attention to the kind of practical and applicable advice aimed at smaller hosts and resellers. This issue carries on with that point of view, asking, in our cover story, "what am I worth?" It's a complicated question without a clear-cut answer.
About This Issue | Read Digital Edition
May 2009 - The Blueprint for a Small Web Host
I was a little surprised by how difficult it became to see this idea through. We set out to assemble a blueprint for a small hosting business, but butted up pretty quickly against the general impossibility of covering all the territory that was out there to be covered. The basic constraints of a printed magazine, and the less-than-infinite amount of time we had available forced us to face the fact that we could never produce an exhaustive guide to starting a hosting company.
About This Issue | Read Digital Edition
Comment anonymously or log into your WHIR account
Logging in allows enhanced commenting features (such as external linking) in news, features, blogs and more.