Anticipating Traffic Surges - Lessons Learned from ESPN Crash
September 13, 2016

Michelle McLean
ScaleArc

Share this

ESPN made news headlines this past weekend – the bittersweet kind. Unfortunately, the news highlighted that ESPN's fantasy football app was crashing, on the first Sunday of the NFL season. Where's the "sweet" part? The crash likely signals a huge amount of user popularity.

We see these types of stories often during so-called "surge" events, like when Black Friday takes down a retailer. Why? Often, it's the database that's been swamped in the process.

The application-to-database connection is fragile, because applications have to directly tie into the database and the coding of the app must match the database infrastructure. For example, if the database has multiple database servers that can all respond to an inbound request, the application needs to know which type of server to send its request to. While those changes can ensure a better response time, the work isn't trivial – a programmer must go through hundreds of thousands of lines of code to program how to handle reads vs. writes – and it can lead to errors.

Any recent changes by ESPN to increase database capacity or update the app could jeopardize that fragile connection. If ESPN recently modified the application to talk to different database servers, for example, the team might have accidentally introduced a "bad" query that the database can't handle or might have changed how the application talks to the database and broken that connection.

Organizations that are anticipating a surge in traffic have a number of best practices they should follow to ensure a smooth experience for their customers, including:

1. Freezing code early

Despite the understandable desire to make the app or site as current as possible, it's essential for engineering to force a code freeze many weeks before the "go live" date. Quality assurance (QA) and other testing require adequate time to ensure the updated site or app is working as needed.

2. Load testing

A big part of that testing work needs to come in the form of load testing. After a QA team has performed functional testing – that is, does each feature work – the next step is to see how the code performs when it's swamped with traffic. The key is to perform this load testing with traffic that's as close to production traffic as possible.

3. Increasing resiliency at the data tier

The lifeblood of any app or site is data; without it, you're down. To build in resiliency at this layer, organizations need to employ techniques such as database scale out to have multiple copies of the data available and database load balancing to ensure traffic is serviced by the fastest-responding server to the user.

4. Enabling redundancy in all network services

Beyond the data tier, organizations need to make sure the rest of the technology stack has all the redundancy built in as possible. Web server infrastructure and web load balancers are critical, as is network redundancy into both the web farms and the database server clusters. If you're hosting the app or service in the cloud, ensure a redundant version is available in an alternate cloud region.

Michelle McLean is VP of Marketing at ScaleArc.

Share this

The Latest

November 21, 2024

Broad proliferation of cloud infrastructure combined with continued support for remote workers is driving increased complexity and visibility challenges for network operations teams, according to new research conducted by Dimensional Research and sponsored by Broadcom ...

November 20, 2024

New research from ServiceNow and ThoughtLab reveals that less than 30% of banks feel their transformation efforts are meeting evolving customer digital needs. Additionally, 52% say they must revamp their strategy to counter competition from outside the sector. Adapting to these challenges isn't just about staying competitive — it's about staying in business ...

November 19, 2024

Leaders in the financial services sector are bullish on AI, with 95% of business and IT decision makers saying that AI is a top C-Suite priority, and 96% of respondents believing it provides their business a competitive advantage, according to Riverbed's Global AI and Digital Experience Survey ...

November 18, 2024

SLOs have long been a staple for DevOps teams to monitor the health of their applications and infrastructure ... Now, as digital trends have shifted, more and more teams are looking to adapt this model for the mobile environment. This, however, is not without its challenges ...

November 14, 2024

Modernizing IT infrastructure has become essential for organizations striving to remain competitive. This modernization extends beyond merely upgrading hardware or software; it involves strategically leveraging new technologies like AI and cloud computing to enhance operational efficiency, increase data accessibility, and improve the end-user experience ...

November 13, 2024

AI sure grew fast in popularity, but are AI apps any good? ... If companies are going to keep integrating AI applications into their tech stack at the rate they are, then they need to be aware of AI's limitations. More importantly, they need to evolve their testing regiment ...

November 12, 2024

If you were lucky, you found out about the massive CrowdStrike/Microsoft outage last July by reading about it over coffee. Those less fortunate were awoken hours earlier by frantic calls from work ... Whether you were directly affected or not, there's an important lesson: all organizations should be conducting in-depth reviews of testing and change management ...

November 08, 2024

In MEAN TIME TO INSIGHT Episode 11, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses Secure Access Service Edge (SASE) ...

November 07, 2024

On average, only 48% of digital initiatives enterprise-wide meet or exceed their business outcome targets according to Gartner's annual global survey of CIOs and technology executives ...

November 06, 2024

Artificial intelligence (AI) is rapidly reshaping industries around the world. From optimizing business processes to unlocking new levels of innovation, AI is a critical driver of success for modern enterprises. As a result, business leaders — from DevOps engineers to CTOs — are under pressure to incorporate AI into their workflows to stay competitive. But the question isn't whether AI should be adopted — it's how ...