2022 App Stability Report: Driving Quality with Visibility
September 20, 2022

Michael Olechna
SmartBear

Share this

Users today expect a seamless, uninterrupted experience when interacting with their web and mobile apps. Their expectations have continued to grow in tandem with their appetite for new features and consistent updates. Mobile apps have responded by increasing their release cadence by up to 40%, releasing a new full version of their app every 4-5 days, as determined in this year's SmartBear State of Software Quality | Application Stability Index report.

When examining last year's report, mobile apps were on average issuing a new release once a week, about once every seven days. To accommodate the market's new standard of faster releases, a growing number of mobile apps are adopting progressive delivery practices, like feature flags and experiments, to accelerate the release of new features while minimizing the risk of releasing new errors to their user base that would impact the stability of their applications.

Stability score measures the percentage of app sessions that are crash-free, providing visibility into app health as well as user experience. It can be thought of as a barometer of quality and quantity: the lower the number of errors in your app, the higher your stability score is and the quality of your app.

Overall, there is a continuing trend of increasing stability among web and mobile apps with the industry striving for five nines or 99.999% stability. In last year's report, mobile apps had a median stability score of 99.80%. In the 2020 report, the last direct comparison of web and mobile app stability score, mobile apps outscored web apps by a significant margin, 99.63% to 99.39%. Perhaps the most surprising finding of this year's report is the revelation web apps had a higher stability score, 99.94%, than their mobile counterparts score of 99.88%.

Diving deeper into the data provides some insight into why web app scores were much higher than in 2020 and against this year's mobile median score. The top two industries by stability score in the report were Media and Entertainment, 99.97% and e-commerce, 99.94%. Media and Entertainment had a strong web app presence, especially with the takeoff of streaming media in the past year. As many newcomers attempt to grow their users, it remains essential for them to provide an optimal, uninterrupted experience. Meanwhile, to retain their massive subscriber base against increased competition, streaming giants seek to strike a balance between delivering a seamless experience and consistently offering new features to enhance their application — across a range of devices.

On the other hand, perhaps no better example of the link between stability and revenue can be thought of than e-commerce applications. The last moment any organization wants their app to crash is during the checkout process. As worldwide e-commerce revenue expects to climb past $5.5 trillion in 2022, one can assume there is a lot of money in customers' carts when they arrive at checkout. Giving customers a smooth experience is paramount, as crashes directly impact revenue.

These two industries provide a model that the lowest scoring industries in the report can learn from. As in previous reports, Gaming was the lowest scoring industry at 99.60%, with the widest range of score distribution between apps. Health and Wellness did not fare much better, scoring the second-lowest at 99.71%. The low stability score of Health and Wellness combined with its median release cadence of every other day and the widest release distribution of all industries demonstrates a balance must be reached between roadmap agility and app stability.

With the user experience becoming increasingly dominant to app success, app stability has evolved into application observability as the need for visibility into software releases has grown. Perhaps most importantly, we're learning that visibility into app stability is key for innovating quickly and delivering apps with speed and confidence.

Michael Olechna is Product Marketing Manager for BugSnag at SmartBear
Share this

The Latest

November 21, 2024

Broad proliferation of cloud infrastructure combined with continued support for remote workers is driving increased complexity and visibility challenges for network operations teams, according to new research conducted by Dimensional Research and sponsored by Broadcom ...

November 20, 2024

New research from ServiceNow and ThoughtLab reveals that less than 30% of banks feel their transformation efforts are meeting evolving customer digital needs. Additionally, 52% say they must revamp their strategy to counter competition from outside the sector. Adapting to these challenges isn't just about staying competitive — it's about staying in business ...

November 19, 2024

Leaders in the financial services sector are bullish on AI, with 95% of business and IT decision makers saying that AI is a top C-Suite priority, and 96% of respondents believing it provides their business a competitive advantage, according to Riverbed's Global AI and Digital Experience Survey ...

November 18, 2024

SLOs have long been a staple for DevOps teams to monitor the health of their applications and infrastructure ... Now, as digital trends have shifted, more and more teams are looking to adapt this model for the mobile environment. This, however, is not without its challenges ...

November 14, 2024

Modernizing IT infrastructure has become essential for organizations striving to remain competitive. This modernization extends beyond merely upgrading hardware or software; it involves strategically leveraging new technologies like AI and cloud computing to enhance operational efficiency, increase data accessibility, and improve the end-user experience ...

November 13, 2024

AI sure grew fast in popularity, but are AI apps any good? ... If companies are going to keep integrating AI applications into their tech stack at the rate they are, then they need to be aware of AI's limitations. More importantly, they need to evolve their testing regiment ...

November 12, 2024

If you were lucky, you found out about the massive CrowdStrike/Microsoft outage last July by reading about it over coffee. Those less fortunate were awoken hours earlier by frantic calls from work ... Whether you were directly affected or not, there's an important lesson: all organizations should be conducting in-depth reviews of testing and change management ...

November 08, 2024

In MEAN TIME TO INSIGHT Episode 11, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses Secure Access Service Edge (SASE) ...

November 07, 2024

On average, only 48% of digital initiatives enterprise-wide meet or exceed their business outcome targets according to Gartner's annual global survey of CIOs and technology executives ...

November 06, 2024

Artificial intelligence (AI) is rapidly reshaping industries around the world. From optimizing business processes to unlocking new levels of innovation, AI is a critical driver of success for modern enterprises. As a result, business leaders — from DevOps engineers to CTOs — are under pressure to incorporate AI into their workflows to stay competitive. But the question isn't whether AI should be adopted — it's how ...