4 Insights into Modern Cloud Inefficiency
September 16, 2024

Bill Buckley
CloudZero

Share this

For the last 18 years — through pandemic times, boom times, pullbacks, and more — little has been predictable except one thing: Worldwide cloud spending will be higher this year than last year and a lot higher next year. But as companies spend more, are they spending more intelligently? Just how efficient are our modern SaaS systems?

CloudZero's new report, How Cloud Efficient Are Software Companies In 2024?, found that most companies have limited (or nonexistent) cloud cost management (CCM) programs, which prevent them from making a substantial profit.

This is particularly concerning in the context of AI spending, which will only exacerbate cloud inefficiency. AI, which has gripped the SaaS world as firmly as it has the public imagination, is notoriously difficult to manage. Immature CCM programs will buckle under its complexity and fail to maximize the profitability of AI-driven applications.

The good news is that companies can take some simple steps to remediate these issues. Let's look at some of this survey's key findings and how companies can reverse the trend of inefficiency and maximize their cloud profitability.

Most Companies Don't Proactively Manage Their Cloud Costs

One of the survey's most troubling findings is that 61% of companies don't have a formalized CCM program. This is consistent with The State of FinOps 2024, a report by the FinOps Foundation, which showed that 62% of companies are in the least mature stage (the "Crawl" stage) of FinOps. Formalized CCM spans numerous functions, from the most straightforward budgeting and forecasting to the most complex unit economics calculation, but most fundamental to CCM is cost allocation.

Cost allocation means assigning appropriate costs to individual customers, products, features, teams, microservices, etc. Complete cost allocation shows companies precisely what's driving their spending — and, by extension, where they're most (and least) efficient. The report found that just 9% of companies have complete or near-complete cost allocation.

If you don't know what's driving your spending, it's impossible to drive meaningful efficiencies. Upon instituting a formalized CCM program, companies reduce their cloud costs by 30% in the first year. Low allocation and infrequency of formalized CCM programs would suggest that companies are leaving profit on the table — and the next key finding confirms it.

COGS Inefficiency: Companies Are Leaving Profit on the Table

Roughly three-quarters of survey respondents said their cloud expenses account for at least 20% of their cost of goods sold (COGS), and more than a quarter (28%) said cloud costs account for more than half of their COGS. Since COGS is a key factor in gross margin (i.e., profitability) calculations, and companies that institute CCM programs tend to reduce their cloud costs by 30%, companies are leaving a lot of profit on the table.

A company with $100 million in revenue and $25 million in COGS would have a gross profit of 75% — good, in SaaS terms, but not elite. Now, imagine that their cloud costs represent 50% of their COGS — $12.5 million. A 30% reduction would lower their cloud costs to $8.75 million and their overall COGS to $21.25 million. Their gross profit would grow to 78.75% — near-elite.

Organizations Aren't Using the Most Powerful CCM Methods

An absence of strong CCM also means companies tend not to use its most powerful approaches — namely, software code optimization. While about half of companies take advantage of simple CCM methods — enterprise discounts, bulk purchasing discounts — just 28% of companies practice software code optimization. Software code optimization entails ad-hoc code fixes that make the software run more efficiently and at the highest scale levels, saving companies millions of dollars.

Software code optimization requires well-allocated, real-time, highly granular cost data and systems to notify the correct engineers when costs spike. Given that just 31% of companies have formal CCM programs, it's not surprising that roughly the same portion uses software code optimization.

Elite Cloud Efficiency Rate (CER): 92%+

Cloud Efficiency Rate (CER) is a universal benchmark for cloud cost efficiency. It compares your revenue to your cloud spend and shows you how much of every revenue dollar you keep versus how much you send to cloud providers. A company with an 80% CER sends $0.20 of every revenue dollar to its cloud providers; a company with a 90% CER sends $0.10 of every dollar to its cloud providers. The report shows that the top-quartile CER is 92%, meaning the most cloud-efficient SaaS companies send just $0.08 of every revenue dollar to their cloud providers.

CERs also tend to worsen as companies scale and add engineers. Angel/bootstrapped companies reported the highest median CER (92%), with every other category reporting significantly worse median CERs (80% across public, debt/private equity, and venture capital). Companies with 11–25 engineers have the highest median CER (87%), with 51–100 (75%) and 100+ (80%) representing significant CER declines.

Increase Your Profitability with CCM

Organizations that want to grow, maintain a high pace of innovation, and increase their cloud efficiency need to compare their CER to industry benchmarks, at minimum. To drive elite CER, they will need sophisticated CCM programs. This involves engagement from the engineering function, precise budgeting, complete allocation, and clear unit economics.

Technical teams buy cloud resources and manage their costs, so they're positioned to have the most positive impact on cloud efficiency. Providing technical teams with relevant, real-time cloud cost data will empower them to make better infrastructure and code decisions. This will make innovations more durable and result in a healthier bottom line for the business.

Methodology: CloudZero, in partnership with Benchmarkit, a B2B SaaS research firm, conducted the report. More than 700 cloud operations and finance professionals at SaaS companies throughout North America were surveyed on all things cloud spending.

Bill Buckley is SVP of Engineering at CloudZero
Share this

The Latest

September 18, 2024

The business case for digital employee experience (DEX) is clear: more than half (55%) of office workers say negative experiences with workplace technology impact their mood/morale and 93% of security professionals say prioritizing DEX has a positive impact on an organization's cybersecurity efforts, according to the 2024 Digital Employee Experience Report: A CIO Call to Action, a new report from Ivanti ...

September 17, 2024

For IT leaders, a few hurdles stand in the way of AI success. They include concerns over data quality, security and the ability to implement projects. Understanding and addressing these concerns can give organizations a realistic view of where they stand in implementing AI — and balance out a certain level of overconfidence many organizations seem to have — to enable them to make the most of the technology's potential ...

September 16, 2024

For the last 18 years — through pandemic times, boom times, pullbacks, and more — little has been predictable except one thing: Worldwide cloud spending will be higher this year than last year and a lot higher next year. But as companies spend more, are they spending more intelligently? Just how efficient are our modern SaaS systems? ...

September 12, 2024

The OpenTelemetry End-User SIG surveyed more than 100 OpenTelemetry users to learn more about their observability journeys and what resources deliver the most value when establishing an observability practice ... Regardless of experience level, there's a clear need for more support and continued education ...

September 11, 2024

A silo is, by definition, an isolated component of an organization that doesn't interact with those around it in any meaningful way. This is the antithesis of collaboration, but its effects are even more insidious than the shutting down of effective conversation ...

September 10, 2024

New Relic's 2024 State of Observability for Industrials, Materials, and Manufacturing report outlines the adoption and business value of observability for the industrials, materials, and manufacturing industries ... Here are 8 key takeaways from the report ...

September 09, 2024

For mission-critical applications, it's often easy to justify an investment in a solution designed to ensure that the application is available no less than 99.99% of the time — easy because the cost to the organization of that app being offline would quickly surpass the cost of a high availability (HA) solution ... But not every application warrants the investment in an HA solution with redundant infrastructure spanning multiple data centers or cloud availability zones ...

September 05, 2024

The edge brings computing resources and data storage closer to end users, which explains the rapid boom in edge computing, but it also generates a huge amount of data ... 44% of organizations are investing in edge IT to create new customer experiences and improve engagement. To achieve those goals, edge services observability should be a centerpoint of that investment ...

September 04, 2024

The growing adoption of efficiency-boosting technologies like artificial intelligence (AI) and machine learning (ML) helps counteract staffing shortages, rising labor costs, and talent gaps, while giving employees more time to focus on strategic projects. This trend is especially evident in the government contracting sector, where, according to Deltek's 2024 Clarity Report, 34% of GovCon leaders rank AI and ML in their top three technology investment priorities for 2024, above perennial focus areas like cybersecurity, data management and integration, business automation and cloud infrastructure ...

September 03, 2024

While IT leaders are preparing organizations for accelerated generative AI (GenAI) adoption, C-suite executives' confidence in their IT team's ability to deliver basic services is declining, according to a study conducted by the IBM Institute for Business Value ...