Do You Need Multi-CDN Monitoring? Here's What You Need to Consider - Part 2
October 04, 2024

Marty Kagan
Hydrolix

Share this

In Part 1 of this two-part series, I defined multi-CDN and explored how and why this approach is used by streaming services, e-commerce platforms, gaming companies and global enterprises for fast and reliable content delivery. Multi-CDN offers unmatched benefits when it comes to redundancy, availability, load balancing, scalability, cost management, and improved user experiences on a global scale. Now, in Part 2 of the series, I'll explore one of the biggest challenges of multi-CDN: observability.

Why Don't All Observability Platforms Monitor Multi-CDN?

If your log monitoring platform is capable of spanning multiple CDNs, you might be in good shape. Some do, but most don't. Those that do have differing levels of sophistication. Let's break down some of the details you'll want to examine.

1. Data Volume and Variety: Multi-CDN generates vast amounts of data from multiple sources. In fact, it's so much data that many multi-CDN users don't even try to analyze it because the storage costs alone can be eye watering. For observability platforms to provide the value you expect, they need to ingest, process, and store all this data in very near real time. With legacy systems, it's almost always resource-intensive and costly.

2. Real-Time Data Transformation: Effective multi-CDN monitoring requires the ability to transform and standardize data in real time, a capability that many platforms lack. Without this, data analysis becomes cumbersome and less accurate.

3. Unified View and Analysis: To effectively monitor multi-CDN performance, businesses need a unified view that combines data from all CDNs. This requires sophisticated data aggregation and query capabilities, which not all platforms can provide.

4. Considerations: As mentioned above, storing and processing multi-CDN data long-term is expensive. Many platforms limit data retention to 90 days due to cost constraints, which restricts the ability to perform historical analysis and trend forecasting. Unfortunately, historical data is where much of the value lies. The ideal log monitoring solution is one that keeps all data hot at minimal cost.

Few log monitoring platforms are capable of meeting all these standards. As a result, many companies end up throwing away their valuable log data, losing out on insights that quite literally describe the state of their business.

When Your Multi-CDN Has Access to All the Data

So, in the perfect world where all the elements above are working, what can having access to comprehensive multi-CDN log data unlock for your businesses?

First, there's real-time visibility and alerting. With data from multiple CDNs ingested into a unified view, companies can monitor performance in real time, detect issues early, and respond proactively to prevent disruptions — disruptions that frustrate customers and reduce revenue. Detailed IP address analytics can help identify and mitigate security threats, such as DDoS attacks or streaming piracy, ensuring that content remains secure and accessible.

Those are powerful advantages for running the business day-to-day, but there's arguably a bigger benefit on the long-term side. Retaining multi-CDN log data for months or years allows companies to perform the kinds of in-depth analyses that 90-day retention policies can't deliver. Uncovering longer-term trends and insights can illuminate future strategies, capacity planning, and cost management.

And of course, there's the holy grail of traffic steering and optimization. By analyzing multi-CDN data, businesses can make informed decisions on how to route traffic, avoiding congested paths and optimizing delivery based on current conditions.

Best Practices for Multi-CDN Monitoring

To effectively leverage multi-CDN, companies should adopt the following best practices:

Insist on Real-time Query-ability: This is essential because logs capture the state of live services, the interruption of which can damage a brand's revenue and reputation.

Combine Log Sources for a Unified View: Ingest data from all CDNs into a single platform to enable easy comparison and analysis. This reduces the need for complex query operations and ensures a comprehensive view of performance.

Standardize Log Data: Use real-time transformation to standardize log data across different CDNs. Consistent naming conventions make querying and analysis more straightforward and reliable.

Enrich Logs with Contextual Data: Enhance CDN logs with additional metadata to provide more context and improve diagnostic capabilities. This can include adding virtual fields, computing new metrics, or extracting specific data elements.

Keep Data Long-Term: Don't discard valuable multi-CDN data after 90 days. Retain it for longer periods to enable deeper insights, trend analysis, and better decision-making. Yes, there are monitoring solutions that enable you to keep all of your data and still pay less for storage than you paid when keeping only 90 days of data.

By following these best practices, businesses can fully capitalize on the advantages of multi-CDN, ensuring optimal performance, reliability, and security for their digital content delivery.

Admittedly, not all organizations will face the type of do-or-die moments described at the outset of this article. Nevertheless, a vast and growing number of companies across a wide variety of industries do depend on a complex, interconnected set of services, and, as the recent Microsoft/Crowdstrike fiasco demonstrated these services can be ground to a halt with a modest mistake. Clearly, log monitoring has never been more important. But log management solutions for today's businesses must take a new approach to observability — one that is real-time and can simplify the management of tremendous volumes of data streaming in from myriad sources.

Marty Kagan is CEO and Co-Founder of Hydrolix
Share this

The Latest

October 04, 2024

In Part 1 of this two-part series, I defined multi-CDN and explored how and why this approach is used by streaming services, e-commerce platforms, gaming companies and global enterprises for fast and reliable content delivery ... Now, in Part 2 of the series, I'll explore one of the biggest challenges of multi-CDN: observability.

October 03, 2024

CDNs consist of geographically distributed data centers with servers that cache and serve content close to end users to reduce latency and improve load times. Each data center is strategically placed so that digital signals can rapidly travel from one "point of presence" to the next, getting the digital signal to the viewer as fast as possible ... Multi-CDN refers to the strategy of utilizing multiple CDNs to deliver digital content across the internet ...

October 02, 2024

We surveyed IT professionals on their attitudes and practices regarding using Generative AI with databases. We asked how they are layering the technology in with their systems, where it's working the best for them, and what their concerns are ...

October 01, 2024

40% of generative AI (GenAI) solutions will be multimodal (text, image, audio and video) by 2027, up from 1% in 2023, according to Gartner ...

September 30, 2024

Today's digital business landscape evolves rapidly ... Among the areas primed for innovation, the long-standing ticket-based IT support model stands out as particularly outdated. Emerging as a game-changer, the concept of the "ticketless enterprise" promises to shift IT management from a reactive stance to a proactive approach ...

September 27, 2024

In MEAN TIME TO INSIGHT Episode 10, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses Generative AI ...

September 26, 2024

By 2026, 30% of enterprises will automate more than half of their network activities, an increase from under 10% in mid-2023, according to Gartner ...

September 25, 2024

A recent report by Enterprise Management Associates (EMA) reveals that nearly 95% of organizations use a combination of do-it-yourself (DIY) and vendor solutions for network automation, yet only 28% believe they have successfully implemented their automation strategy. Why is this mixed approach so popular if many engineers feel that their overall program is not successful? ...

September 24, 2024

As AI improves and strengthens various product innovations and technology functions, it's also influencing and infiltrating the observability space ... Observability helps translate technical stability into customer satisfaction and business success and AI amplifies this by driving continuous improvement at scale ...

September 23, 2024

Technical debt is a pressing issue for many organizations, stifling innovation and leading to costly inefficiencies ... Despite these challenges, 90% of IT leaders are planning to boost their spending on emerging technologies like AI in 2025 ... As budget season approaches, it's important for IT leaders to address technical debt to ensure that their 2025 budgets are allocated effectively and support successful technology adoption ...