The Many Advantages of Application Performance Data
August 03, 2015

Shamus McGillicuddy
EMA

Share this

Enterprise Management Associates (EMA) has discovered that application performance data is extremely valuable when enterprises apply big data analytics to IT monitoring data, and it might be helping in the area where you least expect – Infrastructure capacity planning.

Last year EMA research found that 39% of enterprises were exporting data from network monitoring and management systems into Big Data projects. Naturally, we were curious to know why they were doing this and whether they were exporting any other kinds of monitoring data. So this year, EMA launched a broad study on the subject, Big Data Impacts on IT Infrastructure and Management. We set out to discover exactly what kinds of IT monitoring data enterprises are exporting into big data environments and how they are using it.

The research revealed that application performance data is more relevant and valuable to advanced analytics of monitoring data than any other. Among enterprises that are exporting IT monitoring data into big data environments, 59% of them are exporting application performance data. In contrast, only 41% of these enterprises were exporting log entries and 30% were exporting raw network packets.

We wanted to know about value as well as frequency, so we also asked these enterprises to identify the three most important types of IT data they export into big data environments. Application performance data again came out on top at 44%.

Our research did not ask enterprises why application performance data is so valuable in these projects, but there are numerous reasons why it could be the case. Enterprises may gather Application Performance Management (APM) data more frequently than other data types. For example, EMA has found that only about a third of enterprises use Network Performance Management (NPM) products for continuous monitoring. Instead, troubleshooting is a more popular use case. APM technologies, on the other hand, are essential to understanding end user experience in an application context, which makes continuous monitoring more likely.

Further research will be needed to explore all the variables that go into this outcome. For instance, are APM vendors more supportive than other management tool vendors to exporting their metadata into third party environments like Splunk, Hadoop, Cassandra or MongoDB? It will be important to understand how expensive it is to perform these exports, since some vendors require specialized licensing. We also need to understand how easy it is to export this data. Not all APIs are created equal. Some management vendors offer open, well-documented APIs. Others do not. All of these conditions could influence how popular a data type is.

Use cases also determine the value of data. In this research, EMA asked research participants to identify which types are important to big data analytics for IT planning and engineering, technical performance monitoring, and troubleshooting. It will surprise no one to learn that 63% of the enterprises said application performance data was valuable to performance monitoring via big data analytics. No other data type garnered a majority here. At 56%, application performance data was also the only type of data valuable to a majority of enterprises that are troubleshooting infrastructure via big data analytics. Application performance data can be a good indicator of the root cause of a problem, so again this is no surprise.

But some people may be surprised to learn that 51% of these enterprises are applying application performance data to IT planning and engineering via big data analytics. In this case, it was tied with transaction records for most popular data type. We asked these enterprises to identify the IT planning, monitoring and troubleshooting tasks they perform via big data analytics. Fifty-seven percent of them use these advanced analytics tools for network capacity planning, 66% use it for server capacity planning and 70% use it for storage capacity planning. Clearly the numbers show that application performance data is essential to all three of these tasks.

Other data that one would expect to be valuable to capacity planning lag behind application performance data. For instance, flow records (34%) interpreted packet flow (36%) clearly have value to network capacity planning. But neither is as valued as application performance data.

We’ve established that application performance data is popular and valuable to a broad range of use cases for big data analysis of infrastructure monitoring data. Other sources of data have their uses, too, but clearly an APM platform is a core tool for any organization interested in adopting advanced IT analytics. If an enterprise does choose to move in that direction, they will have to make sure their vendor supports such an initiative. Do they offer open APIs or custom integration with NoSQL databases? Do they charge for such integration? These will be just some of the questions you should ask as you consider advanced analytics.

Shamus McGillicuddy is Senior Analyst, Network Management at Enterprise Management Associates (EMA).

Shamus McGillicuddy is VP of Research, Network Infrastructure and Operations, at Enterprise Management Associates (EMA)
Share this

The Latest

March 18, 2024

Gartner has highlighted the top trends that will impact technology providers in 2024: Generative AI (GenAI) is dominating the technical and product agenda of nearly every tech provider ...

March 15, 2024

In MEAN TIME TO INSIGHT Episode 4 - Part 1, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at Enterprise Management Associates (EMA) discusses artificial intelligence and network management ...

March 14, 2024

The integration and maintenance of AI-enabled Software as a Service (SaaS) applications have emerged as pivotal points in enterprise AI implementation strategies, offering both significant challenges and promising benefits. Despite the enthusiasm surrounding AI's potential impact, the reality of its implementation presents hurdles. Currently, over 90% of enterprises are grappling with limitations in integrating AI into their tech stack ...

March 13, 2024

In the intricate landscape of IT infrastructure, one critical component often relegated to the back burner is Active Directory (AD) forest recovery — an oversight with costly consequences ...

March 12, 2024

eBPF is a technology that allows users to run custom programs inside the Linux kernel, which changes the behavior of the kernel and makes execution up to 10x faster(link is external) and more efficient for key parts of what makes our computing lives work. That includes observability, networking and security ...

March 11, 2024

Data mesh, an increasingly important decentralized approach to data architecture and organizational design, focuses on treating data as a product, emphasizing domain-oriented data ownership, self-service tools and federated governance. The 2024 State of the Data Lakehouse report from Dremio presents evidence of the growing adoption of data mesh architectures in enterprises ... The report highlights that the drive towards data mesh is increasingly becoming a business strategy to enhance agility and speed in problem-solving and innovation ...

March 07, 2024
In this digital era, consumers prefer a seamless user experience, and here, the significance of performance testing cannot be overstated. Application performance testing is essential in ensuring that your software products, websites, or other related systems operate seamlessly under varying conditions. However, the cost of poor performance extends beyond technical glitches and slow load times; it can directly affect customer satisfaction and brand reputation. Understand the tangible and intangible consequences of poor application performance and how it can affect your business ...
March 06, 2024

Too much traffic can crash a website ... That stampede of traffic is even more horrifying when it's part of a malicious denial of service attack ... These attacks are becoming more common, more sophisticated and increasingly tied to ransomware-style demands. So it's no wonder that the threat of DDoS remains one of the many things that keep IT and marketing leaders up at night ...

March 05, 2024

Today, applications serve as the backbone of businesses, and therefore, ensuring optimal performance has never been more critical. This is where application performance monitoring (APM) emerges as an indispensable tool, empowering organizations to safeguard their applications proactively, match user expectations, and drive growth. But APM is not without its challenges. Choosing to implement APM is a path that's not easily realized, even if it offers great benefits. This blog deals with the potential hurdles that may manifest when you actualize your APM strategy in your IT application environment ...

March 04, 2024

This year's Super Bowl drew in viewership of nearly 124 million viewers and made history as the most-watched live broadcast event since the 1969 moon landing. To support this spike in viewership, streaming companies like YouTube TV, Hulu and Paramount+ began preparing their IT infrastructure months in advance to ensure an exceptional viewer experience without outages or major interruptions. New Relic conducted a survey to understand the importance of a seamless viewing experience and the impact of outages during major streaming events such as the Super Bowl ...