New Relic launched New Relic AI monitoring (AIM), an APM solution for AI-powered applications.
New Relic is pioneering AI observability with AIM to provide engineers unprecedented visibility and insights across the AI application stack, making it easier to troubleshoot and optimize their AI applications for performance, quality, cost, and responsible use of AI. With 50+ integrations and features like LLM response tracing and model comparison, AIM helps teams build and run LLM-based applications with confidence.
“With every organization integrating AI into their products and processes, AI workloads are now part of modern organizations’ application architectures,” said New Relic Chief Product Officer Manav Khurana. “With AI monitoring, we have applied our deep expertise from inventing cloud APM to providing end-to-end visibility into AI-powered applications to help businesses manage performance, costs, and the responsible use of AI.”
Key features and use cases include:
- Auto instrumentation: New Relic agents come equipped with all AIM capabilities, including full AI stack visibility, response tracing, model comparison, and more for quick and easy setup.
- Full AI stack visibility: Holistic view across the application, infrastructure, and the AI layer, including AI metrics like response quality and tokens alongside APM golden signals.
- Deep trace insights for every LLM response: Trace the lifecycle of complex LLM responses built with tools like LangChain to fix performance issues and quality problems such as bias, toxicity, and hallucination.
- Compare performance and costs: Track usage, performance, quality, and cost across all models in a single view; optimize use with insights on frequently asked prompts, chain of thought, and prompt templates and caches.
- Enable responsible use of AI: Ensure safe and responsible AI use by verifying that responses are appropriately tagged to indicate AI-generated and are free from bias, toxicity, and hallucinations using response trace insights.
- Instantly monitor your AI ecosystem: The most comprehensive solution for monitoring the entire stack of any AI ecosystem with 50+ integrations and quickstarts including:
Orchestration framework: LangChain
LLM: OpenAI, PaLM2, HuggingFace
Machine learning libraries: Pytorch, TensorFlow
Model serving: Amazon SageMaker, AzureML
Vector databases: Pinecone, Weaviate, Milvus, FAISS
AI infrastructure: Azure, AWS, GCP
AIM is now available in early access to New Relic users.
The Latest
A majority (61%) of organizations are forced to evolve or rethink their data and analytics (D&A) operating model because of the impact of disruptive artificial intelligence (AI) technologies, according to a new Gartner survey ...
The power of AI, and the increasing importance of GenAI are changing the way people work, teams collaborate, and processes operate ... Gartner identified the top data and analytics (D&A) trends for 2024 that are driving the emergence of a wide range of challenges, including organizational and human issues ...
IT and the business are disconnected. Ask the business what IT does and you might hear "they implement infrastructure, write software, and migrate things to cloud," and for some that might be the extent of their knowledge of IT. Similarly, IT might know that the business "markets and sells and develops product," but they may not know what those functions entail beyond the unit they serve the most ...
Cloud spending continues to soar. Globally, cloud users spent a mind-boggling $563.6 billion last year on public cloud services, and there's no sign of a slowdown ... CloudZero's State of Cloud Cost Report 2024 found that organizations are still struggling to gain control over their cloud costs and that a lack of visibility is having a significant impact. Among the key findings of the report ...
The use of hybrid multicloud models is forecasted to double over the next one to three years as IT decision makers are facing new pressures to modernize IT infrastructures because of drivers like AI, security, and sustainability, according to the Enterprise Cloud Index (ECI) report from Nutanix ...
Over the last 20 years Digital Employee Experience has become a necessity for companies committed to digital transformation and improving IT experiences. In fact, by 2025, more than 50% of IT organizations will use digital employee experience to prioritize and measure digital initiative success ...
While most companies are now deploying cloud-based technologies, the 2024 Secure Cloud Networking Field Report from Aviatrix found that there is a silent struggle to maximize value from those investments. Many of the challenges organizations have faced over the past several years have evolved, but continue today ...
In our latest research, Cisco's The App Attention Index 2023: Beware the Application Generation, 62% of consumers report their expectations for digital experiences are far higher than they were two years ago, and 64% state they are less forgiving of poor digital services than they were just 12 months ago ...
In MEAN TIME TO INSIGHT Episode 5, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses the network source of truth ...
A vast majority (89%) of organizations have rapidly expanded their technology in the past few years and three quarters (76%) say it's brought with it increased "chaos" that they have to manage, according to Situation Report 2024: Managing Technology Chaos from Software AG ...
