New Relic announced the general availability of New Relic AI monitoring with a suite of powerful new features to meet the evolving needs of organizations developing AI applications.
New features include in-depth AI response tracing insights with real-time user feedback and model comparison to help drive continuous improvement of AI application performance, quality, and cost—all while ensuring data security and privacy. With 60+ integrations, New Relic AI monitoring is one of the most comprehensive solutions that helps organizations find the root cause of AI application issues faster, furthers their adoption of AI, and supports them at every stage of their AI journey.
“Based on my conversations with CIOs, CTOs, and executives across our customer base, it is clear that every company is thinking about how to scale their business with AI,“ said New Relic Chief Customer Officer Arnie Lopez. “The adoption of AI can be costly and introduce complexity into their stack. IT and technology leaders are turning to New Relic because observability is essential to help them confidently navigate the exciting future of AI, optimize performance and quality, and control costs, ultimately delivering exceptional customer experiences."
New Relic AI monitoring makes it easy for organizations to manage complexities of their AI stack by providing a unified view of their entire AI ecosystem alongside the rest of their performance data.
Key features include:
- Auto instrumentation: New Relic agents offer easy set-up for popular frameworks like OpenAI, AWS Bedrock, and LangChain across Python, Node.js, Ruby, Go and .NET languages.
- Full AI stack visibility: Holistic view across the application, infrastructure, and the AI layer, including AI metrics like number of requests, response time, and token usage.
- AI response view with end-user feedback: Quickly identify trends and outliers in AI responses, analyze sentiment, and see user feedback in a single consolidated view.
- Deep trace insights for every response: Trace the lifecycle of AI responses with tools like LangChain to fix performance and quality issues like bias, toxicity, and hallucinations.
- Enhanced data security: Maintain your organizational security and compliance policies by excluding sensitive data (PII) in your AI requests and responses from monitoring.
- Model comparison: Compare performance and cost of foundational models running in production in a single view to choose the model that best fits your needs.
- Quickstart integrations: One of the most comprehensive solutions for monitoring the AI ecosystem with 60 integrations for critical components like NVIDIA GPUs and vector databases like Pinecone, Weaviate and more.
New Relic AI monitoring is generally available as part of its all-in-one observability platform and offered as part of its usage-based pricing model.
The Latest
Broad proliferation of cloud infrastructure combined with continued support for remote workers is driving increased complexity and visibility challenges for network operations teams, according to new research conducted by Dimensional Research and sponsored by Broadcom ...
New research from ServiceNow and ThoughtLab reveals that less than 30% of banks feel their transformation efforts are meeting evolving customer digital needs. Additionally, 52% say they must revamp their strategy to counter competition from outside the sector. Adapting to these challenges isn't just about staying competitive — it's about staying in business ...
Leaders in the financial services sector are bullish on AI, with 95% of business and IT decision makers saying that AI is a top C-Suite priority, and 96% of respondents believing it provides their business a competitive advantage, according to Riverbed's Global AI and Digital Experience Survey ...
SLOs have long been a staple for DevOps teams to monitor the health of their applications and infrastructure ... Now, as digital trends have shifted, more and more teams are looking to adapt this model for the mobile environment. This, however, is not without its challenges ...
Modernizing IT infrastructure has become essential for organizations striving to remain competitive. This modernization extends beyond merely upgrading hardware or software; it involves strategically leveraging new technologies like AI and cloud computing to enhance operational efficiency, increase data accessibility, and improve the end-user experience ...
AI sure grew fast in popularity, but are AI apps any good? ... If companies are going to keep integrating AI applications into their tech stack at the rate they are, then they need to be aware of AI's limitations. More importantly, they need to evolve their testing regiment ...
If you were lucky, you found out about the massive CrowdStrike/Microsoft outage last July by reading about it over coffee. Those less fortunate were awoken hours earlier by frantic calls from work ... Whether you were directly affected or not, there's an important lesson: all organizations should be conducting in-depth reviews of testing and change management ...
In MEAN TIME TO INSIGHT Episode 11, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses Secure Access Service Edge (SASE) ...
On average, only 48% of digital initiatives enterprise-wide meet or exceed their business outcome targets according to Gartner's annual global survey of CIOs and technology executives ...
Artificial intelligence (AI) is rapidly reshaping industries around the world. From optimizing business processes to unlocking new levels of innovation, AI is a critical driver of success for modern enterprises. As a result, business leaders — from DevOps engineers to CTOs — are under pressure to incorporate AI into their workflows to stay competitive. But the question isn't whether AI should be adopted — it's how ...
