New Relic announced a machine learning operations (MLOps) capability that allows engineering teams to monitor applications built with OpenAI’s GPT Series APIs.
With just two lines of code, engineering teams can monitor OpenAI completion queries while simultaneously tracking performance and cost metrics in real-time in a single view with New Relic. This new integration allows New Relic to ingest raw OpenAI data and helps companies leverage the power of emerging AI technologies like OpenAI’s ChatGPT to accelerate innovation and business goals while balancing considerations to cost.
This integration expands New Relic's catalog of supported data and extends New Relic's access to a wider audience of developers. Engineers can quickly deploy the OpenAI quickstart from New Relic Instant Observability and access this capability for free with no credit card required and minimal setup by signing up for a forever free New Relic account.
“This is an exciting time for companies who are embracing GPT and building modern applications with Generative AI,” said New Relic Chief Growth Officer and GM of Observability Manav Khurana. “Observability is a game changer when it comes to helping companies extract value from GPT. We are making it so that any engineer using GPT APIs can easily monitor their cost and performance with easy set-up and at no cost. This aligns with our mission to put the power of observability into the hands of every engineer.”
The new capability allows engineers to:
- Get started for free: Access to New Relic Instant Observability and our out-of-the-box GPT monitoring solution is the first of its kind, and included at no additional cost for New Relic full platform users.
- Easy installation: With just two lines of code, users can import the monitor module from the nr_openai_monitor library and automatically generate a dashboard that displays a variety of key GPT performance metrics.
- Monitor cost: Usage of OpenAI’s Davinci model costs can add up quickly and make it difficult to operate at scale. New Relic provides engineering teams with real-time cost tracking of their GPT usage.
- Optimize performance: New Relic gives engineering teams insight into the average response time and other key performance metrics around GPT requests, allowing engineers to optimize usage and ensure the best possible response times.
- Analyze prompts and responses: New Relic provides valuable information about the usage, speed, and effectiveness of GPT to help engineering teams achieve better results from their ML models.
The OpenAI GPT integration with New Relic is included at no additional cost to New Relic full platform users. New Relic supports all current OpenAI GPT versions including the recently released GPT-4.
The Latest
In a fast-paced industry where customer service is a priority, the opportunity to use AI to personalize products and services, revolutionize delivery channels, and effectively manage peaks in demand such as Black Friday and Cyber Monday are vast. By leveraging AI to streamline demand forecasting, optimize inventory, personalize customer interactions, and adjust pricing, retailers can have a better handle on these stress points, and deliver a seamless digital experience ...
Broad proliferation of cloud infrastructure combined with continued support for remote workers is driving increased complexity and visibility challenges for network operations teams, according to new research conducted by Dimensional Research and sponsored by Broadcom ...
New research from ServiceNow and ThoughtLab reveals that less than 30% of banks feel their transformation efforts are meeting evolving customer digital needs. Additionally, 52% say they must revamp their strategy to counter competition from outside the sector. Adapting to these challenges isn't just about staying competitive — it's about staying in business ...
Leaders in the financial services sector are bullish on AI, with 95% of business and IT decision makers saying that AI is a top C-Suite priority, and 96% of respondents believing it provides their business a competitive advantage, according to Riverbed's Global AI and Digital Experience Survey ...
SLOs have long been a staple for DevOps teams to monitor the health of their applications and infrastructure ... Now, as digital trends have shifted, more and more teams are looking to adapt this model for the mobile environment. This, however, is not without its challenges ...
Modernizing IT infrastructure has become essential for organizations striving to remain competitive. This modernization extends beyond merely upgrading hardware or software; it involves strategically leveraging new technologies like AI and cloud computing to enhance operational efficiency, increase data accessibility, and improve the end-user experience ...
AI sure grew fast in popularity, but are AI apps any good? ... If companies are going to keep integrating AI applications into their tech stack at the rate they are, then they need to be aware of AI's limitations. More importantly, they need to evolve their testing regiment ...
If you were lucky, you found out about the massive CrowdStrike/Microsoft outage last July by reading about it over coffee. Those less fortunate were awoken hours earlier by frantic calls from work ... Whether you were directly affected or not, there's an important lesson: all organizations should be conducting in-depth reviews of testing and change management ...
In MEAN TIME TO INSIGHT Episode 11, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses Secure Access Service Edge (SASE) ...
On average, only 48% of digital initiatives enterprise-wide meet or exceed their business outcome targets according to Gartner's annual global survey of CIOs and technology executives ...
