Tag: New Relic

New Relic Integrates its Observability Platform with NVIDIA NIM to Accelerate AI Adoption and ROI

Bangalore—June 26, 2024—New Relic, the all-in-one observability platform for every engineer, announced it is integrating its platform with NVIDIA NIM inference microservices to reduce the complexity and costs of developing, deploying, and monitoring generative AI (GenAI) apps. Now, customers can use New Relic AI monitoring to gain comprehensive visibility across the AI stack for applications built with NVIDIA NIM, all with a simplified setup and while ensuring data security. This complements the robust security features and ease of use of NVIDIA NIM’s self-hosted models, which accelerates generative AI application delivery. Together, New Relic integrated with NVIDIA NIM can help customers adopt AI faster and achieve quicker ROI.

Observability is Mission Critical to Deploying Cost-Effective, High-Performance Models

Organizations are rapidly adopting generative AI to enhance digital experiences, boost productivity, and drive revenue. Gartner predicts that over 80% of enterprises will use GenAI or deploy GenAI apps by 2026. Quick deployment and faster ROI are crucial for organizations to gain market advantage and Observability is the key. It offers a holistic, real-time view of the AI application stack – across services, infrastructure, and the AI layer – to ensure efficient, reliable, and cost-effective operation.

“In today’s hyper-competitive market, organizations cannot afford to wait years for AI ROI,” said New Relic CEO Ashan Willy. “Observability solves this by providing visibility across the AI stack. We are pioneering AI observability by extending our platform to include AI apps built with NVIDIA NIM. Combining NVIDIA’s AI technology with our expertise in observability and APM gives enterprises a competitive edge in the AI race.”

“As Asia Pacific organisations brace for huge growth in generative AI users within the next five years, it is crucial for organisations to ensure they have visibility into their AI apps,” said New Relic Chief Architect, APJ Peter Marelas. “Our support for NVIDIA NIM allows organisations to understand how their NVIDIA NIM deployments are performing in real-time.”

“As enterprises race to adopt generative AI, NVIDIA NIM can help businesses quickly deploy applications in production,” said NVIDIA Director of AI Software Amanda Saunders. “New Relic’s integration with NVIDIA NIM enables IT and development teams to optimize their AI applications by rapidly observing and responding to operational insights.”

New Relic Speeds Faster ROI for AI Applications Built with NVIDIA NIM

AI applications can complicate tech stacks, increase security concerns, and be cost prohibitive. New Relic AI monitoring provides a comprehensive view of the AI stack, along with key metrics on throughput, latency, and costs while ensuring data privacy. It also traces the request flows across services and models to understand the inner workings of AI apps. New Relic extends its in-depth monitoring to NVIDIA NIM, supporting a wide range of AI models including–Databricks DBRX, Google’s Gemma, Meta’s Llama 3, Microsoft’s Phi-3, Mistral Large and Mixtral 8x22B, and Snowflake’s Arctic. This helps organizations deploy AI applications built with NVIDIA NIM confidently, accelerate time-to-market, and improve ROI.

Key features and use cases for AI monitoring include:

  • Full AI stack visibility: Spot issues faster with a holistic view across apps, NVIDIA GPU-based infrastructure, AI layer, response quality, token count, and APM golden signals.
  • Deep trace insights for every response: Fix performance and quality issues like bias, toxicity, and hallucinations by tracing the entire lifecycle of AI responses
  • Model inventory: Easily isolate model-related performance, error, and cost issues by tracking key metrics across all NVIDIA NIM inference microservices in one place
  • Model comparison: Compare the performance of NVIDIA NIM inference microservices running in production in a single view to optimize model choice based on infrastructure and user needs.
  • Deep GPU insights: Analyze critical accelerated computing metrics such as GPU utilization, temperature, and performance states; understand context and resolve problems faster.
  • Enhanced data security: In addition to NVIDIA’s self-hosted model’s security advantage, New Relic allows you to exclude monitoring of sensitive data (PII) in your AI requests and responses.

New Relic deepens its 60+ AI integration ecosystem with NVIDIA

This integration follows New Relic’s recent addition to NVIDIA’s AIOps partner ecosystem. Leveraging NVIDIA AI’s accelerated computing, New Relic combines observability and AI to streamline IT operations and accelerate innovation through its machine learning, and generative AI assistant, New Relic AI. New Relic offers the most comprehensive observability solution with 60+ AI integrations including NVIDIA GPUs and NVIDIA Triton Inference Server software.

New Relic AI monitoring is available as part of its all-in-one observability platform and offered via its usage-based pricing model. Get started by contacting your New Relic account representative or signing up for a free account.

New Relic and Atlassian Deliver the First Observability Integration for Incidents Tab in Jira

Bangalore — May 6, 2024—New Relic, the all-in-one observability platform for every engineer, announced a new integration with Atlassian, a leading provider of team collaboration and productivity software. New Relic is the first and only observability platform to be integrated into Atlassian’s new capability to track incidents in Jira Software. The integration empowers engineering teams to bolster their incident management and resolution practices with insights gained from software issues detected in New Relic. This enables organizations to more effectively manage current incidents and prevent future ones, freeing more time for product innovation.

Incidents are inevitable for every software development team. When development teams lack visibility into production issues and incident ownership is unclear, incidents and bugs go unresolved and can impact user experience, revenue, and reputation. This issue is exacerbated when incident tracking is scattered across systems, making collaboration difficult between development and IT operations teams.

New Relic and Atlassian are solving these challenges with the Incidents tab in Jira, which sends incidents from New Relic and other tools to Jira, allowing teams to quickly learn about the incident and focus on identifying the affected services, entities, and issues. By surfacing post-incident reviews (PIRs) in Jira, teams can assign and manage preventative work to reduce the frequency and volume of costly incidents. New Relic is the first and only observability provider to offer an integration available in early access to Jira customers, which helped shape Jira’s new capability.

“At New Relic, we believe in meeting engineers where they are, enabling them to do their best work with their preferred tools. We are delighted to be the first observability platform to integrate with the incidents tab in Jira,” said New Relic Chief Design and Strategy Officer Peter Pezaris. “With our natively-connected solution, we hope to expand access to observability by bringing the right insights into engineers’ existing workflows, helping them manage their work more effectively with the best-of-breed tools they use every day.”

Key benefits of the integration include:

Enhance incident detection and visibility: Enable development teams to monitor their code’s performance in production and identify associated issues in Jira Software.

Avoid screen swivel, speed up resolution: Link and create Jira issues with pre-populated incident details from New Relic to help resolve critical issues faster and reduce downtime.

Prioritize and streamline workflows: Review incidents by priority, affected service, and status to quickly identify incidents that require a team’s attention.

Establish proactive practices: Create PIRs that include real-time New Relic data to help teams understand root causes, remediation options, and how to prevent recurring incidents.

“We’re on a mission to bring software development and IT operations teams closer together so they can deliver consistently high performing software to their customers,” said Suzie Prince, Head of Product, DevOps, Atlassian. “The New Relic integration automatically surfaces insights and observability data in the new Incidents tab in Jira to further improve collaboration between teams. This can help teams move quickly on active incidents and take action to prevent recurring incidents.”

New Relic Recognized as a Customers’ Choice in 2023 Gartner Peer Insights

Bangalore — January 16, 2024 — New Relic, the all-in-one observability platform for every engineer, announced the company has been named a Customers’ Choice in the 2023 Gartner Peer Insights™ Voice of the Customer for Application Performance Monitoring and Observability. The distinction is based on feedback and ratings from IT operations (ITOps), site reliability engineers (SREs), cloud and platform ops, application developers, and product owners who have experience purchasing, implementing, and using New Relic.

Customer ratings contributed to New Relic being recognized with an overall Customers’ Choice distinction in the Application Performance Monitoring and Observability, as well as Midsize Enterprise, Services, and Asia/Pacific segments. As of January 10, 2024, New Relic maintains an all-time overall rating of 4.5 stars out of 5.0 from nearly 1,400 verified customers and 64% 5-star ratings, with 90% of customers recommending the platform.

“Everything we do at New Relic is in service to our customers. We help businesses make decisions with data across the software lifecycle so they can preserve flawless customer experiences, better compete in the market, and protect revenue. And, by enabling our platform with AI, we are expanding to new users by making it even easier for both technical and non-technical customers to use New Relic,” said New Relic CEO Ashan Willy. “We believe this recognition is a testament to our mission, product, and value, and we are honored that our customers continue to recommend us as their observability platform of choice.”

As the most widely used observability platform, engineers in every industry are using New Relic to gather real-time insights and trending data about the performance of their software so they can be more resilient and deliver exceptional customer experiences. Only New Relic provides an all-in-one platform that is built as a unified experience, giving customers access to a telemetry cloud for all metrics, events, logs, and traces; powerful full-stack analysis tools; and predictable usage-based pricing. New Relic is praised by customers for its ease of use, efficiency gains, integrated tool set, and visibility into the entire technology stack.

Notable review quotes:

Reviewing For Life Relief ‘New Relic’: My experience is quite good regarding New Relic software, the tracking, and analytics of this US-based company are awesome, and its cloud-based software allows websites and mobile apps to track user interactions is quite helpful, from this software one can easily view and analyze data and real-time insights, I wanna Give it 7 stars but due to unavailability, I would go for 5 stars. Thank you.” – Project and Development, Construction

Analyzes All Aspects Of The Full Stack And Provides Suggestions For Resolution Of Issues: Its unique ability to offer a full-stack, end-to-end view of the front-end and back-end applications, all the way to the database is great…The automatic and intelligent observability from New Relic helps us to effectively monitor a truckload of hosts with minimal manual oversight and uncovers exceptions occurring within our apps, and the analysis graphs help visualize a problem.” – Manager – IT Infrastructure, Manufacturing

One of the best APM Tools in the Market: My overall experience with the New Relic is very great. All of its features like APM, infra, and synthetic monitoring are very efficient. Alert & AI are some of the best parts of these. New relic customer support is also very quick and give(s) immediate response.” – Engineer, IT Services

New Relic: Best Monitoring Software: We now have the instrumentation and monitoring tools necessary to [manage] back-office operations and a high transaction eCommerce Platform thanks to New Relic…we can monitor the system even after hours and safeguard our income.” – Software Development Engineer, Healthcare and Biotech

Real-Time And Scalable Digital Experience Monitoring Solution: I like that it is easy to scale its performance as our needs increase and our organization grows. The real-time notifications and comprehensive monitoring and reporting keeps us on top of the game in identifying issues with our systems.” – IT Services Associate, IT Services