The 3 Questions Every Product Leader Should Ask When Evaluating a New AI Tool
October 16, 2024

Ranjan Goel
LogicMonitor

Share this

All eyes are on the value AI can provide to enterprises. Whether it's simplifying the lives of developers, more accurately forecasting business decisions, or empowering teams to do more with less, AI has already become deeply integrated into businesses. However, it's still early to evaluate its impact using traditional methods. Here's how engineering and IT leaders can make educated decisions despite the ambiguity.

1. Does my current team have the technical ability to implement this?

Even the most advanced technology won't deliver its full potential if it isn't implemented and maintained properly. Leaders must ask:

Can my existing team do this? Can we train them to do an AI implementation in a timely manner?

Or will we need to hire additional staff?

None of the answers to the above questions spell disaster for implementing AI, they do help create a clearer picture of what's possible for your specific team. Given how quickly AI is evolving, upskilling or reskilling is likely required for most organizations. Whether through training or hiring, implementation needs to be feasible.

2. Am I willing to implement this at its current stage?

AI is full of promises — some near-term, some further off. When evaluating AI vendors, it's important to recognize that the technology's current capabilities may continue to evolve rapidly. If the current proof of concept meets most of your needs, great!

Decision makers should evaluate whether the AI tool provider they're entertaining is open to working closely to iterate the tool. Most AI tools are not yet mature enough for all potential use cases to be available already.

3. So you want to move forward. How do you justify the investment?

Think of the ROI of AI as falling into two categories: business benefits and financial benefits.

Most AI tools today offer value in terms of business benefits, such as improved customer experience, enhanced employee productivity, and faster rollouts of new features or products. Businesses using AI can differentiate better from competitors as more innovative in their products and service offerings.

The other category is financial benefits, which, in addition to the above, will undoubtedly catch the attention of the C-suite and board of directors. These include factors like improved top-line growth or improving margins. Quantifying solid financial benefits from AI tools is starting to make its way, especially for domain-specific AI applications like IT operations, medical or retail. This is an area where a partnership with the AI tool vendor and decision-maker can greatly improve the quality of ROI calculation to account for key use cases.

It's rarely one person's responsibility to ask and answer all these questions. These considerations should involve the broader team and be viewed holistically. Some tools that are still in their infancy may be worth the risk if they check many of the other boxes. A more significant monetary investment could be the right choice if the technology addresses a critical need for your team that otherwise couldn't be met. Ask these questions, and reevaluate often.

Ranjan Goel is VP of Product at LogicMonitor
Share this

The Latest

October 16, 2024

All eyes are on the value AI can provide to enterprises. Whether it's simplifying the lives of developers, more accurately forecasting business decisions, or empowering teams to do more with less, AI has already become deeply integrated into businesses. However, it's still early to evaluate its impact using traditional methods. Here's how engineering and IT leaders can make educated decisions despite the ambiguity ...

October 15, 2024

2024 is the year of AI adoption on the mainframe, according to the State of Mainframe Modernization Survey from Kyndryl ...

October 10, 2024

When employees encounter tech friction or feel frustrated with the tools they are asked to use, they will find a workaround. In fact, one in two office workers admit to using personal devices to log into work networks, with 32% of them revealing their employers are unaware of this practice, according to Securing the Digital Employee Experience ...

October 10, 2024

In today's high-stakes race to deliver innovative products without disruptions, the importance of feature management and experimentation has never been more clear. But what strategies are driving success, and which tools are truly moving the needle? ...

October 09, 2024
A well-performing application is no longer a luxury; it has become a necessity for many business organizations worldwide. End users expect applications to be fast, reliable, and responsive — anything less can cause user frustration, app abandonment, and ultimately lost revenue. This is where application performance testing comes in ....
October 08, 2024

The demand for real-time AI capabilities is pushing data scientists to develop and manage infrastructure that can handle massive volumes of data in motion. This includes streaming data pipelines, edge computing, scalable cloud architecture, and data quality and governance. These new responsibilities require data scientists to expand their skill sets significantly ...

October 07, 2024

As the digital landscape constantly evolves, it's critical for businesses to stay ahead, especially when it comes to operating systems updates. A recent ControlUp study revealed that 82% of enterprise Windows endpoint devices have yet to migrate to Windows 11. With Microsoft's cutoff date on October 14, 2025, for Windows 10 support fast approaching, the urgency cannot be overstated ...

October 04, 2024

In Part 1 of this two-part series, I defined multi-CDN and explored how and why this approach is used by streaming services, e-commerce platforms, gaming companies and global enterprises for fast and reliable content delivery ... Now, in Part 2 of the series, I'll explore one of the biggest challenges of multi-CDN: observability.

October 03, 2024

CDNs consist of geographically distributed data centers with servers that cache and serve content close to end users to reduce latency and improve load times. Each data center is strategically placed so that digital signals can rapidly travel from one "point of presence" to the next, getting the digital signal to the viewer as fast as possible ... Multi-CDN refers to the strategy of utilizing multiple CDNs to deliver digital content across the internet ...

October 02, 2024

We surveyed IT professionals on their attitudes and practices regarding using Generative AI with databases. We asked how they are layering the technology in with their systems, where it's working the best for them, and what their concerns are ...