9 Out of 10 Enterprises Experience Challenges Integrating AI into Their Tech Stack
March 14, 2024

Rich Waldron
Tray.io

Share this

The integration and maintenance of AI-enabled Software as a Service (SaaS) applications have emerged as pivotal points in enterprise AI implementation strategies, offering both significant challenges and promising benefits. Despite the enthusiasm surrounding AI's potential impact, the reality of its implementation presents hurdles. Currently, over 90% of enterprises are grappling with limitations in integrating AI into their tech stack.

We recently commissioned and released findings from The 2024 AI Implementation Strategies in the Enterprise survey that delves into insights from a diverse cohort of 1,044 US-based business professionals, including executives, team leaders, department heads, and practitioners at companies with 1,000 or more employees. This study explores the intricacies of AI integration efforts across various industries and internal departments. We found the following:

1. SaaS bloat remains a challenge — and AI is further complicating the issue

SaaS bloat persists as a significant challenge, with more than half of respondents (55%) reporting that they have more than 50 SaaS apps in their tech stack, and 37% state they have more than 100. Complicating matters further, the majority of SaaS applications now incorporate f AI functionality — 73% of respondents state that over half of their apps have AI capabilities or AI-augmented features. Moreover, 96% intend to leverage these AI features to enhance process efficiency and employee productivity, customer satisfaction and cost reduction.

2. The rapid proliferation of AI within existing SaaS apps is causing significant integration pains

Organizations face challenges such as provisioning, ongoing management, change management, developer dependency, lack of implementation frameworks, and difficulty in experimenting with and prototyping AI features. Additionally, AI tools are perceived as costly and time-intensive to integrate.

Looking ahead, as enterprises prioritize data governance and employee skill development in their AI implementation strategies, anticipated key challenges include managing data governance, compliance, security, and trust, along with addressing the lack of familiarity with AI tools and workforce skills. Employee resistance and deployment costs also loom as significant hurdles.

3. Lack of clear and aligned AI integration strategies threatens to hinder progress

The survey findings reveal a notable disconnect between executives and practitioners regarding AI implementation strategies. While almost half of enterprise executives (48%) emphasize building strong integrations between internal SaaS apps and AI, practitioners often lack clarity on AI strategy, with nearly 20% stating their organization lacks an AI strategy altogether.

4. Despite the challenges, enterprises are optimistic about the potential of AI

Enterprises remain optimistic about AI's potential benefits, including improving process efficiency, enhancing productivity, boosting customer satisfaction, reducing costs, and gaining competitive advantage. When asked, "where can your organization most benefit from the application of AI?" respondents identified IT is universally identified as the number one practice, followed by Product Development and Engineering and Customer Service and Success. Respondents envision leveraging AI to enhance internal processes, automate manual tasks, and improve decision-making. In the future, AI is expected to streamline tasks, accelerate decision-making, and provide frameworks to enhance job performance.

Streamlining AI Integration for Sustainable Growth

As enterprises embark on their AI implementation journeys, they will be challenged with managing the functionality of dozens of different AI features in a sustainable way without causing conflicts between connected apps in their tech stack. Organizations should proactively address the dual challenges of SaaS bloat and the accelerated infusion of AI functionalities by auditing their tech stack, prioritizing applications for AI integration, and developing robust implementation frameworks. Cross-functional collaboration is also crucial for aligning IT, data governance, compliance and business objectives, while a mindset of continuous improvement ensures adaptability to the evolving landscape of AI integration.

Despite current challenges, organizations should maintain optimism about AI's potential benefits, including improved efficiency, productivity, customer satisfaction, cost reduction and competitive advantage. Leveraging AI across various departments, particularly in IT, product development, engineering and customer service, can yield significant dividends.

Moving forward, by thoughtfully prioritizing the strategic integration of AI into business processes with a lens on sustainability and optimization, organizations can unlock the full potential of AI to drive innovation and success in the digital age.

Rich Waldron is CEO and Co-Founder of Tray.io
Share this

The Latest

December 18, 2024

Industry experts offer predictions on how NetOps, Network Performance Management, Network Observability and related technologies will evolve and impact business in 2025 ...

December 17, 2024

In APMdigest's 2025 Predictions Series, industry experts offer predictions on how Observability and related technologies will evolve and impact business in 2025. Part 6 covers cloud, the edge and IT outages ...

December 16, 2024

In APMdigest's 2025 Predictions Series, industry experts offer predictions on how Observability and related technologies will evolve and impact business in 2025. Part 5 covers user experience, Digital Experience Management (DEM) and the hybrid workforce ...

December 12, 2024

In APMdigest's 2025 Predictions Series, industry experts offer predictions on how Observability and related technologies will evolve and impact business in 2025. Part 4 covers logs and Observability data ...

December 11, 2024

In APMdigest's 2025 Predictions Series, industry experts offer predictions on how Observability and related technologies will evolve and impact business in 2025. Part 3 covers OpenTelemetry, DevOps and more ...

December 10, 2024

In APMdigest's 2025 Predictions Series, industry experts offer predictions on how Observability and related technologies will evolve and impact business in 2025. Part 2 covers AI's impact on Observability, including AI Observability, AI-Powered Observability and AIOps ...

December 09, 2024

The Holiday Season means it is time for APMdigest's annual list of predictions, covering IT performance topics. Industry experts — from analysts and consultants to the top vendors — offer thoughtful, insightful, and often controversial predictions on how Observability, APM, AIOps and related technologies will evolve and impact business in 2025 ...

December 05, 2024
Generative AI represents more than just a technological advancement; it's a transformative shift in how businesses operate. Companies are beginning to tap into its ability to enhance processes, innovate products and improve customer experiences. According to a new IDC InfoBrief sponsored by Endava, 60% of CEOs globally highlight deploying AI, including generative AI, as their top modernization priority to support digital business ambitions over the next two years ...
December 04, 2024

Technology leaders will invest in AI-driven customer experience (CX) strategies in the year ahead as they build more dynamic, relevant and meaningful connections with their target audiences ... As AI shifts the CX paradigm from reactive to proactive, tech leaders and their teams will embrace these five AI-driven strategies that will improve customer support and cybersecurity while providing smoother, more reliable service offerings ...

December 03, 2024

We're at a critical inflection point in the data landscape. In our recent survey of executive leaders in the data space — The State of Data Observability in 2024 — we found that while 92% of organizations now consider data reliability core to their strategy, most still struggle with fundamental visibility challenges ...