Problem first, tool last: the question to ask before any AI project

Person at a desk reviewing printed presentation slides with a laptop open alongside showing a product demo
TL;DR

Tool-first AI projects stall because they automate whatever exists, including broken processes, rather than solving a named business problem. The delegates who succeed lead with a concrete operational problem and apply one filter before any tool is scoped. Ask whether this initiative would still matter if it did not use AI. A no means no business case. A yes gives you a foundation worth building on.

Key takeaways

- Problem-first selection means naming the concrete operational problem before any tool is identified, discussed, or budgeted. - Tool-first AI projects tend to automate existing workflows, including broken ones, producing faster waste rather than improved outcomes. - The Addepar test applies one filter to every proposed initiative: would this still matter if it did not use AI? A no means no business foundation. - Tool-first pressure arrives from vendors with polished demos and from founders with enthusiastically endorsed products; the redirect is always to name the problem first. - Problem-first discipline is the entry point to the broader first-30-days assessment sequence, sitting before data readiness, capability gaps, and tool selection.

The demo arrives via email. Fifteen slides, five use cases, three customer logos. The founder has already replied to the vendor’s follow-up before you have opened the original message.

In many founder-led businesses handed an AI mandate, the sequence runs in reverse. The tool arrives first. The problem it is supposed to solve arrives later, or not at all.

What is problem-first AI selection?

Problem-first selection is a working discipline for any delegate leading AI adoption. Before any tool is discussed, scoped, or budgeted, you name the concrete operational problem it must solve. The selection question then becomes whether AI is the right answer for that specific problem, and whether this particular tool is the right form of AI. The tool is the last decision in the sequence.

The opposite pattern has a name in the research, AI theatre. The phrase describes projects that look convincing at demo stage and produce nothing measurable three months later. They start with a tool, then search for a workflow to demonstrate it on. That search tends to land on whatever is visible and accessible rather than whatever matters to the business.

Problem-first selection short-circuits AI theatre before it starts. The question is simple and can be asked at any stage of the conversation. What is the specific operational problem this is solving, and is AI genuinely the right answer for it? Starting there changes the shape of every vendor meeting and every founder conversation that follows.

Why does tool-first thinking break AI projects?

The core failure is that tool-first AI tends to automate whatever already exists, including the broken parts. When a team asks what a tool can do for them, they map current workflows to its available features and deploy against those. If the underlying workflow is inefficient or built on a bad assumption, AI speeds it up. The result is faster waste, not less of it.

BCG’s research on enterprise AI adoption found that usage rates have climbed while measurable business impact has stalled. That gap is partly explained by this pattern. Teams use AI tools, sometimes extensively, but the usage is not translating into outcomes because it was never tied to a specific business problem that mattered.

The ROI patterns in AI adoption make this worse. Research consistently shows that the areas attracting the largest share of AI investment, typically sales and marketing automation, produce the weakest returns. The areas with the highest returns, back-office process work like document handling, reporting, and reconciliation, attract the least funding. The explanation is partly that sales demos are more compelling than accounts-payable demos. Tool-first selection favours the compelling demo over the high-value problem.

Korn Ferry’s research on AI readiness adds a further dimension. Leaders who focus on deploying tools for efficiency gains rather than building underlying capability see consistently lower adoption rates. The tool-first instinct fails on two levels, picking the wrong problems and building nothing durable.

Where will you actually run into tool-first pressure?

Tool-first pressure comes from two directions. Vendors arrive with polished demos, reference customers, and a feature list mapped to common pain points. Founders arrive with a specific product seen at a conference or read about in a peer group, and they are often not asking for your analysis. They want your endorsement. Both situations share the same structure. The tool has already been chosen.

The delegate’s role in these scenarios is to hold the question open without killing the momentum. That is harder than it sounds. Founder enthusiasm for a specific product is often political. They may have already mentioned it to the board, or spoken to the CEO at a peer firm who uses it. Vendor pressure is commercial by design. The demo was built to make the use case look obvious, and the follow-up cadence assumes a yes.

Putting the problem question on the table first tends to work better than pushing back on the tool directly. You might say something like, “That looks like it has real capability. Before we scope it, what’s the specific workflow problem we’re solving with it? If we can name that clearly, we can judge whether this is the right fit.” The conversation changes shape as soon as the problem is on the table. If the problem is genuine and well-understood, the initiative has a foundation. If nobody can articulate it clearly, you have your answer before spending anything.

When should you apply the “would it still matter without AI?” test?

Apply it before any scoping conversation, vendor negotiation, or internal budget pitch. Addepar’s guidance for executives evaluating AI adoption frames the test simply. Would this initiative still matter if it did not use AI? A no means the project has no business foundation. A yes means you have a real problem worth pursuing, and AI may be one route to solving it.

The test works on both new proposals and existing initiatives. If something is already scoped or in pilot, run it against what the initiative was originally designed to achieve, stripped of all technology. “We wanted to reduce the time the finance team spends on month-end reconciliations.” That statement stands without AI. The technology question then becomes whether AI is the fastest, most reliable, and most cost-effective route to that specific outcome.

The question also gives you a neutral redirect when a founder or vendor is already committed to a product. Asking what problem the investment is solving is not confrontational. If they can answer it well, the initiative has a genuine case. If they struggle to name the problem clearly, the filter has done its job without requiring a disagreement.

What connects to the problem-first discipline?

Problem-first selection is an entry point to a broader assessment sequence, not a standalone technique. Confirming the problem is real and worth solving comes before data readiness, capability gaps, and cost are assessed. This discipline belongs at the front of the first 30 days of an AI mandate, before any tool is scoped, any pilot is designed, or any vendor is shortlisted.

The assessment question that follows immediately is readiness. Does the business have the data quality, the process documentation, and the internal ownership to support an AI-led change in this specific area? Research consistently identifies poor data quality as the most commonly cited barrier to successful AI implementation. If the problem is real but the underlying data is not ready, the next step is data preparation, not tool selection.

After readiness comes prioritisation. An AI mandate typically arrives with more candidate problems than the team can address at once. Problem-first discipline gives you a consistent framework for comparing them, asking whether each problem is real, whether the business is ready, and whether AI is genuinely the right solution. Those three questions applied consistently produce a shortlist you can actually deliver.

The discipline also carries forward into ongoing governance. As AI rolls out across a business, departments bring their own requests and their own vendor relationships. A simple intake process that starts by asking what business problem this initiative is solving means every new proposal enters the same filter, not just the ones you personally review. The question does not get harder to ask with practice. It gets easier.

If you are still finding your footing on the AI mandate, a conversation with someone who has mapped this territory is worth having. Book a conversation to talk through where your programme stands.

Sources

- MIT Executive Education (2024). Artificial Intelligence programme. Cites research showing approximately 95% of generative AI pilots produce no measurable P&L impact, a widely-used benchmark for AI project failure rates. https://executive.mit.edu/course/artificial-intelligence/a056g00000URaa3AAD.html - OECD (2025). AI Adoption by Small and Medium-Sized Enterprises. Documents adoption barriers and implementation challenges for owner-managed businesses deploying AI, relevant to the tool-selection failure patterns described here. https://www.oecd.org/en/publications/2025/12/ai-adoption-by-small-and-medium-sized-enterprises_9c48eae6.html - BCG (2025). The AI Adoption Puzzle: Why Usage Is Up but Impact Is Not. Primary research showing enterprise AI usage has risen while measurable business impact has stalled, directly supporting the tool-first failure pattern. https://www.bcg.com/publications/2025/ai-adoption-puzzle-why-usage-up-impact-not - McKinsey & Company (2025). Superagency in the Workplace. Research on AI integration patterns and workforce adoption, relevant to workflow-first versus tool-first approaches to AI deployment. https://www.mckinsey.com/capabilities/tech-and-ai/our-insights/superagency-in-the-workplace-empowering-people-to-unlock-ais-full-potential-at-work - Korn Ferry (2025). 6 Signs Leaders Lack AI Readiness and How to Fix It. Research identifying the gap between AI capability assignment and organisational readiness, and finding that leaders focused on tool deployment over capability-building see lower adoption outcomes. https://www.kornferry.com/insights/featured-topics/gen-ai-in-the-workplace-articles/6-signs-leaders-lack-ai-readiness-and-how-to-fix-it - Addepar (2024). Questions Executives Should Ask Before Adopting AI. Source of the "would it still matter without AI?" test and the AI theatre framing, both central to the problem-first discipline described here. https://addepar.com/blog/questions-executives-should-ask-before-adopting-ai - Logix Guru (2025). The Board Wants an AI Strategy by Tuesday: A CIO's Survival Guide. Practitioner guidance on the first 30 to 90 days of an AI mandate, covering the AI theatre pattern and the avoid-automating-broken-processes discipline. https://www.logixguru.com/post/the-board-wants-an-ai-strategy-by-tuesday-a-cios-survival-guide - Schellman (2024). AI Implementation Failures in Real-World Deployments. Documents patterns behind AI project failures including tool-first selection and data readiness gaps, with reference to Gartner research showing 77% of firms cite data quality as their primary barrier. https://www.schellman.com/blog/ai-services/ai-implementation-failures-in-real-world-deployments

Frequently asked questions

What is the problem-first approach to AI projects?

Problem-first means starting every AI initiative by naming the concrete operational problem it needs to solve before a tool is discussed. The selection question is then whether AI is the right answer for that specific problem, and whether a particular tool is the right form of AI. The opposite pattern, picking a tool first and then searching for a use case, tends to produce flashy demonstrations rather than measurable business outcomes.

How do you redirect a founder who has already committed to a specific AI tool?

Use the problem-first question rather than a direct challenge. Ask what specific workflow problem this tool is being brought in to solve, and name any constraints clearly before scoping begins. The question is neutral, not oppositional, and it opens a conversation rather than closing one. If the founder can answer it clearly, you have a genuine initiative. If they struggle, the absence of a clear business problem has done the filtering for you.

Why do AI projects fail even when the technology works?

The technology working and the project being worth doing are two separate questions. A tool can function exactly as designed and still deliver no measurable improvement if it was applied to the wrong problem, an unimportant workflow, or a process that was broken before AI touched it. BCG research shows that enterprise AI usage rates have risen while measurable business impact has stalled, which is exactly this pattern playing out at scale.

This post is general information and education only, not legal, regulatory, financial, or other professional advice. Regulations evolve, fee benchmarks shift, and every situation is different, so please take qualified professional advice before acting on anything you read here. See the Terms of Use for the full position.

Ready to talk it through?

Book a free 30 minute conversation. No pitch, no pressure, just a useful chat about where AI fits in your business.

Book a conversation

Related reading

If any of this sounds familiar, let's talk.

The next step is a conversation. No pitch, no pressure. Just an honest discussion about where you are and whether I can help.

Book a conversation