AI Consulting for Small Business: What Good Looks Like (and What It Costs)

You get an email from someone calling themselves an “AI Strategy Consultant.” They want to talk about “unlocking AI for your business.” Their company name has “AI” or “Future” or “Transform” in it. Their LinkedIn pitch is polished. They mention clients you’ve heard of.

You take a meeting. The conversation feels smart. They ask questions. They’re interested. By the end of the call, they’re pitching you a $30,000 engagement to “develop your AI strategy.”

Three months later, you have a 40-page PowerPoint deck about your “AI Roadmap.” It talks about generative AI, machine learning, computer vision, large language models. It recommends you hire an AI engineer. It recommends you build a data lake. It recommends you invest in model training.

The consultant gets paid. You have a roadmap. Neither of you has actually solved anything.

That’s bad AI consulting. It’s everywhere. And it’s expensive.

What Bad AI Consulting Looks Like

Bad AI consulting has a consistent pattern:

It starts with the technology, not the business problem.

The consultant’s first slide is about “What is AI?” or “The AI Landscape.” They’re educating you about transformer models and neural networks. What they should be doing is asking about your business. But that’s less interesting than explaining machine learning, so they don’t.

It recommends expensive solutions to problems you haven’t defined.

“You should build a data lake.” “You should hire an AI engineer.” “You should invest in model training.” These might all be true, or they might all be wastes of money. The consultant doesn’t know yet. But they’re recommending them anyway.

It treats “AI” as the goal, not the means.

Good consulting ends with: “Here’s the specific business problem. Here’s how technology (which might be AI, might not be) solves it. Here’s the cost. Here’s the timeline.”

Bad consulting ends with: “Here’s how to do AI in your organization.” It assumes AI is the answer before it understands the question.

It focuses on what’s technologically possible, not what’s commercially viable.

“You could build a recommendation engine powered by a fine-tuned LLM trained on your customer data.” Technically true. Commercially viable? Probably not. The cost to build it might be $200,000 and the value might be $30,000 per year. Not a good deal. But the consultant will recommend it anyway.

It handwaves the implementation.

“And then you’ll need to integrate this with your existing systems.” That sentence is doing a lot of work. Integration is hard. It’s expensive. It creates new risks. But in bad consulting, it’s glossed over because it’s not sexy.

It costs too much and produces an artifact (a report or deck) instead of actionable recommendations.

You pay $30,000-50,000 for a consulting engagement. What you get is a nicely formatted document with recommendations. What you don’t get is help actually implementing those recommendations. What you don’t get is someone who’s willing to say “actually, this won’t work for you.”

The Difference Between Sales and Strategy

Here’s the core distinction: most AI consultants are salespeople. They’re sales for vendors, for big tech companies, for implementation firms. They’re selling you a vision of AI that requires purchasing something.

A real strategist is the opposite. A real strategist is willing to tell you that you don’t need AI. The same principle applies to selecting any technology partner—avoid vendors with conflicts of interest.

Real examples of good strategy advice:

• “You don’t have enough customer service volume to justify an AI chatbot yet. Wait 6 months until you’re at 200+ tickets per month. Then revisit it.”
• “Your competitive advantage is your team’s judgment. If you replace that with AI, you lose what makes you different. Don’t do it.”
• “You could use AI here, but you could also just hire a $40,000/year person to do this work. The AI tool costs $15,000/year, but it’s worse than the person. Hire the person.”
• “AI is worth investing in here, but not for 2 years. First, you need to solve these three operational problems, then we’ll build on top of that.”

These recommendations are not sexy. They don’t sell software. They don’t create implementation projects. A salesperson wouldn’t make them. A strategist would.

What Actually Matters in AI for Your Business

Most AI consulting talks about the technology. It should talk about the business.

What matters for your business:

Your competitive position. If your competitors aren’t using AI and you implement AI before them, that’s valuable. If everyone’s already using it and you’re playing catch-up, the value of that AI is lower. So a good consultant asks: “What’s the competitive landscape? If we do nothing with AI, how much do we lose in market position?”

Your specific constraints. You might need AI for customer support, but you also need the AI to be HIPAA-compliant, or GDPR-compliant, or SOC 2-compliant. Or you need it to integrate with a legacy system from 2010 that doesn’t have APIs. Or you need it to work offline. These constraints change everything. A good consultant understands your constraints before recommending solutions.

Your team’s capacity. If you don’t have a single person who can manage an AI implementation, you’re not implementing AI, you’re hiring someone to implement it and manage it. That’s a 6-month hiring process plus 3 months of ramp-up. That’s a real constraint that most consultants ignore.

Your financial constraints. You might have a $10,000 budget, not a $100,000 budget. A good consultant designs solutions within budget. A bad consultant designs the ideal solution and tells you to raise your budget.

Your organizational readiness. Some organizations are ready for AI. They have good data. They have processes and workflows that AI can improve. They have change management capabilities to implement something new. Some organizations are a mess. Their data is bad. Their workflows are chaotic. They’re not ready for AI, and adding AI to a dysfunctional organization makes it worse. A good consultant will tell you: “You’re not ready yet. Fix these things first.”

The Questions a Good AI Consultant Asks First

If you’re interviewing a consultant or firm, here are the questions they should ask you:

“What’s the business problem you’re trying to solve? (Not what’s the AI opportunity. What’s the business problem.)”

Good consultants start here. They want to understand your business before they recommend technology. They’re trying to define the problem tightly. “We’re losing customers” is too vague. “We’re losing 10% of customers after the first month because the onboarding process is confusing” is specific.

“What have you tried already?”

They want to understand what’s worked and what hasn’t. Maybe you’ve already tried to solve this problem with process changes and it didn’t work. Maybe you’ve already built something custom and it’s unmaintainable. They’re trying to avoid recommending something you’ve already proven doesn’t work.

“What would success look like?”

Not “we want to use AI.” Success is concrete. “Success is reducing onboarding time from 3 weeks to 1 week.” Or “Success is increasing customer support volume from 50 to 500 emails per week without hiring new people.” They want to know what you’re measuring and what the target is.

“What’s your budget for this?”

They’re not trying to sell you an expensive solution. They’re trying to design a solution that works within your constraints. If your budget is $20,000 and the right solution costs $100,000, a good consultant will tell you that and recommend waiting or redesigning.

“Who on your team will own this after implementation?”

They’re trying to understand if you have the capacity to maintain whatever they recommend. If the answer is “nobody, we’d need to hire someone,” that’s a constraint. That might kill the whole recommendation.

“What’s keeping you from solving this yourself?”

They’re trying to understand why you need outside help. Maybe you do. Maybe you just need a framework. Maybe you just need someone to help you think through it. Not every problem requires a paid consultant.

How to Evaluate a Consultant or Firm

You’re looking for someone who will give you honest advice, not someone who will sell you something.

Red flags:

• They immediately recommend “building an AI roadmap” or “developing a data strategy” without understanding your business. (They’re selling engagement hours, not solutions.)
• They talk primarily about technology and rarely about business impact.
• They reference tools, vendors, or implementation firms they have relationships with. (They have a financial incentive to recommend certain solutions.)
• They’re vague about implementation costs and timelines. (They’re hiding something.)
• They get defensive when you push back on their recommendations. (A good consultant welcomes challenge.)
• They don’t ask about your constraints, budget, or team capacity.
• They can’t show you clear before/after examples from previous clients.

Green flags:

• They ask detailed questions about your business and your constraints before making recommendations.
• They’re willing to say “you don’t need AI for this” or “this isn’t worth it.”
• They have experience in your industry or your problem space.
• They can show you specific examples of what they’ve done with previous clients, with numbers.
• They’re transparent about what they don’t know and what would require additional research.
• They recommend a small pilot or quick engagement before a big consulting contract.
• They’re more interested in whether it will work than in whether you’ll buy it.

Questions to ask directly:

1. “Tell me about a time you told a client not to do something they wanted to do. What happened?”
2. “What’s the worst implementation of AI you’ve seen in a company like ours?”
3. “Can you show me 2-3 specific client examples with real metrics?”
4. “What’s the failure rate on the recommendations you make? How often do they actually move the needle?”
5. “What would change your mind about this recommendation?”

If they can answer those honestly, they’re probably a good consultant.

The Right Way to Use an AI Consultant

If you do hire a consultant, structure the engagement correctly:

Phase 1: Discovery (1-2 weeks, with 2-4 weeks of consultant work).

The consultant meets with your team. They understand your business, your constraints, your team capacity. They document what they learn. They tell you if AI makes sense at all. They tell you what your options are. Cost: $5,000-15,000. Outcome: a clear recommendation and a decision (not a pretty deck). This discovery process is similar to the structured vendor search approach, but focused on whether you need to buy anything at all. Most discovery engagements take 2-3 weeks total.

Phase 2: Pilot (4 weeks).

If the recommendation is to move forward, you run a pilot. The consultant helps you pick a tool or solution. You implement it on one small team. You measure the results. You decide if it worked. Cost: $3,000-10,000 plus your team’s time. Outcome: proof that this will work (or proof that it won’t).

Phase 3: Implementation (8-12 weeks).

If the pilot worked, you roll it out. The consultant helps with integration, training, change management. Cost: $20,000-50,000 depending on scope. Outcome: the tool is implemented and your team knows how to use it.

Don’t pay for a big strategy engagement upfront. Pay for discovery. Pay for a pilot. Pay for implementation help. But don’t pay for a consultant to produce a roadmap and then leave you to implement it on your own. That’s expensive and it rarely works.

Conclusion

Most AI consulting is people with PowerPoint skills selling expensive engagements. Real consulting is someone who understands your business so deeply that they can tell you whether you need AI at all.

The consultant worth paying is the one who’s willing to say: “Here’s what you should do, and here’s why. And if you want to go a different direction, here’s why that’s wrong.” Not the one who nods along with your ideas and then creates a beautiful roadmap.

If you’re going to hire an AI consultant, hire one who will fight with you. Not one who will agree with you.

Related Guides

• Do You Need an AI Strategy Consultant? — A decision matrix for whether to hire outside help at all
• The Honest Guide to AI for Small Business in 2026 — Understand the fundamentals before talking to a consultant
• AI Tools for Small Business: A Buyer’s Guide — Evaluate specific tools honestly
• How to Select a Technology Partner — If you’re hiring a consultant, they’re a technology partner; use this framework
• Technology Vendor Due Diligence Checklist — Questions to ask before hiring any advisor