At almost every accounting conference, the same question comes up from firm owners time and time again: "We know we need to be using AI, but where do we even start?"
It's the right question. After all, the ROI from AI is measurable today. The tools are mature. The stakes are real.
But the firms capturing efficiency gains aren't the ones that are chasing the flashiest AI features. They're the ones that built the right foundation first.
How? By following a journey that took them through three distinct phases, each of which builds on the last.
Phase 1: Start with what's already in front of you
If you're a partner at a firm between $2 million and $20 million in revenue, you probably don't have a huge technology budget or a dedicated CTO. What you do have are talented people, demanding clients and a to-do list that never gets shorter.
So the idea of an "AI transformation" probably sounds expensive and abstract. But it doesn't have to be. Phase 1 is all about removing friction from work you're already doing. Firm leaders could look at areas like invoice and document automation to eliminate manual data entry, AI-assisted recruiting screening to dramatically cut interview time, smart timesheet suggestions that reduce administrative burdens, automated client follow-ups with AI document categorization, reporting with actionable insights, and a single source for client interactions so nothing falls through the cracks.
None of these requires you to rebuild your firm from the ground up. They exist in tools that already sit inside your current workflows.
Every manager who spends their morning reconstructing what's happening across client engagements is experiencing a structural inefficiency. That time belongs in client work and revenue generation. Phase 1 gives it back.
Phase 2: Build the foundation that makes everything else possible
This phase is the part most firms skip. They see a compelling AI demo, buy a point solution, and wonder why the results don't match the pitch. The answer is almost always the same: fragmented data.
Why? Because AI is only as good as the data you feed it. If your workflow lives in one place, your client communication in another, your time tracking in a spreadsheet, and your engagement data scattered across email threads, the intelligence layer you want cannot perform. Garbage in, garbage out is more relevant now than it has ever been.
Phase 2 is about getting your data into a single system of record: workflow, time, client engagement and communication. When your firm's backbone is in a single, open system and you can bring all of your data sets together, the calculus changes. And the benefits of getting this right are immediate: Firms will see reduced administrative hours, spend less time chasing documents and have more visibility into what their teams are actually working on.
These deliver in the first months after implementation, not down the road. But there are a couple of key things to keep in mind. One, training is just as important as tech. Firms that invest in proper AI training alongside the right infrastructure see far more benefit than those that don't. In other words, the foundation and the training go together. And two, the smartest firms know what they don't know. Smart people at well-resourced firms have attempted to build custom AI tooling in-house, only to discover that the cost of security review, ongoing maintenance and compliance oversight quickly outpaces any projected savings.
You're not trying to be a software firm, so be sure to seek out trusted vendor help when you need it.
Phase 3: The intelligence layer, and why it changes everything
Once you have clean, centralized data and your team is actually using it consistently, you've unlocked something most firms haven't even imagined yet.
The intelligence layer is where accounting firms start operating like large advisory practices, without the headcount. It can enable early warning signals on client issues that are surfaced before they become problems, firmographic analysis that tells you which services to offer to which clients before the client thinks to ask, predictive staffing models that flag burnout indicators in your team before someone walks out the door, proactive cross-sell signals that let you grow revenue per client without adding headcount, and much more.
Consider that the average small accounting firm serves its clients with 1.2–1.4 services, with the Big Four averaging 6–8. This difference is about capacity and visibility, not talent. With the right data infrastructure in place, firms can finally see the full picture of each client relationship and act on it.
But what about the soul of the firm?
Many firm owners hear the words "AI automation" and ask the same underlying questions: What about the people and the relationships they've spent decades building? What happens to the team and the business that we have invested so much in?
Those are the right questions to ask. Automation, done well, protects exactly what makes your firm valuable to clients.
We have a true devotion to this profession and love to hear small businesses sharing the impact their accountant has had on their business and personal lives. One favorite question we ask every business owner we encounter, whether at the local meat store, the dentist or the boutique, is who their accountant is and what's the biggest thing they've done for them.
Almost every time, the answer is a story about a trusted relationship, not a transaction. The accountant is the No. 1 trusted advisor to a small business. That's not going to change because of AI.
What AI does is give accountants more time to be that advisor. Less time chasing documents. Less time reconstructing status updates. Less time on rote tasks that don't require your expertise. More time on the conversations that actually matter.
And more services to offer. Not just bookkeeping, tax and audit, but also HR services, technology advisory and lending referrals. All grounded in an intimate understanding of a client's financial health.
Firms that build this kind of trusted, full-service relationship with small businesses will pull away from the competition over the next three to five years.
The sequence matters, and so does getting started
The firm leaders who will look back on this period with confidence are the ones who followed the sequence and didn't skip any crucial steps.
They did the foundational work first. They chose platforms built to handle the security and compliance burden so they didn't have to. And they moved while the window was still open.
These firms have a real head start. And the gap compounds every year.
A $500 million transformation budget is not the requirement. What's needed is a clear sequence, the right system of record, and the organizational commitment to embed it into how your team actually works.
These are the elements that separate the firms that capture the value from the ones that simply checked the box.
