AI vs automation works when the model makes one call
AI vs automation is a split inside one process. In the cases we studied, a model read the messy input and made one call, and fixed steps took it from there.
Start building
The difference between AI and automation
Automation follows rules written in advance, so the same input produces the same action every time. AI makes a judgment from input nobody structured, so it can handle the message no rule anticipated, and it can also answer the same input two different ways. People search the same question as automation vs AI, and as agentic AI or AI agents vs traditional automation. The line sits in the same place for all of them. An agent is a model making those judgments in a loop. Traditional automation is a fixed sequence of steps, whether it lives in a workflow tool, a script or an RPA bot.
| Automation | AI | |
|---|---|---|
| What it reads | Structured fields | Messy text, scans, speech |
| Same input twice | Same action | Can differ |
| Cost per run | Close to nothing | Paid on every call |
| When it is wrong | Wrong the same way every time | Wrong differently, and plausibly |
| What changes it | You edit it | The vendor ships an update |
| Who writes it | A person, now often AI | A vendor trains it, you prompt it |
The cost row is where the cases we studied pulled apart. Someone paying $30 a month to move invoices and receipts into a spreadsheet replaced that service with a script they put at about a cent a year to run. A team running a video pipeline for the Brazilian market was spending roughly $15 of cloud compute per video while agent loops ran every stage.
AI still earned its place in the same cases. One model caught billing errors a careful person had missed. Another sorted guest messages no rule could have parsed. So the question that mattered in these cases was which step each one should own. The rest of this piece follows that split, plus a third job AI kept turning up in: writing and checking the automation itself.
Where AI won, it made a call and handed it on
Three cases came out on the model's side. Each gave it one hard reading job and a narrow way to report back.
An owner reviewing construction bills gets several a month, each about 50 pages of low-quality scanned paper. The owner reviews each one and still finds it hard to be right every time. A model got read-only access to the owner's email, plus prior invoices, emails and meeting notes. For each new invoice it emails the owner a report, the only email the API token lets it send. By the owner's count, across three years of projects it found about $45,000 in wrong amounts, duplicate invoices and bills addressed to the wrong person. The owner verified each one and got refunds or credits. The owner put lifetime spend on the model at about $1,800, and believes the errors were honest mistakes.
An operator running short-stay rentals has an agent that, in the operator's estimate, handles about 95% of operations, mostly guest communication. The model classifies incoming texts and transcribed voicemails, answering several questions at once: does this need a response, is it an emergency, should a human look, does it belong to an active workflow, what type is it. The operator called this a hard problem to solve, because it used to take many separate calls. What follows is set in advance. The lockout workflow sees a guest at the door at 2pm before a 3pm check-in, checks whether the cleaners have been in, and if so issues a temporary code. The noise workflow checks whether it is after 10pm (unless it is a dog), messages the neighboring guest, and follows up at 15, 30 and 45 minutes without a reply. Maintenance request triage has the same shape: sort the message, then hand it to a fixed process.
The same operator's accounts payable is a smaller version. An agent watches the payables inbox and checks that each invoiced service was rendered. If it was, it creates the bill in the accounting software. If not, the invoice goes to an exception queue for a human. In that case it saved $183, which the operator said more than paid for its tokens.
In all three cases the model's hard part was a decision in a fixed shape (a report, a category, a yes or no), and what that decision triggered was set in advance.
The model lost when it ran the same step all day
A team running a video pipeline for the Brazilian market had model agents working in loops at every stage. In that setup 42% of runs crashed, and cloud compute came to about $15 a video. The team replaced the loops with small classifiers feeding deterministic state machines, and moved the voice and video rendering onto tools running locally.
| Agent loops | Classifiers and fixed stages | |
|---|---|---|
| Cost per video | About $15 in cloud compute | $0.00 in cloud compute |
| Crash rate | 42%, put down to drift | 0%, on linear stages |
| Unattended runs | Not reported | Days, on a six-hour schedule |
The model stayed in the pipeline. It shrank to small classifiers, each taking an input and passing a label to the next stage, the way one command pipes text to another. The team's framing was that AI works when it is treated as a pipe and not as an oracle. What it stopped doing was running every stage of every video.
Two other cases show the costs that make a model a poor fit for a repeated step. The owner of a bridal shop had leaned on a model all year and handed it half the work. Then the vendor shipped an update and the output got worse, for weeks rather than days. The owner said the vendor had done this before and usually fixed it within a couple of days. This time it did not, and the owner was one invoice away from moving the credits to a competing provider. The model had changed under a business that ran on it.
The president of a small-business acquisition marketplace spent $10,000 on a product feature built as a wrapper around a model. Even with the company's own data behind it, the feature got basic facts wrong and gave odd answers. The AI engineer hired to fix it started by moving to a more expensive model with more tokens. The president called the difference night and day, and the company now spends about $2,000 a month more. The better answers arrive on a monthly bill.
Those are the model's two standing costs, and a script carries neither. Every call is paid for, and the thing answering can change from one week to the next. A step that makes a new judgment each time can be worth both. A step that runs the same way all day, like rendering a video or filing a record, should be code, with the model kept to the reading no rule can do.
AI's other job was writing and checking the automation
Three of the cases put the model outside the automation altogether. It built the workflow, repaired it when it broke, or read what it had done and found the step that had quietly stopped. The automation itself stayed ordinary code.
- More integrations, one developer. A factory owner with a few thousand staff told a writer about building 4-5x as many retailer integrations with AI in three months as in the whole previous year. They are basic integrations, and one main developer now builds them.
- Repaired between calls. For the founder of a sales team, a fault in the calendar tool's integration stopped every pre-call automation for every closer. While the founder was on calls, an agent with browser access remapped each automation into the CRM and tested it, within about 30 minutes.
- Audited on request. An operator of an online software-deals business connected 22 data sources to a model and asked it to audit the welcome email series. It found a discount code had stopped sending, an error the operator said cost $60,000, and the team fixed it.
The drawable part of a workflow has become cheap, as the piece on AI workflow automation argues, and these cases show one reason: a model now drafts it and repairs it.
A solo founder on a first product shows what happens when that help goes unchecked. The founder set up automated emails, checked that they sent, and went to the gym. The email log afterwards showed that a handful of the founder's users had received the exact same email every 15 minutes, for three hours. The founder had wired it by copy-pasting between two AI tools without understanding the join. It worked in the test and went wrong only with real people on the other end. The founder's rule now is that nothing runs on a schedule until it has been watched once on real data.
In every case here the automation still did the work. AI is how it got built, repaired and audited. Automation nobody on the team understands still runs on schedule, and so do its mistakes.
How to split one process between the two
The cases reduce to five questions, asked of one step at a time. Most steps answer yes to more than one, and when they do, the most cautious answer wins.
| # | Ask of each step | If yes |
|---|---|---|
| 1 | Can a rule read the input? | Automation owns it |
| 2 | Is the output one choice from a short list? | The model may make it |
| 3 | Would a wrong call cost money? | Gate it: a rule, a limit or a person |
| 4 | Does it run all day unchanged? | Keep the model out of it |
| 5 | Could it stop without anyone noticing? | Have the model audit it on a schedule |
Row two is the pattern from the wins: the model read what no rule could and handed back a report, a category or a yes or no. Row three is why the construction bills got a report-only email, and why an invoice nobody could match to finished work went to an exception queue. Row four is the video pipeline. Row five covers the discount code that went quiet until a model audit caught it, and the repeated email that ran for three hours before anyone opened the log.
Say a property manager comes to us with a shared inbox of tenant messages: repair requests, questions about late rent, noise complaints, lockouts. The model would read each message and return a category and a draft reply. Everything after that would be a fixed workflow. A repair message opens a job, a late rent question sets the reminders, and each case gets its follow-ups on a timer. Any repair that would go over a spend limit waits for a person, and so does any message the model cannot place in a category. Once a week, the model would read the workflow log and look for the automation that stopped firing, such as a reminder that never went out or a job that opened and never closed. It does not send money, change a lease or decide who gets a locksmith at midnight.
In that inbox, the model does the reading and the weekly check, and fixed steps or a person handle everything else.