Noxia

Field note · Getting started

What to automate first in an advice firm — and what to never automate.

Most automation projects fail at the choosing, not the building. Here is the test we use, which takes about ten minutes and rules out the expensive mistakes before anyone writes anything.

2 min read Sources checked 8 September 2026

The short answer

Score each task on two axes: how reversible is a mistake, and how easily would you spot one. Automate what is reversible and checkable. Never automate what is irreversible and hard to check — that quadrant contains the recommendation itself, and no efficiency gain is worth entering it.

The usual question is "what can AI do for us?" It is the wrong one, because the answer is "quite a lot", and that tells you nothing about where to start.

The better question has two halves, and you can answer both about any task in under a minute.

The two questionsStart with tasks where a mistake is reversible and easy to spot. Never automate tasks where a mistake is irreversible and hard to spot.Start herereversible · easy to spotRe-keying between systemsCompleteness checks before submissionChasing a client for a documentChasing a lender for an updateMeeting notes and action extractionDrafting the factual summary sectionSorting and tagging the inboxNever hereirreversible · hard to spotThe recommendation itselfAttitude-to-risk conclusionsWhat the client is told not to doAnything that sends moneyAnything sent to a client unreviewedVulnerability assessmentsComplaint responses
Reversible and checkable on the left. On the right, an efficiency gain is not the point.Noxia’s framework. Not a regulatory classification.

Why reversibility?

Because it sets the cost of being wrong, and every automation will be wrong sometimes.

A mis-tagged email costs a moment. A payment sent to the wrong account costs a relationship, a complaint, and possibly a report. Same error rate, entirely different exposure. Start where the blast radius is small enough to learn in.

Why checkability?

Because this is the axis people forget, and it is the one that hurts.

A completeness check either produced the list or it did not — you can see it. A suitability narrative reads perfectly whether or not it is right about the fund. The second kind of task hides its failures inside fluent prose, and fluency is precisely what these systems are best at.

If you cannot describe how you would notice the mistake, you have not found an automation candidate. You have found a way to make errors quieter.

The middle two quadrants

QuadrantExampleWhat to do
Reversible, easy to spotRe-keying, chasing, taggingAutomate. Start Monday.
Reversible, hard to spotDrafting a narrative sectionAutomate with a fact-level check. The prose is not the check
Irreversible, easy to spotBooking into a live diaryAutomate with a confirmation step. Cheap insurance
Irreversible, hard to spotThe recommendationDo not. Not with review, not with guardrails

The order to do them in

  1. Pick the highest-volume task in the top-left quadrant. Volume, not glamour. The dull one that happens forty times a week.
  2. Write down how you will know it worked — a number, measured now, before anything is built.
  3. Build only that. One task, one leg, one handover to a named person.
  4. Run it for a month and check the number. If it did not move, stop. Do not build the second thing on top of a first thing that failed.
  5. Then take the next one. Not a platform. The next task.

Why not do it all at once?

Because long, multi-step, cross-application work is exactly where agents fall over: the best agent on Carnegie Mellon's simulated-company benchmark completes 30% of such tasks unaided, against 86.1% on bounded desktop tasks.

Doing it one leg at a time is not caution. It is buying the 86% number instead of the 30% one.

Questions people actually ask

What should a financial advice firm automate first?

The highest-volume task where a mistake is both reversible and easy to spot — typically re-keying between systems, completeness checks before submission, and chasing clients or providers for documents.

What should never be automated in an advice firm?

Anything where a mistake is both irreversible and hard to notice: the recommendation itself, attitude-to-risk conclusions, vulnerability assessments, anything that moves money, and anything that reaches a client unreviewed.

Why automate one task at a time?

Because agent reliability collapses on long, multi-application work. The best agent completes 30% of such tasks unaided on Carnegie Mellon’s benchmark, against 86.1% on bounded desktop tasks. Cutting work into bounded legs buys the higher number.

Sources

  1. OSWorld-Verified leaderboard (86.1%, best agent) and TheAgentCompany, Carnegie Mellon, arXiv:2412.14161 (30% autonomous completion). Re-checked 8 September 2026. source ↗ — primary re-checked every 30 days
  2. The two-axis framework is Noxia’s own and is not a regulatory classification. — our opinion, labelled

Checked 8 September 2026. Next scheduled check 8 October 2026. Numbers that move — leaderboards, live indices — are re-checked every 30 days; annual datasets and rules in force every six months; dated research once a year. If something here has gone stale before we got to it, tell us and we will correct it and say what changed.

Send us your five most repetitive tasks.

We will score them on both axes and tell you which one to do first — including if the answer is that none of them are worth automating yet.

Talk to us about this