Task defence

Become the Person Who Checks the Machine

The least glamorous job in the building is quietly becoming one of the hardest to remove.

My Career Crusader11 min read867 words

it is invisible when done well, and in most organisations it has historically been what you did when you were too senior to produce and not senior enough to decide. That position is changing, and the change is worth getting ahead of.

The asymmetry that creates the job Generated output has a specific and awkward property: it is fluent regardless of whether it is correct. Human work carries texture. When someone is unsure, it shows — hedging in the language, roughness where the thinking got hard, an obvious gap where they ran out of time. Reviewers use those signals constantly and mostly unconsciously to decide where to spend attention. You skim the confident parts and slow down at the wobbly ones. Machine output removes the signal. The uncertain parts read exactly like the certain parts. A fabricated citation is formatted identically to a real one. An invented clause is as well -constructed as a quoted one. This is not a temporary flaw to be engineered away; it follows from how the systems produce text. The consequence is that reviewing generated work requires a different and more expensive process than reviewing human work. You cannot allocate attention by feel. You have to check systematically, which means you have to know what to check and what the failure modes are.

That is a skill, it is domain-specific, and there are not many people who have it.

Why organisations will pay for it

The economics are simple. Automation moves the cost from production to verification. If the verification is cheap, the whole thing is cheap and everyone wins. If verification is expensive or unreliable, the organisation carries a risk it usually cannot quantify. Most organisations currently deploying these tools have not solved verification. They have a policy document saying a human should review the output, which is not a process, and a workforce that has never been trained to review anything systematically. The gap between the policy and any real assurance is enormous and quietly terrifying to anyone who has looked at it. Someone has to close that gap. Whoever does becomes structurally load-bearing.

What the role actually looks like This is not sitting there reading things and nodding. Done properly it has four parts, and all four are learnable. Knowing the failure modes. Every domain has characteristic ways generated output goes wrong.

In legal work it is confident citation of authorities that do not exist or do not say what is claimed. In financial analysis it is arithmetic that is internally consistent and based on a misread input. In technical writing it is plausible procedures with one step in the wrong order. You learn these by collecting them, which means keeping a log of every error you catch and what type it was.

Sampling intelligently. You cannot check everything, so you need a defensible approach to what gets checked and how heavily. This is standard practice in quality assurance and almost unknown outside it. Even a crude version — check everything above a value threshold, sample 10% of the rest, check 100% of anything involving a new counterparty — puts you ahead of nearly everyone.

Defining acceptance criteria. What does correct look like for this output? Written down, specific enough that two people would grade the same item the same way. Most organisations have never articulated this even for human work. Escalating properly. Knowing which errors are cosmetic and which are catastrophic, and having a route for the second kind that does not depend on you being in the office.

Getting into it from where you are The route in is unusually direct, because nobody is competing for this.

Start by keeping the error log for yourself. When you check something a tool produced and find a problem, record what the problem was and how you spotted it. Categories will emerge within a few weeks. This costs nothing and produces the one artefact that makes you the local authority.

Then offer to write the acceptance criteria for one process. Not a policy for the organisation — the criteria for one specific output that your team produces. It is a small enough ask that people say yes, and it puts your name on the definition of correct. Then propose the sampling approach. By this point you have the error log to justify it, which is the difference between a proposal and an opinion.

Two, and they are real.

It is not fun. Producing has intrinsic satisfaction that checking does not. If you are someone who is energised by making things, a role that is mostly verification will grind on you, and no amount of career logic fixes that. It also caps out. Verification is defensible but it is not where the highest ceilings are. It is a strong position, not a spectacular one, and past a certain point you want to move from checking the work to deciding what work gets done. Treat it accordingly: an excellent place to stand while the ground is moving, and a place to move on from once it stops.

record the error type and how you spotted it. In two months you will hold the only structured knowledge of failure modes in your organisation.

Apply this to your role

How exposed is your own week?

The free AI Exposure Audit breaks down your working week by automation risk — and gives you a personalised 30/90/365-day action plan. No account required.

Take the free audit
Share this articleXLinkedInFacebook