Risk analysis

Why the Forecasts Keep Being Wrong

The famous numbers measure something other than what you think, and the correction is the most useful thing in the literature.

My Career Crusader8 min read900 words

the most useful thing in the literature.

In 2013, two Oxford researchers published a paper estimating that around 47% of United States employment sat in a high-risk category for computerisation over the following decade or two. That number went everywhere. It is still being quoted, usually without the qualifiers, usually as though it meant half of all jobs were about to disappear. Three years later, a group of economists at the OECD ran the same question with one methodological change and got roughly 9%. The gap between 47% and 9% is not a disagreement about technology. Both groups were looking at broadly similar capabilities. The gap is entirely about the unit of analysis, and understanding it will tell you more about your own position than any updated forecast will.

What actually changed The first approach assessed whole occupations. Experts looked at a job as a category and judged how automatable it was overall, then that judgement was applied to everyone holding that job title.

The second approach assessed tasks, then reassembled them into jobs, accounting for the fact that people with the same title do measurably different work. Once you do that, the picture changes dramatically, because almost every occupation turns out to contain a mix of highly automatable and highly resistant tasks. Very few jobs are uniformly one or the other.

The occupational method effectively rounds. If a job looks mostly automatable, the whole job goes in the high-risk bucket, including the 30% of the week that is not automatable at all. Do that across an economy and you get 47%. This is the same error a person makes when they read that their occupation is at risk and conclude they are finished. It is the error of treating a bundle as an object.

Why the corrected number is also not your number

Here is where most commentary stops, and it should not, because 9% is not a reassuring figure to build a plan on either. It is an average across an entire labour market, and averages hide exactly the thing you need to see. Within any occupation, the distribution is wide. Two accountants, same qualification, same firm: one spends most of the week on transaction processing and reconciliation, the other on client advisory and complex judgement calls. They face materially different situations, and no economy-wide number distinguishes them. The useful reading of the 9% figure is not "only 9% of us are affected." It is "the affected share is much smaller than headline occupational analysis suggests, and it is distributed by task rather than by title, which means it is distributed within occupations rather than across them." That is the finding. Your risk is not determined by your job title. It is determined by how your particular week is composed, which is why it is worth an hour of your time to actually look.

The systematic errors in prediction Beyond the unit problem, forecasts in this area go wrong in a few consistent ways, and knowing them helps you read the next one more sceptically. They measure capability, not deployment. A task can be technically automatable for a decade before anyone actually automates it, because the systems do not integrate, nobody owns the budget, the vendor contract runs to 2029, or the person who would champion it left. Organisational friction is enormous and is almost never modelled. This consistently makes forecasts early. They ignore the work that appears. Automating part of a process creates new work: specifying, monitoring, correcting, integrating, explaining to customers why the automated thing did something odd. Historically this has been substantial. It rarely appears in a projection because it is not visible in advance. They treat demand as fixed. If a task gets ten times cheaper, the quantity demanded frequently rises. More documents get reviewed because review became affordable. This has happened repeatedly with previous automation waves and it is why some professions grew after the technology that was supposed to end them. They cannot see the exceptions. Every forecast is built on how work is described. Work as actually performed contains a long tail of cases that do not fit, and the tail is invisible from the outside.

These errors do not all point the same way, which is why "the forecasts were wrong" is not the same as "nothing happened." Some things moved faster than predicted, particularly in text-heavy work. The point is not that the predictions were too pessimistic. It is that they were too coarse to be applied to a person.

What to do with this Stop reading occupational forecasts as though they are about you. They are about a statistical category you happen to be filed under, constructed from a job description that was probably written

The transferable habit is to treat every claim about automation with one question: what is the unit? If the answer is an occupation, an industry, or a sector, you are reading something too coarse to act on. If the answer is a specific task with a specific output, you are reading something you can check against your own week. And when someone quotes you a percentage, ask what happens to the other side of it. Forty-seven percent at risk was always also fifty-three percent not at risk, and nobody built a headline out of that.

The next time you see a figure about job losses in your field, find the methodology. If it

Apply this to your role

How exposed is your own week?

The free AI Exposure Audit breaks down your working week by automation risk — and gives you a personalised 30/90/365-day action plan. No account required.

Take the free audit
Share this articleXLinkedInFacebook