Explainer / analysis · Prepared with AI assistance. Published by The AI System Institute. Editorial approach and corrections.
A small digital project contains several jobs disguised as one. Someone has to understand the subject, make a resource, explain it clearly and arrange delivery. AI assistants can contribute to several of those jobs. Treating them as interchangeable is where the trouble begins.
The shift is easiest to see at the draft stage. An operator can ask for alternative outlines, a first version of instructions or a list of questions a reader might raise. A blank page becomes something concrete enough to assess. That is useful progress, although it is not the same as a finished product.
The production barrier is moving
In a 2023 professional-writing experiment, access to ChatGPT reduced average completion time by 40% and increased assessed output quality by 18% on the study’s tasks. Those findings concern a particular experiment. They do not measure the time required to build a business or predict a seller’s earnings.
The sensible interpretation is task-specific: some forms of drafting can become faster. Researching an unfamiliar subject, checking a calculation and testing a resource with a real reader still require their own attention. A shorter first draft can even create more work if its errors are difficult to spot.
A draft still needs a standard
A useful review asks more than whether the prose sounds polished. Are the instructions complete? Does the example work? Are important exceptions missing? Does a reader know what to do when a step fails? These questions connect the resource to the situation it is meant to serve.
For a hypothetical scheduling template, a convincing description is less valuable than a simple test: can someone enter an appointment, change it and understand the result without help? The test reveals friction that a fluent product description can conceal.
Customer research has not become optional
An assistant can suggest possible audiences. It cannot establish demand merely by naming one. A credible brief distinguishes between a hypothesis, a question heard from a potential user and behaviour observed in a test.
That distinction is especially important when a draft includes claims such as “people struggle with this” or “this saves hours.” Those statements need evidence from the situation being described. Without it, they are assumptions expressed in a confident voice.
Usage data is not a success rate
The Anthropic Economic Index’s initial 2025 report analysed anonymised Claude conversations to study how AI was used across tasks. Its dataset provides a view of usage on that service. It is not a representative count of every business, and it does not show that a particular workflow produces a profitable product.
This is a useful habit when reading technology reports: ask what was observed, who was included and what the measure leaves out. Tool adoption, task speed, product quality and business survival answer different questions.
The operational barrier remains
Delivery, support, permissions and recordkeeping belong in the plan from the beginning. A reader who cannot open a file experiences a delivery problem, regardless of how quickly its first draft was produced. An unclear licence can make an otherwise useful asset difficult to use.
A modest first project makes those responsibilities easier to inspect. A small resource, clear instructions and a limited feedback round can reveal more than an ambitious catalogue launched all at once. The purpose of the exercise is to learn whether the resource works for the intended reader.
What has changed
AI assistance can move a project from an idea to a reviewable draft with less initial effort. The value of the next step still depends on judgement: which suggestions to keep, what to verify and what a reader actually needs. The barrier has shifted rather than vanished.
Sources & further reading
- Noy and Zhang, Science, 2023: professional writing experiment
- Anthropic Economic Index, February 2025
Research dates and study settings are stated where relevant. Questions or corrections can be submitted through our contact page.