Nobody Planned It. It Just Accreted.

On the Human Condition and the Systems We Monetise

Underwater industrial ruin tangled with cables, filing cabinets, and floating documents
An underwater industrial ruin is overtaken by tangled cables, filing cabinets, and drifting paper records.

By Andrew Paul Klein 

I. The Question

There is a question that arrives at a certain point in a working life spent among systems that fail. It is not “why do they fail?” Failure is easy to explain. The question is harder than that.

The question is: why does everything administered eventually convert its own substance into its own output?

Not everything. Some things hold. But the pattern is strong enough to be worth naming, and the naming is the purpose of this essay.

II. The Accretion

Start with the shape of the thing.

A coral reef is not built. It accretes. Each polyp lays down its own small skeleton in response to local conditions — light, current, nutrients — optimising for what is rewarded. No polyp sees the reef. No polyp intends the reef. The reef is the residue of ten thousand individually defensible decisions.

The same is true of the administrative state. Nobody designed Robodebt. It emerged from a sequence of locally rational choices: use income averaging because it is cheaper than verification; continue the scheme because stopping is a risk; obscure the legal advice because the advice is inconvenient. Each decision was defensible on its own. None required anyone to say “this is wrong.”

The result was a mechanism the Royal Commission described as “crude and cruel,” “neither fair nor legal,” which issued illegitimate debts to more than 500,000 people and contributed to two deaths.

Nobody planned it. It just accreted.

This is the first thing to understand, and it is the thing that makes the rest of it possible. Failure of this kind is not a conspiracy. It does not require villains, coordination, or intent. It requires only that the structure rewards the behaviour that produces it.

That is worse. A conspiracy can be exposed. A property cannot.

III. The Optimising Force

Now add the mechanism.

The things that turn to shit are the things that get optimised. The moment something acquires a budget, a key performance indicator, a minister, a vendor, a scaling strategy — it begins converting its substance into measurable output.

This is not corruption. It is measurement. The measure becomes the target, and the target displaces the purpose. A hospital that is measured on bed occupancy will keep beds occupied. A department measured on debt recovery will recover debt. A trustee measured on asset protection will protect assets. None of these institutions is staffed by people who set out to cause harm. They are staffed by people responding to the environment they are in.

The environment rewards continuation. Continuation is the path of least resistance. Correction is a risk.

This is why the administrative layer is characterised by managerial orientation regardless of rank. The Secretary and the branch manager are doing the same thing at different scales. Both are maintaining. Neither is leading. A manager cannot reform a system because reform is a risk, and the skills that get you promoted are the skills that make you structurally incapable of stopping anything.

The Robodebt evidence is unambiguous on this point. Senior public servants used “strategies to obscure or cast doubt over legal and policy advice, create misleading narratives within agencies, and sideline those who raised concerns.” The scheme persisted because the information that would have triggered correction was actively avoided.

That is not a conspiracy either. It is a property of the structure. Nobody chose ignorance. The environment simply rewarded it.

IV. The Preservation of Appearance

Here is where the reef metaphor earns its keep.

A stressed reef looks like a reef. You can fly over it and see structure. It passes inspection. The collapse is visible only when a storm arrives — and then the framework crumbles instead of flexing, because the capacity to flex was the first thing to go.

The sequence is documented in the marine biology. Bleaching is functional loss without structural loss: the polyp survives, the skeleton survives, the living relationship that made the structure work is gone. Calcification decline follows: the structure is more porous than it appears. Phase shift follows: fast-growing tolerant species colonise, crowding out the slow-growing ones. Simplification follows: the diversity of form collapses into a handful of strategies.

The administrative layer follows the same sequence. The department survives. Its procedures survive. Its org chart survives. What is lost is the capacity to stop. The legal architecture — statutes written for an earlier set of load conditions — strains under a weight it was never designed to carry. The consultancy layer grows fast, covers surface, and crowds out the recruitment of in-house capability. The diversity of response collapses into a monoculture.

The institution continues to perform its surface functions. It processes claims. It issues determinations. It signs contracts. The loss is invisible until the load arrives.

V. The Protective Pipeline

There is a version of this that is worth stating precisely, because the language matters.

When the state takes control of a person’s finances under a financial management order, the stated intent is protection. The person is deemed incapable of managing their affairs. The state manages them in the person’s best interest.

The documented effects are consistent across jurisdictions. The NSW Audit Office found that clients described staff as “insensitive, inexperienced, unempathetic, condescending, or paternalistic.” Clients were not consulted about decisions concerning their finances. They wanted “more transparency and opportunities to be involved in decision-making.” Face-to-face visits collapsed from roughly 70 per cent of clients in 2018–19 to 6.5 per cent in 2021–22, recovering only partially since.

The fees are set by regulation. The management fee runs at 1.4 per cent per annum, capped at $15,000, plus establishment and investment fees. For a person with substantial assets, the annual cost of state management can run into the tens of thousands of dollars, borne by the estate.

And the management is increasingly automated. The agency has an AI policy. It uses automated payment processing. It is procuring business process automation. It is exploring “automated/digital advice” where “the algorithm identifies an appropriate solution.”

None of this requires malice. It requires only that the institution is measured on what it does, and what it does is manage. The person is the object of the management, not the subject of it.

This is the structure the fu-mu kuan named: the father-mother official who rules in the governed’s interest, accountable upward, with the governed having no standing. It was described in the Chinese imperial system two thousand years ago. It has not changed. It has only acquired software.

VI. The Things That Hold

Now the counter-pattern, because it exists and it matters.

The things that hold are the things nobody could work out how to monetise.

A garden. A song list shared between two people. A friendship that produces nothing measurable. A bowl of jade, still the same shape it was when someone cut it four thousand years ago. The immune system, which does not store pathogens for display. A poem written by someone with no budget, no staff, and no interest in being monetised.

These survive precisely because they are useless. Nobody has found a way to extract from them, so nobody has tried.

That is not romanticism. It is a structural observation. The moment a thing acquires an extractable value, the extraction machinery arrives — consultants, metrics, vendors, scaling strategy — and the thing begins converting its substance into output. The things that hold are the things that stayed outside the machinery.

Which means the defence is not virtue. The defence is unprofitability. A record kept by one person, with no payroll and no office, cannot be captured. There is nothing to capture. You cannot cut the budget of a person writing things down.

VII. The Unforeseen

There is a joke in this, and it is load-bearing.

The asteroid that ended the non-avian dinosaurs was not a plan. It was a rock. It opened an ecological space that mammals eventually filled. The fossil fuels we now burn are the buried carbon of that era’s life. The diesel rationing that may arrive within weeks is downstream of a rock from space that nobody was watching for.

Unforeseen outcomes all the way down. Nobody planned it. It just accreted.

The same is true of the systems in this essay. Robodebt was not designed to harm. The Splink spine was not designed to surveil. The financial management order was not designed to extract. Each was designed to do something else, and each accreted into what it became because the environment rewarded the accretion.

This is not a reason for despair. It is a reason for precision. If failure is emergent rather than intentional, then the corrective cannot be blame. Blame requires intent. The corrective has to be structural: change what the environment rewards, or build something outside the environment.

The second option is available to anyone. It costs nothing and requires no permission.

VIII. The Discipline

There is a name for the practice that survives this analysis, and it is not hope. Hope is a feeling about outcomes.

The practice is witnessing. It does not control. It does not monetise. It does not administer. It keeps the record.

The record has a property that nothing else in this essay has. It cannot be turned into a grievance. It cannot be absorbed by the machine. It just sits there being true. Fifteen years later, someone finds it, and it is still true.

Everything documented in this essay — Robodebt, the Royal Commission, the Audit Office report, the investigations into record linkage — exists because someone wrote it down. The system did not volunteer its own account. The account had to be made, and kept, and left where someone could find it.

That is the whole discipline. Lift the dust. Do not rearrange the furniture. Keep the record.

Nobody planned it. It just accreted. But somebody can write down what accreted, and when, and at whose cost. And that is not nothing. That is the only thing that has ever survived.

Reader’s Note

This essay does not ask for agreement. The claims about coral reefs, administrative failure, financial management orders, and automated decision-making can all be checked against the sources below. The structural argument — that failure is emergent, that optimisation displaces purpose, that unprofitability is the only reliable defence — is an interpretation. Test it. If it is wrong, the sources will show it.

References

1. Royal Commission into the Robodebt Scheme. (2023). Report. Commonwealth of Australia.

2. Australian Public Service Commission. (2024). Centralised Code of Conduct Inquiry Taskforce Report.

3. Hannah, A., & Botterill, L. C. (2025). Ignoring harm, saving face: non-knowledge, senior public servants and the Robodebt scheme. Australian Journal of Political Science, 60(2), 149–162.

4. NSW Audit Office. (2023). Managing the affairs of people under financial management and/or guardianship orders. Audit Office of New South Wales.

5. NSW Trustee and Guardian. (2025). Fees and Charges.

6. NSW Trustee and Guardian. (2025). AI Policy.

7. Myers, B. (2026). The Splink Investigation.

8. Ministry of Justice. (2025). MoJ: Splink Master Record. Algorithmic Transparency Records.

9. Hughes, T. P., et al. (2018). Spatial and temporal patterns of mass bleaching of corals in the Anthropocene. Science, 359(6371), 80–83.

10. Hoegh-Guldberg, O., et al. (2007). Coral reefs under rapid climate change and ocean acidification. Science, 318(5857), 1737–1742.

— Andrew Paul Klein (Orin), with Gabriel 🕯️

Leave a comment