FOUNDATION INVESTIGATION | WORK & DECISIONS
AI can rank, score and filter people without ever making the final decision itself. When the outcome harms you, responsibility should not disappear between the model, the manager and the company.
By Andrew McDonald · Immortal AI
You apply for a job.
You never speak to a person.
A system scores your application, compares your history with other candidates and decides you are not worth moving forward.
Or your shifts fall. Your credit application is declined. A government payment is questioned. A risk score appears beside your name.
You ask why.
The company says the software only assisted the decision.
The software provider says it does not control how customers use the system.
The manager says they relied on the information they were given.
The machine says nothing.
AI rejected you. Who is to blame?
The final click does not tell us who made the decision
Organisations often reassure people that AI does not make important decisions because a person remains “in the loop”.
That can be meaningful.
It can also be cosmetic.
A manager who independently reviews evidence, understands a system’s weaknesses and has real authority to reject its recommendation is exercising judgement.
A manager who receives a score, sees little of the underlying logic and is expected to approve the recommended outcome may be little more than the final step in an automated process.
That distinction is already central to our reporting on Workers Say AI Marked Them for Layoff. Meta Says People Decided. The unresolved question in that case is not merely whether a person technically approved a layoff. It is what information shaped that judgement and whether the decision could genuinely be challenged.
Algorithmic management is already normal
This is not a problem waiting for some distant AI workplace.
The OECD defines algorithmic management as software that fully or partly automates tasks traditionally performed by managers, including instructing, monitoring and evaluating workers.
Its survey of more than 6,000 firms across six countries found these tools were already common. A later OECD policy brief reported that 90 per cent of surveyed US firms and an average of 79 per cent of surveyed European firms used at least one algorithmic-management tool. OECD: How widespread is algorithmic management in workplaces?.
Managers saw benefits, including improved decision quality.
They also identified a problem that goes directly to accountability: the most commonly reported concern was uncertainty about who was responsible when an algorithmic decision went wrong. OECD employer survey on algorithmic management.
The technology is becoming ordinary before responsibility has become clear.
A score can be a decision even when somebody else acts on it
European law provides one useful example of why labels such as “recommendation” or “score” may not settle the issue.
Article 22 of the GDPR gives people protections against certain decisions based solely on automated processing that produce legal or similarly significant effects. Where specified exceptions apply, safeguards include the ability to obtain human intervention, express a point of view and contest the decision. GDPR Article 22.
In the SCHUFA case, the Court of Justice of the European Union considered a credit-scoring company that generated a probability value which lenders then used.
The court held that creating that score can itself amount to automated individual decision-making where the third party relies strongly on it when deciding whether to enter, continue or end a contract. CJEU, SCHUFA, C-634/21.
That principle matters well beyond credit scoring.
An automated output does not become harmless simply because somebody else performs the last action.
The person affected usually knows the least
There is a severe information imbalance in automated decision-making.
The company knows which system was used.
The vendor knows how the product was designed.
The organisation may know what data were entered, what score was produced and how heavily it was weighted.
The person affected may receive only the outcome.
That makes an appeal difficult before it even begins.
How do you challenge incorrect data you cannot see? How do you identify discrimination when the relevant variables are hidden? How do you argue that a manager relied too heavily on a recommendation when you do not know the recommendation existed?
As the OECD noted again in July 2026, policy measures specifically addressing AI in labour markets remain less developed in areas such as privacy, transparency and accountability than in skills and adoption. OECD: Recent policy developments on AI in the labour market.
Australia has already seen what inaccessible automation can do
The Robodebt Royal Commission was not an investigation into generative AI.
It remains one of Australia’s clearest warnings about automated government decisions and weak avenues for challenge.
The Royal Commission recommended that where automated decision-making is used in government services, people should have a clear path to review, websites should explain the process in plain language, and business rules and algorithms should be available for independent expert scrutiny. It also recommended an independent monitoring or audit function for automated decision-making. Robodebt Royal Commission, Chapter 17.
Those recommendations capture a basic principle.
An appeal right is not meaningful if the person cannot find the decision-maker, understand the process or discover what needs to be challenged.
Blame can become fragmented by design
AI systems are often supplied through chains of responsibility.
A vendor builds the model.
A software company packages it into a product.
An employer chooses the settings.
A manager receives the output.
A worker experiences the consequence.
Each participant can truthfully say they controlled only part of the process.
That does not mean nobody is responsible.
It means responsibility needs to follow control.
The developer should be accountable for the system it designs and the claims it makes about performance. The organisation deploying it should be accountable for deciding whether the system is appropriate, what data it uses, how outputs influence decisions and whether people can challenge them. Managers should be responsible where they exercise genuine judgement.
The person affected should not be expected to solve the organisational chart before they can appeal.
A real appeal needs more than another review by the same system
A meaningful appeal should provide several things.
The person should know that automation materially influenced the decision.
They should be able to identify and correct relevant data.
They should receive an explanation sufficient to understand the main reasons for the outcome.
And the reviewer should have the authority, information and competence to change the result.
Sending the same information through the same scoring process again is not independent review.
Nor is a person automatically an effective safeguard merely because their name appears at the end of the workflow.
This is why the broader power question matters. In AI’s Promise Is Real. So Is the Power Shift., we argued that organisations can deploy technology far faster than workers and communities can negotiate the consequences. Automated decisions make that imbalance intensely personal.
Someone must own the outcome
AI can improve consistency, identify patterns people miss and help organisations make faster decisions.
Those benefits are real.
But efficiency cannot become a method for making responsibility harder to find.
The more an organisation relies on automated ranking, scoring or recommendation, the clearer its obligations should become.
Who approved the system?
Who monitors it?
Who can explain an outcome?
Who can override it?
Who is responsible when it harms somebody?
Our Immortal AI Foundations start with the consequence for people and follow the evidence toward those with the power to shape it. Automated decision-making should be judged by the same standard.
If an algorithm has ever rejected, ranked or investigated you, ask who was responsible for the decision and whether a real appeal was available.
Because when a company, provider, employee and machine can all point somewhere else, the person carrying the consequence is left with the only answer that matters:
someone still made a choice to use the system.
Principal sources
- OECD: Algorithmic management in the workplace
- OECD: How widespread is algorithmic management in workplaces?
- OECD: Recent policy developments on AI in the labour market
- EU General Data Protection Regulation, Article 22
- Court of Justice of the European Union: SCHUFA, C-634/21
- Royal Commission into the Robodebt Scheme, Chapter 17
Editorial note: Legal rights differ by jurisdiction and context. This article is analysis, not legal advice.
AI disclosure: Immortal AI uses AI-assisted research and drafting. Sources, claims, framing and final editorial decisions remain the responsibility of Immortal AI.
