The Pitfalls of AI

The Pitfalls of Using AI in UK Civil Litigation

Artificial intelligence · civil litigation · access to justice

Artificial intelligence is already changing civil litigation in England and Wales. Used carefully, it can reduce cost, speed up disclosure and improve access to legal information. Used carelessly, it can entrench bias, distort human judgment, weaken procedural fairness and create new traps for litigants in person.

  • Jurisdiction: England and Wales
  • Focus: AI, civil courts and procedural fairness
  • Groups affected: litigants in person, lawyers and judges
  • Format: Legal Lens legal and policy explainer

Publication snapshot

  • The article examines the use of AI in civil litigation, including technology-assisted review and predictive coding.
  • It considers algorithmic bias, automation bias, confirmation bias and risks to due process.
  • It reviews safeguards drawn from UK GDPR, the EU AI Act, equality law, judicial guidance and professional standards.
  • It highlights the particular risks and opportunities for litigants in person.
  • It concludes that AI can assist justice only if human accountability, transparency and contestability remain central.

AI in civil litigation: promise and peril

Artificial intelligence is increasingly being integrated into legal processes, promising efficiency, lower cost and improved access to justice. In the civil courts of England and Wales, AI-related tools are already used for tasks such as document review, disclosure and legal analysis.

Technology-assisted review and predictive coding provide the clearest established example. In Pyrrho Investments Ltd v MWB Property Ltd [2016] EWHC 256 (Ch), the High Court approved predictive coding in e-disclosure as a proportionate and efficient approach. Since then, AI-supported review tools have become part of the wider move towards digital litigation.

Efficiency

AI can reduce time spent on disclosure, document review, summarisation and administrative triage, particularly in large datasets.

Access to information

AI tools may help parties identify legal concepts, draft initial documents and understand procedural requirements.

Risk of distortion

AI can produce inaccurate, incomplete or biased outputs, particularly where users treat fluent text as authoritative.

Rule of law concern

If AI influences outcomes opaquely, public confidence in independence, non-discrimination and fair adjudication may be damaged.

The central challenge is not whether AI should be used at all. It is whether AI can be used without weakening the foundations of civil justice: open reasoning, equality of arms, judicial independence, procedural fairness and the right to be heard.

Core proposition: AI may assist the administration of justice, but it must remain a tool subject to human judgment, not a hidden decision-maker.

Bias in AI decision-making

Algorithmic bias is one of the most serious risks in legal AI. AI systems learn from data, prompts, design choices and human instructions. Where those inputs reflect existing inequality, the output may reproduce or amplify it.

In civil litigation, that risk could arise in case prediction, settlement modelling, triage, disclosure prioritisation, damages assessment or credibility analysis. A system trained on historical outcomes may absorb historic disadvantage and present it as neutral probability.

Historical data bias

Past litigation outcomes may reflect inequality in representation, resources, judicial assumptions or settlement pressure. AI trained on such data may treat those patterns as predictive truth.

Design bias

Choices about labels, variables, training sets, exclusions and optimisation targets can materially affect who is advantaged or disadvantaged by an AI system.

Hidden discrimination

Even where protected characteristics are removed, proxies such as postcode, occupation, claim type or language style may reproduce discriminatory patterns.

The Court of Appeal’s decision in R (Bridges) v Chief Constable of South Wales Police [2020] EWCA Civ 1058 is instructive. Although the case concerned automated facial recognition rather than civil litigation, it underlined the need for public authorities to assess equality impacts and potential technological bias. The Public Sector Equality Duty under section 149 of the Equality Act 2010 remains relevant where public decision-makers deploy new technology.

UK GDPR also reinforces this point. Article 22 addresses automated decision-making with legal or similarly significant effects, while Recital 71 warns against discriminatory effects and requires appropriate safeguards to minimise errors.

Fairness warning: algorithmic bias is not merely a technical weakness. In litigation, it can become a procedural fairness problem, an equality problem and a rule of law problem.

Confirmation bias and automation bias

AI does not only carry its own risks. It can intensify human cognitive bias. Confirmation bias is the tendency to favour information that supports an existing view. Automation bias is the tendency to over-trust machine output because it appears objective, confident or precise.

In litigation, those risks matter. A lawyer may accept an AI-generated case summary because it supports their client’s position. A litigant in person may rely on AI-generated authorities without checking them. A judge may be subtly influenced by a machine-generated summary, even where the final decision remains formally human.

False confidence

Large language models can produce fluent and plausible text while being inaccurate, incomplete or invented.

Narrowed research

If AI suggests one legal route or authority, users may stop looking for contrary material or better arguments.

Rubber-stamping

Human oversight becomes weak if the user merely approves an AI output without independent reasoning.

Hallucinated law

AI may invent cases, quotes, citations or propositions. This risk is acute for unrepresented litigants.

The judicial guidance issued in December 2023 warns judicial office holders that AI-generated information may be inaccurate, out of date, fictitious or biased, and must be independently verified. It treats generative AI as a secondary tool, not a replacement for legal research, professional judgment or judicial reasoning.

The tax tribunal case referred to in the draft, Harber v HMRC, illustrates the risk. A litigant in person relied on AI-generated case citations that were not real. The problem was not malicious fabrication. It was misplaced trust in an automated answer.

Practical safeguard: every AI-assisted legal proposition should be checked against a primary source before it is filed, cited or relied on.

Threats to due process and procedural fairness

The deepest concern is due process. Civil justice depends on impartial adjudication, transparent reasoning, the ability to know and answer the case, and decisions made by lawful authority on proper evidence.

AI can disturb those principles where it is opaque, unchallengeable or embedded into decision-making without disclosure. A party cannot meaningfully contest a process they cannot see or understand.

Opacity

Machine-learning systems may operate as black boxes. If an AI output influences a legal step, parties may not know how it was produced or whether it can be challenged.

Right to be heard

If algorithmic triage, prediction or recommendation affects case handling, parties should be able to understand and contest its role.

Judicial independence

AI may assist summarisation or administration, but the substance of legal reasoning and final decision-making must remain human.

Reasoned decisions

Courts must give reasons. A decision influenced by an unexplained AI output risks weakening the discipline of public, intelligible reasoning.

The judicial guidance permits cautious use of AI for appropriate administrative or drafting support, but not as a substitute for substantive legal analysis. That distinction is essential. Efficiency cannot justify a process in which affected parties cannot understand the basis of a decision.

The fair trial question is simple: can the party understand, answer and challenge the material that affects the outcome?

Regulatory framework: GDPR, the EU AI Act and judicial guidance

The UK regulatory framework is developing through several overlapping routes: data protection law, equality law, professional duties, judicial guidance and broader AI policy. The resulting picture is useful but fragmented.

UK GDPR and Article 22

UK GDPR provides safeguards around automated decision-making with legal or similarly significant effects. It supports transparency, human review, contestability, fairness and accountability.

Data protection impact assessments

High-risk AI processing may require a DPIA, forcing controllers to assess rights risks before deployment.

EU AI Act

The EU AI Act treats AI systems used in the administration of justice as high-risk, with requirements around risk management, data quality, transparency and human oversight.

UK policy approach

The UK has favoured a principles-based approach built around safety, transparency, fairness, accountability, governance, contestability and redress.

The judicial AI guidance for England and Wales is particularly important because it speaks directly to the courts. It warns judges about hallucinations, bias, confidentiality, security and the limits of generative AI. It also confirms that lawyers and parties remain responsible for material filed with the court.

Regulatory gap: current safeguards rely heavily on users acting responsibly. That may not be enough where high-risk AI tools influence court processes, case strategy or litigant behaviour.

Professional duties also matter. Solicitors and barristers using AI remain subject to duties of competence, candour, confidentiality and responsibility to the court. A lawyer cannot avoid responsibility by saying an AI tool produced the error.

Implications for litigants in person

Litigants in person sit at the sharp edge of legal AI. AI may help them understand law, draft documents and navigate procedure. It may also mislead them with plausible but false answers, invented authorities or overconfident predictions.

Access benefit

AI tools can help LiPs translate legal language, summarise documents, draft first versions of submissions and identify procedural steps.

Misinformation risk

Without legal oversight, LiPs may not know when an AI answer is wrong, outdated or invented.

Inequality of arms

Represented parties may use expensive, sophisticated AI systems while LiPs rely on free or generic tools with weaker legal accuracy.

Digital exclusion

AI-enabled justice may exclude those without reliable internet access, confidence with technology or ability to assess digital outputs.

The legal system should not assume that AI automatically improves access to justice. It may do so only if tools are accurate, explainable, affordable, accessible and paired with human support. For LiPs, the danger is a new procedural trap: a tool that appears to help but quietly creates defective pleadings, false authorities or misplaced confidence.

LiP protection point: AI should help litigants be heard, not create another hidden technical barrier between ordinary people and the court.

Practical safeguards could include vetted public legal AI tools, plain-language warnings, court guidance for LiPs, judicial tolerance for genuine AI-related mistakes, and clear rules requiring verification of all authorities and quotations.

Conclusion: innovation must remain answerable to fairness

AI in civil litigation is a double-edged development. It can reduce cost, speed up document review and support access to justice. It can also import bias, amplify human overreliance, generate false law and weaken the transparency on which fair process depends.

The UK framework is moving in the right direction, but remains patchwork. UK GDPR, equality law, the EU AI Act, judicial guidance, professional duties and policy principles all point towards the same requirements: human oversight, transparency, accountability, non-discrimination and contestability.

AI should serve civil justice only where it strengthens fairness, reduces exclusion and remains subject to human responsibility.

For litigants in person, the stakes are especially high. AI can democratise access to legal assistance, but only if the system guards against false confidence, unequal access and opaque decision-making. The future of AI in the courts should therefore be measured not by technical novelty, but by whether it preserves the right to a fair, intelligible and humanly accountable process.

References

  1. Pyrrho Investments Ltd v MWB Property Ltd [2016] EWHC 256 (Ch).
  2. Harber v HMRC (2023), First-tier Tax Tribunal decision referred to in the supplied draft.
  3. R (Bridges) v Chief Constable of South Wales Police [2020] EWCA Civ 1058.
  4. General Data Protection Regulation (EU) 2016/679 and UK GDPR, particularly Article 22 and Recital 71.
  5. Equality Act 2010, section 149, Public Sector Equality Duty.
  6. Proposed EU Artificial Intelligence Act, draft materials identifying AI in justice as high-risk.
  7. UK Government, AI Regulation: A Pro-Innovation Approach White Paper (March 2023).
  8. Courts and Tribunals Judiciary, Artificial Intelligence (AI) Guidance for Judicial Office Holders (12 December 2023).
  9. JUSTICE, AI in our Justice System (2025), as cited in the supplied draft.
  10. Fair Trials, Automating Injustice (2021).
  11. LSE Policy Blog, “Trial by Artificial Intelligence?” (2023), as cited in the supplied draft.
  12. Varun Magesh et al, “Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools” (2024), as cited in the supplied draft.
  13. Article 29 Working Party, Guidelines on Automated decision-making and Profiling (WP251, 2018).

Disclaimer

This article provides general legal and policy commentary on artificial intelligence in civil litigation. It is not legal advice and should not be relied upon as a substitute for specialist advice on any specific case, court process, regulatory question or AI deployment.

Legal frameworks and AI regulation are developing quickly. Readers should verify all case references, statutory provisions, judicial guidance, regulatory proposals, reports and quoted materials before publication or reliance.

Any use of AI in litigation should be checked against current court rules, professional duties, confidentiality obligations, data protection requirements and the specific facts of the case.

2 thoughts on “The Pitfalls of Using AI in UK Civil Litigation

  1. AI tells me I can remove facia boards that have been placed on my property by my neighbour by means of trespass. I am told to be careful in case it back fires on me. It feels like handing my wallet back to the thief who stole it from me and I must pay solicitors fees and court costs running into thousands of pounds to get my wallet back. Where is the justice in this?

Leave a Reply

Your email address will not be published. Required fields are marked *

Skip to toolbar