What AI legal analysis can and cannot do well

A person at a desk reviewing contract documents next to an open laptop
TL;DR

AI legal tools do document plumbing well and legal reasoning badly. For an owner-managed firm, they are useful for summarising contracts, flagging clauses, and searching your archive, but should not substitute for qualified legal advice on material decisions. Three things shape safe use: hallucination risk in legal citations, the DPIA requirement when processing personal data, and the absence of any professional indemnity cover on the AI side.

Key takeaways

- AI legal tools predict text from training data rather than reasoning through statute. Their output is a draft, not a legal opinion. - Good uses for an owner-managed firm: summarising long documents, flagging unusual clauses before a solicitor reviews them, and searching your own contracts for key dates and obligations. - Hallucination is a structural risk in legal AI. Models can generate plausible-sounding citations and clauses that do not exist. The 2023 Mata v Avianca case resulted in court sanctions for exactly this failure. - If you process personal data through AI in an HR or client-facing context, a data protection impact assessment is likely required under UK GDPR, regardless of your firm's size. - An AI tool carries no professional indemnity insurance. If you rely on AI output without a qualified solicitor in the loop, the legal and financial liability sits with your business.

You get a 30-page supplier agreement. Your solicitor wants £500 to review it. You already pay for a ChatGPT subscription. The question feels obvious: paste the thing in, read the summary, sign if nothing looks worrying.

That shortcut is partly justified and partly the kind of logic that ends in a dispute clause you didn’t spot. AI legal tools genuinely help with parts of this process. They also fail in ways that are hard to detect until something goes wrong. Understanding the difference is the job.

AI legal analysis is any use of a large language model on legal documents, from contract summaries to clause-flagging tools. The model predicts text based on training data rather than reasoning through statute as a solicitor would. The SRA classifies common uses as document review, due diligence, and answering routine queries, and is clear that professional responsibility stays with the regulated firm, not the software.

These tools are already embedded in the platforms law firms use. Luminance and Harvey, for instance, are used by major UK practices to scan contract sets for non-standard clauses and risky language. UK firms report time savings of 20 to 60 percent on bulk document review using these systems. That is a genuine productivity gain, but those outputs are reviewed by qualified lawyers before anyone relies on them.

The EU AI Act classifies AI used for legal interpretation as high-risk, meaning extra obligations apply for providers and users. The UK government has not replicated that classification directly into domestic law but expects UK regulators to apply similar risk-based oversight. So the tools are becoming more capable, deployment is becoming more widespread, and the oversight requirements are moving upward, not downward.

Why does it matter for your business?

For an owner-managed service firm, AI legal tools matter because they are already in your supplier’s systems, in your law firm’s workflow, and possibly being used informally by your own team. The risk is not adopting AI in legal work. The risk is adopting it without knowing which outputs need a human check and which are reliable enough to act on without one.

The case for using AI in legal workflows is real. A 2024 Thomson Reuters study found that 82 percent of legal professionals using generative AI saw value in document summarisation and drafting support. For a business owner, that translates to faster first drafts of NDAs and employment letters, quicker clause checks on supplier contracts before your solicitor sees them, and better search across your existing document archive.

The case for caution is equally solid. If your team sends HR dispute information or client health data into a general-purpose US-hosted chatbot without a data processing agreement in place, that is likely to breach UK GDPR. The ICO’s AI guidance requires a lawful basis, transparency, and a data protection impact assessment for high-risk uses. Using AI in legal processes is not automatically high-risk, but several common applications, including HR screening and client scoring, are.

You’ll encounter AI legal tools in three places: the lawtech your solicitor already uses, the general-purpose AI tools your team pays for, and compliance platforms you buy directly. Each carries different oversight standards. Your law firm using Luminance to flag contract clauses is materially different from a team member pasting staff contracts into a free chatbot, even when both feel like the same kind of shortcut.

At the lawtech level, tools designed for legal practice come with qualified lawyers reviewing the outputs. The LawtechUK sandbox reported cost reductions of 10 to 30 percent for certain document-heavy processes. Those savings come from lawyers doing less manual scanning, not from removing the lawyer from the chain.

At the general-purpose AI level, tools like ChatGPT and Claude can draft a first version of an NDA or summarise a supplier contract. They can also suggest legal concepts that do not exist under English law. A tool trained primarily on US content may propose “at-will employment” clauses that have no standing in the UK, or miss obligations under TUPE, because the training data does not map cleanly to your jurisdiction.

Compliance platforms bought directly vary considerably in how much legal expertise is built into their UK-specific rules and how clearly they disclose what the AI component is doing. Before you rely on any such platform, ask specifically how its legal content is updated as legislation changes, and who is accountable for the accuracy of what it tells you.

Use AI output when the task does not require a legal opinion: summarising documents, flagging unusual clauses for your lawyer to look at, or searching your archive for key dates and obligations. Avoid it when the question involves a specific legal decision and the consequences of getting it wrong are material. The dividing line is whether you need a trained, insured professional to stand behind the answer.

The SRA warned in its AI guidance that failures in due diligence or advice could amount to professional misconduct if lawyers rely uncritically on AI output. For a business owner, the equivalent risk is using a chatbot answer as a substitute for advice in a redundancy programme, a share scheme, or a dispute with a client. These are decisions where the cost of a wrong answer is far higher than the cost of a solicitor.

The Mata v Avianca case in 2023 illustrated the specific failure mode. US lawyers submitted a brief containing fabricated case citations generated by ChatGPT and were sanctioned by the court. UK judges and the SRA have cited this case when warning practitioners against relying on generative AI outputs without verification. The pattern, where AI invents a plausible-sounding legal reference that does not exist, is not a bug to be quickly patched. It is a structural property of how these models generate text.

The practical test before acting on any AI legal output: can you verify the specific claim independently? If the answer is no, or if verification would take longer than consulting a solicitor, the shortcut is not saving you time.

What three things should you understand before starting?

Three concepts determine how safely your business can use AI in legal workflows. Hallucination is the tendency of AI to generate plausible-sounding references, cases, or clauses that do not exist. A DPIA is a data protection impact assessment, legally required under UK GDPR before deploying high-risk AI on personal data. And unlike your solicitor, the AI tool carries no professional indemnity insurance.

On hallucination: the problem is not that AI makes obvious errors. AI makes errors that look correct. A fabricated statute, a misdated case, a clause that mimics real legal language but does not match your jurisdiction, these are difficult to spot without legal training. For document summarisation and clause flagging, where you’re asking AI to describe what’s there rather than invent new analysis, the risk is manageable. For legal advice questions, the risk is high and the errors are often invisible until you act on them.

On DPIAs: the ICO and Equality and Human Rights Commission have warned jointly that AI-assisted scoring can produce discriminatory outcomes when training data reflects historic bias, potentially breaching the Equality Act 2010. If you’re using AI in any process that makes or informs decisions about individuals, including candidates, employees, or clients, a DPIA is almost certainly required before you deploy.

On professional indemnity: SRA-regulated firms must carry professional indemnity insurance that covers their advice, including where AI tools are used in the process. If you rely on a chatbot’s legal output without involving a regulated firm, there is no equivalent safety net. Liability sits with your company and potentially with you personally as a director. Book a conversation if you want to work through where AI sits safely in your specific workflows.

Sources

- UK Government (2024). AI Regulation: A Pro-innovation Approach. Sets out the risk-based approach to AI oversight and the expectation that UK regulators apply appropriate frameworks to high-risk AI uses. https://assets.publishing.service.gov.uk/media/661e81c17d07560011a92a25/AI_Regulation_Report_acc.pdf - Solicitors Regulation Authority (2023). AI and the Legal Market. SRA classification of common AI uses as document review, due diligence, e-discovery and legal research, and the principle that professional responsibility stays with the regulated firm. https://www.sra.org.uk/sra/research-publications/artificial-intelligence-legal-market/ - Solicitors Regulation Authority (2024). Risk Outlook: Use of Technology. SRA warning that AI outputs can be inaccurate or misleading and that uncritical reliance may constitute professional misconduct. https://www.sra.org.uk/sra/risk/outlook/use-of-technology/ - European Union (2024). EU AI Act (Regulation 2024/1689). Classifies AI used for legal interpretation and access to justice as high-risk, with requirements for risk management, data governance, transparency and human oversight. https://eur-lex.europa.eu/eli/reg/2024/1689/oj - Information Commissioner's Office (2024). AI and Data Protection. ICO guidance on lawful basis, purpose limitation, and DPIA requirements for high-risk AI processing of personal data in UK organisations. https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-resources/artificial-intelligence/ - Judiciary of England and Wales (2023). Guidance for Judiciary on Artificial Intelligence. Warns courts staff that AI tools may be used for administrative tasks but not as a source of legal reasoning or citation without verification. https://www.judiciary.uk/guidance-and-resources/guidance-for-juridiciary-on-artificial-intelligence/ - ACAS (2023). AI in the Workplace. Guidance confirming that employers remain legally liable for discriminatory outcomes created by AI, including automated screening and performance management decisions. https://www.acas.org.uk/acas-publishes-guidance-on-artificial-intelligence-in-the-workplace - Thomson Reuters Institute (2024). Future of Professionals: Generative AI in the Legal Profession. Reports 82% of legal professionals using generative AI saw value in document summarisation and drafting support. https://www.thomsonreuters.com/en-us/posts/legal/australian-gc-thomson-reuters-institute-report-genai-legal-profession/ - US Federal Court / Reuters (2023). Mata v Avianca: Sanctions Order. Primary court document recording sanctions against lawyers who submitted AI-fabricated case citations, widely cited by UK practitioners and the SRA as a cautionary precedent. https://static.reuters.com/resources/media/editorial/20230606/chatgpt-sanctions-order.pdf

Frequently asked questions

Can I use ChatGPT to review a supplier contract before my solicitor sees it?

Yes, with caveats. AI can flag unusual clauses and give you a useful list of questions to take to your solicitor, making that professional review more efficient. What it cannot do is interpret the contract under UK law, spot jurisdiction-specific risks, or give you a defensible opinion you can rely on. Use it as a preparation tool, not a substitute for qualified legal review.

Do I need a DPIA if I use AI to help with HR documents?

Possibly. The ICO requires a data protection impact assessment before high-risk AI processing of personal data, and HR decisions are explicitly named as high-risk in ICO guidance. If you're using AI to summarise performance reviews, process disciplinary records, or screen candidates, a DPIA is likely required. Sending personal data into an AI system without one could breach UK GDPR, regardless of how small your firm is.

What happens if AI fabricates a legal reference and I act on it?

The risk lands with your business. Unlike your solicitor, an AI tool carries no professional indemnity insurance. The 2023 Mata v Avianca case, where US lawyers were sanctioned for submitting AI-fabricated citations to a court, illustrates how badly fabricated legal references can end. For your firm, the check before acting on any AI legal output is whether you can independently verify the specific claim.

This post is general information and education only, not legal, regulatory, financial, or other professional advice. Regulations evolve, fee benchmarks shift, and every situation is different, so please take qualified professional advice before acting on anything you read here. See the Terms of Use for the full position.

Ready to talk it through?

Book a free 30 minute conversation. No pitch, no pressure, just a useful chat about where AI fits in your business.

Book a conversation

Related reading

If any of this sounds familiar, let's talk.

The next step is a conversation. No pitch, no pressure. Just an honest discussion about where you are and whether I can help.

Book a conversation