Due diligence checks for an AI supplier or startup

A business owner reviewing vendor documents at a desk with a laptop open beside them
TL;DR

Buying an AI tool that handles your business or client data is a higher-risk procurement than standard software. Under UK GDPR you remain the controller, which means you stay responsible for what the vendor does with your data. A five-proof evidence pack, a short test against your own data, and clear contract terms on incident notification and exit rights are the practical foundation for any owner-managed firm.

Key takeaways

- Under UK GDPR, when an AI vendor processes your data you remain the controller and stay legally responsible for ensuring the vendor meets the required standards; this obligation does not transfer to the vendor. - Ask for five concrete proofs before shortlisting any AI vendor: a security certificate (Cyber Essentials or ISO 27001), a recent penetration test summary, a data-handling document covering sub-processors, service continuity evidence, and an explanation of their internal AI governance approach. - A 10-day test-based evaluation using your own anonymised data and a pre-defined scoring matrix produces more reliable information about vendor performance than any polished demo. - Prompt injection is a specific risk for AI systems built on large language models; ask vendors how they prevent data leakage, how they log access, and what safeguards stop staff from accidentally exposing sensitive information. - The NIST AI Risk Management Framework (2023, updated 2024 for generative AI) and ISO/IEC 42001:2023 give you a structured, recognised vocabulary to stress-test any vendor's AI governance claims without needing a legal or technical background.

A vendor sends over their calendar link after a 30-minute demo. The AI clearly works. Pricing slides arrive the same afternoon. Six weeks later, the contract is signed.

For many owner-managers, that sequence will feel familiar. The UK Government’s 2024 Cyber Security Breaches Survey found that only 18 per cent of medium-sized businesses had reviewed risks from their immediate suppliers in the previous 12 months. The demo-to-contract window is where that gap opens.

The supplier assurance work in that gap takes a week to ten days and costs nothing except time.

What does due diligence on an AI supplier actually involve?

Due diligence on an AI supplier is a structured process of verifying three things before you commit: that the vendor has the security controls to protect your data, that their system will behave reliably and traceably, and that you have written obligations in place if either fails. It covers cyber security, data handling, continuity planning, and how the AI itself is governed internally.

Think of it as the same category of supplier assurance your bank or insurer would run on a new third party. What AI makes different is the chain of components involved: the model provider behind the product, the vector databases it might use, any plug-ins or retrieval pipelines in its stack. NCSC supply-chain guidance explicitly recommends understanding which third-party services a supplier chains together, where data is processed, and how incidents would be reported throughout the contract lifecycle.

The UK Government’s AI Playbook for public-sector buyers structures AI procurement around four areas: early risk assessment, clear allocation of responsibilities, alignment with data-protection law, and cyber-security standards from the outset. Owner-managed firms can follow the same logic at lighter weight, without a procurement committee.

The starting point is a due diligence pack you send to any supplier you shortlist: standardised questions, a test dataset, and a scoring matrix. That pack, not the demo, is where the real selection happens.

Why does it matter more than standard software procurement?

When you buy a standard SaaS tool, you are mostly trusting the vendor to keep the application running. With an AI tool that processes your business or client data, you also remain the UK GDPR controller for everything it does. Your obligations do not transfer to the vendor. If the vendor mishandles the data, the ICO’s enforcement action starts with you.

The ICO has been explicit: using AI does not remove a controller’s obligations. For high-risk processing, a Data Protection Impact Assessment is required. For any processing involving a vendor, you need a Data Processing Agreement that covers what the vendor can do with the data, which sub-processors they use, and your right to audit.

The financial stakes are concrete. IBM Security’s 2023 data breach cost report estimated that third-party supplier breaches cost on average 12.7% more than direct breaches. The same 2024 UK government survey that found only 18 per cent of businesses review supplier risks also reported that 50 per cent of medium-sized businesses experienced a cyber breach or attack in the preceding year.

AI also introduces risks that standard software procurement doesn’t surface. The NCSC has flagged prompt injection as a threat for systems built on large language models: an attacker, or a careless staff member, can cause a model to reveal data it should not. Samsung engineers accidentally exposed sensitive source code by pasting it into a public AI tool in 2023. Your checks need to anticipate both the deliberate and the accidental.

What does a minimum evidence pack look like?

A practical approach for SME buyers is to ask for five concrete proofs before any vendor gets onto a shortlist: a security certificate or attestation (Cyber Essentials or ISO 27001), a penetration test summary from the past 12 months, a data-handling document covering retention, deletion and sub-processors, service continuity evidence including incident-response procedures, and an explanation of how AI risks are managed internally.

A vendor that cannot assemble these five proofs promptly is signalling something about their maturity. Cyber Essentials is a UK government-backed baseline, mandated for many central government suppliers; a capable vendor should be able to evidence it within days. ISO 27001 is the broader information security management standard. Absence of either is not automatically a disqualifier, but absence of a coherent explanation for why not is.

Beyond the evidence pack, a short test-based evaluation works well. Spend the first two days defining one or two real business tasks and preparing a small, legally shareable dataset with known correct answers. Send the pack to three to five vendors. Give shortlisted vendors 48 hours of controlled sandbox access with usage caps and dummy data. Score responses against a pre-defined matrix before you see any more demos. By the end of ten days you have a scored shortlist and a pilot plan.

The discipline is to score against your criteria before any further demos, because demos are designed to impress and your criteria are designed to protect you.

When should you run the full checks, and when can you simplify?

The full checklist is proportionate to risk. If your use case involves personal data, client records, commercially sensitive information, or any output that carries legal or financial weight, apply it in full. If the use case is genuinely low-risk, say generating ideas from publicly available information with no client data involved, a standard SaaS review and basic security check may be enough.

Two other situations allow a lighter approach. If your firm has strong internal data and security capability, you may choose to self-host an open-source model rather than rely on an external vendor, shifting the due diligence focus to your own infrastructure and internal governance. And in niche verticals where only one or two credible AI vendors exist, you may have less bargaining power to demand every proof; additional internal controls or specialist insurance can compensate.

One rule applies regardless of the use case: put your data-handling expectations in writing before you sign. NCSC guidance is clear that embedding security requirements and incident-reporting obligations from the outset of a contract is significantly cheaper than retrofitting them after something goes wrong. That discipline costs nothing extra and scales whether you use the full five-proof pack or a lighter version.

What frameworks sit behind the questions?

Two international frameworks give you a principled basis for vendor conversations without needing a legal or technical background. The NIST AI Risk Management Framework, published in 2023 and updated with a generative AI profile in 2024, covers four functions: govern, map, measure and manage. ISO/IEC 42001:2023 is the AI-specific management system standard, analogous to ISO 27001 for information security.

You do not need to be certified against either, and neither does your vendor. Asking how a vendor’s policies map to NIST AI RMF is a useful stress-test: a vendor who has thought seriously about AI-specific risks will have a coherent answer. One who has not will fill the silence with marketing language.

The EU AI Act is also worth raising, even for UK buyers. Formally adopted in 2024, it applies to providers and deployers of AI systems placed on the EU market or affecting individuals in the EU, regardless of where the provider is based. Penalties reach up to €35 million for the most serious breaches. If your vendor serves EU customers or is EU-registered, ask whether they have classified their systems under the Act and what their compliance timeline looks like.


The due diligence process described here takes a week to ten days and costs nothing except time to prepare. The £98,000 ICO fine issued to a UK law firm after a ransomware attack in 2023 offers a sense of the alternative; that firm had not embedded basic security requirements into its supplier relationships. Treat the checks as the cheapest insurance available to any SME buyer, and run them before the contract arrives, not after.

Sources

- NCSC (2023). Supply chain security. Guidance on understanding third-party risk in AI supply chains, including sub-processor transparency and incident-reporting obligations throughout the contract lifecycle. https://www.ncsc.gov.uk/collection/supply-chain-security - NCSC (2023). Cyber Essentials scheme overview. UK government-backed baseline for cyber security controls, mandated for many central government suppliers handling certain types of data. https://www.ncsc.gov.uk/cyberessentials/overview - NCSC (2023). What is prompt injection and what can you do about it? Explains prompt injection risks in LLM-based systems and the risk of data exfiltration through inadequate input filtering. https://www.ncsc.gov.uk/blog-post/what-is-prompt-injection-and-what-can-you-do-about-it - NIST (2023). AI Risk Management Framework (AI RMF 1.0). Structured govern, map, measure and manage framework for assessing AI-specific risks in vendor procurement conversations. https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.100-1.pdf - NIST (2024). Profile for managing risks of generative AI. 2024 update to AI RMF with controls specific to generative AI systems, cited in vendor due diligence questions. https://www.nist.gov/news-events/news/2024/03/nist-publishes-profile-managing-risks-generative-ai - ISO (2023). ISO/IEC 42001:2023 AI Management System standard. International standard for AI-specific management systems, analogue to ISO 27001 for AI vendor governance assessments. https://www.iso.org/standard/82285.html - ICO (2024). UK GDPR guidance: controllers and processors. Sets out the obligations of data controllers when engaging AI vendors as processors, including audit rights and sub-processor controls. https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-resources/accountability-and-governance/controllers-and-processors/ - ICO (2023). ICO fines law firm £98,000 over ransomware attack. Demonstrates ICO enforcement where a professional services firm failed to embed basic security requirements in supplier relationships. https://ico.org.uk/about-the-ico/media-centre/news-and-blogs/2023/10/ico-fines-law-firm-98000-over-ransomware-attack/ - UK Government (2024). Cyber Security Breaches Survey 2024. Found that 50% of medium-sized businesses experienced a cyber breach in the preceding 12 months; only 18% had reviewed risks from immediate suppliers. https://www.gov.uk/government/statistics/cyber-security-breaches-survey-2024 - IBM Security (2023). Cost of a Data Breach Report 2023. Estimated third-party supplier breaches cost on average 12.7% more than direct breaches; global average breach cost USD $4.45 million. https://www.ibm.com/reports/data-breach

Frequently asked questions

What is the most critical thing to check when evaluating an AI vendor?

The critical check is whether the vendor can sign a Data Processing Agreement aligned with UK GDPR, including which sub-processors they use and your right to audit. Beyond that, ask for a Cyber Essentials or ISO 27001 certificate, a recent penetration test summary, and clear incident response procedures with defined notification timelines. Vendors who cannot assemble these documents promptly are telling you something about the maturity of their practices.

Do I need a lawyer or IT specialist to do AI vendor due diligence?

For the most part, an owner-manager can lead this process with internal resource or a generalist consultant. The question pack, scoring matrix, and test-data preparation are practical rather than deeply technical tasks. Legal advice on the Data Processing Agreement is worth having if the contract value is significant or the data is particularly sensitive, but it doesn't need to come first and shouldn't delay the initial checks.

Does the EU AI Act affect UK businesses buying AI?

It can, depending on your customers and the vendors you use. The EU AI Act, formally adopted in 2024, applies to providers and deployers of AI systems placed on the EU market or affecting individuals in the EU, regardless of where the provider is based. UK buyers are not directly regulated by it, but if your vendor serves EU customers or is EU-registered, ask whether they have classified their systems under the Act.

This post is general information and education only, not legal, regulatory, financial, or other professional advice. Regulations evolve, fee benchmarks shift, and every situation is different, so please take qualified professional advice before acting on anything you read here. See the Terms of Use for the full position.

Ready to talk it through?

Book a free 30 minute conversation. No pitch, no pressure, just a useful chat about where AI fits in your business.

Book a conversation

Related reading

If any of this sounds familiar, let's talk.

The next step is a conversation. No pitch, no pressure. Just an honest discussion about where you are and whether I can help.

Book a conversation