What is a neural network? Plain English for owners

A woman at her desk reviewing a printed vendor shortlist with a laptop open beside her.
TL;DR

A neural network is a layered mathematical structure that learns patterns from data by adjusting numerical weights between interconnected nodes. It is not a brain. It is a sophisticated pattern-matching engine that learns statistical associations from historical examples. By 2026 it is embedded in CRM, email filtering, OCR, fraud detection, voice transcription, and every LLM. For UK SMEs the right posture is buy-not-build, with sharp procurement questions about training data, fine-tuning, explainability, and fairness.

Key takeaways

- A neural network is a layered mathematical structure with interconnected nodes that learn weights from historical data, not a digital brain. - Almost every "AI-powered" feature in mainstream business software in 2026 is a neural network somewhere underneath, usually pre-trained at scale by a vendor. - The buy-not-build economics are decisive for SMEs. Pre-trained vendor models cost a fraction of training from scratch and absorb the data and compute burden. - Neural networks inherit and can amplify bias from training data, which matters under UK GDPR, the Data (Use and Access) Act 2025, and ICO guidance on automated decision-making. - The right vendor questions are about training data, fine-tuning, explainability tooling, fairness audit, and ongoing maintenance, not whether the system uses neural networks.

The MD of a thirty-staff UK recruitment consultancy is sitting in front of a vendor demo for a new CV screening tool. The deck calls it “powered by deep neural networks”, which sounds reassuring until she realises she has no idea what that actually means. She has read enough about ICO guidance on automated decision-making to know that bias in CV screening is a regulatory issue under UK GDPR and the Data (Use and Access) Act 2025. She has no intention of training a neural network herself. She just needs the mental model to evaluate the vendor honestly, document her own AI governance, and avoid signing for something that ends up on a tribunal desk in eighteen months.

That is the right place to be, and this post is for owners in that seat.

What is a neural network?

A neural network is a layered mathematical structure of interconnected nodes that learns to recognise patterns in data by adjusting numerical weights during training. Each node takes multiple numerical inputs, applies learned weightings, combines them, and passes the result through an activation function that decides whether the node fires a signal to the next layer. Power comes from the layered arrangement, not the individual node.

Drop the brain metaphor. It does more harm than good. The “neural” in neural network is historical inspiration, the actual mechanism is statistical pattern-matching, not biological cognition. A trained network has learned to associate specific numerical patterns in its inputs with specific outputs, based on the historical examples it was trained on. It does not understand anything. It does not reason. It will fail when shown patterns substantially different from its training data, because there is no first-principles thinking underneath to fall back on.

There are three layer types. The input layer receives raw data, transaction features, pixel values, words turned into numbers. The hidden layers do the work, combining inputs, applying weights and biases, and passing results through activation functions. The output layer produces the prediction. Training does not change the structure, it changes the weights inside the nodes. A trained network with a million weights is a million learned numerical parameters encoding statistical associations.

Why does it matter for your business?

It matters because by 2026 almost every “AI-powered” feature in mainstream business software is a neural network somewhere underneath. The decision is no longer whether your business will use them, it is which vendor’s neural networks you consume and on what terms. That reframes the question from a technical one to a procurement and governance one, which is squarely in the owner’s job description.

The everyday list is concrete. CRM lead scoring in Salesforce Einstein and HubSpot Breeze AI uses neural networks. Email spam filtering in Microsoft and Google uses neural networks. Voice transcription in Whisper, Deepgram, and AssemblyAI runs on deep neural networks trained on hundreds of thousands of hours of speech. Accounting software invoice matching in Xero and FreshBooks. Bank fraud detection. CV screening. Document OCR. Every modern chatbot or AI agent.

The other reason it matters is regulatory. The ICO’s January 2026 agentic AI guidance, summarised in Skadden Arps’ UK regulator briefing, makes clear that automated decision-making systems based on neural networks fall squarely within UK data protection law. Keystone Law’s analysis of the ICO posture on AI recruitment is direct, employers using neural-network-based screening must be able to explain decisions and demonstrate fairness. If you cannot, the regulator’s interest is no longer hypothetical.

Where will you actually meet it?

You will meet it in four broad architectures, each suited to a different data shape. Convolutional neural networks for images and video, underneath manufacturing quality inspection, OCR, and retail inventory counting. Transformers for language, the architecture from 2017 that powers every modern LLM. Recurrent networks and LSTMs for older sequential and time-series work. Standard feed-forward networks for some tabular problems.

For tabular SME data, neural networks are not always the right tool. Aidan Cooper’s analysis of tree-based models versus deep learning makes the case that gradient boosted trees often outperform neural networks on rows-and-columns problems, and they are easier to interpret. Day to day, the concrete places you encounter neural networks are predictive lead scoring telling your sales team which prospects to call first. Churn prediction flagging customers about to leave. Voice-to-text running quietly under your video conferencing transcripts at 95%+ accuracy on UK English. Invoice matching auto-reconciling purchase orders with bank statements. Recommendation engines suggesting products on your e-commerce site. Document classification routing inbound email to the right department.

The pattern is consistent. The vendor has done the heavy training, often on a foundation model as described in AWS’s foundation models reference. You consume the result, sometimes with a fine-tuning option to adapt it to your data, as covered in IBM Think’s transfer learning explainer.

When to ask vs when to ignore

Ask hard questions when the neural network is making decisions about people, money, or safety. Hiring screens, credit and lending decisions, insurance pricing, fraud flags that block customer transactions, quality control on a regulated product. In any of these cases the regulatory frame, whether UK GDPR, the EU AI Act high-risk classification, or sector-specific rules, demands explainability and fairness controls.

IBM Think’s black-box AI overview lays out the techniques honestly, attention visualisation, activation visualisation, LIME, SHAP. They give partial explanations, not absolute ones, and a vendor who claims full transparency is overselling. Ask for the partial explanations anyway, they are still useful. Ignore the architecture question when the use case is low-stakes and the data shape genuinely fits. Spam filtering, voice transcription, OCR, internal document search. These are commodity neural-network applications where the vendor’s pre-trained model is mature, the failure mode is recoverable, and your time is better spent on the dozen other decisions in front of you. Trust the maturity of the category and move on.

The harder calls are in the middle. A small clean tabular dataset, a thousand rows, a clear target variable. A neural network is probably the wrong tool. Gradient boosted trees often beat them on this kind of data and are far easier to interpret. A deterministic rule covers it cleanly. Use the simpler tool. Resist the vendor’s framing that neural networks are universally superior, because they are not.

A neural network sits inside a small family of overlapping ideas worth knowing by name. Machine learning is the parent category, the broad practice of systems that learn from data, of which neural networks are one approach among several. Deep learning is the subset of machine learning using neural networks with many hidden layers, which is what made image recognition and language understanding viable in the 2010s.

A foundation model is a large pre-trained neural network, often a transformer, that vendors build products on top of. An embedding is the numerical vector representation that neural networks operate on, the way text or images get turned into numbers the network can process. An LLM is a transformer-based neural network trained on language at very large scale, the architecture underneath ChatGPT, Claude, and Gemini. Explainable AI is the response to the opacity of neural networks, a set of techniques and tools, LIME, SHAP, attention visualisation, that vendors increasingly bundle to support regulatory and governance work.

If you remember one thing from this post, make it this. A neural network is a layered statistical pattern-matcher, not a brain. The architecture is interesting, the procurement questions are what move money. Ask the vendor about training data, fine-tuning options, explainability tooling, fairness audit, and drift monitoring. If you want to talk it through against your current vendor stack, book a conversation.

Sources

- IBM Think (2024). AI vs machine learning vs deep learning vs neural networks. The canonical reference for how the four terms relate. https://www.ibm.com/think/topics/ai-vs-machine-learning-vs-deep-learning-vs-neural-networks - IBM Think (2024). What is deep learning. Multi-layer neural networks, backpropagation, and hierarchical feature learning. https://www.ibm.com/think/topics/deep-learning - AWS (2024). Machine learning vs deep learning. The structured versus unstructured data distinction relevant to SME tooling choices. https://aws.amazon.com/compare/the-difference-between-machine-learning-and-deep-learning/ - GeeksforGeeks (2024). Layers in artificial neural networks. Architecture primer covering input, hidden, and output layers. https://www.geeksforgeeks.org/deep-learning/layers-in-artificial-neural-networks-ann/ - Sebastian Raschka (2024). Visual attention variants. The transformer self-attention mechanism explained for non-specialists. https://magazine.sebastianraschka.com/p/visual-attention-variants - IBM Think (2024). What is transfer learning. The pre-trained-then-fine-tune pattern that underpins the buy-not-build case. https://www.ibm.com/think/topics/transfer-learning - Aidan Cooper (2023). Tree-based models versus deep learning. Why gradient boosted trees often outperform neural networks on tabular SME data. https://www.aidancooper.co.uk/tree-based-models-vs-deep-learning/ - IBM Think (2024). What is black-box AI. The explainability question and the partial nature of XAI techniques like LIME, SHAP, and attention visualisation. https://www.ibm.com/think/topics/black-box-ai - Skadden Arps (2026). UK regulator to agentic AI developers and deployers. The January 2026 ICO guidance on automated decision-making. https://www.skadden.com/insights/publications/2026/03/uk-regulator-to-agentic-ai-developers-and-deployers - Keystone Law (2024). What does the ICO's warning against automated decision-making mean for AI recruitment and employers. The CV-screening regulatory frame under UK GDPR. https://keystonelaw.com/keynotes/what-does-the-icos-warning-against-automated-decision-making-mean-for-ai-recruitment-and-employers/ - EU Commission (2024). Regulatory framework for AI. High-risk classification and explainability obligations relevant to UK SMEs trading into the EU. https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai - AWS (2024). What is a foundation model. The largest end of pre-trained neural networks and the basis for modern LLMs. https://aws.amazon.com/what-is/foundation-models/

Frequently asked questions

Do I need to understand the maths to evaluate neural network products?

No. You need a working mental model, not the calculus. If you can describe a neural network as a layered structure that learns patterns from training data by adjusting numerical weights, you have enough to ask sharp procurement questions. The maths matters for the engineers building the model, not for the owner deciding whether to buy it. What matters at your level is what data trained it, whether you can fine-tune it on yours, what explanations the vendor can give for individual predictions, and how fairness is monitored.

Should we train our own neural network on our data?

Almost certainly not. Training from scratch needs thousands of labelled examples, GPU compute, and ML engineering expertise, which usually costs tens to hundreds of thousands of pounds before delivering anything. Vendors have already absorbed that cost across thousands of customers. Buy a pre-trained model and fine-tune it on your domain data if needed. The exception is if your business itself sells AI products, where bespoke models are central to your competitive position.

How do I check whether a neural network product is biased?

Ask the vendor four direct questions. What training data did you use, what date range, and what bias controls did you apply? Can you explain a specific prediction in my use case using LIME, SHAP, or attention visualisation? What is your fairness audit process for protected characteristics under UK GDPR and the Data (Use and Access) Act 2025? How do you monitor for drift after deployment? A vendor who answers with specifics is honest. A vendor who deflects to "it uses deep neural networks" is selling.

This post is general information and education only, not legal, regulatory, financial, or other professional advice. Regulations evolve, fee benchmarks shift, and every situation is different, so please take qualified professional advice before acting on anything you read here. See the Terms of Use for the full position.

Ready to talk it through?

Book a free 30 minute conversation. No pitch, no pressure, just a useful chat about where AI fits in your business.

Book a conversation

Related reading

If any of this sounds familiar, let's talk.

The next step is a conversation. No pitch, no pressure. Just an honest discussion about where you are and whether I can help.

Book a conversation