1.2

Why This Framework Matters for Professional Practice

8 min

The four-layer framework is the mental model that lets a practitioner predict what a given AI tool can and cannot do, and predict it accurately, rather than an academic abstraction. Three specific consequences of the framework matter for everyday professional practice.

The first is that different layers have different reliability profiles, and expectations should match the layer. Automation is highly reliable within its defined scope and brittle outside it, which means automation tools should be used for the cases they were designed for and reviewed carefully when anything about the situation falls outside those cases. Rule-based AI is reliable when the rules are complete and fails when they are not, which means rule-based tools should be reviewed for the gaps in their rules, particularly when the domain is evolving faster than the rules can be updated. Machine learning is reliable on cases that resemble the training data and may fail on cases that do not, which means machine learning predictions should be treated as statistical rather than categorical and should be reviewed more carefully when the current case looks different from what the model was trained on. Deep learning and large language models produce outputs that look uniformly fluent whether they are correct or not, which means their outputs require systematic verification in a way that other layers may not.

The second is that the term "artificial intelligence" alone does not tell a practitioner very much about what a tool will do. A tool described as AI could be any of the four layers or any combination of them. Before forming expectations about the tool, the practitioner needs to understand which layer or combination is operating. This is often less difficult than it sounds. Ask what the tool does with the input. If it follows a fixed sequence of steps, it is automation. If it applies explicit rules to make decisions, it is rule-based AI. If it predicts something from patterns in historical data, it is machine learning. If it interprets unstructured inputs like text or images and produces unstructured outputs, it is probably deep learning, and almost certainly a large language model if the outputs are free-form text.

The third is that large language models, which are the form of AI most professionals will work with most directly, have specific properties that shape how they should be used. They predict rather than retrieve, which means they can produce plausible outputs that are factually wrong. They work within context windows, which means the information they consider is bounded by what has been supplied in the current interaction. They are influenced by everything in the context, which means the framing and supporting material a practitioner provides shapes the quality of the output. They cannot learn from a conversation in a way that persists beyond that conversation, unless the underlying model is fine-tuned. They can be connected to external information through retrieval-augmented generation, which expands what they can work with but does not eliminate their underlying properties.

A practitioner who carries this framework into their work with AI tools will ask better questions before trusting outputs, choose tools better suited to specific tasks, and recognise the distinctive failure modes of each kind of system. The rest of this programme builds on this framework. Module 1.3 develops where these systems show up in professional work across the specific domains this programme covers. Module 1.4 develops the failure modes in more depth, so that practitioners can recognise them when they occur. Module 1.5 develops the skill of communicating with large language models effectively, which is the applied skill that closes out Stage 1. Stage 2 then develops the collaboration disciplines that integrate AI tools into professional practice, built on the foundation this module has established.