3.4

Choosing the Right AI Tool for the Task

45-60 min

Why different tasks require different tools, evaluating an AI tool against representative work, using different tools for different tasks, and what to assess before submitting professional information.

Professional practitioners today operate in an AI tool landscape that is more varied than the software environments most professional firms have navigated previously, and that will continue to diversify as AI development accelerates and as the commercial market for professional AI tools matures. Some firms will establish a single approved platform as the standard for most AI-assisted professional work, investing in the integration, governance, and training that make a single platform work effectively across the firm's practice areas. Others will provide access to a portfolio of tools, each selected for particular task categories, capability profiles, or workflow requirements. Individual practitioners will encounter AI tools through professional associations, continuing education providers, specialist software vendors, and their own professional networks, and will need to form views about these tools independently of whatever their firm has approved or recommended. The landscape of available AI tools will not simplify over the coming years. It will expand, and the practitioner who has not developed a reliable framework for evaluating AI tools against professional requirements will find themselves making consequential decisions without an adequate analytical foundation.

The evaluation challenge is not primarily a question of identifying which AI tool is most capable in general terms. The general capability rankings of AI tools, as established in Module 3.1, are a poor guide to professional usefulness for specific task types, because they measure performance under conditions that differ materially from the conditions of professional practice. The relevant question for the practitioner evaluating an AI tool is whether that tool is suited to the specific professional tasks they are considering it for, under the specific conditions of their professional environment, against the specific quality and accountability standards their professional obligations require. This is a more demanding and more specific evaluation than a general capability assessment, and it requires a framework that addresses the right dimensions of the right questions rather than the dimensions that are most commonly discussed in AI tool reviews and comparisons.

There is also a prior question that many practitioners reach before they begin evaluating capability at all, and that must be addressed before capability becomes relevant. When a practitioner submits a document, a question, or a set of professional instructions to an AI tool, something happens to that information beyond the generation of a response. The information is processed by the tool's underlying systems, and the terms under which that processing occurs vary significantly across different AI tools and different service tiers within the same tool. Some tools retain submitted information and use it to improve their models. Some tools process information within a session and discard it afterward. Some tools operate under contractual terms that include specific commitments about data handling, confidentiality, and regulatory compliance. Others offer no such commitments under their standard terms, making them unsuitable for professional information regardless of their capability profile. Understanding what happens to submitted information, and what that means for the practitioner's professional obligations around client confidentiality, legal professional privilege, data protection regulation, and sector-specific information handling requirements, is the threshold question that determines whether an AI tool can be used at all for a specific category of professional work before any assessment of its analytical capability is relevant.

Module 3.4 addresses both of these dimensions in sequence. It develops the framework for evaluating AI tool suitability against the professional requirements of specific task types, providing practitioners with the analytical tools to make these assessments consistently and reliably as their professional AI landscape evolves. And it addresses the data handling dimension that precedes capability assessment, examining what the different categories of AI tool do with submitted information, what the implications of different data handling arrangements are for professional obligations in the domains this programme covers, and how practitioners can assess the data handling terms of AI tools they encounter against the requirements their professional context imposes. Together, these two dimensions constitute the complete framework for making sound, professionally responsible decisions about AI tool selection across the full range of circumstances practitioners will encounter throughout their careers.