| Author: Abdullah Ahmed | Category: AI Automation
Every afternoon, an operations coordinator opens the same inbox, reads a batch of requests, copies details into a spreadsheet, and forwards each item to the appropriate team. The work looks ready for automation. Yet some messages contain a straightforward address change, while others hide a cancellation, a dispute, or an exception to a customer agreement.
Frequency alone does not establish whether a task is a good candidate for AI automation. You also need to understand what the task requires, how reliably its outcome can be checked, and what happens when the system is wrong. A sensible first project makes a bounded part of the work easier while leaving the business in control of consequential decisions.
This guide offers a practical way to discover candidates, compare them, and build an evidence-based pilot. The examples are illustrative operating scenarios, not claims about customer results.
Observe a complete cycle of the work
Start with work people already do, rather than a list of AI features. Sit with the staff member responsible for the task and follow several items from arrival to completion. Include an ordinary item, an incomplete submission, and an item that required help from another department.
Record the trigger, inputs, decisions, systems touched, and final outcome. Ask what makes the worker hesitate. Often the apparent task is “copy information,” but the actual work includes interpreting terminology, recognising a returning customer, and deciding whether a request is authorised.
Observation also reveals waiting time. A request that takes two days to complete may require only a few minutes of active work. If most delay comes from an unavailable approver, automated reading will have a smaller effect than the elapsed time suggests. Measure active handling and waiting separately.
Ask staff to show the unofficial tools they rely on: saved searches, message templates, personal checklists, or a spreadsheet of exceptions. These may contain essential business knowledge absent from the formal procedure. Capture the reasoning with their help before trying to replace any steps.
Describe a task at the right size
“Automate customer service” is too broad to evaluate. “Extract a delivery reference from an incoming email and suggest the matching order” is narrow enough to test. A useful candidate has a recognisable start, a defined output, and a clear owner who can judge success.
Separate interpretation from action. Reading a request, suggesting a category, preparing a draft, updating a record, and sending a customer message are different activities. They need not share one permission level or one acceptance threshold. You may automate the suggestion while retaining review before any external change.
Write a short task statement: when a specific event occurs, use specified information to produce a defined result for a named role. Then add exclusions. For the inbox example, exclusions might include disputed charges, account ownership changes, or any request without a match to an existing customer.
This boundary helps estimate effort. A pilot limited to one language, one document family, and one department can expose the important integration and review problems without pretending to cover every situation. Record those limits prominently so early success is not mistaken for universal readiness.
Check whether AI is needed at all
Some repetitive work is better addressed with a form, a database query, a scheduled job, or a deterministic rule. If the information already exists in structured fields and the decision follows an agreed rule, adding a language model may increase variability without adding value.
AI becomes more relevant when the work involves interpreting variable language or extracting meaning from inconsistent source material. Even then, surround that interpretation with ordinary software checks. A model might identify a requested delivery date; application code should still verify that the date is valid and that the order can be changed.
Compare three options for each candidate: simplify the process, automate with explicit rules, or introduce AI assistance. For an expense intake task, a better submission form may eliminate missing fields. Rules may handle receipt totals. AI may help classify descriptions that cannot reasonably be captured through a short list of options.
The strongest proposal explains why the chosen approach fits the difficult part of the task. It does not need to maximise the amount of AI involved. A small interpretation step inside a dependable workflow can be commercially useful.
Build an inventory that captures uncertainty
Create one row per candidate task. Include estimated frequency, handling time, source systems, data sensitivity, error consequences, review needs, and known exceptions. Mark estimates as estimates and note how they were obtained. A short period of observation is more credible than a precise-looking number based on memory.
Use ranges when workloads fluctuate. Month-end reconciliation may be unusually concentrated; seasonal enquiries may differ from routine requests. Record the peaks because they determine whether a review queue or integration limit will become the bottleneck.
For each candidate, collect a small, appropriately authorised sample of completed work and the expected outcomes. Keep difficult cases, including corrections. Samples chosen only because they are clean tend to hide the actual cost of making a workflow useful.
Document what remains unknown. Perhaps staff disagree about the correct category, or the source system cannot expose a required field. These are discovery tasks with owners. Treating them as known assumptions would make the business case look stronger while leaving delivery risk unresolved.
Compare readiness across separate dimensions
A single score can conceal a serious weakness. Keep operational value, technical feasibility, and decision risk visible as separate judgements. A task with high volume but no reliable way to verify its output may be a poor first project.
| Dimension | Evidence to collect | Reason to pause |
|---|---|---|
| Repeatability | Similar inputs and a stable definition of done | Policy changes with each case |
| Checkability | Authoritative records or knowledgeable reviewers | No agreement about a correct result |
| Access | Supported system interfaces and appropriate permissions | Essential data is unavailable or unreliable |
| Recoverability | A way to correct or contain mistakes | Actions cannot be reviewed or reversed in time |
| Ownership | A team responsible for exceptions and maintenance | The pilot has no operational home |
Discuss the table with both the people doing the work and the person accountable for the outcome. Their priorities may differ. A manager may value faster throughput; staff may care more about avoiding repetitive correction. Both affect whether the automation will be adopted.
Use any scoring scale as a conversation aid, not a scientific measurement. Preserve the evidence behind each rating. When a candidate improves because an API becomes available or a policy is clarified, you should be able to explain why its readiness changed.
Make the cost of review visible
Suppose a hypothetical team receives 400 requests each week and currently spends five minutes handling each. An assisted workflow might appear attractive if it prepares a result in seconds. The useful comparison must still include review, correction, escalations, and support.
If staff spend two minutes checking each suggestion and another hour each week resolving failures, the proposed saving is smaller than the model runtime implies. This arithmetic is an illustration; use measured times from your own process before making staffing or investment decisions.
Consider whether freed capacity is usable. Saving scattered seconds does not automatically create a block of time that can be assigned elsewhere. Ask which work will actually be completed sooner, which backlog can shrink, or which service commitment becomes easier to meet.
Include ongoing costs beyond model usage: integration hosting, access administration, evaluation, monitoring, and maintaining examples when the process changes. A pilot with modest savings can still be worthwhile if it reduces tedious re-entry, but its sponsor should understand the complete operating commitment.
Decide what the system is allowed to do
Readiness depends on authority as much as accuracy. Begin with the least consequential useful action. For an incoming supplier request, the automation might extract details into a draft record and highlight a missing purchase order, while staff decide whether to accept the submission.
Define a written permission boundary. Specify the records the workflow may read, the fields it may propose, and any actions reserved for staff. Enforce these limits in application services and credentials. A sentence in a prompt is not a substitute for a permission check.
Incoming documents and emails should be treated as task data. They may include text that looks like instructions to the assistant. Keep that content separate from the workflow rules and prevent it from changing tools, recipients, or approval requirements.
The NIST AI Risk Management Framework core groups risk work into Govern, Map, Measure, and Manage. For a small pilot, a practical application is to name an owner, describe the operating context, measure performance, and decide how problems will be handled. These activities continue as the workflow changes.
Test against the mistakes that matter
Choose evaluation cases before tuning the workflow. Otherwise, the team can gradually optimise for examples it already knows. Keep a separate set of representative cases for checking whether a change improves performance beyond the development sample.
Measure more than overall agreement. Confusing two harmless categories may have little consequence; sending a disputed account to an automatic collection workflow is different. Group errors by operational effect and decide which types are unacceptable for the proposed authority level.
Track abstention as well. A system that sends uncertain items to review can be useful, but only if the review volume is manageable. If it avoids nearly every difficult case, the business may still be paying staff to do most of the original work.
Where human reviewers disagree, resolve the policy or record legitimate alternative outcomes. Do not force ambiguous cases into a false single answer merely to calculate an accuracy percentage. The disagreement is evidence about process readiness.
Run the pilot alongside the current process
Start in a mode where the system produces suggestions without making external changes. Compare its output with the actual decisions staff make. Keep the existing process responsible for completion until the team has enough evidence to change the operating arrangement.
Agree on the pilot duration, sample coverage, and review cadence. A quiet week may not represent month-end pressure or unusual customer requests. Include enough variation to test the limits that matter, and explain any gaps in the final decision.
Capture corrections in a structured way. “Wrong” is less useful than “matched the parent account instead of the delivery location.” Specific reasons point to missing information, ambiguous instructions, or a need for a deterministic lookup.
Provide a stop control and a manual handover path. Staff should know how to identify work the system has already touched, how to resume it, and how to avoid duplicate processing. Practise that handover before relying on the automation during a busy period.
Work through a candidate comparison
Imagine an operations team comparing three possible pilots: copying known order numbers into a report, interpreting free-form delivery enquiries, and approving compensation requests. All three occur repeatedly, but their readiness differs.
The report task has structured inputs and a clear calculation. A scheduled query may solve it with less operating complexity. The delivery enquiry task contains variable language but can produce a reviewable suggestion linked to an existing order. It may be a suitable AI-assisted candidate. Compensation approval involves policy interpretation and a consequential commitment, so the team might limit assistance to gathering evidence and preparing a draft.
The comparison changes if the order system has no supported lookup interface. The delivery task then needs integration discovery before the pilot can demonstrate a realistic outcome. It also changes if the team cannot agree on which queue owns ambiguous enquiries. That is a process decision to resolve, not a model setting.
Write a short decision note for each candidate. Include the proposed boundary, simpler alternatives, evidence available, unresolved dependencies, and the authority the system would receive. This makes the selection review useful even if none of the candidates is ready immediately.
Define what would change your mind
Before the pilot begins, record the conditions that would lead to expansion, revision, or cancellation. For example, the team might require consistent matching on representative cases, manageable review effort, and a demonstrated manual recovery path. The actual thresholds should reflect the process and the consequences of mistakes.
Include a time limit for resolving major unknowns. A pilot can continue indefinitely if every weak result is explained as a reason for another prompt revision. A decision date encourages the team to distinguish fixable implementation problems from a task that does not fit the proposed approach.
Consider adoption evidence alongside technical results. If staff must copy suggestions from a separate chat window into the real system, the trial may not measure the intended workflow. Test the proposed handover and review experience, even if the initial integration is deliberately narrow.
Prepare the work after a successful pilot
A successful trial creates maintenance responsibilities. Name who updates examples when the policy changes, who reviews new error patterns, and who can pause the workflow. Set a recurring review that is proportionate to its volume and authority.
Document the manual process well enough to resume it. Staff should know what has already been completed automatically and which items remain open. If the automation is unavailable, the fallback should not require reconstructing its activity from scattered messages.
Finally, revisit the original benefit estimate using observed handling and review time. Include work displaced to other teams. This turns the pilot into a business decision based on the complete process rather than a demonstration of model capability.
Choose a first project you can sustain
At the end of discovery, a candidate should have a defined boundary, representative examples, a measurable benefit, a supported integration route, and an owner for exceptions. If one of those is missing, make resolving it the next step instead of expanding the scope.
A good first pilot might assist with one recurring intake category or prepare one type of internal summary. It should be useful enough to justify real operating attention and contained enough that mistakes can be reviewed. Avoid choosing a trivial demonstration that bypasses the systems and decisions the eventual workflow must face.
Bring the candidate inventory to a short review with operations, the system owner, and a developer. Select one task, write down the evidence that would justify continuing, and reserve time for staff to evaluate it. That creates a decision the business can make with confidence: expand the assistance, adjust the design, or stop because a simpler process would work better.