All Notes

IDEAS & OBSERVATIONS

Give Your First AI Project a Clear Finish Line

Choose one workflow, define a useful result, and measure the full effort required to produce it. A focused pilot gives you evidence for the next decision.

5 min read

An AI demonstration can make a task look remarkably easy. A few inputs go in, a polished answer appears, and everyone starts imagining the hours the business could get back. The next decision deserves more care: which piece of work are we actually prepared to change?

For an owner or executive, a useful first project produces evidence. The team should learn whether a specific workflow can improve, what it takes to run it responsibly, and whether the improvement is worth maintaining. Define that finish line before the demonstration turns into an open-ended implementation.

Choose one piece of work

Consider a professional services business that spends considerable time turning discovery-call notes into proposals. “Use AI in sales” leaves almost everything undecided. A narrower assignment is easier to evaluate: use approved notes and service information to prepare a draft scope and a list of unanswered questions for a person to review.

The starting point and destination are now clear. The tool receives a defined set of information and returns a defined draft. A person remains responsible for pricing, commitments, and sending anything to the client. Other work, such as updating the customer database or scheduling follow-up, can be considered separately.

Walk through the current process before choosing technology. Find out which steps require judgment, where information is missing, and what people repeatedly copy or rewrite. Sometimes a better template or a clearer approval rule will solve a substantial part of the problem. That is useful progress, and it makes any remaining AI work easier to scope.

Describe a result someone can check

For the proposal example, a good draft would accurately reflect the client’s stated needs, use current service descriptions, preserve important qualifications, and identify missing information. It would distinguish an agreed requirement from something the client merely mentioned as a possibility.

Those distinctions matter commercially. “We may add another location next year” should not quietly become a commitment to support two locations. A possible launch date should not become a promised delivery date. The person reviewing the draft needs to see where each important detail came from and which questions remain open.

Generative AI can produce confident inaccuracies, a risk described in NIST’s Generative AI Profile (PDF). Fluent writing alone is a poor acceptance standard. Compare the draft with its approved source material and look specifically for invented details, omitted constraints, and changes in meaning.

Decide what happens when the information is insufficient. In this example, the useful output may be a question for the salesperson. A system that reliably identifies a missing decision can save more trouble than one that fills every blank.

Measure the whole job

Establish a baseline using the current process. How long does it take to prepare a usable proposal, including collecting information, drafting, reviewing, and correcting it? Where do delays arise? Who supplies the final judgment? Keep the measurement simple enough that the team will actually do it.

Then compare the assisted process on a varied set of examples the business is authorized to use. Include ordinary work and difficult cases: incomplete notes, unusual requests, conflicting details, or a client whose needs do not fit the standard offer. Reserve some examples for evaluation after setup so you can see how the approach handles work it was not tuned around.

Count review and repair time. A draft that appears in seconds may still require a senior person to reconstruct the conversation before trusting it. Record the kind of correction needed as well as the time involved. A style preference and an invented commercial commitment deserve different attention.

Include setup, software, training, and ongoing maintenance when assessing the business case. Also consider whether the saved time is usable. Shortening a task is more valuable when it frees someone for work the business actually needs done. Decide who will use the capacity and for what.

Give the workflow a responsible owner

Someone needs to own the result after the initial enthusiasm fades. That person should understand the work, the standard for a useful output, and the circumstances that require escalation. A vendor can help build the process; the business still needs someone accountable for how it is used.

Agree on which information the system may access and where the outputs will be kept. Check the chosen provider’s data-handling settings and terms before introducing client information. Early tests can use fictional or appropriately sanitized examples. Broader access should follow a demonstrated need.

Make review practical. Put the draft, its source information, and unresolved questions where the responsible person can compare them. “Someone will check it” is an incomplete process if that person lacks the context or time. For this proposal pilot, sending remains a deliberate human action.

Make the next decision part of the project

Agree in advance on a review date and the evidence needed to continue. The criteria should cover accuracy, effort, usability, and cost. Be specific about errors that would prevent a broader rollout, even if the average result looks encouraging.

At that review, choose what the evidence supports: adopt the defined workflow, adjust a specific part and test again, or stop. An unsuccessful pilot can still be useful if it identifies an expensive approach before the business becomes dependent on it. Keep the existing process available while the new one is being evaluated.

If the pilot earns a place in daily work, assign responsibility for keeping the source materials current and checking performance when the tool or process changes. An outdated service description can undermine a carefully built proposal workflow. Maintenance belongs in the decision to adopt it.

Finish the first project with a clear answer about one piece of work. That gives the business a basis for deciding where AI should help next, what should remain with people, and how much additional investment the evidence justifies.