isonew

    Find the workflow worth automating

    A scored diagnostic of one named workflow — data, owner, refusal path — before you buy.

    Opportunity diagnostic
    AI for Small Business1 min readUpdated

    Written by Founder & GTM Engineer

    Agents fail on scope, not on intelligence

    Direct answer

    When an AI agent makes the news for the wrong reason, the failure is almost never that the model was not clever enough. The agent was allowed into a conversation nobody had written a rule for, and it answered anyway. A narrow agent with an explicit refusal path beats a broad assistant on every measure that matters to an owner: fewer bad escalations, fewer surprises, and a scope you can defend in one sentence.

    A puzzle piece being forced into a slot where it clearly does not fit, surrounded by correctly fitted pieces on a half-completed jigsaw.
    AI agents fail at the edges of their defined scope, not because the model is wrong — because the boundaries were never drawn clearly.

    Why does narrow beat broad?

    When an AI agent makes the news for the wrong reason, the failure is almost never that the model was not clever enough. It is that the agent was allowed into a conversation nobody had written a rule for, and it answered anyway.

    A narrow agent with an explicit refusal path outperforms a broad assistant on every measure that matters to an owner: fewer escalations that go wrong, fewer surprises, and a scope you can defend to a customer in one sentence. That is the same split we draw in AI agents for business and across the AI for Small Business hub: bounded, observable, reversible work first.

    What do you write before capabilities?

    • Write the refusal rule before the capability list
    • Name the human who receives every escalation
    • Log every action, so a decision can be audited after the fact

    We start with 1 queue, measure it, and only add a second once the first one is boring. The Air Canada chatbot case — where an agent gave an unauthorized discount promise the airline was ordered to honor — is a textbook example of scope left undefined. Refusal rules, an escalation owner, and an audit log are client-owned infrastructure — that is the AI Agents & Automation work, not a broader prompt.

    Frequently asked questions

    Do AI agents fail because the model is not smart enough?

    Almost never. The usual failure is scope: the agent was allowed to answer something nobody wrote a rule for, and it answered anyway.

    What should I write before I list capabilities?

    The refusal rule. Name what the agent must not do, who receives every escalation, and how each action is logged.

    How wide should the first agent be?

    One queue. Measure it until it is boring, then add a second. Broad assistants fail because nobody can defend their scope in one sentence.

    Sources

    1. Air Canada ordered to honour chatbot's incorrect discount — BBC, 2024-02-22
    2. Air Canada chatbot case — CBC coverage — CBC, 2024-02-15

    For the longer definition and the buying test, read AI agents for business. The AI for Small Business hub collects the adjacent operator guides.

    Diagnostic