Skip to content
← Writing
Writing · November 2026 · 2 min read

How do you know your AI works?

Most AI features ship after a few prompts and a look at the answers. Google's engineers explain why that misses failures. Four habits that replace it.

Abhijit Chatterjee Chattopadhyay

The Logic Atelier logo above the words: How do you know your AI works?

Here is how most AI features get tested. You run three or four prompts, read the answers, and if they look reasonable, you ship.

That is close to how Google's engineers describe it in their post on evaluating AI agents (opens in a new tab), published on 15 October. Their title calls it the vibe check. Their point is that it misses the failures that matter.

Why looking at the answer is not enough

An AI agent can go wrong and still sound right. In the post's words, an agent "can get stuck in a retry loop, fire off multiple tool calls, yet still return a polite, plausible-sounding final answer."

The answer you read looks fine. Behind it, the bill went up, a system was called several times instead of once, and the customer waited. None of that shows in the text.

The good news in the post is that the fix does not need to be big: "any repeatable evaluation system (no matter how simple) is better than relying on ad-hoc spot checks or no system at all."

Four habits that make testing real

  1. Write down what success means, in the user's terms. Who is using it, what they expect, and how you would check it. Every part of that sentence becomes a test.
  2. Read the runs before you build scores. The post suggests reading about twenty full runs and marking every place the agent hesitated, made something up or picked the wrong tool. That list tells you what to test.
  3. Ask yes-or-no questions. When a model grades the answers, a 1 to 5 scale moves between runs, because the line between a 3 and a 4 is fuzzy. "Did the agent verify the account ID before calling the refund tool?" does not move.
  4. Keep the test set fixed while you tune. Every time you add or remove a test, you can no longer tell whether the AI changed or the test did. I made the same case for model updates in Your model changed and nobody told you.

Whatever you test, measure time, cost and the number of tool calls alongside the answer. A correct answer that took far too long is still a failure.

After launch, test on every change

The post's rule is simple: whenever you change a prompt, swap a model or edit a tool, run the same tests again and compare. Passing once proves very little. Passing the same tests after every change is what tells you it still works.

Do this today

  • Pick one AI feature and write one sentence on what a good result looks like for its user.
  • Read twenty real runs from start to finish, not just the final answers.
  • Turn the three most common problems into yes-or-no checks you can run again.

Your next step

I write one practical note like this every day. Sign up just below to get them by email.

Drafted with AI help, edited and approved by me.

New articles by email

I will never sell your details, for any reason, and I never send spam.

How I use your details
  • I, Abhijit Chatterjee Chattopadhyay of The Logic Atelier, hold them, in my own newsletter system hosted on Fly.io. Emails go out through Resend.
  • Your name is for greeting you, your email is for sending new articles, and your phone number, if you give it, is so I can reach you directly about my work.
  • If you do not confirm your email within 7 days, I delete the sign-up. If you unsubscribe, I delete your details 30 days later.
  • If Google Analytics is running on your visit, it is told that a sign-up was made, and nothing you typed.
  • To see or delete what I hold about you at any time, email hello@thelogicatelier.com.
  • The full detail is on the privacy page.
NextIs your checkout ready for an AI buyer?
← cd ../writing

How do you know your AI works?

test-your-ai.mdfront matter
title: How do you know your AI works?
date: 2026-11-03
reading_time: 2 min
author: Abhijit Chatterjee Chattopadhyay
test_your_ai_cover_5296e272_b57ee0e3c4.pngcover
The Logic Atelier logo above the words: How do you know your AI works?

Here is how most AI features get tested. You run three or four prompts, read the answers, and if they look reasonable, you ship.

That is close to how Google's engineers describe it in their post on evaluating AI agents (opens in a new tab), published on 15 October. Their title calls it the vibe check. Their point is that it misses the failures that matter.

Why looking at the answer is not enough

An AI agent can go wrong and still sound right. In the post's words, an agent "can get stuck in a retry loop, fire off multiple tool calls, yet still return a polite, plausible-sounding final answer."

The answer you read looks fine. Behind it, the bill went up, a system was called several times instead of once, and the customer waited. None of that shows in the text.

The good news in the post is that the fix does not need to be big: "any repeatable evaluation system (no matter how simple) is better than relying on ad-hoc spot checks or no system at all."

Four habits that make testing real

  1. Write down what success means, in the user's terms. Who is using it, what they expect, and how you would check it. Every part of that sentence becomes a test.
  2. Read the runs before you build scores. The post suggests reading about twenty full runs and marking every place the agent hesitated, made something up or picked the wrong tool. That list tells you what to test.
  3. Ask yes-or-no questions. When a model grades the answers, a 1 to 5 scale moves between runs, because the line between a 3 and a 4 is fuzzy. "Did the agent verify the account ID before calling the refund tool?" does not move.
  4. Keep the test set fixed while you tune. Every time you add or remove a test, you can no longer tell whether the AI changed or the test did. I made the same case for model updates in Your model changed and nobody told you.

Whatever you test, measure time, cost and the number of tool calls alongside the answer. A correct answer that took far too long is still a failure.

After launch, test on every change

The post's rule is simple: whenever you change a prompt, swap a model or edit a tool, run the same tests again and compare. Passing once proves very little. Passing the same tests after every change is what tells you it still works.

Do this today

  • Pick one AI feature and write one sentence on what a good result looks like for its user.
  • Read twenty real runs from start to finish, not just the final answers.
  • Turn the three most common problems into yes-or-no checks you can run again.

Your next step

I write one practical note like this every day. Sign up just below to get them by email.

Drafted with AI help, edited and approved by me.

subscribeemail

// I will never sell your details, for any reason, and I never send spam.

How I use your details
  • I, Abhijit Chatterjee Chattopadhyay of The Logic Atelier, hold them, in my own newsletter system hosted on Fly.io. Emails go out through Resend.
  • Your name is for greeting you, your email is for sending new articles, and your phone number, if you give it, is so I can reach you directly about my work.
  • If you do not confirm your email within 7 days, I delete the sign-up. If you unsubscribe, I delete your details 30 days later.
  • If Google Analytics is running on your visit, it is told that a sign-up was made, and nothing you typed.
  • To see or delete what I hold about you at any time, email hello@thelogicatelier.com.
  • The full detail is on the privacy page.

vi.Contact

06 · contact

Talk to me.

Talk to me.

Production AI and software architecture. Based in Dubai, working with teams in the Emirates and Ireland.

I work Dubai hours, Monday to Friday, the same week you do. Dubai is three hours ahead of Dublin in summer and four in winter, so my afternoon is your morning.

I will never sell your details, for any reason, and I never send spam.

How I use your enquiry
  • Your enquiry comes to me, Abhijit Chatterjee Chattopadhyay of The Logic Atelier. The form is handled by Formspree, which passes it to my inbox and keeps a copy in my Formspree account.
  • I use it to read your enquiry and reply. If no work follows, I delete it within 12 months, and sooner whenever you ask.
  • If Google Analytics is running on your visit, it is told that an enquiry was sent, and nothing you typed.
  • To see or delete what I hold about you, email hello@thelogicatelier.com.
  • The full detail is on the privacy page.