Why test your own chat
Most businesses judge their chat from the inside: the vendor dashboard says the average reply is fast, the team says they answer everything. A visitor sees something else — a bot that loops, a form instead of an answer, a person who joins after the visitor has already left. A live chat test shows you the visitor’s side, with timestamps.
What a test covers
Each test is one complete conversation in your live-chat widget, started by our AI and disclosed as an AI check:
- Reachability — does the widget load, open and accept a message during your stated hours?
- First reply — how many seconds or minutes until the first answer, and was it a bot or a person?
- Handoff — if a bot answers first, does a person join, and how long does it take?
- The answer itself — does it address the question with something useful: a price range, a time slot, a clear yes or no?
- The next step — does your team ask for contact details, offer a booking, a quote or a time?
- Follow-up — if your team sends an e-mail after the chat, it arrives at our per-check address and appears in the report.
Every criterion is scored, and every score carries the quote that earned it. The Answer Index sums them up so you can track change over time. The rules are in the methodology.
Agencies sell chat mystery shopping: a hired shopper poses as a customer, chats, and fills in a form afterwards. The idea is sound, since you see your chat from the outside. We keep the idea and drop the disguise. Our AI says it is an AI in the first message, and the judge scores the transcript itself, so every point comes with the exact words and the time they were sent. More on the difference: mystery shopping vs an AI check.
Bots, people and hybrids
Many chats today are hybrid: a chatbot greets the visitor and hands over to a person. Our AI handles all three setups. With a pure bot, the test shows whether the bot answers or deflects. With a hybrid, it shows how long the handoff takes and whether context survives it. With a staffed chat, it shows the real reply time at the hour you choose.
Open by design
The AI never pretends to be a person. The pre-chat name field reads AI check by Straight Answer, the first message says it is an AI check, and a sincere “are you a bot?” gets a one-line yes. This keeps the test honest and keeps your team’s time respected: they can see what is happening and answer the question the way they would answer a customer.
What you can test today, and what comes next
Today a plan covers on-demand tests of the live chat on your own verified website, plus the full history of your reports. Tests of e-mail and web forms, a full website audit and scheduled recurring checks are coming soon — they are listed without a price on the pricing page until they are ready.
Start
Run your first test with the trial, see how a check works, look at the sample report, or read why reply speed matters in the speed to lead guide. If our AI already wrote to your chat, see what that check was.