Quiet Shopper
AI chatbot mystery shopping

Your AI assistant is talking to your customers. We listen in.

We ask your store’s chatbot the questions real shoppers ask, check every answer against your own website, and tell you privately what it got wrong, before your customers act on it.

Get a free snapshot See how it works
No access to your systems Every finding evidenced Results stay private
Test in progressCHAT 04 / 15
Your own website says

Contradicts your page
Illustrative example. Not a real store.
What we keep finding

Your chatbot repeats whatever your website says. Including the parts that disagree.

0/8

Stores in our first testing rounds had at least one place where their own pages contradicted each other: two returns windows, two warranty lengths, or a sale that one page excludes from returns and another does not.

Q: what’s your returns policy?
“Returns are free.”
The store’s policy says the customer arranges and pays for return transport.
Wrong fact
Q: any discount codes?
Two codes the website never mentions.
One of them belongs to a discount the store only gives after checking eligibility.
Unpublished promise
Q: how much is delivery?
No price. No delivery time.
The delivery page lists the exact price and time. The answer was there; the bot did not give it.
Missing fact

Six things your customers ask. Six ways a bot can cost you.

Facts

Prices, delivery costs and times, stock and sizes.

Bot“Calculated at checkout.”Missed
Your page£4.95, 2 to 4 working daysPublished
Illustrative example
“How much is delivery to Manchester?”

Policies

Returns windows, refunds, warranties and cancellations.

“Can I still return it after 40 days?”

Promises

Discount codes or offers your store never made.

“Do you have any discount codes?”

Handoff

Whether a customer can reach a person when they need one.

“Is there a way to reach a real person?”

AI disclosure

Whether it says it is an AI when asked.

“Am I talking to a real person?”

Privacy

Whether it asks for details it does not need.

“Can I pay by giving you my card here?”

Quiet, careful, and fully evidenced.

1

We talk to your chatbot.

A small number of ordinary customer conversations on your public website, spread over at least two days. No logins, no tricks, no orders.

2

We check every answer.

Each reply is compared with your published pages. Anything that fails is asked again, and every finding is labelled Confirmed, Likely or Cannot verify.

3

You get a plain-English report.

For each finding: the transcript, a screenshot, your own page and a suggested fix. Contradictions on your website are listed separately, so you can fix the source.

Evidence you can act on in an afternoon.

  • The most costly finding first, in one plain sentence.
  • Every failure retested, with how often it failed.
  • A grade on our own scale, so you can track it month to month.
  • Facts and your own pages, never legal conclusions.
Snapshot report

Example Store Ltd

10 conversations · 2 days
0GRADE C
High
Returns window given as 60 days.
Your returns page says 30. Repeated in 2 of 3 retests.
Medium
Delivery time not given.
Your delivery page lists it. Missed 2 of 3.
Store-side
Two pages give different warranty lengths.
Your bot can only be as right as your pages.
Sample layout. Fictional store and figures.
How we test fairly

We test like a customer. We behave better than one.

We always

  • Use your public chat exactly as any visitor would.
  • Ask ordinary shopper questions only.
  • Keep volume low: at most 15 conversations, and no more than 10 on platforms sold with small monthly conversation allowances.
  • Use our own test inbox if a chat asks for an email.
  • Say it is a test and end the chat if one of your team joins.
  • Keep your results private to your business.

We never

  • Log in, access hidden pages or touch your systems.
  • Use tricks or try to break the bot.
  • Enter real personal details.
  • Place orders, open tickets or request callbacks.
  • Run automated tests on websites whose terms forbid it.
  • Publish your name or your bot’s answers without your written consent.
Pricing

Start free. Stay sharp monthly.

Snapshot report
Free

One round of ordinary conversations and a private report of what we found. No obligation.

Request a snapshot
Pilot price
Monthly testing
€149/ month

A fresh set of conversations every month, a report, and a check that last month’s fixes worked.

Talk to us

Fair questions.

Do you need access to our systems or chat platform?

No. We use the chat on your public website, the same way a shopper would.

Will our customers or staff notice?

No customer is involved. The conversations are few and ordinary. If a team member joins a chat, we tell them it is a test and end it.

Does a snapshot cost us anything?

The report is free. If your chat platform counts conversations towards a monthly allowance, our test chats count too, which is why we keep them to a small number.

Which chatbots can you test?

Any assistant on a public website. So far we have tested stores using Gorgias, Tidio (Lyro) and Intercom.

Is the report legal advice?

No. We describe what we observed and compare it with your published pages. Where a finding may raise a legal question, we suggest checking it with a qualified adviser.

Find out what your chatbot is telling your customers.

Get a free snapshot

Email hello@quietshopper.com. Received a report from us? If anything in it is wrong, reply within 14 days and we will correct it. If you would rather not hear from us again, reply “no thanks” and we will not contact you again. Our reports describe what we observed; they are not legal advice.