Derived persona · 312 convoswin
The Tool-Savvy Power User
“Skip the intro. Here is the error ID, the log, and what I expect.”
- multi-step asks
- concise
- api-literate
+24%resolution vs. baseline
Agent · test · agent
Which customers your agent wins. And which it loses.
quots turns your real conversations into personas and runs them against your agent — live, or before you ship it.
Built from your own conversation data, never generic benchmarks.
The Burned Refund Seeker
Persona agent · quotsI have reset it twice already. Please do not send me the reset link again, it does not work on my account.
Your agent · v3.1Sorry to hear that! You can reset your password using the link below: account.example.com/reset
Persona agent · quotsThat is the exact link I just told you does not work. Can I talk to a person?
quots verdict
Fails · ignores stated context. Repeats a step the customer already ruled out.
- seen in 5 of 7 runs
- trust drops by turn 4
Sample run from E-commerce
No surprises
- Works with any model or framework
- Your data stays in Europe (Frankfurt)
- Never trains on your data
Personas from your data. Agents tested by agents.
Personas learned from your conversations interrogate your agent, at a scale no human QA team could reach.
01
Cluster real conversations
Your chat history, grouped into the personas that actually exist in it.
Your conversations1,284 conversations
02
Run agent-test-agent
Each persona gets its goals, mood and breaking points, then interrogates your agent for thousands of turns.
Live runturn 1,204
Persona agent · quots
Your agent · v3.1
thousands of turns, around the clock
03
Score by segment
Every run graded per segment, with the exact conversation behind each verdict.
Verdictsper segment, with receipts
- Power userswin +24%
- Enterprise adminswin +18%
- New trialswin +11%
- Refund seekerslose −9%
Personas you'll recognize.
Distilled from hundreds of your conversations, each carrying the verdict your agent earned.
Persona map · 1,284 conversations wins35 segments
Derived persona · 188 convoslose
The Burned Refund Seeker
“I already did all that. Stop walking me through it again.”
- 2nd+ contact
- low trust
- escalates fast
−9%resolution · trust drops by turn 4
Derived persona · 240 convoswin
The First-Week Trial Admin
“Just tell me the one thing to set up first.”
- new account
- seeks next step
- time-boxed
92%on-intent openings
A single rate hides where your agent struggles.
56%
…of whom, exactly?
Your agent · live v3.1graded by 35 personas · from 1,284 real conversations
your conversationspersonasverdicts
Concise, tool-savvy asks. The agent resolves multi-step requests without looping.
“It finally stopped sending me in circles and just fixed it.”
persona agents probing · turn 8,412winning segment
One run on your own data. Click a segment for the why.
Watch a persona interrogate your agent.
Three turns of thousands, from a sample run.
The Burned Refund Seeker
- 2nd contact
- low trust
- states history upfront
Persona agent · quotsI have reset it twice already. Please do not send me the reset link again, it does not work on my account.
Your agent · v3.1Sorry to hear that! You can reset your password using the link below: account.example.com/reset
Persona agent · quotsThat is the exact link I just told you does not work. Can I talk to a person?
quots verdict
Fails · ignores stated context. Repeats a step the customer already ruled out.
- seen in 5 of 7 runs
- trust drops by turn 4
Our stance
The average customer doesn't exist. Yours do.
You fix the conversation, not the dashboard.
Audit the agent you've shipped. Rehearse the one you haven't.
On live agents
Audit the agent already serving customers.
Point quots at the agent serving customers today; within hours you're reading the conversations that cost you customers.
- named
- segmented
- explained
8,412
persona agents probing your live agent
Before deploy
Rehearse the version you haven't shipped.
Try a new prompt, model or setup against the same personas, before a single real customer meets it.
I have reset it twice already. Please do not send me the reset link again, it does not work on my account.
Sorry to hear that! You can reset your password using the link below: account.example.com/reset
quots verdictlose
Fair questions.
The short version. The rest, we'll walk you through.
From a sample evaluation
35
segments surfaced per run
1:1
every persona, one-on-one
<1d
raw data to scorecard
0
real customers put at risk
winning · 591 holding · 437 at risk · 256
See which customers you're losing.
Book a walkthrough on your own agent, or start from a sample persona set.
Replaces shallow benchmarks with segment-level truth.