For conversation-rich AI products

Your users are already telling you what to build.

Understand why users stay, why they leave, and what they wish your AI could do next.

Otis listens to conversations and combines them with real user behavior to surface the improvements that matter most.

Here’s what they’re telling you.

AI agent that acts on your behalf

They stopped trusting it.

# product
OtisApp8:52 AM
Delegation stops after the third check
98% task success·29% verified every result·3 runs before they stop

Your logs show the drop-off. They don’t show what these users said on the way out.

did it actually send all of them?
Asked after roughly 1 in 3 handoffs. The accounts that asked it three times never delegated again.
See the tasks they took back
940 handoffs read · 29% verified every result
Mara8:58 AM

@Otis which tasks do they drop first?

What you shipped
You made the agent show its work.

On exactly the tasks users were already checking by hand.

AI that drafts work people review

They accepted it, then rewrote it.

# product
OtisApp8:47 AM
Six in ten rewrites are the same correction
93% accepted·17% rewritten in place·61% of those, one fix

Your logs already show the 17%. They don’t show that most of those edits are users making one identical change.

shorter, and drop the intro
The same correction, in 6 phrasings, across 412 rewritten drafts.
See the correction
2,410 sessions read · 412 rewrites clustered
Dan8:51 AM

@Otis so it’s one prompt change, not a model problem?

What you shipped
You changed the default, not the model.

One line in the system prompt closed most of the gap.

AI copilot in a SaaS product

They asked the product, not you.

# product
OtisApp9:02 AM
Bulk actions: most asked for, never reported
37 accounts asked·0 escalated to a human·29 did it by hand

None of this reached your feedback inbox. They asked the copilot, got told no, and worked around it.

Can you just do this for all of them?
One of 6 phrasings Otis clustered, across 37 accounts.
See the accounts
1,180 sessions read · 37 accounts · 6 phrasings clustered
Priya9:04 AM

@Otis none of these came through support?

What you shipped
You shipped bulk apply.

Not because anyone filed a ticket. Because 37 accounts asked your product directly.

What you can’t see is shaping your product.

Six signals that never look like signals.

Friction
Users rewrite and abandon what your AI produces, and nothing in your stack flags it.
Impact
You ship a prompt change, the eval moves, and you still can’t tell if behavior did.
Value
Your best users go quietly stuck, and you find out at renewal, not before.
Discovery
People use your product in ways you never designed for. That’s your next feature, and you can’t see it.
Churn
The greenest dashboard hides the users already on their way out.
Spend
Rising token spend looks like engagement. Much of it is users retrying what didn’t work.

Your stack can tell you what ran. It can’t tell what delivered value.

That gap is where value is quietly won and lost.

Sees
Misses
Product analytics
SeesClicks, events, funnels
MissesWhat the user was actually trying to do
Observability
SeesSystem behavior
MissesWhether the user got any value out of it
Evals
SeesWhether the model passed a test
MissesWhether the user accepted, edited, retried, gave up, or wanted more
Tickets · Slack · Discord
SeesThe loud feedback
MissesSilent churn and the workarounds no one reports

Otis turns signal into ground truth.

Add Otis from your coding agent in minutes. First insights in hours.

# Claude Code or Cursor: npx @runotis/setup, then /otis-analyze
Setup

Your coding agent installs a light SDK and instruments your product surfaces; you review and merge. It runs async, so zero latency for your users, and there’s nothing to label or define. A short strategy onboarding, and you’re live. About 30 minutes.

The @runotis packages are private today: you’ll get access when you come on board. See the docs.

Privacy & trust

Otis knows what users do and say, not who they are. PII is redacted in the SDK and collector, before anything hits disk. SOC 2 in process, with HIPAA options for regulated teams.

Get Otis into your product.

Drop your email and pick a time with one of our cofounders: a look at how Otis works, and a conversation about what your users are actually doing.

Made in San Francisco for AI-native teams, by repeat founders who’ve built services from scratch and scaled them to 1B users.