Call quality signals

Every SIMCOAI call records how it actually went. These are measured during the call, not inferred afterwards.

Measured

The six signals on every call

SignalWhat it meansWhat good looks like
First replyHow long SIMCOAI took to start speaking after the caller finishedUnder 1.2s reads as fast; up to 2.5s acceptable; beyond that sluggish
Caller turnsHow many complete things the caller saidA proxy for how involved the conversation was
Interim resultsPartial speech captured while the caller was still talkingHigh counts on a short call can indicate background noise
InterruptionsHow many times the caller spoke over SIMCOAIOccasional interruptions are normal conversation
Ended byWho finished the callCaller, SIMCOAI, or you from the dashboard
Finish reasonHow the call concludedFor example completed or transferred
Interruptions

What "stale response prevented" means

This is the signal most often misread. It does not mean something went wrong - it means something went right.

When a caller interrupts, SIMCOAI has usually already started composing a reply to what it heard before. That reply is now out of date. SIMCOAI cancels it rather than playing it, and listens to the new input instead. Seeing this on a call means the interruption was handled correctly and the caller was not talked over with a stale answer.
Slow calls

If first reply latency is consistently high

The usual causes, in the order worth checking:

  1. Check the modelPremium models can be slower. Compare a few calls on different model settings.
  2. Trim the knowledgeVery large uploaded documents take longer to search. Keep answers focused.
  3. Compare across daysOne slow call is not a trend. Look at the pattern across a day of traffic.
Related

See also