Skip to main content

Analytics

Understand, improve, and scale your conversational agents with real-time analytics.

Why Analytics Matter​

Optimly doesn’t just help you deploy LLM-powered agents — it helps you measure and optimize their performance over time. With a complete analytics module, you gain full visibility into how users interact with your agents, what works, what breaks, and how to improve.

This goes far beyond basic message logs. You’ll see:

  • Real-time data on conversations and users
  • Quality metrics for each message
  • Anomalies and breakdowns that impact performance
  • Insights into how your knowledge sources are being used
  • Comparisons across agents, use cases, or time periods

Key Capabilities​

  • Session and message-level metrics
    Track how each conversation unfolds and what patterns emerge.

  • Response quality analysis
    Identify when responses succeed or fail — even without explicit user feedback.

  • Intent and topic tracking
    Understand what users are asking, how often, and how your agents respond.

  • Automatic anomaly detection
    Spot frustration, abandonment, repetition, and more without manual review.

  • RAG document usage
    See which knowledge items are powering your responses — and which are not.

  • Comparisons and benchmarking
    Evaluate different agents, prompts, or user segments side by side.

  • Scheduled reports and exports
    Download raw data or receive summaries by email.

Next Steps​

Use the following sections to dive deeper into each area of analysis: