DefinitionBehavioral observability
Behavioral observability is the practice of measuring how an AI agent behaves across many sessions and users, not just whether individual calls succeeded.Where execution observability inspects one LLM call, behavioral observability looks across sessions: which issues recur, who is affected, what users intended, and which original sessions show the pattern. It turns trace data into operating answers.
How do I know if my agent is working in production? ›DefinitionBehavior issue
A behavior issue is a recurring agent pattern such as looping, drifting, user frustration, abandonment, poor result quality, hallucination, or a safety problem.Flowlines separates behavior issues from reliability errors. Each issue includes what happened, why it matters, the next step, technical detection details, where it fires, and the affected production sessions.
What signals does Flowlines detect out of the box? ›DefinitionAgent drift
Agent drift is the gradual divergence of an agent's behavior from its original instructions, learned state, or expected outcomes over time.Drift often does not crash. It appears as a behavior issue that recurs across sessions, users, intents, or tool journeys. The useful unit of investigation is the pattern plus the original sessions, not an isolated response.
How do I detect agent drift over time? ›DefinitionSilent failure
A silent failure is a session that returns a successful response (HTTP 200) while the answer is actually wrong, empty, looping, or off-policy, so error monitoring never flags it.Silent failures do not throw an exception. Flowlines surfaces behavior issues separately from reliability errors, then links the finding to affected sessions so a team can inspect the actual conversation and tool path.
How do I catch silent failures in production? ›DefinitionBehavioral cohort
A behavioral cohort is a group of users summarized by what they did in observed agent sessions rather than by demographic attributes.The Flowlines Home view includes user cohorts alongside active users, intents, issues, and sessions that need attention. Cohort context helps teams see whether a recurring issue is broad or concentrated among a particular group of users.
How do I segment my users by behavior? ›DefinitionIssue-free rate
Issue-free rate is the share of analyzed chats without a detected behavior issue or reliability error in the selected period.It appears on the Flowlines Home view next to analyzed chats, active users, and negative feedback. It gives operators a fast health read while the Issues and Search views provide the evidence behind the aggregate.
How do I know if my agent is working in production? ›DefinitionEvidence session
An evidence session is a production conversation or agent run linked directly to a detected issue so a team can verify the finding in context.Issue details in Flowlines connect the summary and next step to the exact sessions where the pattern occurred. This keeps a conclusion inspectable and gives engineering a concrete starting point for diagnosis.
How do I catch silent failures in production? ›DefinitionMCP journey
An MCP journey is the reconstructed path from a user's use case through the MCP tools an agent called to the resulting outcome.Flowlines shows calls per session, repeated-call loops, failed sessions, and typical tool paths for each intent cluster. It distinguishes a technically successful call from a journey that actually helped the user.
See MCP observability ›DefinitionTrace ingestion
Trace ingestion is how production sessions enter Flowlines through OpenTelemetry push, read-only Langfuse or LangSmith polling, or a one-time public LangSmith trace import.The standard live path accepts OTLP/JSON or protobuf at the Flowlines traces endpoint and routes data using a namespace API key. Provider connectors can poll existing traces without replacing the source trace store.
How do I connect Flowlines to my agent? ›DefinitionOutcome coverage
Outcome coverage is the share of observed MCP activity for which Flowlines has enough context to connect tool execution to a user outcome.A successful tool status does not prove that the agent completed the task. Outcome coverage makes that gap visible and helps teams find where additional context is needed to judge success.
See MCP journey evidence ›