Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.bentolabs.ai/llms.txt

Use this file to discover all available pages before exploring further.

A finding is one thing Bento noticed in a trajectory: a tool call failed, the agent looped, the response drifted off the goal. It’s the smallest unit of analysis. One trajectory can carry many, and Bento groups matching findings across runs into the issues, clusters, and signals you triage everywhere else. Every finding has a kind, a short fixed label you filter on. There are 16 in total; a few of the real values:
KindWhat it flags
tool_errorA tool call returned an error.
hallucinationThe agent stated something unsupported.
loop_detectedThe agent repeated the same step.
wrong_tool_useThe agent reached for the wrong tool.
goal_divergenceThe run drifted away from the user’s goal.
safety_violationOutput crossed a safety boundary.
prompt_injectionInput tried to hijack the agent’s instructions.
excessive_costThe run burned far more tokens or money than expected.
The same values feed the --kind flag on an issue’s findings and the --finding-kind filter on the Runs list.

Commands

A finding only exists in context, so there’s no findings command group. You pull findings from an issue or from a trajectory, and you filter the Runs list by finding kind.
bentolabs issues list-findings --help        # findings attached to an issue
bentolabs trajectories list-findings --help  # findings extracted from one run
CommandWhat it does
issues list-findings <issue-id>The observations attached to an issue. Filter by --kind.
trajectories list-findings <trajectory-id>Every finding extracted from one analyzed run.
traces list --finding-kind <kind>The Runs list, narrowed to runs with a finding of a given kind.

Pull findings from an issue

This is the common path: an issue bundles its findings as evidence. Read them all, newest analysis first:
bentolabs issues list-findings <issue-id> --output table
Narrow to one kind. --kind takes a single value and does not repeat:
bentolabs issues list-findings <issue-id> --kind tool_error

Pull findings from a trajectory

When you’re on one analyzed run, list everything Bento extracted from it. This path returns all of a trajectory’s findings with no kind filter; only the issue path takes --kind.
bentolabs trajectories list-findings <trajectory-id> --output table

Find runs by finding kind

To go the other way, start from a kind and find the runs that exhibit it by filtering the Runs list. --finding-kind repeats to match any of several, with OR semantics:
bentolabs traces list --finding-kind tool_error --finding-kind hallucination --output table

See also

Issues

Where findings roll up: the tracked problems you triage.

Trajectories

The analyzed runs findings are extracted from.

Signals

The detectors learned from matching findings.