the short answer
Install a hook-based client on every developer machine that reports each agent session, tool call and policy decision to a central console. You get the full trace of any session, decisions you can filter by machine, and SQL over everything. For history from before you connected, a local audit scans the agent logs already on each laptop. It is how you answer “which agent ran that command” when CloudTrail only shows the developer’s SSO session.
- Unit of record
- Session, made of events (model calls, tool calls, policy decisions)
- Fleet view
- Admin → enforcement: every enrolled machine, its deployment and last check-in
- Decision view
- Observe → policy: blocks, block rate, unguarded actions, activity while paused
- Past history
failproofai auditscans local agent histories offline- Privacy control
--no-transcriptskeeps content local, still reports decisions
The Visibility Gap
Infra teams can tell you every API call made in their cloud accounts. Few can tell you how many of those were generated by an agent, which agent, from what prompt. Once a whole engineering team runs agents, the honest answer to “what are our agents doing” is usually “we find out from CloudTrail when something breaks”.
What You Can See
| View | Answers |
|---|---|
| Admin → enforcement | Which machines are enrolled, what policies each runs, observe or enforce, last check-in |
| Observe → Sessions | Every agent session; filter by environment, status, agent, session ID, and score or metric ranges |
| Session trace | The ordered model calls, tool calls, errors and decisions in one session |
| Observe → policy | Evaluated actions, blocks, block rate, Cloud decisions, unguarded actions and activity while paused; filter to one machine |
| Observe → Events | The live stream as it arrives |
| Observe → Errors | Repeated errors grouped by type, agent, tool or time, with the sessions behind them |
| Analyze → Queries and Dashboards | SQL over sessions, events and evaluations: top denied commands, agents touching AWS |
| Failproof Assistant | Ask in plain English; it runs the queries and opens the sessions |
History from Before You Connected
failproofai audit scans the agent histories already stored on a machine (Claude Code, Codex, Copilot CLI, Cursor, OpenCode, Pi, Hermes, OpenClaw, Factory, Devin, Antigravity and Goose), replays the tool activity through the built-in policies, and opens a local results view at http://localhost:8020/audit. The scan itself needs no account or network connection. failproofai audit --schedule 7 --email reliability@example.com repeats it weekly and emails the findings; that first setup signs you in when needed.
Correlating with CloudTrail
- Start from the CloudTrail event: time,
eventName, and the role session name (often the developer’s email under SSO). Route 53 events are in us-east-1. - In Failproof, filter Observe → policy to that person’s machine, or filter Observe → Sessions by environment and agent, around the event time; open the linked session.
- Find the
Bashtool call containing the matching command or SDK call. The session shows the prompt that led to it. - Write the policy that would have stopped it, backtest it against the same traffic in the policy editor, and deploy it in observe mode.
From the Terminal
--since accepts 15m, 1h, 6h, 24h, 7d or all; use --from and --to for other ranges. --all paginates only up to --limit, which defaults to 50.
fp sessions --env production --since 24h
fp events --since 1h --event-type hook_completed
fp --json events --full --session-id <session-id> --all
fp agent ask "Which machines ran aws route53 commands from an agent this week?"
fp guardrails summary --since 7d # session-only: needs fp login
fp fleet list # session-only: needs fp loginPrivacy and What Is Collected
- Connecting a machine sends transcripts by default, because traces and audits depend on their content.
--no-transcriptskeeps prompts, file contents and terminal input local; hook activity and policy decisions are still reported.- Organizations isolate sessions, users and keys; machine keys need
events:addandpolicies:pull. - Turning transcript capture off changes what an investigation can prove. Record that decision.
FAQ
Does visibility require enforcement?
No. You can connect machines with only the always-on guard enforcing and use the traces alone. Many teams start that way for a week.
Can developers see each other’s sessions?
Visibility is organization-wide: members whose permission set includes read access see the organization’s sessions. Access is set by permission set (read-only, standard, admin), and the docs describe no per-developer session restriction, so choose permission sets deliberately.
Is there an audit trail of policy changes?
Every Cloud deployment to a machine is a numbered generation with history, and every policy publish is an immutable version.
Sources
Checked against the sources below on October 21, 2026. Harness settings, hook capabilities and cloud features change between versions.
- Failproof AI docs: Sessions overview
- Failproof AI docs: Read a trace
- Failproof AI docs: Policy decisions
- Failproof AI docs: Audit local agent history
- Failproof AI docs: Queries
- Failproof AI docs: Failproof Assistant
- Failproof AI docs: Cloud CLI reference
- Failproof AI docs: Deploy a policy
- Failproof AI docs: Settings and security
- AWS docs: Logging Amazon Route 53 API calls with AWS CloudTrail