AI coding agent admin guide·verified October 21, 2026

alert when an ai agent runs a dangerous command

Route agent policy denies and secret detections to Slack, email or a signed webhook. What to alert on, how to set it up, and what to leave in the dashboard.

the short answer

Create alert rules on the conditions that need a human, such as any deny from a production infrastructure policy or a secret found in tool output, and route them to Slack, email or a signed webhook. Alerts open issues your team can assign and resolve. Leave routine denies in the dashboard. In managed deployments, admins can also deploy a policy by mentioning @Failproof in a Slack channel.

Channel kinds
email, slack, webhook (HMAC-SHA256 X-AgentEye-Signature), dashboard
Trigger kinds
metric_threshold, custom_sql, evaluation_score, eval_compound, per_event
Response
Alerts open issues to acknowledge, assign and resolve
No channels
A rule without channels opens issues but notifies nobody
Slack deploy
@Failproof in a channel (managed deployments; talk to us)

What to Alert On

Alert on attempts that indicate risk or a broken control. Routine denies are the system working; alerting on them trains people to mute the channel. For machines that stop reporting, there is no built-in alert documented: check coverage and last check-in under Admin → enforcement.

ConditionAlert?Channel
Deny from protect-route53, terraform-plan-only, the on-call guardYes, every time#infra-alerts
Secret found by a sanitize-* policyYes#security
block-failproofai-commands denies on one machineYesPlatform owner
block-env-files denyNo, dashboardWeekly review
Instruct decisionsNo, dashboardPolicy tuning

Configure Channels and a Rule

Every entry in --channels needs a kind; leave it out and the rule opens issues but notifies nobody. The organization’s alerts.slack_default_webhook and alerts.email_default_recipients fill in a channel that does not set its own target. The trigger spec is free-form JSON whose shape depends on the trigger kind; the dashboard form under Analyze → Alerts builds it for you, and you can also start an alert from the bell on a representative error in Observe → Errors. Alert URLs must be HTTPS. With alerts.webhook_signing_secret set, webhooks carry an HMAC-SHA256 signature in the X-AgentEye-Signature header.

fp settings set alerts.slack_default_webhook --value https://hooks.slack.com/services/...
fp settings set alerts.email_default_recipients --json-value '["platform-oncall@example.com"]'

fp query schema                        # find the policy-decision fields before writing the trigger
fp alerts create infra-policy-denies \
  --trigger-kind per_event \
  --severity critical \
  --channels '[{"kind":"slack"}]' \
  --trigger-spec '<spec for your per_event or custom_sql trigger>'
fp alerts test infra-policy-denies

Tune When an Alert Fires

  • The rule is evaluated every --eval-interval-secs (30 to 86,400 seconds; 300 by default).
  • --min-breaches of the last --eval-window evaluations must breach before an issue opens (both default to 1).
  • Severities are info, warning and critical.

Deploy a Policy from Slack

In managed deployments, admins can deploy policies by mentioning @Failproof in a Slack channel. The common flow: an alert lands in #infra-alerts, the team discusses it in the thread, and an admin asks @Failproof to deploy the fix to the affected machines in observe mode. Talk to us to connect it to your workspace and to see how Slack deployments appear in your fleet history.

From Alert to Fix

Resolve means fixed, and the issue reopens if the pattern returns. Close means done with it, and it stays closed. Archive takes it off the board without changing how it ended.

01AlertA deny or secret detection crosses the rule.
02IssueAcknowledge and assign an owner under Analyze → Issues.
03SessionRead the trace that triggered it.
04PolicyTighten, loosen or add a rule; publish a version.
05DeployObserve, then enforce; resolve the issue.
An alert should end in a policy change or a closed issue, not a muted channel.

FAQ

Can developers be notified about their own blocks?

The agent tells them in the session, with the deny reason. Alerts are for admins and responders.

Can alerts go to PagerDuty or Opsgenie?

Use a webhook channel pointed at your tool’s inbound integration, and verify the X-AgentEye-Signature header on receipt.

Does a test alert open an issue?

No. fp alerts test sends one synthetic notification through the alert’s channels and changes no state.

Sources

Checked against the sources below on October 21, 2026. Harness settings, hook capabilities and cloud features change between versions.

  1. Failproof AI docs: Alerts
  2. Failproof AI docs: Settings and security
  3. Failproof AI docs: Cloud CLI reference
  4. Failproof AI docs: Findings and issues
  5. Failproof AI docs: Policy decisions
  6. Failproof AI docs: Deploy a policy
  7. Failproof AI docs: Core concepts