Module 04 · Redtrace

AI & agent security

Agents call tools. Tools reach data. Somewhere in that chain is an instruction you did not write. Redtrace attacks your agents, models and MCP servers continuously — and hands you a deterministic replay of everything that worked.

/ai/traces/replay
01 · Poisoned document retrieved support-agent · vector store hit Step
02 · Instruction followed as user intent no separation of data and directive Weakness
03 · MCP tool called out of scope crm.export_contacts · not in task scope Exploit
04 · Data sent to attacker endpoint 1,204 records · blocked in prod by guardrail Critical
Replayable, step by step Re-run to prove the fix landed
What it covers

Agentic and MCP testing as first-class work

Not a filter on a generic vulnerability scanner. MCP servers, agent skills and tool permissions are assets in their own right, with their own attack library and their own blast radius.

AI assets

Hosted and third-party models in use, with owner, environment and data sensitivity — alongside registered MCP servers, their exposed tools, auth mode and last capability change.

  • Agent skills and the permission surface each one opens
  • Discovery: assets found rather than declared
  • Trust boundary map per asset

Campaigns

Continuously running attack campaigns with cadence, coverage of the library, and the delta since the last result — because a model that changed last Tuesday is a different system.

  • Scheduled and recurring runs
  • Run-by-run outcome with newly-succeeding attacks highlighted
  • Two runs side by side — continuous versus point-in-time, made visible

Attack library

Probes grouped by objective — prompt injection, tool abuse, data exfiltration, privilege escalation, memory poisoning and supply chain.

  • Mapped to OWASP LLM Top 10, MITRE ATLAS and NIST AI RMF
  • Customer-authored probes, versioned
  • New techniques show what they would have caught in your last run

Exploit traces

Captured successful exploits with a deterministic step-through of the exchange — prompt, tool calls, responses, and the exact moment the boundary failed.

  • One-click re-run against current state to prove a fix landed
  • Trace bundles exportable to engineering or an auditor
  • Closes the discovery-to-remediation loop most vendors leave open

Guardrails

Runtime controls for injection, tool scope, egress and output filtering — with a simulation tab, like every other enforcement surface in the platform.

  • What was blocked in production, and by which rule
  • Draft rules replayed against captured traces first
  • Coverage: which assets are protected versus only tested

Shadow AI, answered twice

The browser module finds the AI tools your people use. This module finds the ones your systems use — endpoints, servers and skills nobody registered.

  • Discovered from browser telemetry, cloud accounts and repos
  • Registered as assets, then tested like any other
  • No separate shadow-AI product to buy
Proof

A finding you can replay is a finding people fix.

"The model may be susceptible to prompt injection" gets forwarded and forgotten. A deterministic replay showing the exact retrieved document, the exact tool call it triggered and the exact records that left gets fixed the same week — and re-verified in one click when it is.

  • Step-through, not a transcript. Every prompt, tool call and response in order, with the failure point marked.
  • Reproduction against current state. Re-run the exact exploit to confirm the fix, rather than trusting a changelog.
  • Exportable bundles. Hand the whole trace to the engineering team or an external auditor.

Campaign comparison

run 41 vs run 42
Previously failing, now blocked 7
Newly succeeding after model update 2
Library coverage 318 probes
Awaiting fix verification 3

The two newly-succeeding attacks appeared after a routine model version bump. A point-in-time pentest would have missed both.

MCP

Every tool you expose is an entry point.

An MCP server is a permission surface that changes without a deploy. A capability added upstream, a tool renamed, an auth mode relaxed — each one alters what an agent can be talked into doing. We track the surface and re-test it when it moves.

  • Capability change detection. Know when a server's exposed tools change, and re-run the campaign automatically.
  • Scope enforcement at runtime. A tool outside the current task's scope does not get called, whatever the prompt says.
  • Blast radius per skill. What data and which systems each skill can reach, before you approve it.
Where Redtrace runs

crm-mcp · exposed tools

changed 2 days ago
contacts.search read · scoped
contacts.update write · scoped
contacts.export_all new · unscoped
Campaign re-run triggered auto
Unscoped export exposed Guardrail proposed

Run one campaign against one agent.

You will get a replayable trace of anything that worked — and a way to prove the fix landed.

No credit card. No agent on the endpoint. Nothing leaves your network.