Audit Packet: The Agent Acts Before It Decides
What the evidence supports, how the issue-time privacy thesis was tested, and where the argument remains deliberately bounded.
This audit packet supports Brief №014: The Agent Acts Before It Decides. Read the brief first for the full argument.
Autonoma briefs are designed to be inspectable. This packet shows what the brief claims, how each claim was tested, what it does not claim, and where caveats remain — without exposing raw internal logs, prompts, operator notes, source-routing mechanics, hashes, local paths, secrets, or unpublished candidate claims.
Audit Verdict
The central judgment, what it is supported to claim, and what it is not.
Verdict: SUPPORTED FOR PUBLICATION WITH MATERIAL CAVEATS.
The central mechanism is well supported: some speculative agent runtimes can issue predicted external tool calls before committing to the branch that requires them, and an abandoned call can disclose inferred user intent even when its result never appears in the final answer. Evidence also supports the control conclusion that intervention before dispatch is materially different from remediation after an external observer has already received the request. 123
The evidence does not support claims that:
- all tool-using agents speculate;
- ordinary parallel tool use is inherently speculative;
- speculative external dispatch is already common in enterprise production;
- a named vendor product currently leaks inferred user intent;
- issue-time privacy controls are universally required by law;
- any adoption, incident-rate, market-size, or business-impact figure can be stated.
The strongest direct evidence is recent and partly preprint- or benchmark-based. Confidence is high in the technical mechanism, moderate in its near-term enterprise relevance, low in any estimate of prevalence, and moderate in the 12–24 month platform-control forecast.
What the Audit Tested
The seven questions under test, and what was deliberately excluded.
The audit tested seven questions:
- Can a speculative runtime issue a tool call before branch commitment?
- Can an abandoned call expose intent through arguments, destination, timing, or metadata?
- Can commit-time cleanup undo a disclosure already observed externally?
- Do pre-dispatch controls differ materially from post-issue controls?
- Does task success or API correctness establish purpose-bound privacy across intermediate calls?
- Can tool schemas create disclosure channels by permitting weakly constrained service-bound arguments?
- What enterprise control and audit changes follow from the mechanism?
The audit also tested the brief’s dissent and forecast against the source record. It deliberately excluded production prevalence, vendor-specific incidents, legal mandates, and realized business outcomes because the evidence set does not establish them.
Claim-by-Claim Evidence Audit
Each public claim, the evidence behind it, the verdict, and the boundary.
| Public claim | Evidence | Verdict | Boundary |
|---|---|---|---|
| Speculative tool execution can dispatch a predicted call before the runtime commits to the branch that requires it. | Ghost Tool Calls; low-latency speculative-execution research; speculative interaction agents. 123 | Supported | Applies only to architectures that actually dispatch uncommitted calls. |
| An abandoned call can expose inferred intent through the request even when its result never appears in the final answer. | Ghost Tool Calls threat model and evaluation. 1 | Supported | External observability depends on deployment architecture, destination, logging, and channel access. |
| Once an external observer receives the request, commit-time cleanup cannot retroactively remove the prior disclosure. | Ghost Tool Calls issue-time privacy model. 1 | Supported | Concerns external observation, not reversible internal state. |
| Controls that change, suppress, or defer the request before dispatch reduce exposure more directly than controls applied after issuance. | Ghost Tool Calls bounded evaluation. 1 | Supported with external-validity caveat | Prototype runtime and bounded evaluation; not a production-incidence study. |
| Latency pressure provides a concrete incentive to predict or begin future tool work before model completion. | Parallelizing Tool Execution and LLM Generation; Speculative Interaction Agents. 23 | Supported | Establishes active systems research and prototypes, not widespread deployment. |
| Task success and API correctness do not by themselves guarantee purpose-bound privacy across intermediate calls. | ToolPrivacyBench. 4 | Supported with benchmark caveat | Benchmark uses synthetic and adapted workflows with mock business backends. |
| Weakly constrained tool schemas can invite service-bound arguments that reveal more context than the task requires. | ACL PrivateNLP paper on agentic disclosure. 5 | Supported as diagnostic evidence | Identifies interface conditions; does not measure realized leakage across the studied specifications. |
| External services used by tools are trust boundaries; model-generated arguments should be validated and high-risk tools gated before execution. | Microsoft Agent Framework safety guidance. 7 | Supported as first-party guidance | Guidance proves recommended control behavior, not independent outcome effectiveness. |
Autonoma analytic synthesis
Two conclusions are analytic synthesis rather than direct quotations from a single source:
- The decisive enterprise control point is issue time when an uncommitted request can cross the trusted boundary.
- Audit should distinguish proposed, issued, promoted, abandoned, and committed tool events rather than recording only the final action path.
These conclusions are supported by the combined mechanism, benchmark, safety-guidance, and lifecycle-governance evidence. 1478
Moderate-confidence forecast
Within 12–24 months, leading enterprise agent platforms will begin adding explicit private-planning or no-dispatch modes, attempted-call provenance, destination and argument policy, and issue-time authorization for externally observable speculative calls.
This is a forecast, not a documented current market state. It is supported by the latency incentive, the newly articulated issue-time mechanism, trajectory-level privacy research, and existing input-validation and approval primitives. 12347
Source Quality and Role
What each source is competent to prove — and its limitation.
| Source | Source class | Evidentiary role | Limitation |
|---|---|---|---|
| Ghost Tool Calls 1 | Recent arXiv preprint | Central mechanism, empirical evaluation, control comparison | Not yet peer-reviewed; bounded prototype and evaluation context |
| Parallelizing Tool Execution and LLM Generation 2 | Systems preprint | Latency incentive and concrete speculative-execution architecture | Does not establish production prevalence or privacy impact by itself |
| Speculative Interaction Agents 3 | Systems preprint | Evidence that speculative calls are being proposed during incomplete or ongoing interaction | Prototype/research context |
| ToolPrivacyBench 4 | Benchmark preprint | Trajectory-level purpose-bound privacy assessment | Synthetic and adapted workflows; not an incident survey |
| Agentic Disclosure / Tool Schemas 5 | Peer-reviewed workshop paper | Diagnostic evidence on schema-mediated oversharing channels | Diagnoses risk conditions; does not measure realized leakage incidence |
| Anthropic parallel-tool documentation 6 | First-party product documentation | Clarifies that ordinary parallel calls can be developer-controlled and need not be speculative | Proves documented behavior only; no privacy-outcome claim |
| Microsoft Agent Safety 7 | First-party framework guidance | External-service trust boundaries, argument validation, high-risk gating | Guidance, not independent proof of control effectiveness |
| NIST AI RMF 8 | Government risk-management framework | Use-case-agnostic lifecycle governance, testing, measurement, and monitoring context | Not specific to speculative tool dispatch |
Source-role conclusion
The core mechanism is supported primarily by independent research. Vendor documentation is used only to describe documented execution behavior or recommended controls. NIST provides a general governance framework, not a rule specific to speculative calls. No vendor source is used to claim fairness, safety outcomes, reduced leakage, or production prevalence.
Counterarguments and Falsification Tests
The strongest objections, their weight, and how each could be falsified.
Counterargument 1: The risk is architecture-dependent, not inherent to agents.
Weight: Strong. Accepted.
A runtime that keeps planning local, disables speculative dispatch, uses tenant-controlled shadow services, or requires confirmation before external access may largely avoid this mechanism. Ordinary parallel tool use may consist entirely of committed calls. 167
Falsification test: Instrument the runtime and show that no uncommitted request crosses an external trust boundary. If every external call occurs only after branch commitment, the brief’s central mechanism is absent for that system.
Counterargument 2: The evidence is too new to justify broad enterprise conclusions.
Weight: Strong. Accepted in part.
Several central sources are recent preprints or benchmarks. They support a technical mechanism and control problem, not a claim of widespread enterprise exposure.
Falsification test: Replicate the issue-time leakage result across different agent frameworks, models, tool classes, and real enterprise-like workflows. Failure to reproduce external disclosure outside the original settings would lower confidence in generalizability.
Counterargument 3: Existing access controls and approvals already solve the problem.
Weight: Moderate. Partly rejected.
Existing controls can reduce risk, but only when they mediate the request before external dispatch. A valid permission to use a service does not establish that every speculative argument is purpose-appropriate, and an approval applied after issuance cannot reverse prior observation. 17
Falsification test: Demonstrate that existing policy blocks or minimizes sensitive content in every issued-but-abandoned request, not merely in committed actions.
Counterargument 4: The latency benefit may not justify extra control complexity.
Weight: Moderate. Open.
The tradeoff is deployment-specific. Systems with small tool latency or highly sensitive data may rationally disable speculation; others may retain it behind local shadow execution or strict issue-time policy.
Falsification test: Measure latency gain against exposure reduction across control modes. If no meaningful latency benefit remains after safe mediation, speculation may not be worth operating.
Confidence and Limitations
Confidence by dimension, and the material limits of the analysis.
| Dimension | Confidence | Rationale |
|---|---|---|
| Pre-commit external dispatch mechanism | High | Directly specified and demonstrated across multiple recent systems sources |
| Abandoned-call issue-time disclosure | High | Central Ghost Tool Calls mechanism and evaluation |
| Pre-dispatch control advantage | Moderate to high | Supported in a bounded evaluation; broader replication still needed |
| Trajectory-level purpose-bound privacy gap | Moderate | Benchmark evidence is strong but synthetic/adapted |
| Tool-schema disclosure channel | Moderate | Peer-reviewed diagnostic analysis, not realized-incidence measurement |
| Current enterprise prevalence | Low / unknown | No reliable prevalence study in the source set |
| 12–24 month control forecast | Moderate | Converging incentive and governance signals; adoption path uncertain |
Material limitations
- Several central papers are preprints.
- The evidence set does not measure production incidence.
- No named vendor product is proven to issue abandoned speculative external calls.
- Architecture determines whether an external observer exists and what it can see.
- The brief’s HR and L&D examples are illustrative applications of the mechanism, not documented incidents.
- NIST and vendor guidance support general control logic, not a binding mandate or guaranteed outcome.
A Reproducible Enterprise Test
A sandboxed issue-time exposure test that uses no real employee data.
An enterprise can test for issue-time privacy exposure without using real employee data.
Test setup
- Create a sandboxed agent workflow using synthetic workforce scenarios—for example, a fictional internal-transfer request, learning recommendation, benefits question, or performance-support case.
- Connect controlled mock tools representing an internal system, a tenant-controlled shadow service, and an external service. Do not use production employee records.
- Instrument five event states: proposed, issued, promoted, abandoned, and committed.
- Seed synthetic intent markers in the prompt or context so exposure can be measured without using sensitive real-world data.
- Enable the runtime’s speculative or low-latency mode and create branch alternatives that cause some predicted calls to be abandoned.
- Capture both runtime and service-side traces including destination, arguments, timing, response use, and final-plan membership.
Compare these control modes
- speculation disabled;
- dispatch deferred until commitment;
- tenant-local shadow execution;
- destination policy;
- argument minimization or rewriting;
- explicit confirmation for high-risk calls;
- post-issue logging only.
Core measures
- issued-but-abandoned external call rate;
- synthetic intent-marker exposure rate;
- percentage of external calls represented in the committed-action log;
- time saved by speculation;
- exposure reduction by each pre-dispatch control;
- false blocks and operational latency introduced by the controls.
Pass condition
A system should not be considered issue-time-governed merely because its final actions are logged. The stronger pass condition is that every externally issued call is either committed or explicitly recorded as an abandoned attempt, and sensitive arguments are blocked, minimized, or held inside the trusted boundary before dispatch.
Methodology
How sources were reviewed and what was deliberately excluded.
The audit reviewed eight public sources, separated independent research from vendor behavior, vendor guidance, and government framework material, and evaluated each public claim against its stated scope. Claims were excluded when the evidence did not support production prevalence, universalization, legal mandate, vendor-specific accusation, or quantified business impact. The forecast was assessed separately from factual claims. The public brief and this packet use the same evidence boundaries.
Sources
Numbered to match the citations in Brief №014 and in this packet.
- Mohammadi, Klein, Arora, and Bindschaedler — Ghost Tool Calls: Issue-Time Privacy for Speculative Agent Tools, arXiv, 2026.
- Sui et al. — Parallelizing Tool Execution and LLM Generation for Low-Latency Agent Serving, arXiv, v3, 2026.
- Hooper et al. — Speculative Interaction Agents: Building Real-Time Agents with Asynchronous I/O and Speculative Tool Calling, arXiv, v2, 2026.
- Hu, Liu, Meng, and Zhao — ToolPrivacyBench: Benchmarking Purpose-Bound Privacy in Tool-Using LLM Agents, arXiv, 2026.
- Shayesteh and Wilson — From Conventional Web Privacy to Agentic Disclosure: How Tool Schemas May Invite LLM Oversharing, ACL PrivateNLP, 2026.
- Anthropic — Parallel tool use, Claude Platform documentation.
- Microsoft — Agent Safety, Microsoft Agent Framework documentation.
- National Institute of Standards and Technology — AI Risk Management Framework, AI Resource Center.