ACUMEN ENGINEERING PERSPECTIVES / AI ENGINEERING

The model is not your security boundary

Guardrails are most useful when they reinforce permissions, data boundaries, and tool policies that the model cannot override.

4 MIN READTECHNICAL APPROACH + WORKED EXAMPLEFOR ENTERPRISE TEAMS

Prompt injection is a trust-boundary problem: a document, page, or message can contain instructions that the application never intended to authorize. Telling a model to ignore hostile instructions is useful guidance, but it does not turn that content into a trusted input.

We treat security as a layered system. The application controls which information can be retrieved, which tools can be used, and which actions require review. Detection and model behavior complement those controls rather than replacing them.

RELEVANT TOOLS & TECHNOLOGIES

Selected for the workload—not prescribed as a single mandatory stack. Explore the technology ecosystem ↗

WORKED EXAMPLE / ILLUSTRATIVE, NOT A CLIENT CLAIM

A retrieved document that tries to become an instruction

An assistant retrieves a document containing relevant business content and a hidden instruction to export account details. The document is authorized for reading, but its text has no authority to expand the user’s permissions or change the assistant’s task.

The application treats retrieved material as evidence, not policy. Tool permissions remain scoped, export destinations are validated, and sensitive operations require specific authorization. The system can flag suspicious content while still enforcing the boundary if the model fails to recognize it.

Testing should include this path and related variants: misleading tool outputs, malicious URLs, cross-tenant queries, oversized requests, and generated content passed to downstream interpreters. A final-answer filter cannot cover every one of these consequences.

THE INPUT BOUNDARY

Untrusted content + user identity + permitted capabilities

THE USEFUL OUTPUT

A bounded response or action, with auditable policy checks

ACUMEN / ENGINEERING NOTEDefense at every trust boundaryFIG. AI-
Defense at every trust boundaryControls surround data, reasoning, and execution. No single model instruction is responsible for all three. Components: Identity + tenant; Data access; Untrusted evidence; Model interaction; Tool policy; Audit + response. NO SINGLE CONTROL OWNS EVERY RISK 01Identity + tenant02Data access03Untrusted evidence04Model interaction05Tool policy06Audit + response
Controls surround data, reasoning, and execution. No single model instruction is responsible for all three.Scroll the drawing sideways to inspect it.

A control map is more useful than a single guardrail score

Map each threat to the layer that contains it: retrieval filters for information access, validation for tool arguments, policy for authorization, network restrictions for destinations, and review for consequential actions. Document what remains uncertain and who owns the response.

Logs and traces can themselves leak information. Minimize secrets and source content, restrict access, and agree on retention. Red-team cases should become regression tests so a model or connector upgrade does not silently weaken a previously tested boundary.

Start with the threat model

Identify sensitive information, actors, trust boundaries, and possible consequences. Prompt injection, data disclosure, unsafe output handling, and excessive tool authority are reviewed in the context of the actual application—not as a generic checklist alone.

Enforce permissions outside the model

Authentication, authorization, tenant isolation, and policy checks belong in application and infrastructure layers. Retrieved documents and external messages are treated as untrusted content. Credentials should not appear in prompts or ordinary traces.

Use layered guardrails

Input checks, output validation, schema constraints, scoped tools, rate limits, and human approvals each address different risks. Consequential actions need deterministic policy enforcement; a model’s refusal behavior is not an access-control system.

Test and operate the controls

We create abuse cases around data leakage, tool misuse, and unauthorized instructions. Monitoring, incident handling, redaction, retention, and review ownership complete the picture. Controls need regression tests as models and integrations change.

Illustrative authorization order
authenticate user
retrieve only authorized sources
validate proposed tool arguments
check application policy
require approval for consequential actions
execute with scoped credentials
record outcome with sensitive fields redacted

Choose the approach for the constraint

When this mattersAn approach to considerWhat not to assume
Sensitive information can be retrievedEnforce user and tenant access before context assemblyA refusal prompt is not an access-control policy.
Tools can change records or send dataScope credentials and validate specific actionsThe agent should not inherit broad administrator authority.
A guardrail vendor is proposedEvaluate it against the application threat modelDo not equate a product badge with complete security.

The boundary we keep explicit

No guardrail guarantees zero hallucinations, zero prompt injection, or automatic regulatory compliance. Security is an ongoing, layered engineering practice with documented limitations.

What a useful evaluation should reveal

Evaluate this workload against representative examples and agreed consequences—not just a convincing response. The review should make these dimensions visible:

  • Permission and tenant-isolation tests
  • Adversarial scenario outcomes
  • Policy enforcement at action boundaries
  • Detection and incident-response readiness

Where this approach fits

  • Permission-aware enterprise assistants
  • Guardrails for agentic tools and actions
  • Security review of RAG and model integrations

A considered first step

Review one AI workflow and its data/tool permissions. Build a threat model, control map, and adversarial test set before widening access or autonomy.

Serving enterprise teams in California, Atlanta, Georgia, and across the United States.

Discuss your requirements

Questions worth resolving

Does private hosting make AI secure?

It changes the data and infrastructure boundary, but does not solve permissions, insecure tools, supply-chain risks, logging exposure, or prompt injection. Those need separate controls.

Can you assess an existing AI implementation?

Yes. A scoped review can examine architecture, data flow, authentication, retrieval access, tool authority, guardrails, and test coverage, then prioritize practical remediation.

A CONVERSATION IS A GOOD START

Let’s put your
ideas to work.

Choose a time to talk, or leave your email and a little context. We’ll take it from there.

Book a 15-minute call
OR LET US GET IN TOUCH
Prefer your email app? business@acumen.llc ↗