All posts

ISO 27001 for Embeddings

When an ISO 27001 audit arrives, the auditor should be able to walk away with a clear, immutable trail that shows exactly who accessed an embeddings model, what data was fed into it, and how the output was handled. The evidence package includes time‑stamped session logs, approval records for any privileged operation, and redacted data extracts that prove sensitive inputs never left the controlled environment. With those artifacts in hand, the auditor can verify that the organization’s risk‑based

Free White Paper

ISO 27001: The Complete Guide

Architecture patterns, implementation strategies, and security best practices. Delivered to your inbox.

Free. No spam. Unsubscribe anytime.

When an ISO 27001 audit arrives, the auditor should be able to walk away with a clear, immutable trail that shows exactly who accessed an embeddings model, what data was fed into it, and how the output was handled. The evidence package includes time‑stamped session logs, approval records for any privileged operation, and redacted data extracts that prove sensitive inputs never left the controlled environment. With those artifacts in hand, the auditor can verify that the organization’s risk‑based controls operate as documented, and the audit closes with a clean opinion.

In practice, many teams treat embeddings as a black‑box service. Engineers push model updates, data scientists stream raw text, and automated jobs invoke the model via API calls. Teams often handle authentication with a service account, and they protect the underlying infrastructure with network ACLs or IAM roles. While those identity controls tell you *who* could talk to the model, they do not show *what* actually happened on each request. No session recordings exist, no approvals are logged for high‑risk queries, and raw input data can be exposed in logs or downstream systems. When an auditor asks for proof that the organization limits exposure of personally identifiable information (PII) during embedding generation, the answer is usually “we don’t have that level of visibility.”

iso 27001 audit artifacts for embeddings

The standard does not prescribe a specific technology, but it does require demonstrable evidence of the following control objectives:

  • Access to the model is granted on a least‑privilege basis and is time‑bound.
  • All interactions with the model are recorded in an immutable log.
  • Any request that contains sensitive fields triggers inline masking before the response leaves the controlled zone.
  • Elevated or anomalous operations are routed through a human approval workflow.
  • Logs are retained for the period defined by the organization’s information security policy.

Without a gateway that sits on the data path, each of these artifacts must be assembled from disparate sources – cloud‑provider audit trails, application‑level logging, and custom scripts. The resulting evidence set fragments, becomes difficult to verify, and often remains incomplete.

Why the gateway matters

hoop.dev acts as a Layer 7, identity‑aware proxy that sits between any client (engineer, CI job, or AI agent) and the embeddings service. The gateway authenticates the caller via OIDC or SAML, translates group membership into fine‑grained policies, and then inspects every request and response at the protocol level. Because the enforcement point resides in the data path, hoop.dev applies the required controls directly:

  • Session recording. hoop.dev records each interaction, generating a detailed log that includes timestamps, caller identity, and the exact query sent to the model.
  • Just‑in‑time access. hoop.dev grants a user a five‑minute window to run embeddings queries, after which it automatically revokes the permission.
  • Inline masking. hoop.dev masks sensitive values in the outbound response, ensuring downstream systems never see raw PII.
  • Approval workflow. hoop.dev pauses high‑risk operations until a designated approver authorizes the request.
  • Immutable audit trail. hoop.dev writes all enforcement decisions, including approvals, denials, and masking actions, to a central log that you can export for audit review.

Because hoop.dev owns the connection, the agent that runs inside the customer network never sees the underlying credential, and the gateway prevents bypassing unless you change the network topology. This architecture satisfies the ISO 27001 requirement that “access control mechanisms be enforced at the point of use.”

Continue reading? Get the full guide.

ISO 27001: Architecture Patterns & Best Practices

Free. No spam. Unsubscribe anytime.

Generating the auditor’s evidence package

When it is time to respond to an audit request, the organization extracts the following ready‑made artifacts from hoop.dev:

  • A chronological log of every embeddings session, showing user, time, and query details.
  • Approval records that capture who authorized each privileged operation, with digital signatures and timestamps.
  • Masked data excerpts that demonstrate compliance with data‑privacy policies while still proving the operation occurred.
  • Access‑grant logs that prove just‑in‑time permissions were correctly scoped and automatically revoked.
  • Configuration snapshots that document the policy rules applied at the gateway at the time of each request.

You can export these files in CSV or JSON format and feed them directly into the auditor’s evidence repository. Because the logs originate from the gateway itself, the auditor can trust that they have not been altered by the application layer.

Getting started

To adopt this approach, begin with the getting‑started guide to deploy the hoop.dev gateway alongside your embeddings service. The learn section explains policy configuration, masking rules, and approval workflow design in detail. You perform all configuration via the open‑source repository, which you can self‑host and extend as needed.

FAQ

Do I need to change my existing embeddings code?

No. hoop.dev works as a transparent proxy, so existing client libraries continue to connect to the same host and port. The only change is directing traffic through the gateway endpoint.

How long are the logs retained?

Retention follows your organization’s information‑security policy. hoop.dev can be configured to forward logs to any long‑term storage solution you choose, ensuring compliance with the retention period required by ISO 27001.

Can I audit AI‑generated outputs as well as inputs?

Yes. Because hoop.dev records the full request and response, you have a complete picture of both the raw input (masked if needed) and the model’s output, which satisfies the control objective of “monitoring of critical processing activities.”

Ready to see the code? Explore the hoop.dev repository on GitHub and start building an ISO 27001‑ready evidence pipeline today.

Open source

Save the open-source gateway for agent data access

Hoop is MIT-licensed infrastructure for controlling how AI agents reach production data. Star hoophq/hoop so you can inspect it, deploy it, or share it when your team starts governing agent access.

Star and save the repo →More posts