Databricks Compute Permissions

Published
Length
3 min read

Luis Felipe Dias

All posts

You set up databricks compute permissions by assigning cluster rules to users or groups. These rules decide who can start, restart, attach to, or manage shared clusters. Most data teams begin by granting broad cluster access to speed up daily work. Still, wide roles let users run heavy jobs and read sensitive tables without checks. How databricks compute permissions work in practice Workspace admins control compute resources through role lists tied to each cluster or pool. The platform separa

AI Agent Permissions: the complete guide

Architecture patterns, implementation strategies, and security best practices. Delivered to your inbox.

Free white paper. No spam. Unsubscribe anytime.

You set up databricks compute permissions by assigning cluster rules to users or groups. These rules decide who can start, restart, attach to, or manage shared clusters. Most data teams begin by granting broad cluster access to speed up daily work. Still, wide roles let users run heavy jobs and read sensitive tables without checks.

How databricks compute permissions work in practice

Workspace admins control compute resources through role lists tied to each cluster or pool. The platform separates the right to create new clusters from usage rights. An admin can grant a team permission to attach notebooks to a running cluster. A slightly higher role lets users restart or resize that same cluster when needed. The highest compute role allows full management, including changing libraries and stopping the machine.

Teams also use cluster policies to set strict bounds on new compute requests. A policy acts as a rule book for node size, count, and idle time. When an engineer builds a cluster, the policy checks the request against these rules. This keeps cloud bills down and stops one user from taking all workspace capacity. Service principals follow these exact same rules when running automated jobs on a schedule.

Separating compute access from data governance

A common mistake is treating cluster rules as your main data security control. Compute roles only decide which machine a user can use to run code. In older setups, attaching to a cluster gave the user that machine's cloud role. Anyone on that cluster could read any storage bucket the machine could reach. Modern workspaces pair compute policies with catalog privileges to fix this risk.

Shared access modes isolate user code so people cannot read each other's memory state. Single user mode locks a cluster to one person or one automated job run. Admins must match the right cluster access mode with the right group permissions. Even with this separation, once a user attaches, their code runs at full speed.

AI Agent Permissions: architecture patterns and best practices

Continue reading? Get the full guide.

Free. No spam. Unsubscribe anytime.

What native compute roles solve and what they leave open

Native cluster rules are great at controlling cloud costs and stopping bad machine setups. They ensure only approved users can spin up expensive hardware or change base libraries. They also stop teams from deleting shared machines that run vital daily reports. For basic resource management, these built-in workspace controls do their job very well.

Still, compute roles only check who logs in or attaches to a machine. They do not inspect what individual queries or scripts do while they run. Once a user has permission to run code, every command executes right away. Native compute settings cannot pause a dangerous delete command for a peer review. They also do not rewrite emails, phone numbers, or card numbers in query results. If a developer queries a table with national IDs, raw values return as stored. Managing these risks with native roles alone forces teams to build dozens of custom views.

Govern statements and responses across databases and APIs

Good config and scoped roles are needed setup. They do not check single queries in flight or mask sensitive fields in returned rows. Across Postgres, MySQL, SQL Server, MongoDB, ClickHouse, Kubernetes APIs, SSH, and internal HTTP endpoints, hoop.dev runs beside each supported service as an open-source proxy, a sidecar for your database or API.

First, hoop.dev guardrails block banned queries before they run. Then hoop.dev data masking rewrites matched sensitive values in responses in memory. The audit trail records every statement and verdict per resource. Furthermore, hoop.dev holds SOC 2 Type II and is open source on GitHub.

Frequently asked questions

What is the difference between attach and restart permissions on a cluster?

Attach permissions only let a user run notebooks and queries on an active cluster. Restart permissions let the user start, stop, or reboot the cluster when it hangs.

How do cluster policies interact with user compute permissions?

Compute permissions decide who can use an existing cluster in the workspace. Cluster policies set limits on the hardware choices when someone creates a new cluster.

Do databricks compute permissions restrict which tables a user can query?

No, compute roles only govern access to the virtual machines that run your code. Table and column access are controlled by catalog rules or runtime query checks.

Save the open-source gateway.

hoop is MIT-licensed infrastructure for controlling how AI agents reach production data. Star hoophq/hoop so you can inspect it, deploy it, or share it when your team starts governing agent access.