9 min read
EU AI Act compliance for AI agents: a GDPR-ready build guide for European companies
How European companies can build AI agents that respect GDPR and the EU AI Act: classify the use case, minimize data, scope tools, keep humans in control of consequential actions and document it all.
EU AI Act compliance for AI agents starts with classifying each use case by risk, then building GDPR safeguards into the architecture: a legal basis and data map, minimal tool permissions, human approval for consequential actions, EU-appropriate processing agreements, audit logs and clear disclosure to users. Documentation of those decisions is part of the product, not paperwork afterward.
This guide is for European product, IT and compliance leads who are moving from chat assistants to agents that read data and take actions. It is engineering guidance based on our own agent implementation in the ImadDhin portal. It is not legal advice, and every design here should be reviewed by your data protection officer and counsel.
Why agents raise the stakes compared with chatbots
A chatbot answers questions. An agent reads from systems, decides which tool to call, and changes things: it drafts and sends emails, updates CRM records, files tickets, schedules meetings or triggers payments. Each of those capabilities touches personal data, and some produce effects on people.
That shifts the compliance question. With a chatbot, the main concerns are what data goes into the prompt and whether answers are accurate. With an agent, you also need to know which data it can reach, which actions it can take without a human, how you would reconstruct what happened after a mistake, and whether any decision it makes significantly affects an individual.
The regulatory picture has two layers. GDPR governs the processing of personal data, regardless of whether AI is involved. The EU AI Act adds obligations based on the risk of the AI use case and the role you play, such as provider or deployer. Both apply at the same time.
What teams often get wrong
- Giving the agent a broad service account with access to everything the integration allows, because it was faster to set up.
- Assuming that because the model provider has an enterprise agreement, the whole system is compliant.
- Letting the agent make or effectively make decisions about individuals, such as rejecting applications, without meaningful human review.
- Logging full prompts and tool outputs indefinitely for debugging, creating a large store of personal data nobody planned for.
- Skipping the risk classification because the use case feels obviously low-risk, and then being unable to show the reasoning.
- Forgetting to tell users and employees that they are interacting with an AI system.
A practical architecture
Treat compliance as a set of design constraints. The architecture below works for most business agents.
1. Use-case record
For each agent, write a short record: purpose, users, affected individuals, data sources, tools and actions, the AI Act risk classification with reasoning, and the GDPR legal basis. Update it when capabilities change. This single document answers most questions from auditors, customers and your works council.
2. Data map and minimization
List every data source the agent can read and every field it actually needs. Remove access to everything else. Pseudonymize or redact where the task allows, for example by passing a customer ID instead of full contact details when the agent only needs to look up an order.
3. Scoped tools
Give each tool the narrowest permission that works: read-only where possible, limited to specific record types, with rate limits and input validation on the server. The agent should never hold raw credentials; the server holds them and exposes only the defined operations. Our article on agent permissions and audit trails covers this in detail.
4. Human approval for consequential actions
Classify actions by consequence. Reading and drafting can often run automatically. Sending external communications, changing financial records, or anything that affects a person's rights should require human approval, at least until the agent has a measured track record. Where the agent contributes to decisions with legal or similarly significant effects on individuals, GDPR's rules on automated decision-making make meaningful human review essential. See our guide to human-in-the-loop agents.
5. Audit log
Record who triggered the agent, which tools it called with which parameters, what it changed, and who approved it. Store references to records rather than copying personal data into logs. Set a retention period for logs and transcripts.
6. Disclosure and user rights
Tell people when they are interacting with an AI system. Make it possible to handle access, correction and deletion requests across everything the agent stores, including memory and conversation history.
GDPR and the EU AI Act at a high level
Under GDPR, you need a legal basis for each processing purpose, transparency, purpose limitation, data minimization, accuracy, storage limitation and security. A data protection impact assessment is expected when processing is likely to result in high risk, which many agent deployments touching customer or employee data can trigger. Every model and hosting provider that processes personal data on your behalf needs a data processing agreement, and transfers outside the European Economic Area need a valid transfer mechanism.
The EU AI Act is risk-based. A small set of practices is prohibited. Certain high-risk uses, including some in employment, education, access to essential services and credit, carry obligations such as risk management, data governance, logging, human oversight and documentation. Systems that interact with people have transparency obligations so users know they are dealing with AI. Providers of general-purpose AI models have their own obligations, and organizations using AI are expected to ensure appropriate AI literacy among staff. Obligations apply in phases, so check the current timeline with counsel.
Most internal productivity agents, such as summarizing documents or drafting replies for review, are not high-risk. An agent that screens job applicants or evaluates creditworthiness very likely is. The classification depends on the use, not the technology.
Implementation considerations
Choose hosting and providers deliberately. Major model providers offer EU data processing options and enterprise terms that exclude training on your data. Confirm where prompts, outputs, embeddings and logs are stored, not only where the model runs.
Build an evaluation set before launch: realistic tasks, expected tool calls, and cases where the agent should refuse or escalate. Run it on every change to prompts, models or tools. Our evaluation harness guide explains the setup.
Handle memory carefully. Long-term agent memory is convenient but becomes a personal data store with all the obligations that implies. Store only what improves the task, attach an owner and retention period, and make it deletable.
Plan for incidents. Define what counts as an AI incident, who is notified, how to disable a tool quickly, and how personal data breaches are reported within GDPR's timelines.
Trade-offs
Strict tool scoping and human approval slow the agent down and reduce the headline automation. They also make it deployable in regulated environments and far easier to defend when something goes wrong. Most teams start strict and relax approvals for specific actions once evaluation and production logs justify it.
EU-only processing narrows model and service choices and can raise cost. For many companies it simplifies procurement and customer trust enough to be worth it. Others accept transfers with appropriate safeguards. Decide per data category.
Detailed logs make debugging and audits easier but create more personal data to protect. Log references and metadata by default, and capture full content only for sampled or flagged cases with tighter access.
Lessons from ImadDhin work
These are code-level observations from the agent implementation in the ImadDhin portal, not client outcomes.
Agent sessions and messages in the portal are not readable or writable from the browser; all access goes through server routes that authenticate the user. That single boundary is where retention, access control and deletion can be enforced consistently. Research capabilities that reach external services are gated on the server for eligible users, not merely hidden in the interface, so a modified client cannot unlock them.
The browser-facing tools the site exposes to external agents are limited to visitor-safe marketing actions, and provider failures surface an honest user-facing error rather than a fabricated answer. Both choices follow the same principle an EU compliance review will look for: the system should fail visibly and never do more than its declared purpose.
Common mistakes to test for
- Can the agent reach any data or tool not listed in its use-case record?
- Do consequential actions actually block until a human approves?
- Can you reconstruct a specific run from the audit log without reading raw personal data?
- Are users told they are interacting with AI at the start of the interaction?
- Does a deletion request remove data from memory, transcripts, embeddings and logs?
- Does disabling a tool take effect immediately?
- Does the evaluation set include cases where the correct behavior is to refuse or escalate?
When a simpler solution is better
If the task is drafting text for a person to review, an assistant without tool access is simpler and easier to justify than an agent. If the workflow is fully deterministic, conventional automation with no model in the loop may be safer and cheaper. If a vendor product with a clear data processing agreement and EU hosting already covers the use case, configuring it can beat building your own.
Build a custom agent when the workflow needs judgment across several systems and the value justifies the governance work.
Next step
If you are designing agents for a European organization and want the architecture reviewed for GDPR and EU AI Act readiness, see how we build AI agents, start with the AI Readiness Scan, or talk it through in a 30-minute call.
Frequently asked questions
Are AI agents high-risk under the EU AI Act?
Not automatically. Risk depends on the use case. Internal productivity agents are usually not high-risk, while agents used in areas such as hiring, credit or access to essential services very likely are. Classify each use case and document the reasoning with legal review.
Do we need a DPIA for an AI agent?
Often. A data protection impact assessment is expected when processing is likely to result in high risk to individuals, which agents that handle customer or employee data at scale can trigger. Your data protection officer should decide for each deployment.
Can we use US-based model providers under GDPR?
Yes, if you have a data processing agreement and a valid transfer mechanism, and you have assessed the risks. Many providers also offer EU data processing options. Confirm where prompts, outputs, embeddings and logs are stored.
What should an AI agent audit log contain?
Who triggered the run, which tools were called with which parameters, what changed, who approved consequential actions, and timestamps. Store record references instead of copying personal data, and set a retention period.
Do we have to tell users they are talking to an AI?
The EU AI Act includes transparency obligations for systems that interact with people, and GDPR requires transparency about processing. Clear disclosure at the start of the interaction is the safe default.
Build agents your DPO can sign off
Review your agent architecture for GDPR and EU AI Act readiness.
Book a 30-minute callScoped tools, human approval and audit trails by default.
AI agents we buildA structured first look at your use case and data.
Run the AI Readiness ScanKeep reading
AI agent permissions, tool scopes and audit trails
An agent's blast radius is the sum of everything it is allowed to call. Here is how to scope permissions per tool, keep credentials narrow and short-lived, and record an audit trail that answers who asked, what ran, and what changed.
Human-in-the-loop AI agents: approval steps that don't kill the return on investment
Approval steps protect trust in an agent, but applied to everything they erase the time it was meant to save. Here is how to gate only the actions that need a person, and how to design the approval itself.
AI agent evaluation before production: a practical evaluation harness
An agent that looked good in five demo conversations can still fail on the sixth real one. A small, repeatable evaluation harness turns quality from an impression into a report you can rerun on every change.
AI agency vs AI consulting Germany: how mid-sized companies should start
Should a German Mittelstand company hire an AI consultancy or an AI agency first? A practical way to decide, based on how clear the use case is, where the data lives and what GDPR, the EU AI Act and the works council require.