Thought Leadership | Data Privacy + Agentic AI
DPDP and Agentic AI: Why India's Privacy Law Changes How Enterprise AI Agents Must Be Designed
The future of enterprise AI is not unrestricted autonomy. It is governed autonomy.
Introduction — From Chatbot to Digital Actor
For most organisations, the first wave of generative AI was relatively contained. A user asked a question, the model generated an answer, and a human decided what to do next. Agentic AI changes that operating model. An AI agent can retrieve information from multiple enterprise systems, reason across it, call tools, update records, send communications and retain context for future tasks. It moves beyond answering questions to acting on behalf of a person or an organisation.
That shift makes India's Digital Personal Data Protection (DPDP) framework particularly relevant.
What DPDP Means for Agentic AI
The Digital Personal Data Protection Act, 2023 establishes obligations around the processing of digital personal data, while the Digital Personal Data Protection Rules, 2025 provide operational requirements and a phased commencement framework. For enterprise AI teams, the implication is significant: privacy cannot remain something addressed only around databases, applications or legal reviews. It increasingly has to be built into the architecture of the agent itself.
An organisation may already govern its enterprise data. But that does not mean an AI agent should inherit unrestricted access to it.
The question is therefore changing from
"Is our data governed?"
to
"Is the digital actor that can access and act on that data governed?"
Six Implications for Enterprise Agentic AI
Data Access Must Become Purpose-Aware
Consider an HR agent asked to identify employees suitable for a new project. Technically, it may be able to access resumes, performance reviews, compensation, location, project history and manager comments. But technical access is not the same as permission to process every field for every purpose.
The DPDP framework makes the purpose and lawful basis of processing important. In an agentic environment, this means access needs to take into account not just who is asking, but which agent is acting, for what purpose and what information is actually necessary.
This points to a shift from simple role-based access towards purpose-aware access.
Data Minimisation Must Extend into the AI Context
Once an agent has access to enterprise data, another question arises: how much of that data should actually reach the model?
A finance agent investigating an increase in operating expenses may need general-ledger transactions, vendor invoices and budget information. It does not need employee bank details or unrelated personal information simply because those fields exist in the same source system. This makes data minimisation an AI architecture issue.
Data should ideally pass through permission checks, filtering, masking or tokenisation before it enters the model's context. This has an additional benefit: a cleaner context is often a better AI context. Minimising unnecessary information can reduce noise while reducing the exposure of sensitive data.
The principle is not to give the model everything it can technically access and expect it to ignore what is irrelevant.
Agent Memory Creates a New Data Store
Persistent memory is one of the features that makes agents useful. An agent can remember previous interactions, customer complaints, employee project history or recurring preferences and use that information in future tasks. But memory also creates a new governance challenge.
Once those memories contain information relating to identifiable individuals, they become part of the organisation's data environment. Enterprises need to know what an agent is permitted to remember, why it is remembering it, how long that information should remain available and how it can be corrected or erased where applicable.
This is particularly important because the DPDP framework places obligations around retention and erasure. Data cannot simply remain indefinitely in an Agent's memory because it happens to be useful. The future enterprise agent will therefore need something that today's applications rarely required at this level: a governed memory lifecycle.
Without such controls, agent memory can quietly become an ungoverned shadow database.
Privacy Must Follow the Entire Data Journey
Agentic systems also generate far more information about an interaction than conventional applications. A single request may generate a user prompt, retrieved records, model context, tool calls, intermediate outputs, a final response and execution traces. Personal data can potentially appear anywhere along this chain. Consequently, protecting the original database is no longer sufficient.
DPDP readiness therefore requires enterprises to create visibility across the agent's complete data journey — including prompt logs, vector stores, conversation histories, caches, tracing systems and model-provider environments.
The question is no longer simply: "Where is the personal data stored?" It becomes: "Where does the agent see, transform, transmit, remember and leave traces of personal data?"
Using Third-Party AI Does Not Transfer Accountability
Most enterprises will not build every component of their AI stack themselves. Agents may use external foundation models, managed AI services, vector databases and other third-party tools. That creates another important consideration.
Where is the data processed? Are prompts retained? Is enterprise data used for model training? What sub processors are involved? How are deletion requirements handled?
The DPDP framework places responsibility on the Data Fiduciary even when processing is undertaken on its behalf by a Data Processor. For enterprise architecture, this means model selection cannot be based solely on performance, cost or latency. Organisations also need to consider what data a model or service can see, under what conditions, and what controls surround that access.
This is likely to drive greater adoption of enterprise AI gateways, private model endpoints, redaction layers, controlled connectivity and stronger contractual controls.
Autonomous Action Requires Bounded Authority
The biggest change comes when an AI agent moves from recommendation to execution. A copilot might identify customers at risk of churn and recommend an offer. An autonomous agent could identify those customers, decide on the offer, send the communication and update the CRM. The moment AI can act, rather than merely advise, the risk profile changes.
Enterprises therefore need clear boundaries around what an agent can execute autonomously. An agent might draft an email but require approval before sending it. It might recommend a refund but be prevented from issuing a high-value refund. It might read CRM data but not export an unrestricted customer list. The principle is not to eliminate autonomy. It is to make autonomy proportionate to risk.
Agent autonomy should never mean unrestricted authority.
Is your enterprise ready for governed AI?
Talk to our AI expertsDesigning for Governed Autonomy
The six implications point to a larger shift in enterprise AI design. Privacy can no longer be treated as a control surrounding the agent; it has to become part of how the agent is built, what it can access and what it is allowed to do. This is where the idea of governed autonomy becomes central — designing agents that are autonomous enough to be useful, but bounded enough to be trusted.
The Governance Layer
These six implications point to a broader architectural shift. A simple architecture of:
is inadequate when an agent can access personal data and take consequential actions. Enterprises increasingly need a governance layer between the agent and the systems it can access:
Governance / Policy Layer
The governance layer should determine whether a particular request is permitted before data is retrieved or an action is executed. It should bring together identity, purpose, permissions, data sensitivity, action limits, approval requirements and auditability. Crucially, these controls should not depend entirely on the Agent following instructions in its prompt. The boundaries of the Agent should be enforced by the architecture. This is the difference between an AI system that is merely intelligent and one that is enterprise-ready.
From Governing Data to Governing Digital Actors
For decades, enterprise data governance has focused primarily on databases, applications and access controls. Agentic AI introduces a new category: the digital actor.
This actor can retrieve information, reason over it, remember it, communicate with people, interact with enterprise systems and take actions. As its capabilities increase, the enterprise must govern not only the data but also the software entity that is consuming and acting upon that data.
This is where DPDP can become more than a compliance requirement. Many of the principles it reinforces — purpose limitation, data minimisation, least-privilege access, security, processor governance, retention and auditability — are also fundamental to deploying autonomous AI safely. In that sense, privacy governance can become an enabler of trustworthy Agentic AI, rather than simply a constraint on it.
What Enterprises Should Do Now
Enterprises moving from AI pilots to production should begin by creating a clear inventory of their agents: what each agent can access, what systems it can interact with and what actions it can perform. They should then:
- Introduce purpose-aware, least-privilege controls at the retrieval and tool-execution layers.
- Minimise personal data entering prompts and memory.
- Establish approval thresholds for consequential actions.
- Extend existing retention, deletion, audit and vendor-governance practices across the Agentic AI stack.
The objective is not to make agents less capable. It is to ensure that their capability and authority grow together — and that authority remains governed.
Conclusion: The Future Is Governed Autonomy
The transition from chatbot to digital actor is more than an evolution in user experience. It changes the relationship between AI, enterprise data and decision-making. An AI agent can see more, remember more and do more than a traditional chatbot. That is precisely what makes it valuable — and precisely what makes governance essential.
The enterprises that succeed with Agentic AI will not be those that simply give agents more access. They will be those that design agents with the right identity, purpose, permissions, memory, boundaries and accountability from the beginning.
The future of enterprise AI is therefore not unrestricted autonomy. It is governed autonomy.