The rapid development of Artificial Intelligence (AI) has transformed the way people create, share and consume digital content. Among the most significant technological developments is the emergence of deepfakes. Deepfakes are synthetic images, videos, or audio recordings generated or manipulated using AI to make a person appear to say or do something that never actually happened. Although this technology has legitimate applications in entertainment, education, filmmaking and digital communication, its misuse has become a serious concern across the world, including India.
India, with its large internet user base, growing digital economy and widespread use of social media, is particularly vulnerable to the harmful effects of deepfakes. Manipulated videos of political leaders, fake celebrity endorsements, fraudulent voice calls and non-consensual intimate images can spread rapidly through platforms such as Instagram, YouTube, Facebook and WhatsApp. Such content can damage reputations, influence public opinion, facilitate financial fraud and undermine trust in digital information.
Forms of Deep Fakes
Deepfakes generally take several forms: Video deepfakes: A person’s face or body movements are altered to make them appear in a fabricated situation. Audio deepfakes: AI generated voices imitate real individuals, including family members, public officials and business executives. Image deepfakes: Manipulated or artificially generated photographs depict people in situations that never occurred.
Synthetic text and multimedia: AI-generated messages, images and recordings are combined to create convincing but misleading narratives. Not all AI-generated content is harmful. Its ethical and legal implications depend on factors such as consent, disclosure, purpose and the possibility of causing harm. A clearly labelled film effect is fundamentally different from a fabricated video intended to deceive voters or humiliate an individual.
The Growing Deep Fake problem in India
India’s digital transformation has created enormous opportunities for communication, commerce and public participation. At the same time, the speed and scale of online information sharing make it difficult to identify and control manipulated content. One of the most visible concerns is the use of deepfakes involving public figures and celebrities. Fabricated videos can falsely suggest that a political leader made a controversial statement or that a famous actor endorsed a particular product.
Even when such content is later exposed as fake, the original video may already have reached millions of viewers. The problem becomes particularly serious during elections. Misleading audio clips, edited speeches and synthetic videos can be circulated to influence voters, intensify political divisions or damage the credibility of candidates. In a diverse democracy such as India, false information targeting communities, religions or political groups can deepen social tensions.
Women are also disproportionately affected by malicious deepfakes. Nonconsensual synthetic intimate images and sexually explicit videos can be used for harassment, blackmail, humiliation and online abuse. Victims may experience psychological distress, reputational damage and professional consequences, even when the material is entirely fabricated. Financial fraud represents another growing risk. Crimion the nature of the content and the harm caused. The nals can imitate the voice of a relative, employer or senior executive and ask victims to transfer money urgently.
As voice-cloning technology becomes more accessible, traditional assumptions that a familiar voice proves someone’s identity are becoming increasingly unreliable. These examples demonstrate that deepfakes can threaten individuals, institutions and society at multiple levels.
Major risks and Consequences
1. Threat to Democracy and Electoral Integrity
Free and fair elections depend on voters having access to reliable information. Deepfakes can distort political debate by manufacturing speeches, spreading false allegations or creating misleading impressions about candidates. Such material may be strategically released shortly before voting, leaving little time for fact-checkers and authorities to respond. Deepfakes can also weaken public confidence in genuine evidence. When manipulated videos become common, people may dismiss authentic recordings as fake. This phenomenon, sometimes called the “liar’s dividend,” allows individuals to deny real wrongdoing by claiming that genuine evidence has been artificially generated.
2. Violation of Privacy and Human Dignity
Deepfakes can reproduce a person’s face or voice without permission. The misuse of someone’s identity in intimate, humiliating or defamatory content can violate personal autonomy and dignity. Women, children and other vulnerable individuals may face particularly serious consequences. Removing such content can be difficult because copies may be repeatedly uploaded to different websites and messaging groups. The harm may continue long after the original content has been identified as fabricated.
3. Cybercrime and Financial Fraud
AI-generated voices and videos can make impersonation scams more convincing. A fraudster may pretend to be a family member in an emergency, a company director authorising a payment or a bank representative seeking sensitive information. In workplaces, criminals may combine deepfake audio with phishing emails and forged documents to manipulate employees into revealing confidential data or transferring funds. These attacks demonstrate the need for stronger identity verification and cybersecurity practices.
4. Misinformation and Social Conflict
False content can spread rapidly when it triggers fear, anger or outrage. Deepfakes depicting communal violence, inflammatory speeches or fabricated incidents can intensify mistrust between groups and potentially disturb public order. Because many people receive news through social media and private messaging platforms, misleading content may circulate without reliable sources or contextual information. Corrections often receive less attention than the original sensational material.
Deep Fakes and the legal Framework in India
India does not rely on a single, comprehensive law exclusively devoted to every aspect of deepfakes. Instead, several existing laws and regulatory frameworks may apply, depending Information Technology Act, 2000, provides an important foundation for addressing certain forms of online abuse and unlawful digital activity. Sections 66C, 66D, 67 and 67A are examples of provisions that may apply when their specific legal requirements are satisfied.
The Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021, as amended, establish due-diligence obligations for intermediaries and provide mechanisms for addressing certain unlawful content. The Bharatiya Nyaya Sanhita, 2023, which came into force in July 2024, may also be relevant where deepfakes involve cheating, forgery-related conduct, defamation or other offences, depending on the facts of a case. Privacy and personal dignity receive constitutional protection under the framework of fundamental rights. In addition, intellectual property, personality rights and civil remedies may be relevant when a person’s identity, likeness or voice is misappropriated.
However, applying existing provisions to emerging technologies can be challenging. Questions may arise about identifying the creator, establishing intent, determining jurisdiction, preserving digital evidence and securing the timely removal of harmful content. India therefore needs clear, consistent and proportionate rules that address deepfakes while protecting legitimate creativity, journalism, satire and freedom of expression.
Government initiatives and recent Developments
The Indian Government platforms and victims may be located in different countries. Common standards for identifying synthetic media, sharing evidence lawfully and investigating cross-border cybercrime can improve enforcement.
Future prospects
has taken steps to address the misuse of AI-generated content. The Ministry of Electronics and Information Technology (MeitY) has issued advisories reminding online platforms of their responsibilities under the IT Rules and the need to address prohibited misinformation, impersonation and other unlawful content.
Users can also approach platform grievance officers and, where applicable, the Grievance Appellate Committees. Furthermore, the Indian Computer Emergency Response Team (CERT-In) published an advisory on deepfake threats and countermeasures in November 2024. Such initiatives highlight the need to combine legal enforcement with cybersecurity awareness and technical safeguards.
The way Forward
India must adopt a balanced approach that encourages technological innovation while protecting individual rights and democratic institutions. AI-generated content can support education, accessibility, entertainment and economic growth, so banning the technology altogether would be neither practical nor desirable. Instead, policy should focus on accountability, transparency, consent and prevention of harm.
Collaboration between Indian research institutions, technology companies and lawen forcement agencies can improve detection methods and develop tools suited to India’s many languages and regional contexts. Independent fact-checking organisations and responsible journalism also have an important role in exposing fabricated claims. International cooperation is equally important because deepfake creators, online Deepfakes represent one of the most complex challenges arising from the rapid growth of artificial intelligence in India.
They can facilitate financial fraud, damage reputations, violate privacy, spread misinformation and threaten electoral integrity. Their increasing realism makes it difficult for ordinary users to distinguish authentic recordings from fabricated material. India has existing legal provisions and regulatory mechanisms that can address several forms of deepfake misuse, while government advisories and election-related measures demonstrate growing institutional attention to the issue.
Nevertheless, effective implementation, public awareness, victim support and continued adaptation of the legal framework remain essential. Ultimately, the responsibility for combating deepfakes cannot rest with the government alone. Technology companies must build safer platforms, institutions must promote digital literacy, and citizens must verify information before sharing it. The objective should not be to eliminate AI-generated creativity but to prevent its use for deception, exploitation and harm.
*Dr.S.Krishnan is an Academician and Experienced Journalist based in Jaipur Kritika Banga is a 3rd year student of Seedling School of Law and Governance, Jaipur National University, Jaipur
