Govt’s AI-Driven Misinformation Tool Sparks Privacy Controversy in Karnataka

The Karnataka government’s decision to introduce an artificial intelligence-driven tool to monitor false information on social media platforms has ignited a heated political controversy, with the opposition BJP denouncing it as state-sponsored surveillance.

The Rs 67.2-crore “Social Media Analytics Solution” (SMAS) aims to identify and track content that spreads misinformation, hate speech, social disharmony, and obscenity across digital platforms. The cabinet approval for this initiative comes shortly after the state governor sent a contentious hate speech bill to the President for consideration, effectively stalling its implementation.

While government officials describe the AI tool as necessary to combat the growing threat of misinformation, critics argue it represents an alarming breach of privacy that could monitor citizens’ personal communications under the guise of content regulation.

Law and Parliamentary Affairs Minister HK Patil defended the decision, stating that traditional methods have proven inadequate in addressing the speed and complexity of online disinformation. According to Patil, the system would also help identify harmful narratives related to child trafficking, online abuse, and extremist recruitment.

“If need be, the government will introduce legislation to activate the software,” Patil told reporters, signaling the administration’s determination to move forward with the project despite mounting criticism.

IT-BT Minister Priyank Kharge similarly justified the initiative, framing misinformation as an existential threat to democratic institutions. “Even the Prime Minister has said misinformation is a major threat. The Chief Justice of India has flagged fake news as hampering democracy. We are only trying to curtail misinformation and fake narratives,” Kharge explained, referencing global reports that highlight how disinformation undermines democratic processes.

However, BJP’s national information and technology department head Amit Malviya characterized the tool as a “surveillance monster” designed to monitor citizens’ personal communications. “This system won’t just track harmful content, it will snoop on the social and personal digital interactions of ordinary citizens. What’s being sold as regulation is, in reality, state-sponsored surveillance,” Malviya wrote on X (formerly Twitter), calling it a violation of privacy and individual liberty.

The controversy highlights the growing tension between governments’ desire to regulate digital content and citizens’ concerns about privacy and free speech. Technology experts note that AI-powered monitoring tools can potentially process vast amounts of public data, raising questions about the scope and limitations of such surveillance.

This initiative represents the Karnataka government’s second major attempt to address online misinformation. In October last year, the IT-BT department shortlisted five firms to fact-check news and social media posts, though that project has reportedly progressed slowly.

Industry observers point out that the implementation details of the SMAS remain unclear, as no tender has yet been awarded for developing the software. The technical capabilities, data retention policies, oversight mechanisms, and safeguards against misuse will be critical factors in determining whether the system can effectively combat harmful content while respecting civil liberties.

The debate in Karnataka reflects similar discussions happening globally, as governments worldwide grapple with regulating digital platforms while balancing security concerns with fundamental rights. The outcome of this controversy could set an important precedent for how Indian states approach social media monitoring and content regulation in the digital age.