Professor Calls for Global Credibility Institute to Counter AI Disinformation Threat

As artificial intelligence transforms the landscape of digital content creation, the line between real and fake information is rapidly disappearing, warns Associate Professor Jieun Shin of the University of Florida. In a comprehensive analysis published by the Stimson Center’s Korea Program, Shin argues that AI represents a critical inflection point in the global information landscape that requires urgent international collaboration.

The research, part of a project examining AI disinformation implications for the US-ROK alliance, highlights how generative AI tools have democratized the creation of sophisticated fake content, enabling anyone to produce convincing misinformation with minimal effort and cost.

“If social media transformed how misinformation is consumed and redistributed, the recent wave of AI technology is now disrupting the very nature of content creation,” Shin writes, pointing to alarming statistics that forecast deepfake videos could increase sixteen-fold from 500,000 in 2023 to 8 million by 2025.

The consequences extend far beyond technological novelty. A recent NewsGuard report found that leading AI chatbots spread false information 35% of the time when prompted with questions about controversial news topics—nearly double the rate observed a year earlier.

The political implications are already evident worldwide. According to cybersecurity firm Recorded Future, at least 38 countries experienced deepfake incidents targeting public figures within a single year, with most cases linked to elections. One notable example occurred during the 2024 U.S. primaries, when a deepfake robocall imitating President Biden urged New Hampshire voters not to cast ballots.

Beyond politics, AI is fueling a surge in non-consensual deepfake pornography, with women disproportionately targeted. Watchdog organizations have documented an exponential rise in such content since 2023, with reports of AI-generated sexual abuse materials escalating into the millions, while legal protections struggle to keep pace.

The psychological and social consequences are profound. Studies from the Reuters Institute and the University of Michigan indicate that exposure to hyperrealistic misinformation undermines confidence in distinguishing fact from fiction, breeding what scholars describe as “truth fatigue.” This growing skepticism contributes to news avoidance and social disengagement, with particularly concerning impacts on youth and vulnerable populations.

While tech platforms have implemented some measures to combat AI-generated misinformation, Shin notes their response has been less coordinated and explicit compared to earlier crises like the COVID-19 pandemic. “Platforms are operating in an early stage of regulatory and technical uncertainty, where the boundaries between creative innovation and harmful manipulation remain difficult to define,” she explains.

The regulatory landscape remains fragmented globally. The United States has developed incremental regulation primarily through state initiatives, while the European Union has introduced a more comprehensive framework through its AI Act requiring clear disclosure of artificially generated content. China has enforced “Deep Synthesis” provisions since 2023 requiring clear labeling of AI-generated content, and South Korea has established a multi-layered approach including the AI Basic Act and amendments to its Sexual Crime Act.

Shin argues that neither industry safeguards nor national regulations alone can address this borderless threat. She proposes the creation of a global credibility institute bringing together journalists, researchers, technologists, and policymakers to establish common standards for content disclosure and authenticity.

“The United States and South Korea are well-positioned to lead in shaping the global architecture for AI governance and information integrity,” Shin suggests, citing recent bilateral agreements including the Seoul Declaration and the US-Korea Technology Prosperity Deal as potential foundations.

The stakes could not be higher, according to Shin, who previously worked as a journalist for South Korea’s largest newspaper. “Without swift, coordinated action, the erosion of trust may soon exceed our capacity to restore it,” she warns. “What societies choose now will determine whether AI becomes a force for deeper deception or helps prevent the collapse of shared reality.”

As AI continues to advance, Shin’s research underscores that protecting truth has become a global public good problem requiring international cooperation and shared responsibility to establish credible information systems in the AI era.