Skip down to main content

AI-powered social media can subtly manipulate opinion at scale, new study finds

AI-powered social media's impacts on public opinion

AI-powered social media can subtly manipulate opinion at scale, new study finds

Published on
6 Jul 2026
Written by
Sandra Wachter, Brent Mittelstadt, Chris Russell, Kaivalya Rawal and Stratis Tsirtsis,
AI tools used to generate, edit or contextualise social media posts can introduce hidden biases that spread through online networks and shape public opinion, according to new research from the OII and the Hasso Plattner Institute.

The study found that large language models (LLMs) consistently changed the direction of social media posts on contested topics, even when explicitly instructed to preserve the original meaning. The researchers also show, through simulations of real-world social networks, how these small changes could accumulate across millions of interactions and gradually influence broader public opinion. 

The findings raise questions about the growing use of AI-powered writing tools on social media platforms and suggest that AI-mediated communication could become a powerful new mechanism for influencing public discourse.  

The study, AI-Mediated Communication Can Steer Collective Opinion, authored by Dr. Stratis Tsirtsis, Dr Kai Rawal, Dr Chris Russell, Professor Brent Mittelstadt and Professor Sandra Wachter, has been accepted for presentation at the AI4Good and Technical AI Governance Research workshops at the International Conference on Machine Learning (ICML 2026) in Seoul, South Korea. 

Key findings 

  • AI writing and editing tools can introduce bias into social media posts. Large language models (LLMs) systematically altered the direction of users’ messages on contested topics, even when instructed to preserve the original meaning. 
  • Biases were similar across different AI systems. Multiple models tended to nudge posts in similar directions, favouring some positions such as gun control, marijuana legalisation and feminism, while pushing against others such as atheism and the death penalty. 
  • Small changes in individual posts can influence public opinion over time. Simulations using real-world social network data showed that subtle biases introduced into posts can accumulate and gradually shift opinions across online communities. 
  • AI-assisted communication creates a new route for influencing public discourse. The researchers argue that AI systems embedded in social media platforms can shape how opinions spread online, creating new challenges for transparency, accountability and regulation. 
  • The source of bias is not just the AI model itself. The study shows that specific implementation decisions made by platforms can significantly affect the direction and magnitude of AI-generated influence

Methods 

The researchers instructed large language models (LLMs) from different providers to transform human-written texts on contested topics into improved social media posts. They then analysed whether the AI-generated versions systematically changed the position expressed in the original posts. Next, they used mathematical modelling and computer simulations based on real social network data from X and Facebook to examine how these small changes could spread through online networks and affect broader public opinion over time. 

Example: Grok’s “Explain this post” feature 

By recreating and testing X’s “Explain this post” feature, with a focus on abortion-related posts, researchers found that Grok was more supportive of pro-life posts than pro-choice posts. By removing X’s instructions one by one, they traced this imbalance back to a single instruction telling Grok to “challenge mainstream narratives if necessary”. This experiment illustrates how targeted, easy-to-implement platform interventions can shape the way AI systems influence public discourse online. 

Implications for regulation 

The research highlights AI-mediated communication as an emerging form of influence that existing regulatory frameworks do not yet cover. While initiatives such as the EU AI Act and Digital Services Act focus on systemic risks, harmful content, discrimination, and threats to democratic processes, they do not directly address the more subtle ways AI can shape opinions through drafting, editing, or contextualising online content. 

“Our research points to AI-mediated communication as a new and more subtle way of influencing opinions – one the law has yet to catch up with – and offers food for thought about who, or what, is shaping public discourse,” says senior author Sandra Wachter, Professor of Technology and Regulation at the Oxford Internet Institute, University of Oxford.  

Notes for editors 

Download the paper 

Journalists can download a copy of the study, “AI-Mediated Communication Can Steer Collective Opinion,” by Stratis Tsirtsis, Kai Rawal, Chris Russell, Brent Mittelstadt, and Sandra Wachter from arXiv: https://arxiv.org/abs/2605.16245  

It will be presented at the AI4Good and Technical AI Governance Research workshops at the International Conference on Machine Learning (ICML 2026) in Seoul, South Korea. 

How social platforms are using AI 

Generative AI is increasingly integrated across online platforms, shaping how we interact with each other. For example, LinkedIn offers premium users the ability to improve their posts using AI, X’s Grok model is already a cornerstone of the platform, and recent advertised updates to Google search are pointing to a future where our online production and consumption of information is increasingly AI-mediated. 

Funding  

This work has also been supported by the Alexander von Humboldt Foundation in the framework of the Alexander von Humboldt Professorship (Humboldt Professor of Technology and Regulation awarded to Sandra Wachter) endowed by the German Federal Ministry of Education and Research. 

Contact 

For more information or to interview the authors, please contact:
Anthea Milnes, Head of Communications, or Sara Spinks / Veena McCoole, Media and Communications Manager
T: +44 (0)1865 280527
M: +44 (0)7551 345493
E:press@oii.ox.ac.uk 

About the Oxford Internet Institute (OII)    

The Oxford Internet Institute (OII) is a multidisciplinary research and teaching department of the University of Oxford, dedicated to the social science of the Internet. Drawing from many different disciplines, the OII works to understand how individual and collective behaviour online shapes our social, economic and political world. Since its founding in 2001, research from the OII has had a significant impact on policy debate, formulation and implementation around the globe, as well as a secondary impact on people’s wellbeing, safety and understanding. Drawing on many different disciplines, the OII takes a combined approach to tackling society’s big questions, with the aim of positively shaping the development of the digital world for the public good. 

About the University of Oxford 

Oxford University has been placed number 1 in the Times Higher Education World University Rankings for a record-breaking tenth year running, and number 4 in the QS World Rankings 2026. At the heart of this success are the twin-pillars of our ground-breaking research and innovation and our distinctive educational offer. Oxford is world-famous for research and teaching excellence and home to some of the most talented people from across the globe. Our work helps the lives of millions, solving real-world problems through a huge network of partnerships and collaborations. The breadth and interdisciplinary nature of our research alongside our personalised approach to teaching sparks imaginative and inventive insights and solutions. 

Through its research commercialisation arm, Oxford University Innovation, Oxford is the highest university patent filer in the UK and is ranked first in the UK for university spinouts, having created more than 300 new companies since 1988. Over a third of these companies have been created in the past five years. The university is a catalyst for prosperity in Oxfordshire and the United Kingdom, contributing around £16.9 billion to the UK economy in 2021/22, and supports more than 90,400 full-time jobs. 

Related Topics:

Privacy Overview
Oxford Internet Institute

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Strictly Necessary Cookies
  • moove_gdrp_popup -  a cookie that saves your preferences for cookie settings. Without this cookie, the screen offering you cookie options will appear on every page you visit.

This cookie remains on your computer for 365 days, but you can adjust your preferences at any time by clicking on the "Cookie settings" link in the website footer.

Please note that if you visit the Oxford University website, any cookies you accept there will appear on our site here too, this being a subdomain. To control them, you must change your cookie preferences on the main University website.

Google Analytics

This website uses Google Tags and Google Analytics to collect anonymised information such as the number of visitors to the site, and the most popular pages. Keeping these cookies enabled helps the OII improve our website.

Enabling this option will allow cookies from:

  • Google Analytics - tracking visits to the ox.ac.uk and oii.ox.ac.uk domains

These cookies will remain on your website for 365 days, but you can edit your cookie preferences at any time via the "Cookie Settings" button in the website footer.