OpenAI and the Battle to Stop Social Media Manipulation

Whilst the rapid advancement of AI has ushered in a new level of technological innovation, it has also brought forth complex ethical challenges that the tech industry must navigate.
Social media platforms for example, once simple tools for connection and sharing, have become battlegrounds where the power of AI is being tested against the integrity of democratic processes worldwide.
This shift has placed tech companies at the front of the line of a global effort to balance the transformative potential of AI with the critical need to protect users from manipulation and misinformation.
Yet the ethical implications of AI in social media extend far beyond individual privacy concerns.
They touch on fundamental aspects of democratic society, including the integrity of elections, the spread of information and the formation of public opinion.
In this case, OpenAI, the company behind the popular language model ChatGPT, has discovered attempts to use its models for US election influence.
AI tools in election interference
OpenAI has reported a troubling trend regarding the misuse of its AI models.
According to a recent report by Reuters, the company has observed numerous attempts to generate fake content, including long-form articles and social media comments, aimed at swaying voter opinion in US elections.
It says that cybercriminals are increasingly leveraging AI tools, including ChatGPT, to aid in malicious activities.
These range from creating and debugging malware to generating fake content for websites and social media platforms.
The company also claims to have neutralised more than 20 such attempts in the current year alone.
For instance, in August, OpenAI discovered a set of ChatGPT accounts being used to produce articles on topics related to US elections.
Additionally, in July, OpenAI banned several accounts from Rwanda that were generating election-related comments for posting on X, formerly Twitter.
Reuters notes that while these attempts at election influence were identified and neutralised, the incident highlights the growing sophistication of AI-powered disinformation campaigns.
Global concerns and ethical implications
Despite the use of AI tools and social media sites to generate and propagate fake content related to elections being recognised, it is growing as a concern worldwide.
This issue extends beyond just the US, affecting democracies everywhere.
The US Department of Homeland Security warns of an increasing threat from Russia, Iran and China attempting to influence the November 5 elections.
These actors are reportedly using AI to disseminate fake or divisive information, exploiting the technology's ability to create convincing, large-scale disinformation campaigns.
This trend raises significant ethical questions about the responsibility of AI companies and social media platforms in safeguarding democratic processes.
In India, for example, the government has introduced new regulations requiring social media companies to use AI to proactively identify and remove misleading content.
Meanwhile, the EU's Digital Services Act places strict requirements on large online platforms to combat disinformation.
Tech companies are responding to these threats by enhancing their detection and prevention measures.
OpenAI, which recently secured a multi-year, multi-billion dollar investment from Microsoft, is investing in robust safeguards for its AI models.
Moreover, the rise of AI ethics boards within major tech companies signals a growing recognition of the need for diverse perspectives in shaping AI policies.
These boards, often comprising experts from fields such as ethics, law and social sciences, are tasked with providing guidance on the responsible development and use of AI technologies.
Tech companies are now grappling with their role as gatekeepers of information, facing pressure from governments, civil society and their own user bases to implement robust safeguards against AI-powered misinformation campaigns.
******
Make sure you check out the latest edition of Technology Magazine and also sign up to our global conference series - Tech & AI LIVE 2024
******
Technology Magazine is a BizClik brand

