Army of fake fans boosts China’s messaging on Twitter

BRUSSELS (AP) — China’s ruling Communist Party has opened a new front in its long, ambitious war to shape global public opinion: Western social media.

Liu Xiaoming, who recently stepped down as China’s ambassador to the United Kingdom, is one of the party’s most successful foot soldiers on this evolving online battlefield. He joined Twitter in October 2019, as scores of Chinese diplomats surged onto Twitter and Facebook, which are both banned in China.

Since then, Liu has deftly elevated his public profile, gaining a following of more than 119,000 as he transformed himself into an exemplar of China’s new sharp-edged “wolf warrior” diplomacy, a term borrowed from the title of a top-grossing Chinese action movie.

“As I see it, there are so-called ‘wolf warriors’ because there are ‘wolfs’ in the world and you need warriors to fight them,” Liu, who is now China’s Special Representative on Korean Peninsula Affairs, tweeted in February.

His stream of posts — principled and gutsy ripostes to Western anti-Chinese bias to his fans, aggressive bombast to his detractors — were retweeted more than 43,000 times from June through February alone.

But much of the popular support Liu and many of his colleagues seem to enjoy on Twitter has, in fact, been manufactured.

A seven-month investigation by the Associated Press and the Oxford Internet Institute, a department at Oxford University, found that China's rise on Twitter has been powered by an army of fake accounts that have retweeted Chinese diplomats and state media tens of thousands of times, covertly amplifying propaganda that can reach hundreds of millions of people — often without disclosing the fact that the content is government-sponsored.

This type of analysis is possible because Twitter makes more of its data available to researchers than other social media platforms routinely do.

More than half the retweets Liu got from June through January came from accounts that Twitter has suspended for violating the platform’s rules, which prohibit manipulation. Overall, more than one in ten of the retweets 189 Chinese diplomats got in that time frame came from accounts that Twitter had suspended by Mar. 1.

But Twitter’s suspensions did not stop the pro-China amplification machine. An additional cluster of fake accounts, many of them impersonating U.K. citizens, continued to push Chinese government content, racking up over 16,000 retweets and replies before Twitter kicked them off late last month and early this month, in response to the AP and Oxford Internet Institute’s investigation.

This fiction of popularity can boost the status of China’s messengers, creating a mirage of broad support. It can also distort platform algorithms, which are designed to boost the distribution of popular posts, potentially exposing more genuine users to Chinese government propaganda. While individual fake accounts may not seem impactful on their own, over time and at scale, such networks can distort the information environment, deepening the reach and authenticity of China’s messaging.

“You have a seismic, slow but large continental shift in narratives,” said Timothy Graham, a senior lecturer at Queensland University of Technology who studies social networks. “Steer it just a little bit over time, it can have massive impact.”

Twitter, and others, have identified inauthentic pro-China networks before. But the AP and Oxford Internet Institute investigation shows for the first time that large-scale inauthentic amplification has broadly driven engagement across official government and state media accounts, adding to evidence that Beijing’s appetite for guiding public opinion — covertly, if necessary — extends beyond its borders and beyond core strategic interests, like Taiwan, Hong Kong and Xinjiang.

Twitter’s takedowns often came only after weeks or months of activity. All told, AP and the Oxford Internet Institute identified 26,879 accounts that managed to retweet Chinese diplomats or state media nearly 200,000 times before getting suspended. They accounted for a significant share — sometimes more than half — of the total retweets many diplomatic accounts got on Twitter.

It was not possible to determine whether the accounts were sponsored by the Chinese government.

Twitter told AP that many of the accounts had been sanctioned for manipulation, but declined to offer details on what other platform violations may have been at play. Twitter said it was investigating whether the activity was a state-affiliated information operation.

“We will continue to investigate and action accounts that violate our platform manipulation policy, including accounts associated with these networks,” a Twitter spokesperson said in a statement. “If we have clear evidence of state-affiliated information operations, our first priority is to enforce our rules and remove accounts engaging in this behavior. When our investigations are complete, we disclose all accounts and content in our public archive.”

China’s Ministry of Foreign Affairs said that it does not employ trickery on social media. “There is no so-called misleading propaganda, nor exporting a model of online public opinion guidance,” the ministry said in a statement to AP. “We hope that the relevant parties will abandon their discriminatory attitude, take off their tinted glasses, and take a peaceful, objective, and rational approach in the spirit of openness and inclusiveness.”

IDEOLOGICAL BATTLEFIELD

Twitter and Facebook function as formidable — and one-sided — global megaphones for China’s ruling Communist Party, helping to amplify messaging broadly set by central authorities.

Today, at least 270 Chinese diplomats in 126 countries are active on Twitter and Facebook. Together with Chinese state media, they control 449 accounts on Twitter and Facebook, which posted nearly 950,000 times between June and February. These messages were liked over 350 million times and replied to and shared more than 27 million times, according to the Oxford Internet Institute and AP’s analysis. Three-quarters of Chinese diplomats on Twitter joined within the last two years.

The move onto Western social media comes as China wages a war for influence — both at home and abroad — on the internet, which President Xi Jinping has called “the main battlefield” for public opinion.

“On the battlefield of the Internet, whether we can withstand and win is directly related to our country’s ideological security and political security,” he said in 2013, not long after taking power. In September 2019, as Chinese diplomats flocked to Twitter, Xi gave another speech, urging party cadres to strengthen their “fighting spirit.”

Xi has reconfigured China’s internet governance, tightening controls, and bound Chinese media ever more tightly to the party, to ensure, as he said in a 2016 speech, that the media loves, protects and serves the party.

That intimacy was formalized in 2018, when the party consolidated administrative control of major print, radio, film and television outlets under an entity it manages, the Central Propaganda Department.

Like other nations, China has recognized the value of social media for amplifying its messaging and reinforcing its hold on power. But unfettered access to Western social media has given Beijing a unilateral advantage in the global fight for influence.

Twitter and Facebook are blocked within China, and Beijing controls the conversation on domestic alternatives like WeChat and Weibo, effectively cutting off unmediated access to the Chinese public.

“It’s creating a significant challenge for Western democracies. We don’t have the same capacity to influence international audiences given that China has walled off its internet,” said Jacob Wallis, a senior analyst at the Australian Strategic Policy Institute’s International Cyber Policy Centre. “That creates a significant asymmetric advantage.”

Despite the high levels of Chinese government activity, Twitter and Facebook have failed to label state content consistently. In an effort to provide users with more context, Twitter last year began labelling accounts belonging to “key government officials” and state-affiliated media. But Twitter had labeled just 14% of Chinese diplomatic accounts on the platform, as of March 1, failing even to flag dozens of verified profiles.

Twitter said that in keeping with its policy of labelling senior officials and institutions that speak for a country abroad, not all diplomatic accounts will be flagged. It offered no further details on how those decisions are made and declined to provide a list of Chinese accounts that have been labeled.

Facebook also began putting transparency labels on state-controlled media accounts last year. But disclosure is especially weak in languages other than English, despite the fact that Chinese state content has strong distribution in Spanish, French, and Arabic, among other languages.

Facebook had labeled two-thirds of a sample of 95 Chinese state media accounts in English, as of Mar. 1, but less than a quarter of accounts in other languages. Unlike Twitter, Facebook does not flag diplomatic accounts, the majority of which are official embassy and consulate accounts.

Facebook labeled an additional 41 Chinese state media outlets AP and the Oxford Internet Institute brought to their attention, bringing the overall portion of labeled accounts from less than half to nearly 90%. The company said it was looking into the rest.

“We apply the label on a rolling basis and will continue to label more publishers and pages over time,” a company spokesperson said in a statement to AP. The company declined to provide a full list of which Chinese state media accounts it has flagged.

The China Media Project, a Hong Kong research group, found that transparency labels make a difference: Twitter users liked and shared fewer tweets by Chinese news outlets after August 2020, when the platform started flagging them as state-affiliated media and stopped amplifying and recommending their content.

“We need the labels,” said China Media Project director David Bandurski, though he cautioned that they risk painting all Chinese media with the same broad brush, including outlets like Caixin that have managed to maintain a degree of independence. “This is all about co-opting the narrative. Telling China’s story means we the party get to tell China’s story and no one else. That’s happening in Portuguese and Spanish and French. It really is a global plan.”

The outspoken editor-in-chief of China’s Global Times, Hu Xijin, noticed the impact immediately. On Aug. 14, he tweeted his dismay at the “China state-affiliated media” label that had been added to his profile, saying his follower growth had plummeted. “It seems Twitter will eventually choke my account,” he wrote.

COUNTERFEITING CONSENSUS

In early February, China’s state news agency Xinhua published a “fact check” of 24 “lies” it said anti-China forces in the West had been spreading about Xinjiang, where China stands accused of genocide for its brutal, systematic repression of minority Uighur Muslims.

According to Xinhua, the real problem in Xinjiang is not human rights, but Uighur terrorism. Beijing has brought stability and economic development to its restive western region, and information suggesting otherwise has been fabricated by U.S. intelligence agencies, a racist scholar, and lying witnesses, Xinhua said.

The story was picked up by other Chinese state media outlets, amplified by China’s foreign ministry at a press conference, and blasted across Twitter by the foreign ministry and Chinese diplomats in the United States, India, Djibouti, Canada, Hungary, Austria, Tanzania, Kazakhstan, Jordan, Liberia, Grenada, Nigeria, Lebanon, Trinidad and Tobago, Qatar and the United Kingdom.

From there, it was further amplified by devoted but mysterious fans — like gyagyagya10, whose account pushed out an identical quote-tweet and reply, within seconds, to a message about Xinjiang posted by China’s Embassy in London, writing, “Ethnic groups in China are well protected, no matter in economic aspect or in cultural aspect.”

This is the ruling Communist Party’s global propaganda machine in action: Messages set by key state media outlets and the Ministry of Foreign Affairs get picked up by Chinese diplomats around the world, who repackage the content on Twitter, where it is amplified by networks of fake and suspicious accounts working covertly to shape public discourse for the benefit of China’s ruling Communist Party.

Gyagyagya10, who had a single follower, was part of a network of 62 accounts dedicated to amplifying Chinese diplomats in the U.K. that Marcel Schliebs, the Oxford Internet Institute's lead researcher on the project, found exhibited multiple patterns suggesting coordination and inauthenticity.

Little can be gleaned about gyagyagya10 from the image of abstract art posted as a profile photo and the lack of any sort of personal description. Indeed, none of the accounts in the network had fleshed-out profiles with recognizable names and authentic profile photos.

Gyagyagya10’s account came to life in mid-August at the same time as more than a dozen other accounts that also devoted themselves exclusively to promoting tweets by the Chinese Embassy in London and Ambassador Liu. Then, after Liu left his post at the end of Jan., they went quiet.

The 62 accounts in the network retweeted and replied to posts by Chinese diplomats in London nearly 30,000 times between June and the end of January, the Oxford Internet Institute found. They exhibited unique patterns in the ways they amplified content.

Like gyagyagya10, they often simultaneously posted identical quote-tweets and replies, and they repeatedly used identical phrases like “Xinjiang is beautiful” and “shared future for mankind” in their comments. Other users who engaged with the two diplomatic accounts did neither.

They were also slavish in their devotion, sometimes replying to more than three-quarters of all the ambassador’s tweets. Most weeks, the fake accounts generated at least 30 to 50% of all retweets of Ambassador Liu and the Chinese Embassy in London.

By Mar. 1, Twitter had suspended 31 of the accounts in the pro-China U.K. network and two had been deleted. The remaining 29 — including gyagyagya10 — continued to operate, churning out more than 10,000 retweets and nearly 6,000 replies in support of China’s U.K. diplomats before Twitter permanently suspended them for platform manipulation at the end of April and beginning of May in response to this investigation.

“We are also aware of concerns about some of the Twitter rules,” China’s Embassy in the U.K. said in a statement to AP. “If it is against the rules of social media to retweet the Chinese Embassy’s tweets, then shouldn’t these rules be more applicable to retweets of malicious rumors, smears, and false information against China? We hope relevant companies will not adopt double standards.”

China’s Ministry of Foreign Affairs says China uses social media the same way other nations do, with the goal of deepening friendly ties and facilitating fact-based communication.

In practice, China’s network on Twitter amplifies messaging set by central authorities, both for domestic and global consumption, as diplomats translate, repackage and amplify content from the Ministry of Foreign Affairs and key state media outlets, network analysis and academic research show.

Zhao Alexandre Huang, a visiting assistant professor at Gustave Eiffel University, in Paris, analyzed social media messaging at key points in the U.S.-China trade dispute and found that content first published on the Weibo account of China’s Ministry of Foreign Affairs was repackaged and broadcast around the world by Chinese diplomats on Twitter.

“The Ministry of Foreign Affairs uses Weibo like a central kitchen of information,” Huang said. “It’s an illusion of polyphony.”

Within China’s state network on Twitter, the most referenced accounts belonged to China’s Ministry of Foreign Affairs and its spokespeople, as well as People’s Daily, CGTN, China Daily, and Xinhua, and the most active amplifiers were diplomats, AP network analysis showed.

The party’s efforts on Twitter have been helped by a core of hyperactive super-fans. Some 151,000 users retweeted posts by Chinese diplomats from June through January. But nearly half of all retweets came from just one percent of those accounts, which together blasted out nearly 360,000 retweets, often in bursts of activity separated by just seconds.

Among the biggest beneficiaries of this concentrated bulk engagement — which is not necessarily inauthentic — were Chinese diplomatic accounts in Poland, Pakistan, India, and South Africa, as well as China’s foreign ministry and its spokespeople.

The pro-China accounts that Twitter later suspended were active in a host of languages, with profile descriptions in English, Mandarin, Spanish, Arabic, Hindi, Italian, French, Russian, Korean, Urdu, Portuguese, Thai, Swedish, Japanese, Turkish, German and Tamil. Some worked cross-network to amplify a range of government accounts, while others appeared to function as smaller cells, dedicated to amplifying diplomats in a specific location.

This manufactured chorus accounted for a significant portion of all the engagement many Chinese diplomats got on Twitter. More than 60% of all retweets for the Chinese embassies in Angola and Greece from June 2020 through January 2021 came from accounts that have been suspended. China’s hawkish foreign ministry spokespeople Hua Chunying and Zhao Lijian racked up more than 20,000 retweets from accounts that have been sanctioned by Twitter.

INTERNET COMMENTING SYSTEMS

Within China, manipulation of online discourse has been effectively institutionalized. It remains to be seen how aggressive — and how successful — China will be in implementing its model of public opinion guidance on Western social media, which was founded on very different civic values, like transparency, authenticity, and the free exchange of ideas.

The party’s systems for shaping public opinion online go far beyond censorship. Budget documents for Chinese propaganda and cyberspace departments include references to cyber armies, teams of trained online commentators tasked with keeping conversation online aligned with the ruling party’s interests. Universities in China openly post announcements about their teams of “online commentators” and “youth internet civilization volunteers,” composed exclusively of recruits who “love the motherland” and work to guide public opinion by eliminating negative influences and spreading positive energy online.

The scale of the operation is immense. Ryan Fedasiuk, a research analyst at Georgetown University’s Center for Security and Emerging Technology, reviewed dozens of government budget documents, university announcements and media reports and found that last year, China's Communist Party had some 20 million part-time volunteers, many of them students, and 2 million paid commentators at its disposal to steer conversation online.

For-profit companies also contract with government agencies to run coordinated networks of social media accounts, both human and automated, to help “guide public opinion,” according to Mareike Ohlberg, a senior fellow at the German Marshall Fund’s Asia Program, and Jessica Batke, a senior editor at ChinaFile, an online magazine published by the Asia Society. They poured through thousands of Chinese government procurement notices to identify tenders for such services.

While the majority were for opinion management on domestic platforms, Ohlberg told AP that since 2017 a growing number have also targeted Twitter, Facebook and YouTube. One public security bureau in a relatively small city in northeastern China, for example, wanted to buy a “smart Internet-commenting system,” capable of commenting on Twitter, Facebook and YouTube from thousands of different accounts and IP addresses.

“This is just a natural extension of what the party has been doing at home for a very long time,” Ohlberg said. “Why would they change that model once they go abroad?

China’s advance on Western social media is one part of a much broader infrastructure of influence that has shaped how Hollywood makes movies, what Western publishers print and what overseas Chinese-language media outlets communicate to China’s vast diaspora.

Anne-Marie Brady, a professor at the University of Canterbury in New Zealand and an expert in Chinese propaganda, said people may not even realize that information they receive has been, in part, framed by China's ruling Communist Party.

“The propaganda system is vast, and it has incorporated Western social media," she said. "It has helped to reshape perceptions of China. It may not uniquely create a positive image of China, but it creates hopelessness that anything can be done about what China is doing to our democracies.”

____

Associated Press researcher Chen Si in Shanghai contributed to this report.

____

Follow Associated Press reporter Erika Kinetz on Twitter at http://twitter.com/ekinetz

____

Contact AP’s global investigative team at Investigative@ap.org or https://www.ap.org/tips/