TikTok’s Potential Threat: Chinese Government Manipulation and Data Tracking Concerns
While talk of a possible U.S. ban of TikTok has been tempered of late, concerns still linger around the app, and the way that it could theoretically be used by the Chinese Government to implement varying forms of data tracking and messaging manipulation in Western regions. The latter was highlighted again this week, when Meta released its latest “Adversarial Threat Report,” which includes an overview of Meta’s latest detections, as well as a broader summary of its efforts throughout the year.
Meta says that this group aimed to sway discussion around both U.S. and China policy by both sharing news stories, and engaging with posts related to specific issues. Google, too, has repeatedly removed large clusters of YouTube accounts of Chinese origin that had been seeking to build audiences in the app, in order to then seed pro-China sentiment.
So these groups, whether they’re associated with the CCP or not, are already looking to infiltrate Western-based networks. Which underlines the potential threat of TikTok in the same respect, given that it’s controlled by a Chinese owner, and therefore likely more directly accessible to these operators.
That’s partly why TikTok is already banned on government-owned devices in most regions, and why cybersecurity experts continue to sound the alarm about the app, because if the above figures reflect the level of activity that non-Chinese platforms are already seeing, you can only imagine that, as TikTok’s influence grows, it too will be high on the list of distribution for the same material.
And we don’t have the same level of transparency into TikTok’s enforcement efforts, nor do we have a clear understanding of parent company ByteDance’s links to the CCP. Which is why the threat of a possible TikTok ban remains, and will linger for some time yet, and could still spill over if there’s a shift in U.S./China relations.
One other point of note from Meta’s Adversarial Threat Report is its summary of AI usage for such activity, and how it’s changing over time. X owner Elon Musk has repeatedly pointed to the rise of generative AI as a key vector for increased bot activity, because spammers will be able to create more complex, harder to detect bot accounts through such tools. That’s why X is pushing towards payment models as a means to counter bot profile mass production. And while Meta does agree that AI tools will enable threat actors to create larger volumes of convincing content, it also says that it hasn’t seen evidence “that it will upend our industry’s efforts to counter covert influence operations” at this stage.
Meta also makes this interesting point: “For sophisticated threat actors, content generation hasn’t been a primary challenge. They rather struggle with building and engaging authentic audiences they seek to influence. This is why we have focused on identifying adversarial behaviors and tactics used to drive engagement among real people. Disrupting these behaviors early helps to ensure that misleading AI content does not play a role in covert influence operations. Generative AI is also unlikely to change this dynamic.”
So it’s not just content that they need, but interesting, engaging material, and because generative AI is based on everything that’s come before, it’s not necessarily built to establish new trends, which would then help these bot accounts build an audience.
These are some interesting notes on the current threat landscape, and how coordinated groups are still looking to use digital platforms to spread their messaging. Which will likely never stop, but it is worth noting where these groups originate from, and what that means for related discussion.
You can read Meta’s Q3 “Adversarial Threat Report” here.