Bots Don't Sit Still: A Longitudinal Study of Bot Behaviour Change, Temporal Drift, and Feature-Structure Evolution

Explainable & Ethical AI
Published: arXiv: 2512.17067v1
Authors

Ohoud Alzahrani Russell Beale Bob Hendley

Abstract

Social bots are now deeply embedded in online platforms for promotion, persuasion, and manipulation. Most bot-detection systems still treat behavioural features as static, implicitly assuming bots behave stationarily over time. We test that assumption for promotional Twitter bots, analysing change in both individual behavioural signals and the relationships between them. Using 2,615 promotional bot accounts and 2.8M tweets, we build yearly time series for ten content-based meta-features. Augmented Dickey-Fuller and KPSS tests plus linear trends show all ten are non-stationary: nine increase over time, while language diversity declines slightly. Stratifying by activation generation and account age reveals systematic differences: second-generation bots are most active and link-heavy; short-lived bots show intense, repetitive activity with heavy hashtag/URL use; long-lived bots are less active but more linguistically diverse and use emojis more variably. We then analyse co-occurrence across generations using 18 interpretable binary features spanning actions, topic similarity, URLs, hashtags, sentiment, emojis, and media (153 pairs). Chi-square tests indicate almost all pairs are dependent. Spearman correlations shift in strength and sometimes polarity: many links (e.g. multiple hashtags with media; sentiment with URLs) strengthen, while others flip from weakly positive to weakly or moderately negative. Later generations show more structured combinations of cues. Taken together, these studies provide evidence that promotional social bots adapt over time at both the level of individual meta-features and the level of feature interdependencies, with direct implications for the design and evaluation of bot-detection systems trained on historical behavioural features.

Paper Summary

Problem
Social media platforms are facing a growing problem with automated accounts, or social bots, that are used to promote products, shape opinions, and manipulate public discourse. Most existing bot-detection systems assume that bots behave in a consistent and predictable way, but this study suggests that this assumption may not be valid.
Key Innovation
This research paper presents a longitudinal study of promotional bot behavior on Twitter, examining how their behavior changes over time. The study uses a dataset of 2,615 bot accounts and 2.8 million tweets collected between 2009 and 2020. The researchers found that bots exhibit non-stationary behavior, with significant changes in their behavior over time. They also identified systematic differences in behavior between older and newer bots, as well as between short-lived and long-lived bots.
Practical Impact
This research has important implications for the development of effective bot-detection systems. By recognizing that bots are dynamic and adaptable, researchers and policymakers can develop more sophisticated methods for identifying and mitigating their influence. This could help to reduce the spread of misinformation and promote a healthier online environment.
Analogy / Intuitive Explanation
Imagine a person who is trying to sell you a product. At first, they might be very enthusiastic and persuasive, but over time, they might become less active or change their tactics to try to reach you more effectively. This is similar to what the researchers found with the bots in this study. They started out behaving in a certain way, but over time, they adapted and changed their behavior to try to achieve their goals. This highlights the need to treat social bots as dynamic adversaries whose behavior changes over time.
Paper Information
Categories:
cs.HC cs.AI cs.SI
Published Date:

arXiv ID:

2512.17067v1

Quick Actions