  The detection of state-sponsored trolls operating in influence campaigns on
social media is a critical and unsolved challenge for the research community,
which has significant implications beyond the online realm. To address this
challenge, we propose a new AI-based solution that identifies troll accounts
solely through behavioral cues associated with their sequences of sharing
activity, encompassing both their actions and the feedback they receive from
others. Our approach does not incorporate any textual content shared and
consists of two steps: First, we leverage an LSTM-based classifier to determine
whether account sequences belong to a state-sponsored troll or an organic,
legitimate user. Second, we employ the classified sequences to calculate a
metric named the "Troll Score", quantifying the degree to which an account
exhibits troll-like behavior. To assess the effectiveness of our method, we
examine its performance in the context of the 2016 Russian interference
campaign during the U.S. Presidential election. Our experiments yield
compelling results, demonstrating that our approach can identify account
sequences with an AUC close to 99% and accurately differentiate between Russian
trolls and organic users with an AUC of 91%. Notably, our behavioral-based
approach holds a significant advantage in the ever-evolving landscape, where
textual and linguistic properties can be easily mimicked by Large Language
Models (LLMs): In contrast to existing language-based techniques, it relies on
more challenging-to-replicate behavioral cues, ensuring greater resilience in
identifying influence campaigns, especially given the potential increase in the
usage of LLMs for generating inauthentic content. Finally, we assessed the
generalizability of our solution to various entities driving different
information operations and found promising results that will guide future
research.
