  In this paper, we present an acoustic side channel attack which makes use of
smartphone microphones recording a robot in operation to exploit acoustic
properties of the sound to fingerprint a robot's movements. In this work we
consider the possibility of an insider adversary who is within physical
proximity of a robotic system (such as a technician or robot operator),
equipped with only their smartphone microphone. Through the acoustic
side-channel, we demonstrate that it is indeed possible to fingerprint not only
individual robot movements within 3D space, but also patterns of movements
which could lead to inferring the purpose of the movements (i.e. surgical
procedures which a surgical robot is undertaking) and hence, resulting in
potential privacy violations. Upon evaluation, we find that individual robot
movements can be fingerprinted with around 75% accuracy, decreasing slightly
with more fine-grained movement meta-data such as distance and speed.
Furthermore, workflows could be reconstructed with around 62% accuracy as a
whole, with more complex movements such as pick-and-place or packing
reconstructed with near perfect accuracy. As well as this, in some environments
such as surgical settings, audio may be recorded and transmitted over VoIP,
such as for education/teaching purposes or in remote telemedicine. The question
here is, can the same attack be successful even when VoIP communication is
employed, and how does packet loss impact the captured audio and the success of
the attack? Using the same characteristics of acoustic sound for plain audio
captured by the smartphone, the attack was 90% accurate in fingerprinting VoIP
samples on average, 15% higher than the baseline without the VoIP codec
employed. This opens up new research questions regarding anonymous
communications to protect robotic systems from acoustic side channel attacks
via VoIP communication networks.
