Security News > 2020 > November > Determining What Video Conference Participants Are Typing from Watching Shoulder Movements

Determining What Video Conference Participants Are Typing from Watching Shoulder Movements
2020-11-04 16:28

Accuracy isn't great, but that it can be done at all is impressive.

Murtuza Jadiwala, a computer science professor heading the research project, said his team was able to identify the contents of texts by examining body movement of the participants.

In a controlled setting, with specific chairs, keyboards and webcam, Jadiwala said he achieved an accuracy rate of 75 percent.

In uncontrolled environments, accuracy dropped to only one out of every five words being correctly identified.

With long hair obstructing a clear view of the shoulders, accuracy plummeted.


News URL

https://www.schneier.com/blog/archives/2020/11/determining-what-video-conference-participants-are-typing-from-watching-shoulder-movements.html