image courtesy of GPT4/Dall-E-3, generated using the keywords "computer mouse with big ears and a microphone as a scroll whell"
Side-Channel Audio Attack through computer mice.
- Conda or Mamba
- A computer mouse with a high polling rate (4kHz < ), and a high DPI count (16,000 <).
The conda/mamba environment can be installed with the following command: conda env create -f environment.yml
- waveformReconstruction_AUDIOMNIST.ipynb: Waveform Reconstruction Experiments for AudioMNIST, including collecting the samples used in the user study
- waveformReconstruction.ipynb: Waveform Reconstruction Experiments for VCTK
- models/: Directory containing all models trained and made public
- fig/: Directory containing all figures and visuals used in the paper and this repo
- core/nn/: Methods used for Neural Networks, dataloaders, network primitives, and utilities
- core/signal/: Methods used for signal processing
- src/: Mouse_Logger and OpenBlok modified sources
- utils/: HTML test to check if browsers can record audio
- vctk/: utils used to automate dataset creation
Anonymous Data available HERE
https://drive.google.com/drive/folders/1DcTldouupfp7BMteE1Br0lq7RCdQQ0Hc?usp=drive_link