This paper introduces the first audio-visual dataset for traffic anomaly detection called MAVAD, taken from real-world scenes, with a diverse range of illumination conditions. In addition, a novel anomaly detection method is proposed which combines visual and audio features extracted from video sequences by means of cross-attention. We demonstrate that the addition of audio improves anomaly detection performance by up to 5.2%. Moreover, the impact of image anonymization is evaluated, showing only a minor decrease in performance averaging at 1.7%.
MAVAD: Audio-Visual Dataset and Method for Anomaly Detection in Traffic Videos
Luca Zanella;Yiming Wang;
2024-01-01
Abstract
This paper introduces the first audio-visual dataset for traffic anomaly detection called MAVAD, taken from real-world scenes, with a diverse range of illumination conditions. In addition, a novel anomaly detection method is proposed which combines visual and audio features extracted from video sequences by means of cross-attention. We demonstrate that the addition of audio improves anomaly detection performance by up to 5.2%. Moreover, the impact of image anonymization is evaluated, showing only a minor decrease in performance averaging at 1.7%.File in questo prodotto:
Non ci sono file associati a questo prodotto.
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
