Model-agnostic Body Part Relevance Assessment for Pedestrian Detection Model Benchmarking

Model-agnostic explanation methods for deep learning models are flexible regarding usability and availability. However, due to the fact that they can only manipulate input to see changes in output, they suffer from weak performance when used with complex model architectures. For models with large inputs as, for instance, in object detection, sampling-based methods like {KernelSHAP} are inefficient due to many computation-heavy forward passes through the model. In this work, we present a framework for using sampling-based explanation methods in a computer vision context shown for body part relevance assessment for pedestrian detection. Furthermore, we introduce a novel sampling-based method similar to {KernelSHAP} that shows more robustness for lower sampling sizes and, thus, is more efficient for explainability analyses on large-scale datasets. We demonstrate our relevance assessment method on simulation data acquired with the {CARLA} simulator. In the end, our method enables the benchmarking and performance comparison of various pedestrian detection models based on human-interpretable semantic regions.

Citation information

Günder, Maurice; Banerjee, Sneha; Sifa, Rafet; Bauckhage, Christian: Model-agnostic Body Part Relevance Assessment for Pedestrian Detection Model Benchmarking, 2024 {IEEE} International Conference on Big Data ({BigData}), 2024, 3664--3673, December, https://ieeexplore.ieee.org/abstract/document/10825259, Guender.etal.2024a,

Associated Lamarr Researchers

Prof. Dr. Rafet Sifa

Prof. Dr. Rafet Sifa

Principal Investigator Hybrid ML to the profile
Kopie von LAMARR Person 500x500 1 - Lamarr Institute for Machine Learning (ML) and Artificial Intelligence (AI)

Prof. Dr. Christian Bauckhage

Director to the profile