HIVTP: A Training-Free Method to Improve VLMs Efficiency via Hierarchical Visual Token Pruning Using Middle-Layer-Based Importance Score
arXiv preprint
HIVTP uses middle-layer attention to score visual tokens and a hierarchical selection strategy to preserve both global context and locally important details without model fine-tuning.
* Equal contribution.