code for Attention Dice Coefficient

[nguyentr17]

Hi, it was good talking to you at ICML. Can you point me to the code to compute Attention Dice Coefficient? Also, how can you get the ground truth for each patch?

[Woohye0n]

Hi,

It was a pleasure speaking with you at ICML.

Regarding your questions, please see the information below:

Attention Dice Coefficient Code: The code for generating the heatmaps, which are necessary to compute the attention dice coefficient, can be found at the following path in our repository:
SECOND/lmms-eval-vicuna/LLaVA-NeXT/llava/model/language_model/llava_recursion.py

Specifically, you'll want to look at the get_heatmap() function around line 350.

Ground Truth Data: For the analysis presented in Section 3 of the paper, we used the dataset and ground truth masks from the MSCOCO 2017 validation set.

I hope this helps. Please let me know if you have any further questions.

Best regards,