How to manually check if one position or row has correct masking?

[Leo-T-Zang]

Hi,

I wonder if we can manually verify attention mask patterns during testing. While I can visualize masks by printing them as strings, I'm looking to add proper test assertions.

• How to assert if a specific position (i,j) has the correct True/False value
• How to verify an entire row matches expected masking pattern

Current approach:

• Can print mask as string for visual inspection

Would appreciate examples of how to properly test these mask values.

[drisspg]

attention-gym/attn_gym/utils.py

Line 24 in 36f8bd5

def create_score_mod(

This function makes use of some private functions, and we dont provide BC guarantees on this but this should allow you to extract out the (potentially large) attn-scores matrix

[Leo-T-Zang]

Thanks @drisspg!

Will try!