Skip to content
Commit f54e19d5 authored by Phil Wang's avatar Phil Wang
Browse files

introduce attn_dynamic_pos_bias for soundstream, which should have the best...

introduce attn_dynamic_pos_bias for soundstream, which should have the best length extrapolation properties for attention
parent d4680bed
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment