Skip to content
Commit af903342 authored by Phil Wang's avatar Phil Wang
Browse files

create specially engineered relative positional bias for fine transformer, so...

create specially engineered relative positional bias for fine transformer, so coarse and fine sequences learn to attend to each other at relative distances apart
parent 7a35a8bc
Loading
Loading
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment