Many Different Choices . ·Longformer https://arxiv.org/abs/2004.05150 (b)Sliding window attention (c)Dilated sliding window (d)Global+sliding window 。Big Bird https://arxiv.org/abs/2007.14062 (a)Random attention (b)Window attention (c)Global Attention (d)BIGBIRD Many Different Choices … • Longformer • Big Bird https://arxiv.org/abs/2004.05150 https://arxiv.org/abs/2007.14062