keyi

keyishen's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in ai21labs/Jamba-v0.1 8 months ago

Can you give a short explanation about the benefits and the architecture?

2

#7 opened 8 months ago by SicariusSicariiStuff

commented a paper 8 months ago

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

Paper • 2402.19427 • Published Feb 29 • 52 •

5

New activity in NousResearch/Yarn-Mistral-7b-128k about 1 year ago

sliding_window = 131072? Sliding window attention doesn't work for 128?

1

#4 opened about 1 year ago by keyishen

sliding_window = 131072? Sliding window attention doesn't work for 128?

1

#4 opened about 1 year ago by keyishen