Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models
Paper
•
2501.13629
•
Published
•
40
Martial Hue
mhue
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
10 days ago
Sigma: Differential Rescaling of Query, Key and Value for Efficient
Language Models
upvoted
a
paper
6 months ago
OpenDevin: An Open Platform for AI Software Developers as Generalist
Agents
updated
a Space
6 months ago
mhue/demo-app
Organizations
mhue's activity
upvoted
a
paper
10 days ago
upvoted
a
paper
6 months ago
updated
a
Space
6 months ago
upvoted
an
article
7 months ago
Article
Deprecation of Git Authentication using password
•
22
liked
a
Space
8 months ago
updated
a
collection
11 months ago
liked
a
Space
12 months ago
liked
a
Space
about 1 year ago
upvoted
a
paper
about 1 year ago
liked
a
Space
about 1 year ago