Peter Szemraj PRO

pszemraj

AI & ML interests

metallic intuition

Recent Activity

liked a Space about 19 hours ago
multimodalart/flux-fill-outpaint
liked a dataset 1 day ago
abisee/cnn_dailymail
liked a dataset 1 day ago
HuggingFaceTB/finemath
View all activity

Organizations

Stacked Summaries's profile picture Analytics Club at ETH Zürich's profile picture ml4pubmed's profile picture Gradio-Blocks-Party's profile picture OneFrame's profile picture postbot's profile picture Ontocord's M*DEL's profile picture BEEspoke Data's profile picture Sablo AI's profile picture memecaps's profile picture Hugging Face Discord Community's profile picture

pszemraj's activity

reacted to MoritzLaurer's post with 👍 4 days ago
view post
Post
2248
Quite excited by the ModernBERT release! 0.15/0.4B small, 2T modern pre-training data and tokenizer with code, 8k context window, great efficient model for embeddings & classification!

This will probably be the basis for many future SOTA encoders! And I can finally stop using DeBERTav3 from 2021 :D

Congrats @answerdotai , @LightOnIO and collaborators like @tomaarsen !

Paper and models here 👇https://huggingface.co./collections/answerdotai/modernbert-67627ad707a4acbf33c41deb