answerdotai/ModernBERT-base

#56 opened 3 days ago by

benhachem

Import fails on AWS lamba instance.

#55 opened 4 days ago by

obeijbom

Performance vs the original architecture on approximate original data sizes (BooksCorpus/Wikipedia)

#54 opened 11 days ago by

tollefj

Problem with highly padded sequences

#49 opened 17 days ago by

fmrs

Speed Benchmarks with MPS Backend

#47 opened 17 days ago by

mlburnham

Continual pre-training for multilingual support (extend embedding matrix and tokenizer)

#46 opened 18 days ago by

ibotana

Encountering Error: cannot import name 'shard_checkpoint' from 'transformers.modeling_utils'

#44 opened 19 days ago by

rkabir

ModernBertModel works on the CPU but fails on the GPU

#43 opened 20 days ago by

rudigung

ModernBERT-base-chinese

#42 opened 20 days ago by

ZBW

Error: RuntimeError: Failed to import transformers.models.modernbert.modeling_modernbert because of the following error (look up to see its traceback): Windows not yet supported for torch.compile

#40 opened 25 days ago by

JoAmps42i

ModernBART wen?

6

#38 opened 25 days ago by

Fizzarolli

Pretraining Using HF Tokenizers and Transformers

#36 opened 28 days ago by

akhooli

Update README.md

#35 opened 28 days ago by

solankibhargav

Unpadding and Sequence Packing inference example?

#34 opened 29 days ago by

denti

Interview Request: Thoughts on Model Documentation

#33 opened 29 days ago by

evatang

Training Data?

#32 opened about 1 month ago by

binarymax

What is the position of this model in MTEB leaderboard?

#31 opened about 1 month ago by

deepak-banka

tokenizer

#24 opened about 1 month ago by

ulasarikaya

RuntimeError: Failed to import transformers.models.modernbert.modeling_modernbert

#21 opened about 1 month ago by

SantoshHF

Pretraining data cutoff?

#17 opened about 1 month ago by

ytsaig

How to use ModernBERT with the AutoModelForQuestionAnswering class?

#15 opened about 1 month ago by

sraj

Is ModernBERT already fine-tuned for IR tasks?

#13 opened about 1 month ago by

belerico

Question about output embedding vector of ModernBERT

#12 opened about 1 month ago by

Youm9602

ModernBert for multi-vector embeddings

#11 opened about 1 month ago by

admarcosai

How to use ModernBERT as a sentence transformer?

30

#9 opened about 1 month ago by

hungrybiker

multilingual

#8 opened about 1 month ago by

ale-volpe

Is this model meant for full bfloat16, AMP bfloat16 or no bfloat16?

#7 opened about 1 month ago by

umarbutler

# Fine-tuning ModernBERT on a Large Dataset with Masked Language Modelling

#6 opened about 1 month ago by

ssmits

Precisions about the config properties wrt the paper