impresso-project
/

ner-newsagency-bert-multilingual

Model card Files Files and versions Community

emanuelaboros commited on Oct 16, 2024

Commit

cd060c7

·

verified ·

1 Parent(s): 2b23ed9

Update newsagency_ner.py

Files changed (1) hide show

newsagency_ner.py +1 -1

newsagency_ner.py CHANGED Viewed

@@ -179,7 +179,7 @@ class NewsAgencyModelPipeline(Pipeline):
     def preprocess(self, text, **kwargs):
         tokenized_inputs = self.tokenizer(
-            text, padding="max_length", truncation=True, max_length=256
         )
         text_sentence = tokenize(text)

     def preprocess(self, text, **kwargs):
         tokenized_inputs = self.tokenizer(
+            text, padding="max_length", truncation=True, max_length=512
         )
         text_sentence = tokenize(text)