ScandEval: A Benchmark for Scandinavian Natural Language Processing
Paper
•
2304.00906
•
Published
•
4
Benchmarks for evaluating Danish Models.
Note Evaluated Scandinavian and Germanic models for natural language generation (NLG) and natural language understanding (NLU).
Note Evaluated for embeddings models, e.g. used for retrieval e.g. within retrieval augmented generation, classification such setfit models, clustering and more. It evaluated models on a representative set of tasks covering Danish, Swedish, and Norwegian (Nynorsk and Norwegian).