Stefan Schweter's picture

Stefan Schweter PRO

stefan-it

·

AI & ML interests

Flair Library 💕, NER & PoS Tagging, LM Pretraining (mostly encoder-only & encoder-decoder), Historical Language Models

Recent Activity

liked a model about 7 hours ago

chandar-lab/NeoBERT

commented on a paper about 7 hours ago

NeoBERT: A Next-Generation BERT

posted an update about 17 hours ago

After running some 3DMark and FurMark benchmarks on Windows to make sure that my new 5090 is not causing melting cables [1] and some nice shots with a thermal camera (I don't think that's too much), running some fine-tuning experiments with my favorite Flair & Transformers libraries are very easy to perform. Important steps: Good idea is to start with a fresh Ubuntu 24.04 installation with latest CUDA 12.8 and the open NVIDIA driver - follow more advices from [2]: ```bash sudo apt -y install cuda-toolkit-12-8 nvidia-open ``` I tried update from an existing Ubuntu installation with an older CUDA and driver version and it resulted in a non-startable system. If you are using PyTorch 2.6 with built CUDA 12.6 it will result in: ```bash NVIDIA Graphics Device with CUDA capability sm_120 is not compatible with the current PyTorch installation. The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90. ``` But no worries! For PyTorch you need just to use a nightly 2.7 version that was built with CUDA 12.8. This can easily done via: ```bash pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu128 ``` After that the latest Flair version can be installed and fine-tuning will work! References: [1]: https://www.reddit.com/r/nvidia/comments/1inpox7/rtx_50_series_12vhpwr_megathread/ [2]: https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network

View all activity

Organizations

stefan-it's activity

commented a paper about 7 hours ago

NeoBERT: A Next-Generation BERT

Paper • 2502.19587 • Published 2 days ago • 8 •

New activity in dbmdz/bert-base-swedish-europeana-cased 2 days ago

fix language tag metadata

#2 opened 2 days ago by

New activity in dbmdz/electra-base-italian-mc4-cased-discriminator 3 days ago

Adding `safetensors` variant of this model

#1 opened 3 days ago by

New activity in stefan-it/it5-efficient-small-el32 4 days ago

Adding `safetensors` variant of this model

#1 opened 4 days ago by

New activity in GermanT5/t5-efficient-gc4-german-base-nl36-old 4 days ago

Adding `safetensors` variant of this model

#1 opened 5 days ago by

New activity in dbmdz/electra-base-french-europeana-cased-discriminator 4 days ago

Adding `safetensors` variant of this model

#1 opened 5 days ago by

New activity in bigscience-historical-texts/bert-base-blbooks-cased 7 days ago

Adding `safetensors` variant of this model

#1 opened 8 days ago by

New activity in dbmdz/electra-base-turkish-cased-v0-discriminator 9 days ago

Adding `safetensors` variant of this model

#1 opened 9 days ago by

New activity in dbmdz/electra-base-turkish-mc4-uncased-generator 11 days ago

Adding `safetensors` variant of this model

#1 opened 11 days ago by

New activity in dbmdz/bert-base-swedish-europeana-cased 12 days ago

Adding `safetensors` variant of this model

#1 opened 13 days ago by

commented a paper 18 days ago

NER4all or Context is All You Need: Using LLMs for low-effort, high-performance NER on historical texts. A humanities informed approach

Paper • 2502.04351 • Published 24 days ago • 1 •

New activity in gerturax/gerturax-3 21 days ago

Adding `safetensors` variant of this model

#1 opened 21 days ago by

New activity in gerturax/gerturax-2 21 days ago

Adding `safetensors` variant of this model

#1 opened 21 days ago by

New activity in gerturax/gerturax-1 21 days ago

Adding `safetensors` variant of this model

#1 opened 21 days ago by

New activity in Rijgersberg/GEITje-7B 21 days ago

❤️❤️

#2 opened 21 days ago by

New activity in dbmdz/bert-base-german-uncased 24 days ago

Request: DOI

#4 opened 24 days ago by

New activity in dbmdz/bert-base-german-cased 24 days ago

Request: DOI

#4 opened 30 days ago by

New activity in hmteams/teams-base-historic-multilingual-generator 25 days ago

Adding `safetensors` variant of this model

#2 opened 26 days ago by

New activity in hmteams/teams-base-historic-multilingual-discriminator 25 days ago

Adding `safetensors` variant of this model

#1 opened 26 days ago by

commented a paper about 1 month ago

Hierarchical Autoregressive Transformers: Combining Byte-~and Word-Level Processing for Robust, Adaptable Language Models

Paper • 2501.10322 • Published Jan 17 • 1 •