Zoran's picture

27

Zoran

zokica

·

AI & ML interests

None yet

Organizations

None yet

zokica's activity

New activity in google/gemma-2-9b 6 months ago

Gemma 2's Flash attention 2 implementation is strange...

#23 opened 7 months ago by

New activity in google/gemma-2-2b 6 months ago

Problem with Lora finetuning, Out of memory

#13 opened 6 months ago by

New activity in unsloth/gemma-2-2b-bnb-4bit 6 months ago

OOM when finetuning with lora.

#1 opened 6 months ago by

New activity in unsloth/gemma-2-9b-bnb-4bit 6 months ago

Peft out of memory

#2 opened 6 months ago by

New activity in google/gemma-2-9b 7 months ago

Model repeating information and "spitting out" random characters

#14 opened 7 months ago by

Gemma2FlashAttention2 missing sliding_window variable

#8 opened 7 months ago by

New activity in upstage/SOLAR-10.7B-Instruct-v1.0 7 months ago

Why batch size>1 does not increase model speed

#41 opened 7 months ago by

New activity in EleutherAI/pile-t5-large 7 months ago

why UMT5

#1 opened 10 months ago by

New activity in microsoft/phi-1_5 9 months ago

Something broken on last update

#85 opened 10 months ago by

New activity in rhysjones/phi-2-orange 10 months ago

Can't get it to generate the EOS token and beam search is not supported

#3 opened about 1 year ago by

New activity in microsoft/phi-2 10 months ago

How to fine-tune this? + Training code

#19 opened about 1 year ago by

New activity in rhysjones/phi-2-orange-v2 10 months ago

Added token

#5 opened 10 months ago by

New activity in microsoft/phi-2 10 months ago

Generation after finetuning does not ends at EOS token

#123 opened 10 months ago by

New activity in microsoft/phi-1_5 over 1 year ago

Attention mask for generation function in the future?

#7 opened over 1 year ago by

New activity in mosaicml/mpt-30b-chat over 1 year ago

The model is extremelly slow in 4bit, is my code for loading ok?

#7 opened over 1 year ago by

New activity in TheBloke/guanaco-33B-GPTQ over 1 year ago

guanaco-65b

#1 opened over 1 year ago by

New activity in mosaicml/mpt-7b over 1 year ago

Speed on CPU

#8 opened over 1 year ago by

Will you make a 3B model as well?

#7 opened over 1 year ago by

New activity in Sosaka/Alpaca-native-4bit-ggml almost 2 years ago

How do you run this?

#2 opened almost 2 years ago by

New activity in openai-community/roberta-base-openai-detector almost 2 years ago

How to run this?

#13 opened almost 2 years ago by