4 contributors

History: 11 commits

SFconvertbot

Adding `safetensors` variant of this model

d7efed6 verified 12 days ago

configs
Model at 210k steps, mlm acc 0.6509 over 3 years ago
mc4
Model at 210k steps, mlm acc 0.6509 over 3 years ago
outputs
Updating logs over 3 years ago
.gitattributes

929 Bytes

Adding `safetensors` variant of this model 12 days ago
.gitignore

39 Bytes

Updating logs over 3 years ago
README.md

1.22 kB

Automatic correction of README.md metadata. Contact [email protected] for any question over 3 years ago
config.json

618 Bytes

Model at 210k steps, mlm acc 0.6509 over 3 years ago
convert.py

876 Bytes

Model at 210k steps, mlm acc 0.6509 over 3 years ago
flax_model.msgpack

250 MB
LFS

Step... (230001/250000 | Loss: 1.7595738172531128, Acc: 0.6519749760627747): 92%|███████████████████▎ | 230248/250000 [111:01:26<10:03:20, 1.83s/it] over 3 years ago
mc4-es-train-50M-random-stats.csv.tar.gz

551 MB
LFS

Adding dataset stats over 3 years ago
merges.txt

514 kB

Model at 210k steps, mlm acc 0.6509 over 3 years ago
model.safetensors

499 MB
LFS

Adding `safetensors` variant of this model 12 days ago
pytorch_model.bin
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.LongStorage",
- "torch.FloatStorage",
- "collections.OrderedDict"
What is a pickle import?
499 MB
LFS

Step... (230001/250000 | Loss: 1.7595738172531128, Acc: 0.6519749760627747): 92%|███████████████████▎ | 230248/250000 [111:01:26<10:03:20, 1.83s/it] over 3 years ago
run_mlm_flax_stream.py

30.8 kB

Model at 210k steps, mlm acc 0.6509 over 3 years ago
run_stream.log

40.1 MB
LFS

Updating logs over 3 years ago
run_stream.sh

930 Bytes

Model at 210k steps, mlm acc 0.6509 over 3 years ago
special_tokens_map.json

239 Bytes

Model at 210k steps, mlm acc 0.6509 over 3 years ago
tokenizer.json

1.47 MB

Model at 210k steps, mlm acc 0.6509 over 3 years ago
tokenizer_config.json

292 Bytes

Model at 210k steps, mlm acc 0.6509 over 3 years ago
vocab.json

855 kB

Model at 210k steps, mlm acc 0.6509 over 3 years ago

Detected Pickle imports (4)