Hugging Face's logo

AntoineD
/
camembert_ccnet_classification_tools_fr

Text Classification
Transformers
PyTorch
camembert
Generated from Trainer
Inference Endpoints
Model card Files Community
AntoineD commited on
Commit
a542f74
•
1 Parent(s): acb0d13

End of training

Browse files
Files changed (2) hide show
  1. README.md +80 -0
  2. pytorch_model.bin +1 -1
README.md ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: camembert/camembert-base-ccnet
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - accuracy
7
+ model-index:
8
+ - name: camembert_ccnet_classification_tools_fr
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # camembert_ccnet_classification_tools_fr
16
+
17
+ This model is a fine-tuned version of [camembert/camembert-base-ccnet](https://huggingface.co/camembert/camembert-base-ccnet) on the None dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 1.3899
20
+ - Accuracy: 0.7
21
+ - Learning Rate: 0.0001
22
+
23
+ ## Model description
24
+
25
+ More information needed
26
+
27
+ ## Intended uses & limitations
28
+
29
+ More information needed
30
+
31
+ ## Training and evaluation data
32
+
33
+ More information needed
34
+
35
+ ## Training procedure
36
+
37
+ ### Training hyperparameters
38
+
39
+ The following hyperparameters were used during training:
40
+ - learning_rate: 0.0001
41
+ - train_batch_size: 24
42
+ - eval_batch_size: 192
43
+ - seed: 42
44
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
+ - lr_scheduler_type: linear
46
+ - lr_scheduler_warmup_ratio: 0.01
47
+ - num_epochs: 60
48
+
49
+ ### Training results
50
+
51
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | Rate |
52
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
53
+ | No log | 1.0 | 5 | 2.0931 | 0.125 | 0.0001 |
54
+ | No log | 2.0 | 10 | 1.9035 | 0.325 | 0.0001 |
55
+ | No log | 3.0 | 15 | 1.7443 | 0.525 | 0.0001 |
56
+ | No log | 4.0 | 20 | 1.6035 | 0.575 | 0.0001 |
57
+ | No log | 5.0 | 25 | 1.4599 | 0.525 | 0.0001 |
58
+ | No log | 6.0 | 30 | 1.4177 | 0.575 | 0.0001 |
59
+ | No log | 7.0 | 35 | 1.2438 | 0.675 | 0.0001 |
60
+ | No log | 8.0 | 40 | 1.2116 | 0.65 | 0.0001 |
61
+ | No log | 9.0 | 45 | 1.2569 | 0.625 | 0.0001 |
62
+ | No log | 10.0 | 50 | 1.1010 | 0.7 | 0.0001 |
63
+ | No log | 11.0 | 55 | 1.0926 | 0.7 | 0.0001 |
64
+ | No log | 12.0 | 60 | 1.1022 | 0.725 | 0.0001 |
65
+ | No log | 13.0 | 65 | 1.1841 | 0.725 | 0.0001 |
66
+ | No log | 14.0 | 70 | 1.2344 | 0.725 | 0.0001 |
67
+ | No log | 15.0 | 75 | 1.3195 | 0.7 | 0.0001 |
68
+ | No log | 16.0 | 80 | 1.3959 | 0.7 | 0.0001 |
69
+ | No log | 17.0 | 85 | 1.3734 | 0.725 | 0.0001 |
70
+ | No log | 18.0 | 90 | 1.3948 | 0.725 | 0.0001 |
71
+ | No log | 19.0 | 95 | 1.4222 | 0.7 | 0.0001 |
72
+ | No log | 20.0 | 100 | 1.3899 | 0.7 | 0.0001 |
73
+
74
+
75
+ ### Framework versions
76
+
77
+ - Transformers 4.34.0
78
+ - Pytorch 2.0.1+cu117
79
+ - Datasets 2.14.5
80
+ - Tokenizers 0.14.1
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8f07258e8982a9d20a84f754aa8890fe7f591dc7ca9cec453aa7d7d404868d31
3
  size 442581361
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71d1b428302b20c3337044249bebdcc2ddbd734aa49a0b0b59a8b10a754aa5ac
3
  size 442581361