Create README.md

README.md

@@ -0,0 +1,19 @@
+---
+thumbnail: "https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true"
+tags:
+- kaggle
+license: "CC0-1.0 License"
+datasets:
+- Commonlit-Readibility
+---
+![](https://github.com/SauravMaheshkar/CommonLit-Readibility/blob/main/assets/CommonLit%20-%20Big%20Banner.png?raw=true)
+# PreTraining 
+|       **Architecture**      |     **Weights**     | **Training Loss** | **Validation Loss** |
+|:-----------------------:|:---------------:|:----------------:|:----------------------:|
+|       roberta-base      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-roberta-base) |      **0.641**      |          **0.4728**         |
+|    bert-base-uncased    | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-bert-base-uncased) |      0.6781     |          0.4977         |
+|      albert-base      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-albert-base) |       0.7119      |          0.5155         |
+|       xlm-roberta-base       | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-xlm-roberta-base) |      0.7225      |          0.525          |
+|      bert-large-uncased      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-bert-large-uncased) |      0.7482      |         0.5161         |
+|       albert-large      | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-albert-large) |      1.075      |          0.9921         |
+| roberta-large | [huggingface/hub](https://huggingface.co/SauravMaheshkar/clr-finetuned-roberta-large) |       2.749      |          1.075         |