Upload folder using huggingface_hub

README.md

@@ -0,0 +1,87 @@
+---
+license: llama3.2
+language:
+- en
+base_model: meta-llama/Llama-3.2-1B
+pipeline_tag: text-classification
+library_name: peft
+tags:
+- regression
+- story-point-estimation
+- software-engineering
+datasets:
+- mulestudio
+metrics:
+- mae
+- mdae
+model-index:
+- name: llama-3.2-1b-story-point-estimation
+  results:
+  - task:
+      type: regression
+      name: Story Point Estimation
+    dataset:
+      name: mulestudio Dataset
+      type: mulestudio
+      split: test
+    metrics:
+    - type: mae
+      value: 3.877
+      name: Mean Absolute Error (MAE)
+    - type: mdae
+      value: 2.781
+      name: Median Absolute Error (MdAE)
+---
+# LLAMA 3 Story Point Estimator - mulestudio
+
+This model is fine-tuned on issue descriptions from mulestudio and tested on mulestudio for story point estimation.
+
+## Model Details
+- Base Model: LLAMA 3.2 1B
+- Training Project: mulestudio
+- Test Project: mulestudio
+- Task: Story Point Estimation (Regression)
+- Architecture: PEFT (LoRA)
+- Tokenizer: SP SentencePiece
+
+- Input: Issue titles
+- Output: Story point estimation (continuous value)
+
+## Usage
+```python
+from transformers import AutoModelForSequenceClassification, XLNetTokenizer
+from peft import PeftConfig, PeftModel
+
+# Load peft config model
+config = PeftConfig.from_pretrained("DEVCamiloSepulveda/7-LLAMA3SP-mulestudio")
+
+# Load tokenizer and model
+tokenizer = XLNetTokenizer('spm_tokenizer.model', padding_side='right')
+base_model = AutoModelForSequenceClassification.from_pretrained(
+    config.base_model_name_or_path,
+    num_labels=1,
+    torch_dtype=torch.float16,
+    device_map='auto'
+)
+model = PeftModel.from_pretrained(base_model, "DEVCamiloSepulveda/7-LLAMA3SP-mulestudio")
+
+# Prepare input text
+text = "Your issue description here"
+inputs = tokenizer(text, return_tensors="pt", truncation=True, max_length=20, padding="max_length")
+
+# Get prediction
+outputs = model(**inputs)
+story_points = outputs.logits.item()
+```
+
+## Training Details
+- Fine-tuning method: LoRA (Low-Rank Adaptation)
+- Sequence length: 20 tokens
+- Best training epoch: 0 / 20 epochs
+- Batch size: 32
+- Training time: 15.513 seconds
+- Mean Absolute Error (MAE): 3.877
+- Median Absolute Error (MdAE): 2.781
+### Framework versions
+
+- PEFT 0.14.0

adapter_config.json

@@ -0,0 +1,37 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "meta-llama/Llama-3.2-1B",
+  "bias": "none",
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": [
+    "classifier",
+    "score"
+  ],
+  "peft_type": "LORA",
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "v_proj",
+    "k_proj",
+    "q_proj",
+    "o_proj"
+  ],
+  "task_type": "SEQ_CLS",
+  "use_dora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0d3274ed40bb190c27e2b791e634b5d6f87df914c8991620b347becf7be4c1bb
+size 6840816

pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b3a4bb17f63f08b5d181796bfd9177ccaac773b14f55eb7a8d067c0d26dc488
+size 1560270490

spm_tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:01efe174cfad718fe7365005a35085426f618e57a1a1a5a92d36465f448087d6
+size 917083