SteelStorage
/

Aura-llama

Text Generation

NousResearch/Meta-Llama-3-8B-Instruct

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Steelskull commited on Apr 19

Commit

ea6fb91

•

1 Parent(s): 5d72e53

Update README.md

Files changed (1) hide show

README.md +4 -2

README.md CHANGED Viewed

@@ -43,9 +43,11 @@ license: apache-2.0
         <pre><code>
           slices:
             - sources:
-              - model: meta-llama/Meta-Llama-3-8B-Instruct layer_range: [0, 23]
             - sources:
-              - model: meta-llama/Meta-Llama-3-8B-Instruct layer_range: [7, 31]
           merge_method: passthrough
           dtype: bfloat16
         </code></pre>

         <pre><code>
           slices:
             - sources:
+              - model: meta-llama/Meta-Llama-3-8B-Instruct
+                layer_range: [0, 23]
             - sources:
+              - model: meta-llama/Meta-Llama-3-8B-Instruct
+                layer_range: [7, 31]
           merge_method: passthrough
           dtype: bfloat16
         </code></pre>