Update instruction with infinity

#23
by michaelfeil - opened
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -5466,6 +5466,16 @@ print(scores.tolist())
5466
  # [[91.92853546142578, 67.5802993774414], [70.38143157958984, 92.13307189941406]]
5467
  ```
5468
 
 
 
 
 
 
 
 
 
 
 
5469
  ## Supported Languages
5470
 
5471
  This model is initialized from [xlm-roberta-large](https://huggingface.co/xlm-roberta-large)
 
5466
  # [[91.92853546142578, 67.5802993774414], [70.38143157958984, 92.13307189941406]]
5467
  ```
5468
 
5469
+ ### Infinity
5470
+
5471
+ Usage with [Infinity](https://github.com/michaelfeil/infinity):
5472
+
5473
+ ```bash
5474
+ docker run --gpus all -v $PWD/data:/app/.cache -e HF_TOKEN=$HF_TOKEN -p "7997":"7997" \
5475
+ michaelf34/infinity:0.0.68 \
5476
+ v2 --model-id intfloat/multilingual-e5-large-instruct --revision "main" --dtype float16 --batch-size 32 -engine torch --port 7997
5477
+ ```
5478
+
5479
  ## Supported Languages
5480
 
5481
  This model is initialized from [xlm-roberta-large](https://huggingface.co/xlm-roberta-large)