how to load the model with multiple GPUs

by Sven00 - opened Jul 4, 2023

Jul 4, 2023

•

edited Jul 4, 2023

I have not found a guidance on how to load the model and run inference with multiple GPUs. The instructions provided by mosaicML covers only a single GPU. Thank you

316usman

Aug 22, 2023

•

edited Aug 22, 2023

@Sven00 Can you please link those instructions (single gpu) here

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment