runtime error

�███████▌| 587M/613M [00:05<00:00, 103MB/s] Downloading pytorch_model.bin: 97%|█████████▋| 598M/613M [00:05<00:00, 102MB/s] Downloading pytorch_model.bin: 99%|█████████▉| 608M/613M [00:05<00:00, 88.6MB/s] Downloading pytorch_model.bin: 100%|██████████| 613M/613M [00:05<00:00, 103MB/s] Traceback (most recent call last): File "app.py", line 4, in <module> from demo import query_image File "/home/user/app/demo.py", line 77, in <module> owlvit_model = OwlViTForObjectDetection.from_pretrained("google/owlvit-base-patch32").to(device) File "/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/transformers/modeling_utils.py", line 1896, in to return super().to(*args, **kwargs) File "/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1145, in to return self._apply(convert) File "/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/torch/nn/modules/module.py", line 797, in _apply module._apply(fn) File "/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/torch/nn/modules/module.py", line 797, in _apply module._apply(fn) File "/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/torch/nn/modules/module.py", line 797, in _apply module._apply(fn) [Previous line repeated 1 more time] File "/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/torch/nn/modules/module.py", line 820, in _apply param_applied = fn(param) File "/home/user/.pyenv/versions/3.8.9/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1143, in convert return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking) RuntimeError: CUDA error: invalid device ordinal CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.

Container logs: