runtime error

Exit code: 1. Reason: ami/python/lib/python3.11/site-packages/transformers/modeling_utils.py", line 2793, in save_pretrained model_to_save = unwrap_model(self) ^^^^^^^^^^^^^^^^^^ File "/opt/bitnami/python/lib/python3.11/site-packages/transformers/modeling_utils.py", line 5599, in unwrap_model return extract_model_from_parallel(model, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/bitnami/python/lib/python3.11/site-packages/accelerate/utils/other.py", line 86, in extract_model_from_parallel from deepspeed import DeepSpeedEngine File "/opt/bitnami/python/lib/python3.11/site-packages/deepspeed/__init__.py", line 25, in <module> from . import ops File "/opt/bitnami/python/lib/python3.11/site-packages/deepspeed/ops/__init__.py", line 15, in <module> from ..git_version_info import compatible_ops as __compatible_ops__ File "/opt/bitnami/python/lib/python3.11/site-packages/deepspeed/git_version_info.py", line 29, in <module> op_compatible = builder.is_compatible() ^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/bitnami/python/lib/python3.11/site-packages/deepspeed/ops/op_builder/fp_quantizer.py", line 35, in is_compatible sys_cuda_major, _ = installed_cuda_version() ^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/bitnami/python/lib/python3.11/site-packages/deepspeed/ops/op_builder/builder.py", line 51, in installed_cuda_version raise MissingCUDAException("CUDA_HOME does not exist, unable to compile CUDA op(s)") deepspeed.ops.op_builder.builder.MissingCUDAException: CUDA_HOME does not exist, unable to compile CUDA op(s) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/user/app/prep.py", line 183, in <module> Space().stop(e) File "/home/user/app/util.py", line 16, in stop raise Conclusion(f"{type(message).__name__}: {message}") util.Conclusion: MissingCUDAException: CUDA_HOME does not exist, unable to compile CUDA op(s) Preprocessing failed. Exiting...

Container logs:

Fetching error logs...