Inference Endpoint not working
Hi,
when I try to create a inference endpoint based on this model then I get this error:
[Server message]Endpoint failed to start
See details
(most recent call last):
File "/usr/local/lib/python3.10/dist-packages/starlette/routing.py", line 732, in lifespan
async with self.lifespan_context(app) as maybe_state:
File "/usr/local/lib/python3.10/dist-packages/starlette/routing.py", line 608, in aenter
await self.router.startup()
File "/usr/local/lib/python3.10/dist-packages/starlette/routing.py", line 709, in startup
await handler()
File "/app/webservice_starlette.py", line 60, in some_startup_task
inference_handler = get_inference_handler_either_custom_or_default_handler(HF_MODEL_DIR, task=HF_TASK)
File "/app/huggingface_inference_toolkit/handler.py", line 54, in get_inference_handler_either_custom_or_default_handler
return HuggingFaceHandler(model_dir=model_dir, task=task)
File "/app/huggingface_inference_toolkit/handler.py", line 18, in init
self.pipeline = get_pipeline(
File "/app/huggingface_inference_toolkit/utils.py", line 276, in get_pipeline
hf******** = pipeline(
File "/usr/local/lib/python3.10/dist-packages/transformers/pipelines/init.py", line 782, in pipeline
config = AutoConfig.from_pretrained(
File "/usr/local/lib/python3.10/dist-packages/transformers/models/auto/configuration_auto.py", line 1082, in from_pretrained
config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/transformers/configuration_utils.py", line 644, in get_config_dict
config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/transformers/configuration_utils.py", line 699, in _get_config_dict
resolved_config_file = cached_file(
File "/usr/local/lib/python3.10/dist-packages/transformers/utils/hub.py", line 360, in cached_file
raise EnvironmentError(
OSError: /repository does not appear to have a file named config.json. Checkout 'https://huggingface.co.//repository/None' for available files.
Application startup failed. Exiting.
How can we solve this?