Fatal Error
#14
by
seadude
- opened
Hello,
I'm completely new here, so bear with me.
I just spun up a DataBricks trial to test dolly out. I'm feeling like the free trial may be limited in the memory, etc and thats what caused this error?
Thoughts on this one?
Thank you
Fatal error: The Python kernel is unresponsive.
---------------------------------------------------------------------------
The Python process exited with exit code 137 (SIGKILL: Killed). This may have been caused by an OOM error. Check your command's memory usage.
The last 10 KB of the process's stderr and stdout can be found below. See driver logs for full logs.
---------------------------------------------------------------------------
Last messages on stderr:
Thu Apr 13 05:58:50 2023 Connection to spark from PID 1173
Thu Apr 13 05:58:50 2023 Initialized gateway on port 46403
Thu Apr 13 05:58:50 2023 Connected to spark.
---------------------------------------------------------------------------
Last messages on stdout:
NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work.
To exit, you will have to explicitly quit this process, by either sending
"quit" from a client, or using Ctrl-\ in UNIX-like environments.
To read more about this, see https://github.com/ipython/ipython/issues/2049
To connect another client to this kernel, use:
--existing /databricks/kernel-connections/X.json
Command took 4.03 minutes -- by at 4/12/2023, 10:58:56 PM on Cluster
The problem lies in the memory usage, as the model is quite large.
Sorry I'm not familiar with the details of what is available in the free trial. Does your cluster have GPUs available? We just released some smaller versions of the model (see below) but you will probably still need to use a GPU for generation to complete in a reasonable amount of time.
https://huggingface.co./databricks/dolly-v2-2-8b
https://huggingface.co./databricks/dolly-v2-6-9b
srowen
changed discussion status to
closed