Hugging Face's logo

Spaces:
rgerganov
/
llama-rpc-server
Paused

App Files Community
rgerganov commited on
Commit
1b58f4d
·
1 Parent(s): caea732

update

Browse files
Files changed (6) hide show
  1. Dockerfile +1 -1
  2. libcuda/libggml.so +2 -2
  3. libcuda/libllama.so +2 -2
  4. llama-bench-cuda +2 -2
  5. llama-cli-cuda +2 -2
  6. rpc-server-cuda +2 -2
Dockerfile CHANGED
@@ -1,6 +1,6 @@
1
  ARG UBUNTU_VERSION=22.04
2
  # This needs to generally match the container host's environment.
3
- ARG CUDA_VERSION=12.2.0
4
  # Target the CUDA runtime image
5
  ARG BASE_CUDA_RUN_CONTAINER=nvidia/cuda:${CUDA_VERSION}-runtime-ubuntu${UBUNTU_VERSION}
6
 
 
1
  ARG UBUNTU_VERSION=22.04
2
  # This needs to generally match the container host's environment.
3
+ ARG CUDA_VERSION=12.6.0
4
  # Target the CUDA runtime image
5
  ARG BASE_CUDA_RUN_CONTAINER=nvidia/cuda:${CUDA_VERSION}-runtime-ubuntu${UBUNTU_VERSION}
6
 
libcuda/libggml.so CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e196725b5195047e595d88cb1b51110265d07d3d8935262e7811d2f27307bf69
3
- size 302659560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cde1f5ebc170ab0159e64b246e4d8a2db2377888b5001935b2ab2f92695d4836
3
+ size 359722136
libcuda/libllama.so CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:618734028e9cb2a9606ee39b5a0578ecb17ffee84bb867eec2872c0f03b7c64f
3
- size 1782664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b083f67faa80d85c4f76727375943c38c163f84de5a635c9f0d808be5eb0eed
3
+ size 1934432
llama-bench-cuda CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:64b30c41c7c49247e5547e278bfc27347238d0b083401080043cd36d2d5c22e9
3
- size 969200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e2337b4fb0487c88045177f1b3ba3b29dbbd09e81b33cff8eb5f6a090e81b48
3
+ size 1042784
llama-cli-cuda CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:62f6c5aea438966452c273e2976314be11606eff867c23e1f8f180f8fa3499e4
3
- size 933584
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a07786b00e0388ffc82a867eddec91b68d91d39903c6f810855cb4f63d89c837
3
+ size 988232
rpc-server-cuda CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:09d4b77b6ed0bf961f651b599aec37719be8e6545520f86dd175066edddc472f
3
- size 27192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c78628554ad233bd2730ce7440093aec05233f639ee21aaff8bfa6dd1124dac0
3
+ size 26560