Carl Silva PRO
silvacarl
AI & ML interests
anything to do with applying ML to speech to text in the healthcare field.
Organizations
silvacarl's activity
vllm call for multiple GPUs, just fyi.
1
#16 opened about 2 months ago
by
silvacarl
Hosting an Inference endpoint
11
#6 opened over 1 year ago
by
lukehansen
training data?
#11 opened 7 months ago
by
silvacarl
Is there any vllm support for this version?
9
#49 opened 9 months ago
by
Aloukik21
Loading and Running the Grok-1 Open-Weights Model
6
#54 opened 8 months ago
by
Ateeqq
Text Generation Inference?
3
#28 opened 11 months ago
by
silvacarl
extremely variable response time for inference?
9
#21 opened 11 months ago
by
silvacarl
API and prompt format?
1
#11 opened about 1 year ago
by
silvacarl
How to fine tune ?
14
#12 opened about 1 year ago
by
NickyNicky
any idea how to test this for inferencing using vllm?
3
#1 opened about 1 year ago
by
silvacarl
highest score yet out of a plain vanilla 7B model!!!!
1
#17 opened about 1 year ago
by
silvacarl
key error
15
#2 opened about 1 year ago
by
NS-Y
space configuration?
1
#8 opened about 1 year ago
by
silvacarl
Prompt for instructions ?
4
#1 opened over 1 year ago
by
asach
Various Prompt Formats
8
#24 opened over 1 year ago
by
gsaivinay
GPU requirement for simply running the model
27
#9 opened over 1 year ago
by
abhi24
I am getting the CUDA OUT-Of-Memory on Tesla T4 but only with these prompts...
18
#5 opened over 1 year ago
by
AayushShah
Licensing? Commercial use?
2
#4 opened over 1 year ago
by
xjdeng
Few shot learning
4
#1 opened over 1 year ago
by
iRanadheer