Add model failed (android)
Same issue as the medllama model
i naively assumed that when compiled for TVM, my model (which works for iOS) would also work for Android as the TVM documentation states, i was wrong, but i'm actively working on a fix, compiling it for android specifically, expect it soon! this WILL work for ALL android devices
I appreciate your hard work and incredible talent in bringing this to us! :)
Thanks a lot 👏
Good Job! yohoo!
Yeah I have same problem. Eagerly awaiting a fix. Lucky I checked here I was going to try pushing the model onto the phone via ADB, glad I didn't waste my time.
It works on iOS on MLC, easy as pie!
However the data needs a ton more work, and this 3B? parameter size is too small to do even rather basic inference on decision making abilities.
It struggled on even the most basic USMLE questions. Didn't get any of the 5 right in my limited test.
I'd be interested in seeing performance of the medllama though.
@llSourcell any luck yet fixing the model for Android?
i am actively working on this. it's just me. Me and the good ol' Tensor Virtual Machine, sorting through matrix math TVM errors that make CUDA errors look like fun. when i have it ready you will all know. i will blast it on all my socials too.
Thanks for working on this. I am excited to try it when done.