Gianfranco Palumbo's picture
6 63

Gianfranco Palumbo

gianpaj
ยท

AI & ML interests

None yet

Recent Activity

liked a Space 1 day ago
myshell-ai/OpenVoiceV2
liked a dataset 3 days ago
open-thoughts/OpenThoughts-114k
liked a model 4 days ago
hexgrad/Kokoro-82M
View all activity

Organizations

escuela.dev's profile picture

gianpaj's activity

liked a Space about 2 months ago
liked a Space 2 months ago
replied to Xenova's post 3 months ago
view reply

i'm getting 11.24tokens/second on an MacBook M1 Pro

reacted to Xenova's post with ๐Ÿ”ฅ 3 months ago
view post
Post
13987
I can't believe this... Phi-3.5-mini (3.8B) running in-browser at ~90 tokens/second on WebGPU w/ Transformers.js and ONNX Runtime Web! ๐Ÿคฏ Since everything runs 100% locally, no messages are sent to a server โ€” a huge win for privacy!
- ๐Ÿค— Demo: webml-community/phi-3.5-webgpu
- ๐Ÿง‘โ€๐Ÿ’ป Source code: https://github.com/huggingface/transformers.js-examples/tree/main/phi-3.5-webgpu
ยท