Morgan Funtowicz's picture

22 3 4

Morgan Funtowicz

mfuntowicz

·

https://github.com/mfuntowicz

AI & ML interests

Model inference low-level optimization, hardware affinity and large-scale distributed training.

Recent Activity

upvoted an article 2 days ago

Yay! Organizations can now publish blog Articles

upvoted an article 3 days ago

Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference

updated a model 3 months ago

mfuntowicz/SmolLM2-360M-Instruct-Q4_K_M-GGUF

View all activity

Articles

Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference

Introducing the AMD 5th Gen EPYC™ CPU

Hugging Face on AMD Instinct MI300 GPU

CPU Optimized Embeddings with 🤗 Optimum Intel and fastRAG

Accelerating SD Turbo and SDXL Turbo Inference with ONNX Runtime and Olive

AMD + 🤗: Large Language Models Out-of-the-Box Acceleration with AMD GPU

Optimum-NVIDIA - Unlock blazingly fast LLM inference in just 1 line of code

Accelerating over 130,000 Hugging Face models with ONNX Runtime

Case Study: Millisecond Latency using Hugging Face Infinity and modern CPUs

Scaling up BERT-like model Inference on modern CPU - Part 2

Introducing Optimum: The Optimization Toolkit for Transformers at Scale

Scaling-up BERT Inference on CPU (Part 1)

Organizations

mfuntowicz's activity

upvoted an article 2 days ago

Article

Yay! Organizations can now publish blog Articles

By

•

3 days ago

• 29

upvoted an article 3 days ago

Article

Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference

8 days ago

• 59

upvoted a collection 8 months ago

Embedding Model Datasets

A curated subset of the datasets that work out of the box with Sentence Transformers: https://huggingface.co./datasets?other=sentence-transformers • 67 items • Updated Jul 3, 2024 • 98