Jonathan Lorraine PRO

lorraine2

AI & ML interests

machine learning, computer vision, generative AI

Recent Activity

View all activity

Organizations

Social Post Explorers's profile picture

Posts 7

view post
Post
1965
πŸ¦™New NVIDIA paper: LLaMA-Mesh πŸ¦™

We enable large language models to generate and understand 3D meshes by representing them as text and fine-tuning. This unifies the 3D and text modalities in a single model and preserves language abilities, unlocking conversational 3D creation with mesh understanding.

πŸ”Ž Project Page: https://research.nvidia.com/labs/toronto-ai/LLaMA-Mesh/
πŸ•ΉοΈ Interactive Demo: Zhengyi/LLaMA-Mesh (courtesy of HuggingFace and Gradio)
πŸ“– Full Paper: https://arxiv.org/abs/2411.09595
πŸ‘¨β€πŸ’»Code: https://github.com/nv-tlabs/LLaMa-Mesh
πŸ’Ύ Model Checkpoint: Zhengyi/LLaMA-Mesh
🧩 Blender Addon: https://github.com/huggingface/meshgen (courtesy of Dylan Ebert)
πŸŽ₯ 5-min Overview Video: https://youtu.be/eZNazN-1lPo?si=-idQa5aaceVw0Bbj (courtesy of AI Papers Academy)
view post
Post
1203
New NVIDIA paper: ⚑ Multi-student Diffusion Distillation for Better One-step Generators ⚑

Do you want to make your diffusion models (a) run in a single step, (b) run with a smaller model, and (c) have improved quality simultaneously? Check out our multi-student distillation (MSD) method, which is simple and applicable to most diffusion models! The only catch is now we have to distill (and store) a mixture-of-expert student generators.

Explore the MSD project page to learn more: https://research.nvidia.com/labs/toronto-ai/MSD/

Work led by Yanke Song along with Weili Nie, Karsten Kreis and James Lucas

Check out more work from the Toronto AI Lab here: https://research.nvidia.com/labs/toronto-ai/

models

None public yet

datasets

None public yet