Spaces:

---

BrokenSource

/

DepthFlow

like 1

Running on Zero

I'm applying for a GPU grant in my project named DepthFlow (704 ⭐️) - it converts "Images to 3D Parallax Video" using their estimated depth maps, often via state of the art monocular depth estimation models like DepthAnything2. Gradio itself has shared it in X/Twitter and Linkedin in the past! It is my current oldest unresolved issue in GitHub having it hosted on spaces, and a recurrent user request for a website.

Speeds: The processing is done in an optimized GLSL Shader, achieving 170fps at 4k resolution on an RTX 3060 in stress tests. The main bottleneck in production usage (exporting videos) is the encoding itself, which I can swap for NVENC to do the job instead of the CPU if available.

Suggested GPU: I believe the cheapest HuggingFace's option for GPU spaces, the t4-small, should be plenty for me - as NVENC doesn't doubles throughput in higher tier cards, plus CUDA is only briefly used for MDE. Albeit t4-medium would be preferable if there's multiple simultaneous jobs, as a single render uses roughly 3x to 4x maxed out theads offloaded to NVENC:

$ /usr/bin/time -v depthflow h264-nvenc main -o /tmp/video.mp4 --time 60
(...)
    User time (seconds): 34.51
    System time (seconds): 8.51
    Percent of CPU this job got: 338%

ZeroGPU also cuts it, though sub-utilizing the A100's resources for simple encoding and lightweight CUDA/VRAM tasks.

Technical concerns: I will need graphics capabilities enabled in NVIDIA Container Toolkit on the host for EGL to find the GPU as a OpenGL capable device in headless rendering, if not already enabled (and some packages, configuration on my side). Some cloud providers seem to disable NVENC due security concerns, not sure if it's the case here, better safe than sorry!

^{Sidenote: This configuration for EGL could be baked-in your builds, it's non-trivial getting it working :)}

A clarification on "Personal project" vs hosting on a organization: I am the current sole maintainer with no legal company behind it, it's mostly for the separation of personal (lower-tier) and professional projects, making it easier to manage potential contributors. I may be a company in the future, if time comes I'll be sure to notify, but for the medium term, it's personal.