Skip to content
Hacker News1 min read

Show HN: sllm – Split a GPU node with other develo

Running DeepSeek V3 (685B) requires 8×H100 GPUs which is about $14k/month. Most developers only need 15-25 tok/s. sllm lets you join a cohort of developers sharing a dedicated node. You reserve a spot with your card, and nobody is charged until the cohort fills. Prices start at $5/mo for smaller models.The LLMs are completely private (we don't log any traffic).The API is OpenAI-compatible (we run vLLM), so you just swap the base URL. Currently offering a few models.
Read original on sllm.cloud
3
0

Comment

Sign in to join the discussion.

Loading comments…

Related

Get the 10 best reads every Sunday

Curated by AI, voted by readers. Free forever.

Liked this? Start your own feed.

3
0