Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA - AllTheNews.today
Home / Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA
Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA

Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA

2026-05-29T19:38  ·  tech
Article URL: https://github.com/jmaczan/tiny-vllm Comments URL: https://news.ycombinator.com/item?id=48328184 Points: 6 # Comments: 0
Read Full Article →
github.com
← Back to Latest

Related News

Real-time LLM Inference on Standard GPUs: 3k tokens/s per request
2026-05-29
Article URL: https://blog.kog.ai/real-time-llm-inference-on-standard-gpus-3-000-tokens-s-per-request/ Comments URL:…
CVE-Bench: testing LLM agents on real-world vulnerability patches
2026-05-29
Article URL: https://giovannigatti.github.io/cve-bench/ Comments URL: https://news.ycombinator.com/item?id=48328088…
Various LLM Smells
2026-05-28
Article URL: https://shvbsle.in/various-llm-smells/ Comments URL: https://news.ycombinator.com/item?id=48313810 Points:…
Caio, a cleaner search engine for 500k+ tech jobs
2026-05-28
Article URL: https://caio-jobs.com/ Comments URL: https://news.ycombinator.com/item?id=48314650 Points: 8 # Comments: 1
Show HN: TV Explorer. Adding advanced UI to free online TV
2026-05-29
Article URL: https://tvexplorer.live Comments URL: https://news.ycombinator.com/item?id=48325624 Points: 13 # Comments:…