Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.
You must be logged in to block users.
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
I'm a Software developer, love LLM inference :)
Currently I am building vLLM.
A high-throughput and memory-efficient inference and serving engine for LLMs
Python 93.3k 23.1k
High-performance Rust benchmark client for vLLM serving endpoints.
Rust 51 12
Manage multiple vLLM installations with isolated Python virtual environments. Switch between releases, commits, branches, and PRs instantly.
Rust 13 4
Common recipes to run vLLM
JavaScript 1k 442
There was an error while loading. Please reload this page.