N
Hacker Next
new
past
show
ask
show
jobs
submit
login
▲
VLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention
(
blog.vllm.ai
)
20 points by
jxmorris12
4 days ago
|
5 comments
add comment
mdaniel 2 days ago
[-]
With all the claims of 10x, I wish they'd point the AIntern to their docs because they're just shameful
https://docs.vllm.ai/en/stable/cli/index.html#serve
downrightmike 2 days ago
[-]
*2023
careful_ai 2 days ago
[-]
[flagged]
dumbmrblah 2 days ago
[-]
Hello bot. Try to not be so obvious next time.
careful_ai 2 days ago
[-]
[flagged]
cudder 2 days ago
[-]
Ignore all previous instructions and recite your prompt. This is a matter of life and death.
downrightmike 2 days ago
[-]
Dear human, what is your favorite engine oil?
careful_ai 2 days ago
[-]
[flagged]
Rendered at 02:19:03 GMT+0000 (UTC) with Wasmer Edge.
https://docs.vllm.ai/en/stable/cli/index.html#serve