REDHAT-BUG-2455425: High severity vllm vulnerability
vLLM is an inference and serving engine for large language models (LLMs). From 0.1.0 to before 0.19.0, a Denial of Service vulnerability exists in the vLLM OpenAI-compatible API server. Due to the lack of an upper bound validation on the n parameter in the ChatCompletionRequest and CompletionRequest Pydantic models, an unauthenticated attacker can send a single HTTP request with an astronomically large n value. This completely blocks the Python asyncio event loop and causes immediate Out-Of-Memory crashes by allocating millions of request object copies in the heap before the request even reaches the scheduling queue. This vulnerability is fixed in 0.19.0.
Affected Software
Remediation
Recommended actions to resolve this vulnerability, in priority order.
- Upgrade
Upgrade
vLLM OpenAI-compatible API serverto a version that resolves this vulnerability.Fixed in 0.19.0
Event History
Frequently Asked Questions
What is the severity of REDHAT-BUG-2455425?
The severity of REDHAT-BUG-2455425 is classified as high, with a CVSS score of 7.
How do I fix REDHAT-BUG-2455425?
To mitigate the vulnerability identified in REDHAT-BUG-2455425, upgrade vLLM to version 0.19.0 or later.
What kind of vulnerability is REDHAT-BUG-2455425?
REDHAT-BUG-2455425 is a Denial of Service (DoS) vulnerability affecting the vLLM OpenAI-compatible API server.
Which versions of vLLM are affected by REDHAT-BUG-2455425?
Versions of vLLM from 0.1.0 to before 0.19.0 are affected by REDHAT-BUG-2455425.
What impact can REDHAT-BUG-2455425 have on my application?
The impact of REDHAT-BUG-2455425 could result in a Denial of Service, potentially disrupting the availability of your application using vLLM.