What is the severity of REDHAT-BUG-2311895?

The severity of REDHAT-BUG-2311895 is considered moderate, as it causes the vllm API server to crash with an empty prompt but primarily affects the GPT-2 model.

How do I fix REDHAT-BUG-2311895?

To fix REDHAT-BUG-2311895, ensure that prompts sent to the vllm API server are not empty, or update to the latest version of the vllm software that addresses this issue.

What models are affected by REDHAT-BUG-2311895?

Only the GPT-2 model is directly affected by REDHAT-BUG-2311895; most other models are not impacted due to token prepending.

What happens when a completions API request with an empty prompt is made in REDHAT-BUG-2311895?

Making a completions API request with an empty prompt will crash the vllm API server, leading to potential service downtime.

Is the impact of REDHAT-BUG-2311895 dependent on the model being served?

Yes, the impact of REDHAT-BUG-2311895 is dependent on the model being served, with GPT-2 being affected and other models generally being safe.

Vulnerability/
REDHAT-BUG-2311895

high

12/9/2024

17/9/2024

REDHAT-BUG-2311895

First published: Thu Sep 12 2024(Updated: )

A completions API request with an empty prompt will crash the vllm API server. The impact is limited based on what model is being served. * Serving gpt2 is affected. * Most models are not affected, as vllm will prepend tokens to the prompt, avoiding the problematic code. <a href="https://github.com/vllm-project/vllm/commit/e25fee57c2e69161bd261f5986dc5aeb198bbd42">https://github.com/vllm-project/vllm/commit/e25fee57c2e69161bd261f5986dc5aeb198bbd42</a>

Affected Software	Affected Version	How to fix
vLLM
GPT-2

Never miss a vulnerability like this again

Reference Links

Frequently Asked Questions

What is the severity of REDHAT-BUG-2311895?
The severity of REDHAT-BUG-2311895 is considered moderate, as it causes the vllm API server to crash with an empty prompt but primarily affects the GPT-2 model.
How do I fix REDHAT-BUG-2311895?
To fix REDHAT-BUG-2311895, ensure that prompts sent to the vllm API server are not empty, or update to the latest version of the vllm software that addresses this issue.
What models are affected by REDHAT-BUG-2311895?
Only the GPT-2 model is directly affected by REDHAT-BUG-2311895; most other models are not impacted due to token prepending.
What happens when a completions API request with an empty prompt is made in REDHAT-BUG-2311895?
Making a completions API request with an empty prompt will crash the vllm API server, leading to potential service downtime.
Is the impact of REDHAT-BUG-2311895 dependent on the model being served?
Yes, the impact of REDHAT-BUG-2311895 is dependent on the model being served, with GPT-2 being affected and other models generally being safe.

collector/redhat-bugzilla
source/Red Hat
alias/CVE-2024-8768
agent/severity
agent/references
agent/last-modified-date
agent/description
agent/first-publish-date
agent/event
agent/type
agent/source
agent/tags
agent/softwarecombine
agent/guess-ai
agent/software-canonical-lookup
agent/software-canonical-lookup-request
vendor/vllm
canonical/vllm
vendor/openai
canonical/gpt-2

Company

Resources

Contact

SecAlerts Pty Ltd.
132 Wickham Terrace
Fortitude Valley,
QLD 4006, Australia
info@secalerts.co

By using SecAlerts services, you agree to our services end-user license agreement. This website is safeguarded by reCAPTCHA and governed by the Google Privacy Policy and Terms of Service. All names, logos, and brands of products are owned by their respective owners, and any usage of these names, logos, and brands for identification purposes only does not imply endorsement. If you possess any content that requires removal, please get in touch with us.