-
-
Notifications
You must be signed in to change notification settings - Fork 11.6k
Open
Labels
bugSomething isn't workingSomething isn't workinggood first issueGood for newcomersGood for newcomersgpt-ossRelated to GPT-OSS modelsRelated to GPT-OSS models
Description
🐛 Describe the bug
Currently there is no check for this, vLLM will just respond sub-optimally in a "silent" way. We should fail the individual request in this case with appropriate error message.
This is a problem in particular for example when using the demo tool server without the gpt-oss package installed.
See discussion here: #29336 (comment)
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workinggood first issueGood for newcomersGood for newcomersgpt-ossRelated to GPT-OSS modelsRelated to GPT-OSS models
Type
Projects
Status
To Triage