Skip to content

[Bug]: Add validation for tool requests that the tool is available #29432

@njhill

Description

@njhill

🐛 Describe the bug

Currently there is no check for this, vLLM will just respond sub-optimally in a "silent" way. We should fail the individual request in this case with appropriate error message.

This is a problem in particular for example when using the demo tool server without the gpt-oss package installed.

See discussion here: #29336 (comment)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinggood first issueGood for newcomersgpt-ossRelated to GPT-OSS models

    Type

    No type

    Projects

    Status

    To Triage

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions