Image-Text-to-Text
Transformers
Safetensors
llava
image-to-text
conversational

vllm bug

#11
by prudant - opened

when tool enable + reasoning the output is corrupt, the thinking tag is not parsed as well

ServiceNow-AI org

Hey @prudant can you share a sample of response you are seeing. So we can replicate on our end and fix the issue.

Share the details:

  1. Command used to start the image
  2. The input or a mock input passed
  3. The response you get from the model

Sign up or log in to comment