Skip to content

fix(qwen3): Be explicit with function calling format#8265

Merged
mudler merged 1 commit intomudler:masterfrom
richiejp:fix/qwen3-template
Jan 28, 2026
Merged

fix(qwen3): Be explicit with function calling format#8265
mudler merged 1 commit intomudler:masterfrom
richiejp:fix/qwen3-template

Conversation

@richiejp
Copy link
Collaborator

Qwen3 4b was using the wrong function format (i.e. using "function"
instead of "name") within the realtime API.

If we specify the function calling format explicitly then it stops it.

Qwen3 4b was using the wrong function format (i.e. using "function"
instead of "name") within the realtime API.

If we specify the function calling format explicitly then it stops it.

Signed-off-by: Richard Palethorpe <io@richiejp.com>
@netlify
Copy link

netlify bot commented Jan 28, 2026

Deploy Preview for localai ready!

Name Link
🔨 Latest commit a4281a9
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/6979f191b033dc0008eede9b
😎 Deploy Preview https://deploy-preview-8265--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@richiejp
Copy link
Collaborator Author

#6245

@mudler mudler merged commit 856ca2d into mudler:master Jan 28, 2026
33 checks passed
nanoandrew4 pushed a commit to nanoandrew4/LocalAI that referenced this pull request Jan 31, 2026
Qwen3 4b was using the wrong function format (i.e. using "function"
instead of "name") within the realtime API.

If we specify the function calling format explicitly then it stops it.

Signed-off-by: Richard Palethorpe <io@richiejp.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants