[Bug]: Gemini pipeline does not recognize the built-in tools of OWUI

[silenceroom]

Before submitting

• I searched existing issues and did not find a matching report.
• I can reproduce this issue on the latest version of the repository or current main branch.
• I removed or masked secrets, tokens, and private endpoints from my report.

Affected area

pipelines/google

Bug summary

Gemini does not recognize the built-in tools despite the function calling mode to "native"

Current behavior

When ask the model what tools it has, it response with a general descriptoin.
It seems that the model has no clue of the built-in tools.

Expected behavior

The model should levarage with the built-in tools provided by Open-WebUI, including notes, image generatetion, history search etc.

Steps to reproduce

1. Install the pipiline.
2. Change the function calling to "native" in the model configuraiotn.
3. Use model of "gemin-3-flash-preview".
4. Ask the model what tools it has.

Relevant logs, errors, or screenshots

Environment details

• OS: Mac OS
• OWUI version: 0.8.10
• Pipeline version: lateset
• OWUI Deployement : Docker
• Gemini connection: Via default base url (not vertex)
• Provider: Google

Additional context

[owndev]

Hi @silenceroom

I already encountered this problem in #135. My tools (I only have MCP tools) don't work with native, but they do work with default.

As described in #135 (comment), I also don't receive any tools from Open WebUI and therefore can't pass them to the model.

I would recommend using N8N for more complex processes. I also have a pipeline for that.

---

@olivier-lacroix, is it not working for you either?

[olivier-lacroix]

Hum, I have not tried / debugged the use of these built-in tools.

With log level set to debug, native tools being added should be visible in the logs. I'll try to have a look if you guys don't beat me to it :)

[olivier-lacroix]

So, the issue stems from the fact that builtin tools are not present in the __tools__ input (and neither are mcp tools). Only user-defined ones are.

#159 fixes this by relying on metadata['tools'] instead. Note it is populated only when in native function calling mode, which would need to be activated.