Tenkai Runtime Error

[InMatrix]

Enviornments:

• Node v25.2.1
• Go 1.25.5
• Gemini CLI 0.23.0
• macOS 26.2

Server logs:

2026/01/13 16:34:15 [Server] Listening on http://localhost:8080
2026/01/13 16:34:46 [Server] Listening on http://localhost:8080
2026/01/13 16:34:46 Server failed: listen tcp :8080: bind: address already in use
2026/01/13 16:35:35 [Server] Listening on http://localhost:8080
2026/01/13 16:50:47 [Server] Spawning tenkai: [-config /Users/taodong/Code/devrel-demos/agents/tenkai/experiments/templates/2/config.yaml -reps 1 -concurrent 2 -name Gemini 3 vs Gemini 2.5_run -control gemini-2.5-flash -timeout 5m -alternatives gemini-3-flash-preview,gemini-3-pro-preview -scenarios 2]
2026/01/13 16:50:47 START [gemini-3-pro-preview|2|#1]
2026/01/13 16:50:47 START [gemini-3-flash-preview|2|#1]
2026/01/13 16:50:47 Progress: 1/2 jobs completed (50.0%)
2026/01/13 16:50:47 Warning: failed to copy prompt to stdin: write |1: file already closed
2026/01/13 16:50:47 Warning: failed to copy prompt to stdin: write |1: file already closed
2026/01/13 16:50:47 Progress: 2/2 jobs completed (100.0%)
2026/01/13 16:50:47 [Server] Runner process 57951 finished successfully
2026/01/13 17:05:18 [API Error] GET /api/experiments/1: sql: no rows in result set
2026/01/13 17:06:03 [Server] Spawning tenkai: [-config /Users/taodong/Code/devrel-demos/agents/tenkai/experiments/templates/2/config.yaml -reps 1 -concurrent 2 -name Gemini 3 vs Gemini 2.5_run -control gemini-2.5-flash -timeout 5m -alternatives gemini-3-flash-preview,gemini-2.5-flash -scenarios 2]
2026/01/13 17:06:03 START [gemini-2.5-flash|2|#1]
2026/01/13 17:06:03 START [gemini-3-flash-preview|2|#1]
2026/01/13 17:06:05 DONE  [gemini-2.5-flash|2|#1] in 2.396s
2026/01/13 17:06:05 Progress: 1/2 jobs completed (50.0%)
2026/01/13 17:06:05 DONE  [gemini-3-flash-preview|2|#1] in 2.45s
2026/01/13 17:06:05 Progress: 2/2 jobs completed (100.0%)
2026/01/13 17:06:05 [Server] Runner process 59890 finished successfully
2026/01/14 20:16:46 [Server] Listening on http://localhost:8080

[InMatrix]

The experiments start to work after I set GEMINI_API_KEY. I was using my Google login with Gemini CLI previously. It would be useful to clarify the supported authentication method in the project's readme. @danicat

[danicat]

@InMatrix this actually surprises me! I didn't hardcode the need for GEMINI_API_KEY in the runner - at least not intentionally. Technically it should respect whatever configuration for gemini CLI you have in your environment. Maybe it was a bug in this version... could you please try with the new one?

I want to achieve full env isolation from the host so you can configure the runners independently, but this will require running the jobs in containers and it will be a major refactor

[InMatrix]

@danicat I had a chance to try Tenkai again today, but I ran into a error with the frontend:

⨯ ./frontend/components/ui/tooltip.tsx:6:1
Module not found: Can't resolve '@/lib/utils'
  4 | import * as TooltipPrimitive from "@radix-ui/react-tooltip"
  5 |
> 6 | import { cn } from "@/lib/utils"
    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  7 |
  8 | const TooltipProvider = TooltipPrimitive.Provider
  9 |

Import map: aliased to relative './lib/utils' inside of [project]/frontend


Import trace:
  Server Component:
    ./frontend/components/ui/tooltip.tsx
    ./frontend/app/layout.tsx

https://nextjs.org/docs/messages/module-not-found

I had ran npm install in the frontend directory before starting the app.