POC Request: kubectl-ai takes kubernetes certifications exam such CKAD

[droot]

It will be pretty interesting to have kubectl-ai take one of the industry certification exams like CKAD and record AI model's performance.

If anyone in the community is aware of these exams and their setup, let us know. we can help with the agent harness etc.

PS: This was inspired by "Gemini plays pokemon" effort :)

[droot]

/cc @selimacerbas @tuannvm @zvdy

[tuannvm]

That’s a really cool idea! Maybe we can take a look at these amazing works for inspiration.

Simulator/Repo	Features	Link
alijahnas/CKA-practice-exercises	Comprehensive, scenario-based, up-to-date	GitHub
devopshubproject/cka-lab	Task-based, practical, community-driven	GitHub
tariqsheikhsw/CKA-Simulator-Practice-Test-Killer-Sh	Killer.sh-inspired, context management	GitHub
bmuschko/cka-crash-course	In-depth, structured, hands-on	GitHub

[tuannvm]

Or this would become a cka-bench :)

[hakman]

Or this would become a cka-bench :)

I guess cka-practice-bench or something like that would not upset anyone, but cool idea.

[zvdy]

This is a nice idea, the implementation could be a set of tasks in a new folder, perhaps called CKA under k8s-bench itself.
The OSS repositories @tuannvm mentioned are quite nice ideas to use as the tasks, and based on the results, determinate if the model passes or no the "mock test"