Skip to content

feat(cpp_kernel): add comprehensive benchmarking harness with CI hardening and docs#6

Draft
cto-new[bot] wants to merge 1 commit intomainfrom
feat-benchmark-harness-ci-hardening
Draft

feat(cpp_kernel): add comprehensive benchmarking harness with CI hardening and docs#6
cto-new[bot] wants to merge 1 commit intomainfrom
feat-benchmark-harness-ci-hardening

Conversation

@cto-new
Copy link
Copy Markdown

@cto-new cto-new Bot commented Dec 15, 2025

Summary

This PR introduces a complete benchmarking harness, sanitizer-enabled CI, and accompanying docs for Betti-RDL's C++ kernel. It enables running Firehose/Deep Dive/Swarm benchmarks with latency sampling and memory telemetry, and integrates with CI to validate performance and safety on PRs.

Details

  • Added benchmark harness under src/cpp_kernel/benchmarks to execute three scenarios with structured metrics (JSON/CSV/TXT) and memory telemetry.
  • Extended CMake to build the harness and sanitizer targets (ASAN/LSAN) while keeping existing demos compatible.
  • Added CI workflow (.github/workflows/ci.yml) to build, test, benchmark, and smoke-test Python/Node bindings on PRs.
  • Documented usage and interpretation in docs/BENCHMARK_HARNESS.md and docs/CI_CD_WORKFLOW.md; updated README with summary.
  • Expanded .gitignore to exclude benchmark artifacts and sanitizer outputs.

Note on breaking changes

No API changes; build system and CI integration augmented. The sanitizer targets are optional via ENABLE_SANITIZERS.

Warning: Task VM test is not fully passing, using partial setup (2/5 steps working)

…ening and docs

Adds a complete benchmarking harness and CI scaffolding for Betti-RDL's C++ kernel.

- Benchmark harness at src/cpp_kernel/benchmarks/benchmark_harness.cpp runs The Firehose, The Deep Dive, and The Swarm with latency sampling and JSON/CSV/TXT outputs, plus memory telemetry.
- Extend CMakeLists to build the harness and sanitizer demo targets (ASAN/LSAN) while preserving existing demos.
- CI workflow .github/workflows/ci.yml to build, run unit tests, stress/benchmark targets, and smoke tests for Python/Node bindings on PR.
- Documentation added: docs/BENCHMARK_HARNESS.md, docs/CI_CD_WORKFLOW.md; README updated with usage notes.
- .gitignore extended to cover benchmark outputs and sanitizer artifacts.

Impact: improves CI-driven performance checks and memory-safety validation; API remains stable.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants