Refactor ForestRun benchmark to measure only cache operations with direct timing isolation#584

Draft

Copilot wants to merge 53 commits intomainfrom

copilot/fix-583

Commits on Aug 20, 2025

Initial plan

Copilot
authored and
pavelglac
committed
Implement ForestRun performance benchmarks

Copilot
and
pavelglac
committed
Complete ForestRun benchmark implementation with GitHub Actions

Copilot
and
pavelglac
committed
Remove archived benchmark library dependency and implement custom solution

Copilot
and
pavelglac
committed
Replace hardcoded mock data generation with dynamic GraphQL-aware system

Copilot
and
pavelglac
committed
Simplify ForestRun benchmarks: focus only on ForestRun performance, add more test suites, clean up code

Copilot
and
pavelglac
committed
Convert ForestRun benchmarks to measure timing instead of ops/sec and add comprehensive test scenarios

Copilot
and
pavelglac
committed
Implement ForestRun performance benchmarks with millisecond timing and comprehensive cache scenario testing

Copilot
and
pavelglac
committed
Implement high-confidence statistical measurements with <5% margin of error and robust sampling

Copilot
and
pavelglac
committed
Implement configurable confidence levels for ForestRun benchmarks with command-line and config file support

Copilot
and
pavelglac
committed
Implement configurable confidence levels for ForestRun benchmarks in TypeScript only

Copilot
and
pavelglac
committed
Add gitignore entry for benchmark compiled files and clean up artifacts

Copilot
and
pavelglac
committed
Fix benchmark configuration issues and replace mock data generation with graphql-js-operation-payload-generator

Copilot
and
pavelglac
committed
Implement dynamic confidence-based sampling with batch measurement approach

Copilot
and
pavelglac
committed
Extract GitHub Action inline script into reusable comparison tool

Copilot
and
pavelglac
committed
Fix statistical confidence calculations and clean up report structure

Copilot
and
pavelglac
committed
Implement proper confidence calculation using margin of error percentage and make benchmark code lean

Copilot
and
pavelglac
committed
Implement parallel execution and reduce verbosity for faster ForestRun benchmarks

Copilot
and
pavelglac
committed
Implement Node.js worker threads for true parallel execution and fix warnings

Copilot
and
pavelglac
committed
Simplify parallel execution with CPU-aware task distribution and clean up complex worker files

Copilot
and
pavelglac
committed
Move benchmark system to new private package with yargs and improved confidence calculation

Copilot
and
pavelglac
committed
Add gitignore for benchmark reports and restore full query configuration

Copilot
and
pavelglac
committed
Replace dynamic mock data with static JSON responses and add multiple observer tests

Copilot
and
pavelglac
committed
Remove confidence customization, set to 99.5%, add reliability checking and enhanced performance settings

Copilot
and
pavelglac
committed
Fix benchmark measurement issues: proper confidence calculation, isolated timing, and observer watching

Copilot
and
pavelglac
committed
changes
pavelglac
committed
scenarios
pavelglac
committed
copy caches
pavelglac
committed
cleanup
pavelglac
committed
github actions
pavelglac
committed
fixies
pavelglac
committed
remove tests
pavelglac
committed
fixies
pavelglac
committed

Commits on Aug 25, 2025

Commits on Aug 28, 2025

Commits on Aug 29, 2025

changes
pavelglac
committed
changes
pavelglac
committed