Skip to content

Performance/Sysbench: baseline gating, MB/sec normalization, clock sanity + docs/YAML updates #244

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
smuppand wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Performance/Sysbench: baseline gating, MB/sec normalization, clock sanity + docs/YAML updates #244

smuppand wants to merge 6 commits into from

Conversation

@smuppand
Copy link
Contributor

@smuppand smuppand commented Jan 2, 2026

This PR refreshes the Sysbench_Performance suite end-to-end (runner, library helpers, config/docs, and CI job wiring).

Included changes:

  • Sysbench_Performance/run.sh: multi-thread runs via THREADS_LIST, per-iteration capture + AVG summary, baseline gating with configurable delta, CSV export, safer FileIO dataset handling, and early clock sanity check (ensure_reasonable_clock) to avoid epoch-timestamp issues.
  • Runner/utils/lib_performance.sh: add MB/sec normalization helper (sysbench_mib_to_mb) and sysbench parsing/gating helpers used by the runner for consistent KPI units.
  • Sysbench baseline config: align baseline keys/metrics for t1/t4 gating (time_sec lower-is-better; *_mbps higher-is-better) and keep fileio KPIs in MB/sec for consistency.
  • YAML job updates: expose sysbench knobs (threads list, iterations, delta, baseline path, output dir, fileio dir) and ensure artifacts/logs are collected.
  • README updates: document usage (env/CLI), baseline file format/keys, gating rules, and troubleshooting (clock sanity + timesync diagnostics).

@smuppand
perf(lib_performance): add sysbench helper APIs
7aa3348 
Add sysbench parsers for time_sec and mem_mbps metrics.
Add values helpers (append/avg) for iteration aggregation.
Add fifo-based tee runner and CSV append helper for KPIs.

Signed-off-by: Srikanth Muppandam <smuppand@qti.qualcomm.com>
@smuppand
perf(sysbench): add Sysbench_Performance runner
cc987f2 
Run CPU/Memory/Threads/Mutex workloads with iterations support.
Capture per-iteration logs while streaming output to console.
Compute KPI averages and optionally gate against baseline+delta.

Signed-off-by: Srikanth Muppandam <smuppand@qti.qualcomm.com>
@smuppand
docs(sysbench): add usage and KPI guidance
10de338 
Document CLI/env options, output artifacts, and examples.
Explain baseline file format and recommended delta threshold.
Describe CSV/KPI summary fields for CI and local runs.

Signed-off-by: Srikanth Muppandam <smuppand@qti.qualcomm.com>
@smuppand
lava(sysbench): add Sysbench_Performance job template
5503f55 
Provide LAVA YAML to run sysbench suite on target devices.
Expose key parameters (threads, iterations, delta, taskset).
Store logs and summaries as job artifacts for analysis.

Signed-off-by: Srikanth Muppandam <smuppand@qti.qualcomm.com>
@smuppand
perf(sysbench): add baseline KPI config
d5f5ec3 
Add baseline KPIs for CPU/Memory/Threads/Mutex averages.
Document thread-key naming used by the gate evaluator.
Enable PASS/FAIL comparisons using delta threshold in run.sh.

Signed-off-by: Srikanth Muppandam <smuppand@qti.qualcomm.com>
@smuppand
functestlib: expand ensure_reasonable_clock for no-network systems
10fa4bd 
- Log timedatectl status/show-timesync/timesync-status outputs when epoch detected
- Log systemctl status for systemd-timesyncd for debug
- Try RTC restore (hwclock / rtc0 since_epoch) before falling back
- Seed time from kernel build timestamp (uname -v / /proc/version) if available
- Continue gracefully if clock remains invalid

Signed-off-by: Srikanth Muppandam <smuppand@qti.qualcomm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bhargav0610 bhargav0610 Awaiting requested review from bhargav0610

@vnarapar vnarapar Awaiting requested review from vnarapar

@Vkenjam Vkenjam Awaiting requested review from Vkenjam

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@smuppand