Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
87 commits
Select commit Hold shift + click to select a range
d946f23
feat: add jolt-eval crate for invariant checking and objective measur…
moodlezoup Mar 31, 2026
ea99ac8
docs: add README for jolt-eval crate
moodlezoup Mar 31, 2026
6f64e3d
feat(jolt-eval): add fuzz CLI binary for invariant fuzz testing
moodlezoup Mar 31, 2026
f389381
feat(jolt-eval): implement red-team CLI with Claude Code agent invoca…
moodlezoup Mar 31, 2026
7cb1b5f
feat(jolt-eval): move optimize to a CLI binary with Claude invocation
moodlezoup Mar 31, 2026
edd7c43
refactor(jolt-eval): extract AgentHarness trait for customizable agen…
moodlezoup Mar 31, 2026
60fd789
test(jolt-eval): add MockAgent and comprehensive agent harness tests
moodlezoup Mar 31, 2026
99fa7cf
test(jolt-eval): add auto_optimize library function and mock-based tests
moodlezoup Mar 31, 2026
076a176
refactor(jolt-eval): replace hardcoded invariant/objective names with…
moodlezoup Apr 1, 2026
6301ac1
refactor(jolt-eval): use inventory crate for invariant and objective …
moodlezoup Apr 1, 2026
6470e72
feat(jolt-eval): parse agent counterexamples as JSON in auto_redteam
moodlezoup Apr 1, 2026
9b52b86
cleanup(jolt-eval): remove truncation of agent responses in auto_redteam
moodlezoup Apr 1, 2026
3f00b1e
test(jolt-eval): exercise measure_dyn with non-empty objective list
moodlezoup Apr 1, 2026
7fe3d49
feat(jolt-eval): use --output-format json --json-schema for structure…
moodlezoup Apr 1, 2026
5cd0271
docs(jolt-eval): add Fuzzing section to README, remove Crate structure
moodlezoup Apr 1, 2026
4fd724e
feat(jolt-eval): add cargo-fuzz scaffolding and fuzz_invariant() harness
moodlezoup Apr 1, 2026
62e2ff8
feat(jolt-eval): add guest catalog and --guest flag, make TestCase op…
moodlezoup Apr 1, 2026
3aa1397
refactor(jolt-eval): replace proof-level invariants with split-eq pol…
moodlezoup Apr 2, 2026
a915d3d
refactor(jolt-eval): remove inventory crate, use explicit registration
moodlezoup Apr 2, 2026
cc623f4
cleanup(jolt-eval): remove fuzz binary, redundant with check-invariants
moodlezoup Apr 2, 2026
0200fa7
refactor(jolt-eval): replace DynInvariant/SynthesisRegistry with Jolt…
moodlezoup Apr 2, 2026
ccbb256
cleanup(jolt-eval): remove check-invariants binary, simplify invarian…
moodlezoup Apr 2, 2026
49812d0
refactor(jolt-eval): simplify fuzz targets and split-eq input represe…
moodlezoup Apr 2, 2026
bb5c17e
refactor(jolt-eval): split targets() into InvariantTargets trait, mac…
moodlezoup Apr 2, 2026
291f98a
refactor(jolt-eval): split agent.rs into agent/ directory
moodlezoup Apr 2, 2026
d89e092
fix(jolt-eval): fix Claude CLI invocation for structured output
moodlezoup Apr 2, 2026
43c1ea4
feat(jolt-eval): add --hint flag to redteam CLI
moodlezoup Apr 2, 2026
ab109ef
feat(jolt-eval): add soundness invariant with guest-sandbox template
moodlezoup Apr 2, 2026
58cbc00
refactor(jolt-eval): add CheckError, refactor guests into directory
moodlezoup Apr 2, 2026
010e8cb
feat(jolt-eval): add soundness invariant tests, fix guest compilation
moodlezoup Apr 2, 2026
e19244c
refactor(jolt-eval): replace guest-based objectives with tokei-based …
moodlezoup Apr 2, 2026
9b025b5
refactor(jolt-eval): use rust-code-analysis for code quality objectives
moodlezoup Apr 2, 2026
2dd2fb6
Tweak redteam prompt
moodlezoup Apr 3, 2026
7ac4bfc
Tweak soundness invariant description
moodlezoup Apr 3, 2026
cb683ca
refactor(jolt-eval): remove TestCase, add measure/optimize binaries
moodlezoup Apr 3, 2026
3697139
feat(jolt-eval): Criterion integration for perf objectives, sync script
moodlezoup Apr 3, 2026
a8418a1
tinker with measure_objectives output
moodlezoup Apr 3, 2026
fdff172
feat(jolt-eval): add units() method to objective traits
moodlezoup Apr 3, 2026
44ca237
feat(jolt-eval): use iter_batched and --save-baseline for benchmarks
moodlezoup Apr 3, 2026
b4d5e3d
fix(jolt-eval): run Criterion benchmarks individually with --bench flag
moodlezoup Apr 3, 2026
52c2d24
refactor(jolt-eval): add DiffScope, enrich_input, capture worktree diffs
moodlezoup Apr 3, 2026
0959fca
feat(jolt-eval): add ProverTimeObjective with configurable guest prog…
moodlezoup Apr 3, 2026
04cbc59
refactor(jolt-eval): organize objectives into code_quality/ and perfo…
moodlezoup Apr 3, 2026
cd829a6
chore: gitignore .omc/ state files
moodlezoup Apr 3, 2026
374a6a4
chore: remove accidentally committed .omc/ state files
moodlezoup Apr 3, 2026
2a681e5
refactor(jolt-eval): split guest configs into own files, add new benches
moodlezoup Apr 3, 2026
8400107
docs(jolt-eval): update README to reflect current architecture
moodlezoup Apr 3, 2026
88807b2
fix(jolt-eval): register jolt-inlines for secp256k1 and sha2 benchmarks
moodlezoup Apr 3, 2026
e3bae5d
rename(jolt-eval): bind_bench.rs -> binding.rs
moodlezoup Apr 3, 2026
c03f880
refactor(jolt-eval): move tests into their relevant source directories
moodlezoup Apr 3, 2026
07a0c60
refactor(jolt-eval): replace Direction with ObjectiveFunction trait
moodlezoup Apr 3, 2026
9c6c756
refactor(jolt-eval): unify objective traits, type-safe ObjectiveFunct…
moodlezoup Apr 4, 2026
02155d4
style(jolt-eval): cargo fmt
moodlezoup Apr 4, 2026
94dba4b
feat(jolt-eval): add sorting e2e tests and --test/--list CLI flags
moodlezoup Apr 4, 2026
3fb739c
feat(jolt-eval): add --verbose flag to optimize and redteam binaries
moodlezoup Apr 4, 2026
55cec38
refactor(jolt-eval): add NAIVE_SORT_TIME objective for sort e2e tests
moodlezoup Apr 4, 2026
86f32bd
fix(jolt-eval): pass --dangerously-skip-permissions to Claude CLI
moodlezoup Apr 4, 2026
1c2cdca
fix(jolt-eval): make diff_scope configurable in OptimizeConfig
moodlezoup Apr 4, 2026
2e24818
refactor(jolt-eval): move sort e2e out of invariant/, split targets
moodlezoup Apr 4, 2026
9f5b191
feat(jolt-eval): auto-optimize creates git branch and commits per ite…
moodlezoup Apr 4, 2026
a1578ff
fix(jolt-eval): SortOptimizeEnv applies diff to actual file on disk
moodlezoup Apr 4, 2026
acb20fd
feat(jolt-eval): clearer optimize iteration status and higher-precisi…
moodlezoup Apr 4, 2026
dfe3f96
docs(jolt-eval): update README for unified Objective trait and Object…
moodlezoup Apr 4, 2026
f911bff
merge: resolve Cargo.lock conflict with origin/main
moodlezoup Apr 4, 2026
87df638
fix(jolt-eval): typo unparseable → unparsable
moodlezoup Apr 4, 2026
18ecdc2
fix(jolt-eval): ignore libfuzzer-sys in cargo-machete
moodlezoup Apr 4, 2026
ad59fea
delete spec
moodlezoup Apr 4, 2026
121142e
feat(jolt-eval): derive diff_scope from objective inputs
moodlezoup Apr 4, 2026
925ad6d
feat(jolt-eval): improve optimize and redteam agent prompts
moodlezoup Apr 4, 2026
eac6ddb
refactor(jolt-eval): move objective descriptions to Objective trait
moodlezoup Apr 4, 2026
74c4f3b
refactor(jolt-eval): add JoltInvariants::red_team() via dispatch macro
moodlezoup Apr 4, 2026
674e85a
feat(jolt-eval): add baseline() and normalized() for objective score …
moodlezoup Apr 4, 2026
43fe4b1
refactor(jolt-eval): use initial measurements as normalization baselines
moodlezoup Apr 4, 2026
a65c10e
cleanup(jolt-eval): remove AI slop — separators, duplication, dead pa…
moodlezoup Apr 4, 2026
d40acab
feat(jolt-eval): add --measure flag, subprocess-based sort measurement
moodlezoup Apr 4, 2026
c16ad58
refactor(jolt-eval): make naive_sort a proper Criterion benchmark
moodlezoup Apr 4, 2026
8fdf320
refactor(jolt-eval): move NaiveSortObjective to performance/, remove …
moodlezoup Apr 4, 2026
ab555b5
fix(jolt-eval): correct limit names in soundness validation error mes…
moodlezoup Apr 4, 2026
9ac4412
fix(jolt-eval): address PR review — docs, git clean, apply_diff stderr
moodlezoup Apr 4, 2026
625fe80
fix(jolt-eval): update guest-sandbox README to reflect actual behavior
moodlezoup Apr 4, 2026
f828a7d
feat(jolt-eval): persist optimize attempts to gitignored history dire…
moodlezoup Apr 4, 2026
ff5a6a7
feat(jolt-eval): persist redteam attempts to gitignored history direc…
moodlezoup Apr 4, 2026
3ae9531
Clean up unnecessary fields in OptimizationAttempt
moodlezoup Apr 4, 2026
be7b340
refactor(jolt-eval): replace root: PathBuf with target_dir: &'static str
moodlezoup Apr 4, 2026
bef916d
refactor(jolt-eval): Objective::description returns String
moodlezoup Apr 4, 2026
ef9887c
Manual cleanup
moodlezoup Apr 4, 2026
3f84c42
fix(jolt-eval): restore Default derive on perf objective structs
moodlezoup Apr 4, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -57,3 +57,6 @@ benchmark-runs/
/perfetto_traces/
*.pb
*benchmark_results.json
.omc/
optimize-history/
redteam-history/
Loading