-
Notifications
You must be signed in to change notification settings - Fork 13.5k
Pretend in bootstrap snapshot tests that we always build in-tree LLVM #143474
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
I'm not 100%, would like to double-check this change in #143126. |
IIUC, this is because the CI configuration is changing the test input? |
We will need to normalize more things in the bootstrap test config, yeah. I don't understand why the LLVM build step disappeared though, when LLVM was modified, it should be built, not downloaded, so if anything the step should appear (but really it should be called in both cases). |
Yeah, it should be unconditionally called (a no-op step is fine), but it should still appear... |
@bors r+ p=1 (bootstrap fix blocking other PRs) |
☀️ Test successful - checks-actions |
What is this?This is an experimental post-merge analysis report that shows differences in test outcomes between the merged PR and its parent PR.Comparing fd9ca71 (parent) -> 6dec76f (this PR) Test differencesNo test diffs found Test dashboardRun cargo run --manifest-path src/ci/citool/Cargo.toml -- \
test-dashboard 6dec76f1c2809fded082dd44d3752d3f6220d767 --output-dir test-dashboard And then open Job duration changes
How to interpret the job duration changes?Job durations can vary a lot, based on the actual runner instance |
Finished benchmarking commit (6dec76f): comparison URL. Overall result: ✅ improvements - no action needed@rustbot label: -perf-regression Instruction countOur most reliable metric. Used to determine the overall result above. However, even this metric can be noisy.
Max RSS (memory usage)This benchmark run did not return any relevant results for this metric. CyclesResults (secondary -0.9%)A less reliable metric. May be of interest, but not used to determine the overall result above.
Binary sizeThis benchmark run did not return any relevant results for this metric. Bootstrap: 458.797s -> 461.008s (0.48%) |
Otherwise, depending on whether CI LLVM is inhibited or if an externally-provided LLVM is used, bootstrap host LLVM build step could be missing in step snapshots.
Note that I'm not sure if this is the right solution (this might be a solution). I imagine we do want to control for the set of configuration that these snapshot tests are run, as much as possible.
r? @Kobzol