[PY312] Use official eigen commit with minimum CMS changes #10240

smuzaffar · 2025-12-04T10:48:21Z

No description provided.

smuzaffar · 2025-12-04T10:48:27Z

enable gpu

smuzaffar · 2025-12-04T10:48:32Z

please test

cmsbuild · 2025-12-04T10:48:46Z

A new Pull Request was created by @smuzaffar for branch IB/CMSSW_16_0_X/py312.

@akritkbehera, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2025-12-04T10:48:46Z

cms-bot internal usage

smuzaffar · 2025-12-05T15:33:57Z

please test

fwyzard · 2025-12-09T14:09:47Z

please test

cmsbuild · 2025-12-10T16:56:35Z

-1

Failed Tests: nvidia_h100UnitTests nvidia_l40sUnitTests nvidia_t4UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/49859/summary.html
COMMIT: 5f72516
CMSSW: CMSSW_16_0_PY312_X_2025-12-08-2300/el8_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10240/49859/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 218 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 11221 differences found in the comparisons
Reco comparison had 4 failed jobs
DQMHistoTests: Total files compared: 53
DQMHistoTests: Total histograms compared: 4273241
DQMHistoTests: Total failures: 9562
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4263659
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 52 files compared)
Checked 227 log files, 198 edm output root files, 53 DQM output files
TriggerResults: found differences in 1 / 51 workflows

fwyzard · 2025-12-10T17:09:44Z

OK, I was expecting compilation failures, not runtime failures.
Still it looks like at least part of our changes are still needed.

cmsbuild · 2025-12-10T20:42:38Z

-1

Failed Tests: nvidia_h100UnitTests nvidia_l40sUnitTests nvidia_t4UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/49859/summary.html
COMMIT: 5f72516
CMSSW: CMSSW_16_0_PY312_X_2025-12-08-2300/el8_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10240/49859/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 218 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 11221 differences found in the comparisons
Reco comparison had 4 failed jobs
DQMHistoTests: Total files compared: 53
DQMHistoTests: Total histograms compared: 4273241
DQMHistoTests: Total failures: 9562
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4263659
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 52 files compared)
Checked 227 log files, 198 edm output root files, 53 DQM output files
TriggerResults: found differences in 1 / 51 workflows

cmsbuild · 2025-12-13T22:08:11Z

-1

Failed Tests: nvidia_h100UnitTests nvidia_l40sUnitTests nvidia_t4UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/49898/summary.html
COMMIT: 5f72516
CMSSW: CMSSW_16_0_PY312_X_2025-12-10-2300/el8_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10240/49898/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@cms-sw Celeritas: Remove G4VGConfig relocation from post-install #10248

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/49898/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/49898/git-merge-result

Comparison Summary

Summary:

You potentially added 223 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 1194 differences found in the comparisons
Reco comparison had 4 failed jobs
DQMHistoTests: Total files compared: 53
DQMHistoTests: Total histograms compared: 4273241
DQMHistoTests: Total failures: 3011
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4270210
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 52 files compared)
Checked 227 log files, 198 edm output root files, 53 DQM output files
TriggerResults: no differences found

smuzaffar · 2025-12-17T14:41:10Z

please test with cms-sw/cmssw#49655 for CMSSW_16_0_PY312_X

cmsbuild · 2025-12-20T07:26:03Z

-1

Failed Tests: nvidia_h100UnitTests nvidia_l40sUnitTests nvidia_t4UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/50320/summary.html
COMMIT: 5f72516
CMSSW: CMSSW_16_0_PY312_X_2025-12-16-2300/el8_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10240/50320/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/50320/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/50320/git-merge-result

Comparison Summary

The workflows 2025.0010001, 2025.0000001, 2024.0070001, 2024.0060001, 2024.0050001, 2024.0040001, 2024.0030001, 2024.0020001, 2024.0010001, 2024.0000001, 2023.0020001, 2022.0030001 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

Summary:

You potentially removed 729 lines from the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 46678 differences found in the comparisons
Reco comparison had 4 failed jobs
DQMHistoTests: Total files compared: 53
DQMHistoTests: Total histograms compared: 4036186
DQMHistoTests: Total failures: 207981
DQMHistoTests: Total nulls: 267
DQMHistoTests: Total successes: 3827918
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 13071.691999999997 KiB( 49 files compared)
DQMHistoSizes: changed ( 16834.0,... ): 3141.484 KiB HLT/ScoutingOffline
DQMHistoSizes: changed ( 2022.0030001 ): 19.594 KiB Hcal/DigiRunHarvesting
DQMHistoSizes: changed ( 2022.0030001 ): 0.516 KiB RPC/DCSInfo
DQMHistoSizes: changed ( 2022.0030001 ): 0.191 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 2022.0030001 ): -0.066 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 2023.0020001 ): 60.117 KiB Hcal/DigiRunHarvesting
DQMHistoSizes: changed ( 2023.0020001,... ): 27.582 KiB PixelPhase1/Tracks
DQMHistoSizes: changed ( 2023.0020001 ): 2.961 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 2023.0020001 ): 1.582 KiB RPC/DCSInfo
DQMHistoSizes: changed ( 2023.0020001 ): -0.094 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 2024.0000001 ): ...
Checked 227 log files, 198 edm output root files, 53 DQM output files
TriggerResults: no differences found

smuzaffar · 2026-01-05T08:59:46Z

please test with cms-sw/cmssw#49655 for CMSSW_16_1_PY312_X

cmsbuild · 2026-01-06T12:47:05Z

Pull request #10240 was updated.

smuzaffar · 2026-01-06T12:47:15Z

please test with cms-sw/cmssw#49655 for CMSSW_16_1_PY312_X

cmsbuild · 2026-01-06T13:48:13Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/50448/summary.html
COMMIT: d113fa0
CMSSW: CMSSW_16_1_PY312_X_2026-01-05-2300/el8_amd64_gcc13
Additional Tests: GPU,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10240/50448/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed External Build

I found compilation warning when building: See details on the summary page.

smuzaffar · 2026-01-06T15:19:17Z

please test with cms-sw/cmssw#49655 for CMSSW_16_1_PY312_X

cmsbuild · 2026-01-06T15:19:25Z

Pull request #10240 was updated.

cmsbuild · 2026-01-07T04:13:16Z

-1

Failed Tests: nvidia_h100UnitTests nvidia_l40sUnitTests nvidia_t4UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/50452/summary.html
COMMIT: 1ba800b
CMSSW: CMSSW_16_1_PY312_X_2026-01-05-2300/el8_amd64_gcc13
Additional Tests: GPU,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10240/50452/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/50452/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-692b43/50452/git-merge-result

Comparison Summary

Summary:

You potentially added 226 lines to the logs
Reco comparison results: 2708 differences found in the comparisons
Reco comparison had 4 failed jobs
DQMHistoTests: Total files compared: 53
DQMHistoTests: Total histograms compared: 4280544
DQMHistoTests: Total failures: 6719
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4273805
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -0.002 KiB( 52 files compared)
DQMHistoSizes: changed ( 18434.0,... ): -0.001 KiB HLT/Filters
Checked 227 log files, 198 edm output root files, 53 DQM output files
TriggerResults: no differences found

[PY312] Use official eigen commit without cms patch

5f72516

cmsbuild added externals-pending pending-signatures tests-started orp-pending labels Dec 4, 2025

smuzaffar mentioned this pull request Dec 4, 2025

[nVidia][PY312] Assertion failures in DataFormats/Math/simpleCholeskyTest, RecoTracker/PixelTrackFitting/{testBrokenLineFitGPU_t, testEigenGPUNoFit_t, testFitsGPU_t} cms-sw/cmssw#49546

Open

cmsbuild added tests-rejected and removed tests-started labels Dec 10, 2025

cmsbuild added tests-started and removed tests-rejected labels Dec 10, 2025

cmsbuild added tests-rejected tests-started and removed tests-started tests-rejected labels Dec 10, 2025

cmsbuild added tests-rejected and removed tests-started labels Dec 13, 2025

cmsbuild added requires-external tests-started and removed tests-rejected labels Dec 17, 2025

smuzaffar changed the base branch from IB/CMSSW_16_0_X/py312 to IB/CMSSW_16_1_X/py312 December 18, 2025 13:46

cmsbuild added tests-rejected and removed tests-started labels Dec 20, 2025

cmsbuild added tests-started and removed tests-rejected labels Jan 5, 2026

update eigen with reduced CMS changes

d113fa0

smuzaffar changed the title ~~[PY312] Use official eigen commit without cms patch~~ [PY312] Use official eigen commit with minimum CMS changes Jan 6, 2026

cmsbuild added tests-pending and removed tests-started requires-external labels Jan 6, 2026

cmsbuild added tests-started requires-external and removed tests-pending labels Jan 6, 2026

cmsbuild added tests-rejected and removed tests-started labels Jan 6, 2026

Update eigen.spec

1ba800b

cmsbuild added tests-started and removed tests-rejected labels Jan 6, 2026

cmsbuild added tests-rejected and removed tests-started labels Jan 7, 2026

[PY312] Use official eigen commit with minimum CMS changes #10240

Are you sure you want to change the base?

[PY312] Use official eigen commit with minimum CMS changes #10240

Uh oh!

Conversation

smuzaffar commented Dec 4, 2025

Uh oh!

smuzaffar commented Dec 4, 2025

Uh oh!

smuzaffar commented Dec 4, 2025

Uh oh!

cmsbuild commented Dec 4, 2025

Uh oh!

cmsbuild commented Dec 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

smuzaffar commented Dec 5, 2025

Uh oh!

fwyzard commented Dec 9, 2025

Uh oh!

cmsbuild commented Dec 10, 2025

Comparison Summary

Uh oh!

fwyzard commented Dec 10, 2025

Uh oh!

cmsbuild commented Dec 10, 2025

Comparison Summary

Uh oh!

cmsbuild commented Dec 13, 2025

Comparison Summary

Uh oh!

smuzaffar commented Dec 17, 2025

Uh oh!

cmsbuild commented Dec 20, 2025

Comparison Summary

Uh oh!

smuzaffar commented Jan 5, 2026

Uh oh!

cmsbuild commented Jan 6, 2026

Uh oh!

smuzaffar commented Jan 6, 2026

Uh oh!

cmsbuild commented Jan 6, 2026

Failed External Build

Uh oh!

smuzaffar commented Jan 6, 2026

Uh oh!

cmsbuild commented Jan 6, 2026

Uh oh!

cmsbuild commented Jan 7, 2026

Comparison Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

cmsbuild commented Dec 4, 2025 •

edited

Loading