Upgrade to Spack v1.1.1 and related fixes.

[nkoukpaizan]

Merge request type

• New feature
• Resolves bug
• Documentation
• Other

Relates to

• OPFLOW
• SOPFLOW
• SCOPFLOW
• TCOPFLOW
• CMake build system
• Spack configuration
• Manual
• Web docs
• Other

This MR updates

• Header files
• Source code
• CMake build system
• Spack configuration
• Web docs
• Manual
• Other

Summary

This upgrades the Spack submodule to v1.1.1 and deprecates incompatible build configurations (deception, newell and incline) that are not being tested with the new configuration.

• With the Spack upgrade, now pointing to upstream Spack and using local Spack repos for modified packages that have yet to be contributed upstream. I plan to submit appropriate PRs to spack-packages once we know this works.
• Updated Frontier modules accordingly. romcc is no longer a supported compiler, and mixes compiler modules are deprecated on Frontier. The only way to get a performant Fortran compiler for coinhsl, etc., and support HIP is to load PrgEnv-gnu and rocm. So, most packages are built built withgcc unless there is HIP code.
• Moved deprecated configurations to deprecated folders with corresponding README files.

Linked Issue(s)

• Partially addresses Transition dependencies from submodules into spack #38 for spdlog

[pelesh]

CC @cameronrutherford

[nkoukpaizan]

@cameronrutherford Do you know a fix for the error I'm seeing?

Error: invalid push configuration for mirror local-buildcache: environment variable `***` (secret_variable) not set

Everything is building fine, but the push to the container registry is not working.

[nkoukpaizan]

@cameronrutherford Do you know a fix for the error I'm seeing?

Error: invalid push configuration for mirror local-buildcache: environment variable `***` (secret_variable) not set

Everything is building fine, but the push to the container registry is not working.

Finally figured out a way to make it work!

[cameronrutherford]

Some NITs, some other more interesting comments.

[cameronrutherford]

LGTM if CI passes. I'm sure you'll get a better review from a maintainer about the package.py recipe anyway.

[nkoukpaizan]

I fixed several issues related to running the tests in GH-Actions (e.g., detecting the maximum number of available cores for testing in parallel, fixing test dependencies in CMake when some EXAGO_ENABLE_* options are off). Now, we can also build against ipopt~coinhsl+mumps ^mumps+mpi.

I documented the main remaining issues in #201. I suggest we keep the Test build stage of GH-Actions commented out for now.