FMS 2024.01 build segfaults with llvm Intel 2024.01/mpiifx on NOAA hercules platform

[GeorgeVandenberghe-NOAA]

/apps/spack-managed/oneapi-2024.1.0/intel-oneapi-mpi-2021.12.0-ehon7g4v724zl5ks5ihv53suriijlbpk/mpi/2021.12/bin/mpiifx -DENABLE_QUAD_PRECISION -DGFS_CONSTANTS -DGFS_PHYS -DHAVE_GETTID -DINTERNAL_FILE_NML -DOVERLOAD_R4 -DOVERLOAD_R8 -Duse_deprecated_io -Duse_libMPI -Duse_netCDF -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/fms -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/fms/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/fms2_io/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/string_utils/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/mpp/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/column_diagnostics/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/monin_obukhov/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/sat_vapor_pres/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/horiz_interp/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/diag_integral/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/random_numbers/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/diag_manager/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/constants4 -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/topography/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/axis_utils/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/mosaic2/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/constants -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/astronomy/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/field_manager/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/time_interp/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/tracer_manager/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/tridiagonal/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/interpolator/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/coupler/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/data_override/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/amip_interp/include -isystem /work/noaa/noaatest/gwv/herc/simstacks/simt/netcdf140.492.460.mapl241.fms2301.crtm240/include -fpp -fno-alias -auto -safe-cray-ptr -ftz -assume byterecl -align array64byte -nowarn -traceback -O2 -debug minimal -nowarn -qoverride-limits -qno-opt-dynamic-align -module include_r4 -real-size 32 -fiopenmp -c /work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/fms2_io/netcdf_io.F90 -o CMakeFiles/fms_r4_f.dir/fms2_io/netcdf_io.F90.o
#0 0x00000000023916e2Describe the bug

It does build with this compiler level on other platforms. WIll also report to Hercules admins

[bensonr]

@GeorgeVandenberghe-NOAA - Thanks for reporting, though this does seem to be system specific. It looks like your input for the issue was cut off. If so, can you provide the rest of the error message.

[GeorgeVandenberghe-NOAA]

Building Fortran object CMakeFiles/fms_r4_f.dir/fms2_io/netcdf_io.F90.o
/apps/spack-managed/oneapi-2024.1.0/intel-oneapi-mpi-2021.12.0-ehon7g4v724zl5ks5ihv53suriijlbpk/mpi/2021.12/bin/mpiifx -DENABLE_QUAD_PRECISION -DGFS_CONSTANTS -DGFS_PHYS -DHAVE_GETTID -DINTERNAL_FILE_NML -DOVERLOAD_R4 -DOVERLOAD_R8 -Duse_deprecated_io -Duse_libMPI -Duse_netCDF -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/fms -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/fms/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/fms2_io/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/string_utils/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/mpp/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/column_diagnostics/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/monin_obukhov/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/sat_vapor_pres/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/horiz_interp/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/diag_integral/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/random_numbers/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/diag_manager/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/constants4 -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/topography/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/axis_utils/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/mosaic2/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/constants -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/astronomy/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/field_manager/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/time_interp/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/tracer_manager/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/tridiagonal/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/interpolator/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/coupler/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/data_override/include -I/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/amip_interp/include -isystem /work/noaa/noaatest/gwv/herc/simstacks/simt/netcdf140.492.460.mapl241.fms2301.crtm240/include -fpp -fno-alias -auto -safe-cray-ptr -ftz -assume byterecl -align array64byte -nowarn -traceback -O2 -debug minimal -nowarn -qoverride-limits -qno-opt-dynamic-align -module include_r4 -real-size 32 -fiopenmp -c /work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/fms2_io/netcdf_io.F90 -o CMakeFiles/fms_r4_f.dir/fms2_io/netcdf_io.F90.o
#0 0x00000000023916e2
#1 0x00000000023f5bc7
#2 0x00000000023f5cf0
#3 0x00007ff8df112d90
#4 0x00000000028a0c88
#5 0x000000000289be8a
#6 0x000000000289b3c5
#7 0x0000000002897a55
#8 0x000000000284d3f8
#9 0x0000000002700b26
#10 0x00000000027089df
#11 0x00000000027022cf
#12 0x000000000232ede6
#13 0x000000000232cf52
#14 0x00000000022d97eb
#15 0x00000000024b171c
#16 0x00007ff8df0fdeb0
#17 0x00007ff8df0fdf60 __libc_start_main + 128
#18 0x00000000021134e9

/tmp/ifx0181314741gadzUm/ifxRvDRWF.i90: error #5633: Internal compiler error: segmentation violation signal raised Please report this error along with the circumstances in which it occurred in a Software Problem Report. Note: File and line given may not be explicit cause of this error.
compilation aborted for /work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/fms2_io/netcdf_io.F90 (code 3)
make[2]: *** [CMakeFiles/fms_r4_f.dir/build.make:816: CMakeFiles/fms_r4_f.dir/fms2_io/netcdf_io.F90.o] Error 3
make[2]: Leaving directory '/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/build'
make[1]: *** [CMakeFiles/Makefile2:119: CMakeFiles/fms_r4_f.dir/all] Error 2
make[1]: Leaving directory '/work/noaa/noaatest/gwv/herc/simstacks/simt/build/FMS-2024.01/build'
make: *** [Makefile:136: all] Error 2

[bensonr]

The "Internal compiler error" indicates a potential difference for this installation of the compiler. I'd suggest checking the exact build version by adding the "--version" flag to the compiler invocation and comparing it to the system installations where things work. It's possible Hercules has an earlier version within the same stream and not one of the patch versions.