Skip to content

make test seems broken #26

@johnfgibson

Description

@johnfgibson

Describe the bug

On running "make test", many individual tests are reported to fail, even though the tests pass when run individually.

For example, running "make test" blow reports that chebyTest passes and laminarTest fails, but if you run each individually, they both emit "pass" and have return status 0 (correct termination).

gibson@sophist$ pwd
/home/gibson/channelflow-master/build_release

gibson@sophist$ make test
Running tests...
Test project /home/gibson/channelflow-master/build_release
        Start   1: unitTests
  1/105 Test   #1: unitTests ........................***Failed    2.06 sec
        Start   2: tridiag
  2/105 Test   #2: tridiag ..........................   Passed    0.06 sec
        Start   3: cheby
  3/105 Test   #3: cheby ............................   Passed    0.04 sec
        Start   4: laminar
  4/105 Test   #4: laminar ..........................***Failed    2.04 sec
        Start   5: helmholtz
  5/105 Test   #5: helmholtz ........................   Passed    0.12 sec
        Start   6: tausolver
  6/105 Test   #6: tausolver ........................***Failed    2.04 sec
        Start   7: poisson
  7/105 Test   #7: poisson ..........................***Failed    2.06 sec

^C^C make:  [Makefile:130: test] Interrupt

gibson@sophist$ tests/chebyTest | tail
chebyTest:         pass   
L1Dist(diff(integrate(g)), g) == 9.31699e-17
L1Dist(integrate(diff(gy)), g) == 0
trans  error == 2.27846e-18
d/dy   error == 1.3089e-15
d2/dy2 error == 2.24967e-14
test1
test2
test3
test4
           pass   
gibson@sophist$ echo $?
0

gibson@sophist$ tests/tausolverTest | tail

tausolverTest:           pass   
L2Dist(P,Ps)/L2Norm(P) == 1.9395e-14
L2Norm(udiv)  == 4.37638e-15
L2Norm(udivs) == 4.01131e-15
L2Dist(udiv,udivs)  == 5.1362e-15
 us(+/-1) == (-5.55112e-16, 1.59872e-14) (-1.44329e-15, 2.13163e-14)
 vs(+/-1) == (3.27516e-15, 7.85483e-15) (2.498e-15, 8.13238e-15)
vsy(+/-1) == (2.22045e-16, -1.27676e-15) (-6.66134e-16, 4.996e-16)
 ws(+/-1) == (6.66134e-16, 5.55112e-16) (4.44089e-16, -5.88418e-15)
 Ps(+/-1) == (-1.82077e-14, -4.36179e-14) (1.53766e-14, 4.25077e-14)
           pass   
gibson@sophist$ echo $?
0

Information on your system

openSUSE 15.2, openmpi3, gcc 7.5.0

This problem first appeared for me after upgrading to openSUSE 15.2 from 15.1. All the failed tests take about 2.06 seconds to execute, whereas the passing tests take fractions of a second. All the DNS tests fail.

cmake /home/gibson/gitworking/channelflow -DCMAKE_C_COMPILER=/usr/lib64/mpi/gcc/openmpi3/bin/mpicc -DCMAKE_CXX_COMPILER=/usr/lib64/mpi/gcc/openmpi3/bin/mpic++ -DCMAKE_BUILD_TYPE=release -DWITH_HDF5CXX=ON -DCMAKE_INSTALL_PREFIX=~/channelflow-masterster

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions