Skip wall-clock timing tests on CI to stop false-positive flake

Skip wall-clock timing tests on CI to stop false-positive flake #1221