Exclude flaky wall-clock timing tests from default CI

Exclude flaky wall-clock timing tests from default CI #1164