Silence SUBPASS

[giampaolo]

Hello and sorry if I'm missing something or this has already been asked.
I find it extremely annoying that each subtest success is printed to stdout. E.g. when running psutil test suite I get:

[gw3] (pid=2846) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2847) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2848) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2849) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2850) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2851) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2852) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2853) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2854) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2855) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2856) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
[gw3] (pid=2857) SUBPASS psutil/tests/test_process_all.py::TestPidsRange::test_it 
...

I would like to configure this, and only print output when one or more sub-tests fail. Is it possible?
Incidentally, this would mimic unittest's behavior, which does NOT print output for passed subtests.

[nicoddemus]

Hi,

Currently, there’s no option to silence that behavior.

We have the --no-subtest-shortletter flag, but it only affects short letters (when -v is not used). We could either:

1. Add a new option, or

2. Rename/extend --no-subtest-shortletter to --no-subtest-reports to cover both short letters and verbose words.

If anyone would like to contribute this, I’d be happy to review a PR!

[giampaolo]

Would you be open to just silence anything != SUBFAIL by default? That would mimic unittest's behavior.

[nicoddemus]

Would you be open to just silence anything != SUBFAIL by default?

By default no, I think having feedback that the plugin is active is good.

[giampaolo]

@nicoddemus I created #199. Feel free to give me further directions if you want to change anything.