CUDA out of memory Error when using many metrics

[womackC]

Hey,
very nice repo!

I realised that when running many metrics at the same time, I get an out of memory error. I assume it is caused by loading all metric-models at the same time in https://github.com/wavlab-speech/versa/blob/main/versa/scorer_shared.py (line 44). When I run the metrics individually, I do not get that error.

Best,
Wolfgang

[ftshijt]

Thanks for reporting the issue. We do detect this issue and are working on fixing it by providing options for metric-oriented scoring. Will update here when the function is ready.