Proposal
Use proper ensemble modeling techniques to combine artifact detectors. From some of our plots, we can see that even a linear classifier on top of the two predictions could work better. Deriving its parameters from training data should yield better results in less time.
Current state
We combine multiple artifact detectors into a single final detection. We currently manually tweak their per-category thresholds and make them agree on the prediction. This is a time-consuming manual process and the result can be improved.