Apparently we might be able to swap the renderer to an [SVGRenderer](https://threejs.org/docs/#examples/en/renderers/SVGRenderer) for achieving this.