Palladium conflicts with Umapyoi's Player Model

[Hogor2]

As shown in the image below, whenever you wear any of the Umamusume Souls in the curio slot, it would render the character on top of the umamusume model. I guess umapyoi hides the player model so it would show the umamusme one but instead palladium forces the player model to be visible.

Using
Palladium 4.2.3
Umapyoi 1.9.50 and all the mod dependencies