EVMC4U is a software which connects to Virtual Motion Capture (VMC) to get skeletal data from a VR player (using the VRM avatar format), while the player may be playing any VR game. Together with OBS, this could give a source of data for the MetaGen dataset.
The task would be to fork EVMC4U (or make something from scratch if easier), to make a program that connects to VMC and writes the data to a file or to a server (having both options could be nice), and it also launches OBS and starts recording VR view (can use https://github.com/baffler/OBS-OpenVR-Input-Plugin), as well as hearing, and speech. there may be the need for the user to set up the right audio devices, as well as doing the VMC callibration step, but shouldn't be too burdensome.