Pybind11 2.11.0 has proper support for numpy object dtype (`PyObject *`): https://github.com/pybind/pybind11/releases/tag/v2.11.0.