Multiview Inference Order of Four-View Sequence #23
Description
Body:
The order of the four-view sequence inferred by the multiview model in the previous step may not be fixed. It could be "left-front-right-rear" or "rear-left-front-right." What do you think could be the reason for this inconsistency?
For the subsequent LRM input, there is a requirement for the order of the four-view sequence. The code also includes camera encoding. However, when I randomly change the order of the four views, the results do not seem to change significantly.
Expected result:
The order of the four-view sequence should be consistent and follow the requirements for LRM input.
Actual result:
The order of the four-view sequence varies and does not seem to affect the results significantly.
Additional notes:
- Please provide insights into the potential causes of this behavior.
- Any suggestions on how to ensure a consistent four-view sequence order would be appreciated.