-
Notifications
You must be signed in to change notification settings - Fork 5
Description
I have a question about how the pseudo labels on validation sets in Table 3 evaluated in code? I observed that the validation data in the scannet_subcloud.py is 1201 training data, and through generate_pseudo_label.py, it is possible to generate and evaluate 1201 pseudo labels of Training (i.e., Training in Table 3). I would like to know what comments or statements to add if I want to get the validation set evaluation?
In scannet_subcloud.py, I try to comment out the following lines of code:(line 414~418)
# Get number of clouds
self.input_trees['validation'] = self.input_trees['training']
self.input_colors['validation'] = self.input_colors['training']
self.input_vert_inds['validation'] = self.input_colors['training']
self.input_labels['validation'] = self.input_labels['training']
I also change the following code (line 447,remove the "not"):
if (not self.load_test) and 'train' in cloud_folder and cloud_name not in self.validation_clouds:
In addition, in generate_pseudo_label.py, I change the validation_size=312. After making these changes, an error occurs when running the generate_pseudo_label.py, as follows:
Traceback (most recent call last):
File "generate_pseudo_label.py", line 183, in
test_caller(chosen_log, chosen_snapshot, on_val)
File "generate_pseudo_label.py", line 131, in test_caller
tester.test_cloud_segmentation_on_val(model, dataset)
File "/home/chn/Downloads/Weakly Supervised/mprm-master/utils/tester_cam.py", line 543, in test_cloud_segmentation_on_val
probs = self.test_probs[i_val][dataset.validation_proj[i_val], :]
IndexError: list index out of range