Skip to content

Questions about 6.2. pseudo label evaluation #4

@ruler9527

Description

@ruler9527

I have a question about how the pseudo labels on validation sets in Table 3 evaluated in code? I observed that the validation data in the scannet_subcloud.py is 1201 training data, and through generate_pseudo_label.py, it is possible to generate and evaluate 1201 pseudo labels of Training (i.e., Training in Table 3). I would like to know what comments or statements to add if I want to get the validation set evaluation?
In scannet_subcloud.py, I try to comment out the following lines of code:(line 414~418)
# Get number of clouds
self.input_trees['validation'] = self.input_trees['training']
self.input_colors['validation'] = self.input_colors['training']
self.input_vert_inds['validation'] = self.input_colors['training']
self.input_labels['validation'] = self.input_labels['training']
I also change the following code (line 447,remove the "not"):
if (not self.load_test) and 'train' in cloud_folder and cloud_name not in self.validation_clouds:
In addition, in generate_pseudo_label.py, I change the validation_size=312. After making these changes, an error occurs when running the generate_pseudo_label.py, as follows:
Traceback (most recent call last):
File "generate_pseudo_label.py", line 183, in
test_caller(chosen_log, chosen_snapshot, on_val)
File "generate_pseudo_label.py", line 131, in test_caller
tester.test_cloud_segmentation_on_val(model, dataset)
File "/home/chn/Downloads/Weakly Supervised/mprm-master/utils/tester_cam.py", line 543, in test_cloud_segmentation_on_val
probs = self.test_probs[i_val][dataset.validation_proj[i_val], :]
IndexError: list index out of range

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions