Unable to Reproduce Results with Provided Checkpoint

[TeaDrinkingGong]

Hello,

I am trying to reproduce the results using the checkpoint provided by the authors on HuggingFace, which is trained on the EmbodiedScan dataset (ScanNet part). However, I am unable to reproduce the same results as mentioned in the documentation. I didn't change any code before running the code.

Here is the command I am using to test the model:

python test.py ./configs/bip3d_det.py ./ckpt/det_rgbd_dat/model_checkpoint.pth

The results I am getting are:
+-------------------+---------+---------+---------+---------+
| classes | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+-------------------+---------+---------+---------+---------+
| couch | 0.1085 | 0.3918 | 0.0565 | 0.2239 |
| table | 0.2049 | 0.4313 | 0.1234 | 0.2500 |
| cabinet | 0.0515 | 0.2469 | 0.0160 | 0.0887 |
| shelf | 0.0708 | 0.2720 | 0.0206 | 0.1120 |
| pillar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| column | 0.0620 | 0.2353 | 0.0000 | 0.0000 |
| pillow | 0.0818 | 0.1671 | 0.0243 | 0.0808 |
| plant | 0.1188 | 0.1946 | 0.0267 | 0.0671 |
| curtain | 0.0660 | 0.2151 | 0.0104 | 0.0756 |
| chair | 0.1665 | 0.3262 | 0.0825 | 0.1526 |
| decoration | 0.0009 | 0.0690 | 0.0000 | 0.0000 |
| screen | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| cushion | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| fireplace | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stool | 0.0517 | 0.2105 | 0.0211 | 0.0987 |
| counter | 0.0214 | 0.1895 | 0.0008 | 0.0316 |
| bed | 0.1732 | 0.5069 | 0.0927 | 0.2431 |
| desk | 0.1368 | 0.4231 | 0.0569 | 0.2000 |
| door | 0.0865 | 0.1751 | 0.0042 | 0.0420 |
| blanket | 0.0233 | 0.2000 | 0.0074 | 0.0857 |
| furniture | 0.0009 | 0.2308 | 0.0000 | 0.0000 |
| ottoman | 0.0868 | 0.2500 | 0.0849 | 0.1731 |
| bar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stand | 0.1199 | 0.2803 | 0.0544 | 0.1288 |
| book | 0.0190 | 0.1009 | 0.0013 | 0.0168 |
| piano | 0.1670 | 0.2500 | 0.0855 | 0.1667 |
| carpet | 0.0052 | 0.0417 | 0.0000 | 0.0000 |
| bicycle | 0.0040 | 0.1000 | 0.0000 | 0.0000 |
| bench | 0.1109 | 0.3793 | 0.0387 | 0.1379 |
| doorframe | 0.0304 | 0.2222 | 0.0005 | 0.0458 |
| bottle | 0.0270 | 0.0790 | 0.0015 | 0.0082 |
| picture | 0.0148 | 0.0721 | 0.0058 | 0.0203 |
| bathtub | 0.2857 | 0.5238 | 0.1466 | 0.3571 |
| light | 0.0145 | 0.0563 | 0.0020 | 0.0141 |
| keyboard | 0.0630 | 0.0825 | 0.0000 | 0.0000 |
| oven | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| wardrobe | 0.0083 | 0.2593 | 0.0000 | 0.0000 |
| blinds | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| tv | 0.0106 | 0.0968 | 0.0022 | 0.0108 |
| sheet | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| window | 0.0279 | 0.2004 | 0.0032 | 0.0292 |
| printer | 0.2009 | 0.2679 | 0.1047 | 0.1250 |
| sink | 0.1704 | 0.2346 | 0.0433 | 0.0782 |
| bin | 0.0839 | 0.1919 | 0.0381 | 0.0904 |
| sign | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| rail | 0.0307 | 0.1053 | 0.0000 | 0.0000 |
| stairs | 0.0000 | 0.0769 | 0.0000 | 0.0000 |
| mirror | 0.0173 | 0.1406 | 0.0002 | 0.0156 |
| clothes | 0.0174 | 0.1211 | 0.0098 | 0.0547 |
| ladder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| pipe | 0.0068 | 0.1818 | 0.0000 | 0.0000 |
| case | 0.0032 | 0.1091 | 0.0000 | 0.0182 |
| shower | 0.0245 | 0.1316 | 0.0002 | 0.0263 |
| scale | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| clock | 0.0725 | 0.0909 | 0.0227 | 0.0227 |
| backpack | 0.0889 | 0.1455 | 0.0319 | 0.0606 |
| refrigerator | 0.0755 | 0.1573 | 0.0567 | 0.1011 |
| toilet | 0.2347 | 0.4565 | 0.1606 | 0.2283 |
| basket | 0.0402 | 0.1667 | 0.0401 | 0.1389 |
| guitar | 0.0500 | 0.0500 | 0.0000 | 0.0000 |
| tissue box | 0.0456 | 0.0943 | 0.0000 | 0.0000 |
| dish rack | 0.0441 | 0.1429 | 0.0357 | 0.0714 |
| microwave | 0.1366 | 0.1667 | 0.0654 | 0.1061 |
| toaster | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| shoe | 0.0078 | 0.0078 | 0.0078 | 0.0078 |
| speaker | 0.0238 | 0.0714 | 0.0000 | 0.0000 |
| paper | 0.0075 | 0.0438 | 0.0000 | 0.0037 |
| computer | 0.0012 | 0.0506 | 0.0001 | 0.0127 |
| remote control | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| cup | 0.0202 | 0.0610 | 0.0075 | 0.0122 |
| towel | 0.0447 | 0.1126 | 0.0149 | 0.0303 |
| switch | 0.0087 | 0.0352 | 0.0000 | 0.0000 |
| pot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bowl | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| lamp | 0.0500 | 0.1366 | 0.0178 | 0.0617 |
| box | 0.0155 | 0.0912 | 0.0041 | 0.0185 |
| toy | 0.0309 | 0.1143 | 0.0001 | 0.0286 |
| plate | 0.0351 | 0.0526 | 0.0000 | 0.0000 |
| monitor | 0.1114 | 0.1984 | 0.0394 | 0.0794 |
| board | 0.0164 | 0.1270 | 0.0159 | 0.0159 |
| calendar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| jacket | 0.0308 | 0.0702 | 0.0175 | 0.0175 |
| telephone | 0.0558 | 0.1220 | 0.0030 | 0.0122 |
| socket | 0.0018 | 0.0177 | 0.0001 | 0.0018 |
| vase | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| mat | 0.0625 | 0.0625 | 0.0000 | 0.0000 |
| dresser | 0.0568 | 0.2568 | 0.0145 | 0.1081 |
| container | 0.0001 | 0.0556 | 0.0000 | 0.0000 |
| pool table | 0.6667 | 0.6667 | 0.6667 | 0.6667 |
| car | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bucket | 0.0119 | 0.0476 | 0.0119 | 0.0476 |
| rack | 0.0004 | 0.1176 | 0.0001 | 0.0588 |
| vanity | 0.0533 | 0.2812 | 0.0409 | 0.1250 |
| tray | 0.0018 | 0.0833 | 0.0000 | 0.0000 |
| statue | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| shovel | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| wrap | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| kettle | 0.0016 | 0.1053 | 0.0007 | 0.0526 |
| hanger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| toilet paper | 0.0548 | 0.0652 | 0.0199 | 0.0326 |
| washbasin | 0.0001 | 0.0667 | 0.0000 | 0.0000 |
| basin | 0.0696 | 0.2857 | 0.0110 | 0.1429 |
| stove | 0.1656 | 0.2632 | 0.1634 | 0.2368 |
| frame | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| washing machine | 0.0505 | 0.3846 | 0.0479 | 0.2308 |
| tissue | 0.1667 | 0.1667 | 0.0185 | 0.0556 |
| hamper | 0.0014 | 0.0526 | 0.0014 | 0.0526 |
| range hood | 0.0985 | 0.1429 | 0.0000 | 0.0000 |
| blackboard | 0.0334 | 0.1126 | 0.0080 | 0.0331 |
| flowerpot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| faucet | 0.0330 | 0.1200 | 0.0000 | 0.0000 |
| brush | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| vacuum cleaner | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| clothes dryer | 0.2301 | 0.5556 | 0.2290 | 0.4444 |
| fruit | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| helmets | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bag | 0.0052 | 0.0714 | 0.0019 | 0.0317 |
| purse | 0.0325 | 0.1250 | 0.0312 | 0.0625 |
| stall | 0.0090 | 0.1724 | 0.0000 | 0.0000 |
| fire extinguisher | 0.0833 | 0.0833 | 0.0000 | 0.0000 |
| holder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| machine | 0.0019 | 0.1111 | 0.0000 | 0.0000 |
| fan | 0.0967 | 0.2093 | 0.0233 | 0.0465 |
| mattress | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| ledge | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| rod | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| coffee maker | 0.0017 | 0.0667 | 0.0000 | 0.0000 |
| radiator | 0.0521 | 0.0993 | 0.0081 | 0.0284 |
| hat | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| wire | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| windowsill | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| grab bar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| poster | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| divider | 0.0106 | 0.4286 | 0.0019 | 0.1429 |
| globe | 0.2000 | 0.2000 | 0.0000 | 0.0000 |
| mouse | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| map | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| structure | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| candle | 0.2150 | 0.3333 | 0.0833 | 0.0833 |
| notebook | 0.0067 | 0.1667 | 0.0000 | 0.0000 |
| trophy | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bread | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| pitcher | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| soap | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| luggage | 0.0014 | 0.2000 | 0.0000 | 0.0000 |
| radio | 0.1667 | 0.1667 | 0.0000 | 0.0000 |
| pen | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| folder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| person | 0.0889 | 0.1667 | 0.0060 | 0.0417 |
| package | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| mask | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| door knob | 0.5000 | 0.5000 | 0.0000 | 0.0000 |
| coil | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| plug | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| plunger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| water cooler | 0.0452 | 0.1429 | 0.0000 | 0.0000 |
| soap dispenser | 0.0273 | 0.0526 | 0.0273 | 0.0526 |
| dispenser | 0.0569 | 0.1067 | 0.0180 | 0.0400 |
| stopcock | 0.0171 | 0.0769 | 0.0000 | 0.0000 |
| chandelier | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| control | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| toothbrush | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| copier | 0.1302 | 0.3333 | 0.0679 | 0.2222 |
| laptop | 0.1533 | 0.3056 | 0.0842 | 0.1111 |
| alarm | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| scissors | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| air conditioner | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| magazine | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| cart | 0.0635 | 0.0952 | 0.0079 | 0.0476 |
| dvd | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| vent | 0.0500 | 0.1000 | 0.0000 | 0.0000 |
| projector | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| tube | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| soap dish | 0.0208 | 0.1250 | 0.0000 | 0.0000 |
| support | 0.0736 | 0.2857 | 0.0130 | 0.1429 |
| pool | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| ball | 0.0391 | 0.0769 | 0.0000 | 0.0000 |
| file | 0.0048 | 0.0333 | 0.0000 | 0.0000 |
| spoon | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| teapot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| toiletry | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| broom | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| mailbox | 0.2073 | 0.4000 | 0.2000 | 0.2000 |
| paper cutter | 0.0034 | 0.1111 | 0.0008 | 0.0741 |
| camera | 1.0000 | 1.0000 | 1.0000 | 1.0000 |
| sunglasses | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| eraser | 0.0250 | 0.1000 | 0.0000 | 0.0000 |
| dumbbell | 0.1230 | 0.1481 | 0.0185 | 0.0370 |
| coat hanger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dustpan | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| toothpaste | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stapler | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dishwasher | 0.0111 | 0.0667 | 0.0111 | 0.0667 |
| hair dryer | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| headphones | 0.0833 | 0.1667 | 0.0833 | 0.1667 |
| cosmetics | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| adhesive tape | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
+-------------------+---------+---------+---------+---------+
| Overall | 0.0487 | 0.1144 | 0.0235 | 0.0466 |
+-------------------+---------+---------+---------+---------+
07/15 22:02:26 - mmengine - INFO -
+-----------------+---------+---------+---------+---------+
| head_classes | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+-----------------+---------+---------+---------+---------+
| chair | 0.1665 | 0.3262 | 0.0825 | 0.1526 |
| picture | 0.0148 | 0.0721 | 0.0058 | 0.0203 |
| door | 0.0865 | 0.1751 | 0.0042 | 0.0420 |
| pillow | 0.0818 | 0.1671 | 0.0243 | 0.0808 |
| cabinet | 0.0515 | 0.2469 | 0.0160 | 0.0887 |
| table | 0.2049 | 0.4313 | 0.1234 | 0.2500 |
| book | 0.0190 | 0.1009 | 0.0013 | 0.0168 |
| window | 0.0279 | 0.2004 | 0.0032 | 0.0292 |
| box | 0.0155 | 0.0912 | 0.0041 | 0.0185 |
| doorframe | 0.0304 | 0.2222 | 0.0005 | 0.0458 |
| shelf | 0.0708 | 0.2720 | 0.0206 | 0.1120 |
| light | 0.0145 | 0.0563 | 0.0020 | 0.0141 |
| plant | 0.1188 | 0.1946 | 0.0267 | 0.0671 |
| paper | 0.0075 | 0.0438 | 0.0000 | 0.0037 |
| bin | 0.0839 | 0.1919 | 0.0381 | 0.0904 |
| curtain | 0.0660 | 0.2151 | 0.0104 | 0.0756 |
| bottle | 0.0270 | 0.0790 | 0.0015 | 0.0082 |
| lamp | 0.0500 | 0.1366 | 0.0178 | 0.0617 |
| couch | 0.1085 | 0.3918 | 0.0565 | 0.2239 |
| towel | 0.0447 | 0.1126 | 0.0149 | 0.0303 |
| sink | 0.1704 | 0.2346 | 0.0433 | 0.0782 |
| socket | 0.0018 | 0.0177 | 0.0001 | 0.0018 |
| clothes | 0.0174 | 0.1211 | 0.0098 | 0.0547 |
| desk | 0.1368 | 0.4231 | 0.0569 | 0.2000 |
| stand | 0.1199 | 0.2803 | 0.0544 | 0.1288 |
| monitor | 0.1114 | 0.1984 | 0.0394 | 0.0794 |
| stool | 0.0517 | 0.2105 | 0.0211 | 0.0987 |
| mirror | 0.0173 | 0.1406 | 0.0002 | 0.0156 |
| case | 0.0032 | 0.1091 | 0.0000 | 0.0182 |
| decoration | 0.0009 | 0.0690 | 0.0000 | 0.0000 |
| bag | 0.0052 | 0.0714 | 0.0019 | 0.0317 |
| bed | 0.1732 | 0.5069 | 0.0927 | 0.2431 |
| cup | 0.0202 | 0.0610 | 0.0075 | 0.0122 |
| switch | 0.0087 | 0.0352 | 0.0000 | 0.0000 |
| shoe | 0.0078 | 0.0078 | 0.0078 | 0.0078 |
| toilet | 0.2347 | 0.4565 | 0.1606 | 0.2283 |
| counter | 0.0214 | 0.1895 | 0.0008 | 0.0316 |
| tv | 0.0106 | 0.0968 | 0.0022 | 0.0108 |
| backpack | 0.0889 | 0.1455 | 0.0319 | 0.0606 |
| carpet | 0.0052 | 0.0417 | 0.0000 | 0.0000 |
| basket | 0.0402 | 0.1667 | 0.0401 | 0.1389 |
| cushion | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| rail | 0.0307 | 0.1053 | 0.0000 | 0.0000 |
| blanket | 0.0233 | 0.2000 | 0.0074 | 0.0857 |
| blackboard | 0.0334 | 0.1126 | 0.0080 | 0.0331 |
| radiator | 0.0521 | 0.0993 | 0.0081 | 0.0284 |
| toilet paper | 0.0548 | 0.0652 | 0.0199 | 0.0326 |
| bench | 0.1109 | 0.3793 | 0.0387 | 0.1379 |
| keyboard | 0.0630 | 0.0825 | 0.0000 | 0.0000 |
| board | 0.0164 | 0.1270 | 0.0159 | 0.0159 |
| stairs | 0.0000 | 0.0769 | 0.0000 | 0.0000 |
| plate | 0.0351 | 0.0526 | 0.0000 | 0.0000 |
| refrigerator | 0.0755 | 0.1573 | 0.0567 | 0.1011 |
| frame | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| wardrobe | 0.0083 | 0.2593 | 0.0000 | 0.0000 |
| telephone | 0.0558 | 0.1220 | 0.0030 | 0.0122 |
| vase | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| computer | 0.0012 | 0.0506 | 0.0001 | 0.0127 |
| windowsill | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bathtub | 0.2857 | 0.5238 | 0.1466 | 0.3571 |
| ottoman | 0.0868 | 0.2500 | 0.0849 | 0.1731 |
| toy | 0.0309 | 0.1143 | 0.0001 | 0.0286 |
| column | 0.0620 | 0.2353 | 0.0000 | 0.0000 |
| rack | 0.0004 | 0.1176 | 0.0001 | 0.0588 |
| clock | 0.0725 | 0.0909 | 0.0227 | 0.0227 |
| dresser | 0.0568 | 0.2568 | 0.0145 | 0.1081 |
| faucet | 0.0330 | 0.1200 | 0.0000 | 0.0000 |
| flowerpot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bucket | 0.0119 | 0.0476 | 0.0119 | 0.0476 |
| bowl | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dispenser | 0.0569 | 0.1067 | 0.0180 | 0.0400 |
| mouse | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| microwave | 0.1366 | 0.1667 | 0.0654 | 0.1061 |
| container | 0.0001 | 0.0556 | 0.0000 | 0.0000 |
| stove | 0.1656 | 0.2632 | 0.1634 | 0.2368 |
| fan | 0.0967 | 0.2093 | 0.0233 | 0.0465 |
| pot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| blinds | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| shower | 0.0245 | 0.1316 | 0.0002 | 0.0263 |
| mat | 0.0625 | 0.0625 | 0.0000 | 0.0000 |
| laptop | 0.1533 | 0.3056 | 0.0842 | 0.1111 |
| remote control | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| washing machine | 0.0505 | 0.3846 | 0.0479 | 0.2308 |
| tissue box | 0.0456 | 0.0943 | 0.0000 | 0.0000 |
| pillar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| printer | 0.2009 | 0.2679 | 0.1047 | 0.1250 |
+-----------------+---------+---------+---------+---------+
| Overall | 0.0550 | 0.1512 | 0.0229 | 0.0587 |
+-----------------+---------+---------+---------+---------+
07/15 22:02:26 - mmengine - INFO -
+-------------------+---------+---------+---------+---------+
| common_classes | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+-------------------+---------+---------+---------+---------+
| poster | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| oven | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| fireplace | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| washbasin | 0.0001 | 0.0667 | 0.0000 | 0.0000 |
| statue | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| jacket | 0.0308 | 0.0702 | 0.0175 | 0.0175 |
| pipe | 0.0068 | 0.1818 | 0.0000 | 0.0000 |
| sign | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| vanity | 0.0533 | 0.2812 | 0.0409 | 0.1250 |
| soap dispenser | 0.0273 | 0.0526 | 0.0273 | 0.0526 |
| vent | 0.0500 | 0.1000 | 0.0000 | 0.0000 |
| clothes dryer | 0.2301 | 0.5556 | 0.2290 | 0.4444 |
| rod | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stopcock | 0.0171 | 0.0769 | 0.0000 | 0.0000 |
| speaker | 0.0238 | 0.0714 | 0.0000 | 0.0000 |
| bar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| tissue | 0.1667 | 0.1667 | 0.0185 | 0.0556 |
| candle | 0.2150 | 0.3333 | 0.0833 | 0.0833 |
| coffee maker | 0.0017 | 0.0667 | 0.0000 | 0.0000 |
| range hood | 0.0985 | 0.1429 | 0.0000 | 0.0000 |
| kettle | 0.0016 | 0.1053 | 0.0007 | 0.0526 |
| file | 0.0048 | 0.0333 | 0.0000 | 0.0000 |
| plug | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| alarm | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bicycle | 0.0040 | 0.1000 | 0.0000 | 0.0000 |
| purse | 0.0325 | 0.1250 | 0.0312 | 0.0625 |
| toiletry | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| brush | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| pen | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| ball | 0.0391 | 0.0769 | 0.0000 | 0.0000 |
| soap dish | 0.0208 | 0.1250 | 0.0000 | 0.0000 |
| basin | 0.0696 | 0.2857 | 0.0110 | 0.1429 |
| dumbbell | 0.1230 | 0.1481 | 0.0185 | 0.0370 |
| tube | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stall | 0.0090 | 0.1724 | 0.0000 | 0.0000 |
| hanger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| chandelier | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| copier | 0.1302 | 0.3333 | 0.0679 | 0.2222 |
| hamper | 0.0014 | 0.0526 | 0.0014 | 0.0526 |
| notebook | 0.0067 | 0.1667 | 0.0000 | 0.0000 |
| dishwasher | 0.0111 | 0.0667 | 0.0111 | 0.0667 |
| teapot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| vacuum cleaner | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| hat | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| folder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| fire extinguisher | 0.0833 | 0.0833 | 0.0000 | 0.0000 |
| air conditioner | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| piano | 0.1670 | 0.2500 | 0.0855 | 0.1667 |
| ladder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| scale | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| tray | 0.0018 | 0.0833 | 0.0000 | 0.0000 |
| ledge | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| machine | 0.0019 | 0.1111 | 0.0000 | 0.0000 |
| guitar | 0.0500 | 0.0500 | 0.0000 | 0.0000 |
| furniture | 0.0009 | 0.2308 | 0.0000 | 0.0000 |
| person | 0.0889 | 0.1667 | 0.0060 | 0.0417 |
| cart | 0.0635 | 0.0952 | 0.0079 | 0.0476 |
| paper cutter | 0.0034 | 0.1111 | 0.0008 | 0.0741 |
| screen | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| fruit | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| soap | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| mask | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| calendar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| trophy | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dish rack | 0.0441 | 0.1429 | 0.0357 | 0.0714 |
| hair dryer | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| holder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| sunglasses | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| headphones | 0.0833 | 0.1667 | 0.0833 | 0.1667 |
+-------------------+---------+---------+---------+---------+
| Overall | 0.0285 | 0.0790 | 0.0113 | 0.0287 |
+-------------------+---------+---------+---------+---------+
07/15 22:02:26 - mmengine - INFO -
+---------------+---------+---------+---------+---------+
| tail_classes | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+---------------+---------+---------+---------+---------+
| mailbox | 0.2073 | 0.4000 | 0.2000 | 0.2000 |
| toaster | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| water cooler | 0.0452 | 0.1429 | 0.0000 | 0.0000 |
| toothbrush | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| broom | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| wrap | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| grab bar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| plunger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| toothpaste | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| pitcher | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| eraser | 0.0250 | 0.1000 | 0.0000 | 0.0000 |
| projector | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| luggage | 0.0014 | 0.2000 | 0.0000 | 0.0000 |
| helmets | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| divider | 0.0106 | 0.4286 | 0.0019 | 0.1429 |
| magazine | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| spoon | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| structure | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| mattress | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| adhesive tape | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| shovel | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stapler | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| coil | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dustpan | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bread | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| globe | 0.2000 | 0.2000 | 0.0000 | 0.0000 |
| pool table | 0.6667 | 0.6667 | 0.6667 | 0.6667 |
| car | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| map | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| radio | 0.1667 | 0.1667 | 0.0000 | 0.0000 |
| wire | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| sheet | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| support | 0.0736 | 0.2857 | 0.0130 | 0.1429 |
| scissors | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| cosmetics | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| pool | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| control | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dvd | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| package | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| coat hanger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| door knob | 0.5000 | 0.5000 | 0.0000 | 0.0000 |
| camera | 1.0000 | 1.0000 | 1.0000 | 1.0000 |
+---------------+---------+---------+---------+---------+
| Overall | 0.0690 | 0.0974 | 0.0448 | 0.0512 |
+---------------+---------+---------+---------+---------+
07/15 22:03:41 - mmengine - INFO -
+----------------+---------+---------+---------+---------+
| area | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+----------------+---------+---------+---------+---------+
| small_Overall | 0.0191 | 0.0481 | 0.0018 | 0.0054 |
| medium_Overall | 0.0522 | 0.1254 | 0.0260 | 0.0559 |
| large_Overall | 0.0470 | 0.1887 | 0.0245 | 0.0608 |
+----------------+---------+---------+---------+---------+
=================== scannet =========================
eval : 600, 600, rank: 0
07/15 22:04:13 - mmengine - INFO -
+-------------------+---------+---------+---------+---------+
| classes | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+-------------------+---------+---------+---------+---------+
| couch | 0.1085 | 0.3918 | 0.0565 | 0.2239 |
| table | 0.2049 | 0.4313 | 0.1234 | 0.2500 |
| cabinet | 0.0515 | 0.2469 | 0.0160 | 0.0887 |
| shelf | 0.0708 | 0.2720 | 0.0206 | 0.1120 |
| pillar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| column | 0.0620 | 0.2353 | 0.0000 | 0.0000 |
| pillow | 0.0818 | 0.1671 | 0.0243 | 0.0808 |
| plant | 0.1188 | 0.1946 | 0.0267 | 0.0671 |
| curtain | 0.0660 | 0.2151 | 0.0104 | 0.0756 |
| chair | 0.1665 | 0.3262 | 0.0825 | 0.1526 |
| decoration | 0.0009 | 0.0690 | 0.0000 | 0.0000 |
| screen | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| cushion | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| fireplace | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stool | 0.0517 | 0.2105 | 0.0211 | 0.0987 |
| counter | 0.0214 | 0.1895 | 0.0008 | 0.0316 |
| bed | 0.1732 | 0.5069 | 0.0927 | 0.2431 |
| desk | 0.1368 | 0.4231 | 0.0569 | 0.2000 |
| door | 0.0865 | 0.1751 | 0.0042 | 0.0420 |
| blanket | 0.0233 | 0.2000 | 0.0074 | 0.0857 |
| furniture | 0.0009 | 0.2308 | 0.0000 | 0.0000 |
| ottoman | 0.0868 | 0.2500 | 0.0849 | 0.1731 |
| bar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stand | 0.1199 | 0.2803 | 0.0544 | 0.1288 |
| book | 0.0190 | 0.1009 | 0.0013 | 0.0168 |
| piano | 0.1670 | 0.2500 | 0.0855 | 0.1667 |
| carpet | 0.0052 | 0.0417 | 0.0000 | 0.0000 |
| bicycle | 0.0040 | 0.1000 | 0.0000 | 0.0000 |
| bench | 0.1109 | 0.3793 | 0.0387 | 0.1379 |
| doorframe | 0.0304 | 0.2222 | 0.0005 | 0.0458 |
| bottle | 0.0270 | 0.0790 | 0.0015 | 0.0082 |
| picture | 0.0148 | 0.0721 | 0.0058 | 0.0203 |
| bathtub | 0.2857 | 0.5238 | 0.1466 | 0.3571 |
| light | 0.0145 | 0.0563 | 0.0020 | 0.0141 |
| keyboard | 0.0630 | 0.0825 | 0.0000 | 0.0000 |
| oven | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| wardrobe | 0.0083 | 0.2593 | 0.0000 | 0.0000 |
| blinds | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| tv | 0.0106 | 0.0968 | 0.0022 | 0.0108 |
| sheet | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| window | 0.0279 | 0.2004 | 0.0032 | 0.0292 |
| printer | 0.2009 | 0.2679 | 0.1047 | 0.1250 |
| sink | 0.1704 | 0.2346 | 0.0433 | 0.0782 |
| bin | 0.0839 | 0.1919 | 0.0381 | 0.0904 |
| sign | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| rail | 0.0307 | 0.1053 | 0.0000 | 0.0000 |
| stairs | 0.0000 | 0.0769 | 0.0000 | 0.0000 |
| mirror | 0.0173 | 0.1406 | 0.0002 | 0.0156 |
| clothes | 0.0174 | 0.1211 | 0.0098 | 0.0547 |
| ladder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| pipe | 0.0068 | 0.1818 | 0.0000 | 0.0000 |
| case | 0.0032 | 0.1091 | 0.0000 | 0.0182 |
| shower | 0.0245 | 0.1316 | 0.0002 | 0.0263 |
| scale | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| clock | 0.0725 | 0.0909 | 0.0227 | 0.0227 |
| backpack | 0.0889 | 0.1455 | 0.0319 | 0.0606 |
| refrigerator | 0.0755 | 0.1573 | 0.0567 | 0.1011 |
| toilet | 0.2347 | 0.4565 | 0.1606 | 0.2283 |
| basket | 0.0402 | 0.1667 | 0.0401 | 0.1389 |
| guitar | 0.0500 | 0.0500 | 0.0000 | 0.0000 |
| tissue box | 0.0456 | 0.0943 | 0.0000 | 0.0000 |
| dish rack | 0.0441 | 0.1429 | 0.0357 | 0.0714 |
| microwave | 0.1366 | 0.1667 | 0.0654 | 0.1061 |
| toaster | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| shoe | 0.0078 | 0.0078 | 0.0078 | 0.0078 |
| speaker | 0.0238 | 0.0714 | 0.0000 | 0.0000 |
| paper | 0.0075 | 0.0438 | 0.0000 | 0.0037 |
| computer | 0.0012 | 0.0506 | 0.0001 | 0.0127 |
| remote control | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| cup | 0.0202 | 0.0610 | 0.0075 | 0.0122 |
| towel | 0.0447 | 0.1126 | 0.0149 | 0.0303 |
| switch | 0.0087 | 0.0352 | 0.0000 | 0.0000 |
| pot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bowl | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| lamp | 0.0500 | 0.1366 | 0.0178 | 0.0617 |
| box | 0.0155 | 0.0912 | 0.0041 | 0.0185 |
| toy | 0.0309 | 0.1143 | 0.0001 | 0.0286 |
| plate | 0.0351 | 0.0526 | 0.0000 | 0.0000 |
| monitor | 0.1114 | 0.1984 | 0.0394 | 0.0794 |
| board | 0.0164 | 0.1270 | 0.0159 | 0.0159 |
| calendar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| jacket | 0.0308 | 0.0702 | 0.0175 | 0.0175 |
| telephone | 0.0558 | 0.1220 | 0.0030 | 0.0122 |
| socket | 0.0018 | 0.0177 | 0.0001 | 0.0018 |
| vase | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| mat | 0.0625 | 0.0625 | 0.0000 | 0.0000 |
| dresser | 0.0568 | 0.2568 | 0.0145 | 0.1081 |
| container | 0.0001 | 0.0556 | 0.0000 | 0.0000 |
| pool table | 0.6667 | 0.6667 | 0.6667 | 0.6667 |
| car | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bucket | 0.0119 | 0.0476 | 0.0119 | 0.0476 |
| rack | 0.0004 | 0.1176 | 0.0001 | 0.0588 |
| vanity | 0.0533 | 0.2812 | 0.0409 | 0.1250 |
| tray | 0.0018 | 0.0833 | 0.0000 | 0.0000 |
| statue | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| shovel | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| wrap | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| kettle | 0.0016 | 0.1053 | 0.0007 | 0.0526 |
| hanger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| toilet paper | 0.0548 | 0.0652 | 0.0199 | 0.0326 |
| washbasin | 0.0001 | 0.0667 | 0.0000 | 0.0000 |
| basin | 0.0696 | 0.2857 | 0.0110 | 0.1429 |
| stove | 0.1656 | 0.2632 | 0.1634 | 0.2368 |
| frame | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| washing machine | 0.0505 | 0.3846 | 0.0479 | 0.2308 |
| tissue | 0.1667 | 0.1667 | 0.0185 | 0.0556 |
| hamper | 0.0014 | 0.0526 | 0.0014 | 0.0526 |
| range hood | 0.0985 | 0.1429 | 0.0000 | 0.0000 |
| blackboard | 0.0334 | 0.1126 | 0.0080 | 0.0331 |
| flowerpot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| faucet | 0.0330 | 0.1200 | 0.0000 | 0.0000 |
| brush | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| vacuum cleaner | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| clothes dryer | 0.2301 | 0.5556 | 0.2290 | 0.4444 |
| fruit | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| helmets | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bag | 0.0052 | 0.0714 | 0.0019 | 0.0317 |
| purse | 0.0325 | 0.1250 | 0.0312 | 0.0625 |
| stall | 0.0090 | 0.1724 | 0.0000 | 0.0000 |
| fire extinguisher | 0.0833 | 0.0833 | 0.0000 | 0.0000 |
| holder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| machine | 0.0019 | 0.1111 | 0.0000 | 0.0000 |
| fan | 0.0967 | 0.2093 | 0.0233 | 0.0465 |
| mattress | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| ledge | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| rod | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| coffee maker | 0.0017 | 0.0667 | 0.0000 | 0.0000 |
| radiator | 0.0521 | 0.0993 | 0.0081 | 0.0284 |
| hat | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| wire | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| windowsill | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| grab bar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| poster | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| divider | 0.0106 | 0.4286 | 0.0019 | 0.1429 |
| globe | 0.2000 | 0.2000 | 0.0000 | 0.0000 |
| mouse | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| map | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| structure | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| candle | 0.2150 | 0.3333 | 0.0833 | 0.0833 |
| notebook | 0.0067 | 0.1667 | 0.0000 | 0.0000 |
| trophy | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bread | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| pitcher | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| soap | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| luggage | 0.0014 | 0.2000 | 0.0000 | 0.0000 |
| radio | 0.1667 | 0.1667 | 0.0000 | 0.0000 |
| pen | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| folder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| person | 0.0889 | 0.1667 | 0.0060 | 0.0417 |
| package | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| mask | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| door knob | 0.5000 | 0.5000 | 0.0000 | 0.0000 |
| coil | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| plug | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| plunger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| water cooler | 0.0452 | 0.1429 | 0.0000 | 0.0000 |
| soap dispenser | 0.0273 | 0.0526 | 0.0273 | 0.0526 |
| dispenser | 0.0569 | 0.1067 | 0.0180 | 0.0400 |
| stopcock | 0.0171 | 0.0769 | 0.0000 | 0.0000 |
| chandelier | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| control | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| toothbrush | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| copier | 0.1302 | 0.3333 | 0.0679 | 0.2222 |
| laptop | 0.1533 | 0.3056 | 0.0842 | 0.1111 |
| alarm | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| scissors | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| air conditioner | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| magazine | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| cart | 0.0635 | 0.0952 | 0.0079 | 0.0476 |
| dvd | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| vent | 0.0500 | 0.1000 | 0.0000 | 0.0000 |
| projector | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| tube | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| soap dish | 0.0208 | 0.1250 | 0.0000 | 0.0000 |
| support | 0.0736 | 0.2857 | 0.0130 | 0.1429 |
| pool | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| ball | 0.0391 | 0.0769 | 0.0000 | 0.0000 |
| file | 0.0048 | 0.0333 | 0.0000 | 0.0000 |
| spoon | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| teapot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| toiletry | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| broom | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| mailbox | 0.2073 | 0.4000 | 0.2000 | 0.2000 |
| paper cutter | 0.0034 | 0.1111 | 0.0008 | 0.0741 |
| camera | 1.0000 | 1.0000 | 1.0000 | 1.0000 |
| sunglasses | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| eraser | 0.0250 | 0.1000 | 0.0000 | 0.0000 |
| dumbbell | 0.1230 | 0.1481 | 0.0185 | 0.0370 |
| coat hanger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dustpan | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| toothpaste | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stapler | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dishwasher | 0.0111 | 0.0667 | 0.0111 | 0.0667 |
| hair dryer | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| headphones | 0.0833 | 0.1667 | 0.0833 | 0.1667 |
| cosmetics | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| adhesive tape | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
+-------------------+---------+---------+---------+---------+
| scannet | 0.0487 | 0.1144 | 0.0235 | 0.0466 |
+-------------------+---------+---------+---------+---------+
07/15 22:04:13 - mmengine - INFO -
+-----------------+---------+---------+---------+---------+
| head_classes | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+-----------------+---------+---------+---------+---------+
| chair | 0.1665 | 0.3262 | 0.0825 | 0.1526 |
| picture | 0.0148 | 0.0721 | 0.0058 | 0.0203 |
| door | 0.0865 | 0.1751 | 0.0042 | 0.0420 |
| pillow | 0.0818 | 0.1671 | 0.0243 | 0.0808 |
| cabinet | 0.0515 | 0.2469 | 0.0160 | 0.0887 |
| table | 0.2049 | 0.4313 | 0.1234 | 0.2500 |
| book | 0.0190 | 0.1009 | 0.0013 | 0.0168 |
| window | 0.0279 | 0.2004 | 0.0032 | 0.0292 |
| box | 0.0155 | 0.0912 | 0.0041 | 0.0185 |
| doorframe | 0.0304 | 0.2222 | 0.0005 | 0.0458 |
| shelf | 0.0708 | 0.2720 | 0.0206 | 0.1120 |
| light | 0.0145 | 0.0563 | 0.0020 | 0.0141 |
| plant | 0.1188 | 0.1946 | 0.0267 | 0.0671 |
| paper | 0.0075 | 0.0438 | 0.0000 | 0.0037 |
| bin | 0.0839 | 0.1919 | 0.0381 | 0.0904 |
| curtain | 0.0660 | 0.2151 | 0.0104 | 0.0756 |
| bottle | 0.0270 | 0.0790 | 0.0015 | 0.0082 |
| lamp | 0.0500 | 0.1366 | 0.0178 | 0.0617 |
| couch | 0.1085 | 0.3918 | 0.0565 | 0.2239 |
| towel | 0.0447 | 0.1126 | 0.0149 | 0.0303 |
| sink | 0.1704 | 0.2346 | 0.0433 | 0.0782 |
| socket | 0.0018 | 0.0177 | 0.0001 | 0.0018 |
| clothes | 0.0174 | 0.1211 | 0.0098 | 0.0547 |
| desk | 0.1368 | 0.4231 | 0.0569 | 0.2000 |
| stand | 0.1199 | 0.2803 | 0.0544 | 0.1288 |
| monitor | 0.1114 | 0.1984 | 0.0394 | 0.0794 |
| stool | 0.0517 | 0.2105 | 0.0211 | 0.0987 |
| mirror | 0.0173 | 0.1406 | 0.0002 | 0.0156 |
| case | 0.0032 | 0.1091 | 0.0000 | 0.0182 |
| decoration | 0.0009 | 0.0690 | 0.0000 | 0.0000 |
| bag | 0.0052 | 0.0714 | 0.0019 | 0.0317 |
| bed | 0.1732 | 0.5069 | 0.0927 | 0.2431 |
| cup | 0.0202 | 0.0610 | 0.0075 | 0.0122 |
| switch | 0.0087 | 0.0352 | 0.0000 | 0.0000 |
| shoe | 0.0078 | 0.0078 | 0.0078 | 0.0078 |
| toilet | 0.2347 | 0.4565 | 0.1606 | 0.2283 |
| counter | 0.0214 | 0.1895 | 0.0008 | 0.0316 |
| tv | 0.0106 | 0.0968 | 0.0022 | 0.0108 |
| backpack | 0.0889 | 0.1455 | 0.0319 | 0.0606 |
| carpet | 0.0052 | 0.0417 | 0.0000 | 0.0000 |
| basket | 0.0402 | 0.1667 | 0.0401 | 0.1389 |
| cushion | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| rail | 0.0307 | 0.1053 | 0.0000 | 0.0000 |
| blanket | 0.0233 | 0.2000 | 0.0074 | 0.0857 |
| blackboard | 0.0334 | 0.1126 | 0.0080 | 0.0331 |
| radiator | 0.0521 | 0.0993 | 0.0081 | 0.0284 |
| toilet paper | 0.0548 | 0.0652 | 0.0199 | 0.0326 |
| bench | 0.1109 | 0.3793 | 0.0387 | 0.1379 |
| keyboard | 0.0630 | 0.0825 | 0.0000 | 0.0000 |
| board | 0.0164 | 0.1270 | 0.0159 | 0.0159 |
| stairs | 0.0000 | 0.0769 | 0.0000 | 0.0000 |
| plate | 0.0351 | 0.0526 | 0.0000 | 0.0000 |
| refrigerator | 0.0755 | 0.1573 | 0.0567 | 0.1011 |
| frame | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| wardrobe | 0.0083 | 0.2593 | 0.0000 | 0.0000 |
| telephone | 0.0558 | 0.1220 | 0.0030 | 0.0122 |
| vase | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| computer | 0.0012 | 0.0506 | 0.0001 | 0.0127 |
| windowsill | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bathtub | 0.2857 | 0.5238 | 0.1466 | 0.3571 |
| ottoman | 0.0868 | 0.2500 | 0.0849 | 0.1731 |
| toy | 0.0309 | 0.1143 | 0.0001 | 0.0286 |
| column | 0.0620 | 0.2353 | 0.0000 | 0.0000 |
| rack | 0.0004 | 0.1176 | 0.0001 | 0.0588 |
| clock | 0.0725 | 0.0909 | 0.0227 | 0.0227 |
| dresser | 0.0568 | 0.2568 | 0.0145 | 0.1081 |
| faucet | 0.0330 | 0.1200 | 0.0000 | 0.0000 |
| flowerpot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bucket | 0.0119 | 0.0476 | 0.0119 | 0.0476 |
| bowl | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dispenser | 0.0569 | 0.1067 | 0.0180 | 0.0400 |
| mouse | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| microwave | 0.1366 | 0.1667 | 0.0654 | 0.1061 |
| container | 0.0001 | 0.0556 | 0.0000 | 0.0000 |
| stove | 0.1656 | 0.2632 | 0.1634 | 0.2368 |
| fan | 0.0967 | 0.2093 | 0.0233 | 0.0465 |
| pot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| blinds | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| shower | 0.0245 | 0.1316 | 0.0002 | 0.0263 |
| mat | 0.0625 | 0.0625 | 0.0000 | 0.0000 |
| laptop | 0.1533 | 0.3056 | 0.0842 | 0.1111 |
| remote control | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| washing machine | 0.0505 | 0.3846 | 0.0479 | 0.2308 |
| tissue box | 0.0456 | 0.0943 | 0.0000 | 0.0000 |
| pillar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| printer | 0.2009 | 0.2679 | 0.1047 | 0.1250 |
+-----------------+---------+---------+---------+---------+
| scannet | 0.0550 | 0.1512 | 0.0229 | 0.0587 |
+-----------------+---------+---------+---------+---------+
07/15 22:04:13 - mmengine - INFO -
+-------------------+---------+---------+---------+---------+
| common_classes | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+-------------------+---------+---------+---------+---------+
| poster | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| oven | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| fireplace | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| washbasin | 0.0001 | 0.0667 | 0.0000 | 0.0000 |
| statue | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| jacket | 0.0308 | 0.0702 | 0.0175 | 0.0175 |
| pipe | 0.0068 | 0.1818 | 0.0000 | 0.0000 |
| sign | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| vanity | 0.0533 | 0.2812 | 0.0409 | 0.1250 |
| soap dispenser | 0.0273 | 0.0526 | 0.0273 | 0.0526 |
| vent | 0.0500 | 0.1000 | 0.0000 | 0.0000 |
| clothes dryer | 0.2301 | 0.5556 | 0.2290 | 0.4444 |
| rod | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stopcock | 0.0171 | 0.0769 | 0.0000 | 0.0000 |
| speaker | 0.0238 | 0.0714 | 0.0000 | 0.0000 |
| bar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| tissue | 0.1667 | 0.1667 | 0.0185 | 0.0556 |
| candle | 0.2150 | 0.3333 | 0.0833 | 0.0833 |
| coffee maker | 0.0017 | 0.0667 | 0.0000 | 0.0000 |
| range hood | 0.0985 | 0.1429 | 0.0000 | 0.0000 |
| kettle | 0.0016 | 0.1053 | 0.0007 | 0.0526 |
| file | 0.0048 | 0.0333 | 0.0000 | 0.0000 |
| plug | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| alarm | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bicycle | 0.0040 | 0.1000 | 0.0000 | 0.0000 |
| purse | 0.0325 | 0.1250 | 0.0312 | 0.0625 |
| toiletry | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| brush | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| pen | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| ball | 0.0391 | 0.0769 | 0.0000 | 0.0000 |
| soap dish | 0.0208 | 0.1250 | 0.0000 | 0.0000 |
| basin | 0.0696 | 0.2857 | 0.0110 | 0.1429 |
| dumbbell | 0.1230 | 0.1481 | 0.0185 | 0.0370 |
| tube | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stall | 0.0090 | 0.1724 | 0.0000 | 0.0000 |
| hanger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| chandelier | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| copier | 0.1302 | 0.3333 | 0.0679 | 0.2222 |
| hamper | 0.0014 | 0.0526 | 0.0014 | 0.0526 |
| notebook | 0.0067 | 0.1667 | 0.0000 | 0.0000 |
| dishwasher | 0.0111 | 0.0667 | 0.0111 | 0.0667 |
| teapot | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| vacuum cleaner | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| hat | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| folder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| fire extinguisher | 0.0833 | 0.0833 | 0.0000 | 0.0000 |
| air conditioner | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| piano | 0.1670 | 0.2500 | 0.0855 | 0.1667 |
| ladder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| scale | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| tray | 0.0018 | 0.0833 | 0.0000 | 0.0000 |
| ledge | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| machine | 0.0019 | 0.1111 | 0.0000 | 0.0000 |
| guitar | 0.0500 | 0.0500 | 0.0000 | 0.0000 |
| furniture | 0.0009 | 0.2308 | 0.0000 | 0.0000 |
| person | 0.0889 | 0.1667 | 0.0060 | 0.0417 |
| cart | 0.0635 | 0.0952 | 0.0079 | 0.0476 |
| paper cutter | 0.0034 | 0.1111 | 0.0008 | 0.0741 |
| screen | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| fruit | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| soap | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| mask | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| calendar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| trophy | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dish rack | 0.0441 | 0.1429 | 0.0357 | 0.0714 |
| hair dryer | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| holder | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| sunglasses | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| headphones | 0.0833 | 0.1667 | 0.0833 | 0.1667 |
+-------------------+---------+---------+---------+---------+
| scannet | 0.0285 | 0.0790 | 0.0113 | 0.0287 |
+-------------------+---------+---------+---------+---------+
07/15 22:04:13 - mmengine - INFO -
+---------------+---------+---------+---------+---------+
| tail_classes | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+---------------+---------+---------+---------+---------+
| mailbox | 0.2073 | 0.4000 | 0.2000 | 0.2000 |
| toaster | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| water cooler | 0.0452 | 0.1429 | 0.0000 | 0.0000 |
| toothbrush | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| broom | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| wrap | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| grab bar | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| plunger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| toothpaste | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| pitcher | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| eraser | 0.0250 | 0.1000 | 0.0000 | 0.0000 |
| projector | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| luggage | 0.0014 | 0.2000 | 0.0000 | 0.0000 |
| helmets | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| divider | 0.0106 | 0.4286 | 0.0019 | 0.1429 |
| magazine | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| spoon | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| structure | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| mattress | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| adhesive tape | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| shovel | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| stapler | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| coil | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dustpan | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| bread | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| globe | 0.2000 | 0.2000 | 0.0000 | 0.0000 |
| pool table | 0.6667 | 0.6667 | 0.6667 | 0.6667 |
| car | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| map | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| radio | 0.1667 | 0.1667 | 0.0000 | 0.0000 |
| wire | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| sheet | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| support | 0.0736 | 0.2857 | 0.0130 | 0.1429 |
| scissors | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| cosmetics | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| pool | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| control | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| dvd | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| package | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| coat hanger | 0.0000 | 0.0000 | 0.0000 | 0.0000 |
| door knob | 0.5000 | 0.5000 | 0.0000 | 0.0000 |
| camera | 1.0000 | 1.0000 | 1.0000 | 1.0000 |
+---------------+---------+---------+---------+---------+
| scannet | 0.0690 | 0.0974 | 0.0448 | 0.0512 |
+---------------+---------+---------+---------+---------+
07/15 22:05:27 - mmengine - INFO -
+----------------+---------+---------+---------+---------+
| area | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+----------------+---------+---------+---------+---------+
| small_scannet | 0.0191 | 0.0481 | 0.0018 | 0.0054 |
| medium_scannet | 0.0522 | 0.1254 | 0.0260 | 0.0559 |
| large_scannet | 0.0470 | 0.1887 | 0.0245 | 0.0608 |
+----------------+---------+---------+---------+---------+
=================== 3rscan =========================
=================== matterport3d =========================
=================== arkit =========================
07/15 22:05:27 - mmengine - INFO -
+--------------+---------+---------+---------+---------+
| Summary | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 |
+--------------+---------+---------+---------+---------+
| scannet | 0.0487 | 0.1144 | 0.0235 | 0.0466 |
| 3rscan | 0.xxxx | 0.xxxx | 0.xxxx | 0.xxxx |
| matterport3d | 0.xxxx | 0.xxxx | 0.xxxx | 0.xxxx |
| arkit | 0.xxxx | 0.xxxx | 0.xxxx | 0.xxxx |
+--------------+---------+---------+---------+---------+
| Overall | 0.0487 | 0.1144 | 0.0235 | 0.0466 |
+--------------+---------+---------+---------+---------+
Could you please help me understand if there are any specific settings or dependencies I might have missed in order to match the results from the paper? Also, are there any configuration changes or additional pre-processing steps required to get the same results as in the documentation?

Thank you for your time and assistance!