Hi,
Thanks for your work!
I found that the code in the file compress_inner_product_layer.cpp, line 139, 140, 145, and 146, might be problematic.
this->mu += fabs(weight[k]);
this->std += weight[k]*weight[k];
this->mu += fabs(bias[k]);
this->std += bias[k]*bias[k];
Should they be the following? With the “mask” multiplied.
this->mu += fabs(weight[k]* weightMask[k]);
this->std += weight[k]*weight[k* weightMask[k]];
this->mu += fabs(bias[k]* biasMask[k]);
this->std += bias[k]*bias[k]* biasMask[k];
Thanks,
Kai
Hi,
Thanks for your work!
I found that the code in the file compress_inner_product_layer.cpp, line 139, 140, 145, and 146, might be problematic.
this->mu += fabs(weight[k]);this->std += weight[k]*weight[k];this->mu += fabs(bias[k]);this->std += bias[k]*bias[k];Should they be the following? With the “mask” multiplied.
this->mu += fabs(weight[k]* weightMask[k]);this->std += weight[k]*weight[k* weightMask[k]];this->mu += fabs(bias[k]* biasMask[k]);this->std += bias[k]*bias[k]* biasMask[k];Thanks,
Kai