[cherry-pick]Call WaitGroup.Done() once only when PVB changes to final status the first time to avoid panic

[cherry-pick]Call WaitGroup.Done() once only when PVB changes to final status the first time to avoid panic #10853