Orthogonality?

[Sumching]

Hi!
What an attractive work it is. But I wonder if every subspace is orthogonal? I noticed you do not constrain how the subspace generates.

If I add a loss like that, would the performance be better?

[frobelbest]

Tried, will make things worse. The orthogonality is unnecessary as long as there are no linear dependent basis vectors.

…

On Tue, Oct 13, 2020 at 2:43 AM ChengShen ***@***.***> wrote: Hi! What an attractive work it is. But I wonder if every subspace is orthogonal? I noticed you do not constrain how the subspace generates. If I add a loss like that, would the performance be better? [image: image] <https://user-images.githubusercontent.com/34994554/95844487-8ba64400-0d7b-11eb-9319-f2e617150e45.png> — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#3>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAHQGIHSSN5LWGIOS6IHNUTSKQOMNANCNFSM4SOPZZHQ> .