Can't move view with mouse after closing VGUI window with enter

[Aynekko]

Steps to reproduce:

• open vgui window
• DON'T touch mouse
• press enter to close window
• can't move view until pressing TAB to show scores
  Bug doesn't appear if vgui window is opened, I move the mouse, and close it with enter.
  Version is 1.12.0 which is stated as latest available version here in releases.

[tmp64]

Might be related to #143 and #107