Click to draw shapes ("lasso" like)

[kyrieb-ekat]

Stafflines are, regrettably, consistently inconsistent which makes a perfectly fitting rectangle often accidentally include page or glyph material in the annotation that could be avoided if I were to be able to click several points around a line I wanted to be enclosed in my annotation that then "close" when I click the starting point.

Kind of like how in powerpoint you can create a shape through clicks (screen recording below).

Screen.Recording.2026-03-19.at.5.29.24.PM.mov

[JoyfulGen]

Another option is to do what Neon allows the user to do with staff lines, which is to change the tilt of an entire staff to better follow the curve of the page. Like so:

Neon.staff.tilting.mov

This solution really only applies to staff lines though, and still restricts the user to the rectangle box shape.

[yinanazhou]

The frontend is not difficult to implement. My concern is on the data representation. Right now we are using bounding boxes, which is [x, y, width, height] and doesn't handle rotation or extra ancors.

[kyrieb-ekat]

This is a good point. Even if we switched to a segmentation mask we'd need to completely change tacks and redo our previous annotations (...no). Given our current detection-classification pipeline, the polygon tool's primary value is in annotation precision rather than output format; the derived bounding box will still be axis-aligned, but a tighter polygon trace would possibly result in a meaningfully cleaner box than freehand rectangle drawing. No changes to the existing export schema should be required/we don't need to add segmentation mask logic.