Skip to content

Remote Display proof-of-concept #316

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
ewired wants to merge 81 commits into
base: master
Choose a base branch
from
Draft

Remote Display proof-of-concept #316

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
81 commits
Select commit Hold shift + click to select a range
cb1ea2c
Remote Display proof-of-concept
ewired Aug 22, 2023
20b0e37
Popup settings and persistency in remote display
ewired Aug 23, 2023
71a65a2
Local storage
ewired Aug 23, 2023
3347a33
Adjust contrast on remote tab with bottom corners
ewired Aug 23, 2023
427896e
Top corners to rescale window, better than zoom
ewired Aug 25, 2023
9478dc3
Toggle invert at lowest contrast setting
ewired Sep 8, 2023
a4834ca
Ignore bugged rotate gesture events
ewired Sep 8, 2023
306b7fd
Remove grayscale at normal contrast always
ewired Sep 9, 2023
8fbf5a4
Get cargo lock from upstream
ewired Sep 25, 2023
73e69d2
PNG -> PBM
ewired Sep 25, 2023
9aa03f8
Device button presses to scroll half page
ewired Sep 25, 2023
e93ece7
Decouple display from currently focused window
ewired Oct 8, 2023
2cd6ba9
Remove redundant viewport resize
ewired Oct 11, 2023
b7bb4b7
Handle basic authentication and TLS
ewired Oct 11, 2023
5f115e0
Rotate counterclockwise to reopen closed tab
ewired Oct 13, 2023
0c6f9d2
Handle rotation during remote display session
ewired Oct 13, 2023
72651db
Merge branch 'baskerville:master' into master
ewired Oct 26, 2023
4c7260b
Merge remote-tracking branch 'upstream/master'
ewired Dec 15, 2023
dd6a427
Merge cargo lock
ewired Dec 15, 2023
54aaa78
Handle new Deno binary WebSocket messages
ewired Dec 21, 2023
a3ded98
Repeat scroll while back/forward button held
ewired Dec 24, 2023
f31db8e
Handle errors in sending to closed sockets
ewired Jan 4, 2024
ac54da0
Merge branch 'master' of https://github.com/baskerville/plato
ewired Feb 2, 2024
e4c4cb8
Upgrade remote display server dependencies
ewired Feb 2, 2024
2c3d144
Merge remote-tracking branch 'upstream/master'
ewired Feb 24, 2024
8bde749
Merge remote-tracking branch 'upstream/master'
ewired Feb 25, 2024
9e45adc
Merge branch 'master' of https://github.com/baskerville/plato
ewired Mar 1, 2024
335199a
Close previous browser connection if it exists
ewired Mar 14, 2024
f6de53d
Move image conversion to webextension
ewired Mar 15, 2024
7f7aedf
Remote display server container
ewired Mar 15, 2024
c5ef232
Remote display over MQTT
ewired Mar 17, 2024
4b581da
Subscribe on reconnect and handle failed connections gracefully
ewired Mar 17, 2024
d445240
Add connection and last will notification for browser
ewired Mar 26, 2024
b95a965
Use CBOR for message format
ewired Mar 27, 2024
fbb8fed
Update size on new browser connection and log display update
ewired Mar 27, 2024
8ccce05
Use chacha20poly1305 COSE encryption
ewired Mar 27, 2024
5b9efe1
Refactor send functions to use async/await
ewired Mar 30, 2024
74b97a0
Send grayscale images to device
ewired Mar 30, 2024
fab0475
Add delay before capturing tab screenshot
ewired Mar 30, 2024
178d2b4
Fix issue with display update roundtrip
ewired Mar 30, 2024
12f680a
Use JPEG XL and add quality/depth configuration
ewired Mar 30, 2024
43b4c79
Merge branch 'master' of https://github.com/baskerville/plato
ewired Apr 4, 2024
e572fe3
Refactor zoom gestures
ewired Apr 4, 2024
a4d00ef
Send images after notices
ewired Apr 4, 2024
f61242b
Use debounce instead of delay when sending images
ewired Apr 4, 2024
b6d977e
Merge remote-tracking branch 'upstream/master'
ewired Oct 12, 2024
7202cd3
Undowngrade dependency
ewired Oct 12, 2024
618e3b6
Update dependencies in extension background script
ewired Oct 13, 2024
ae2e0f2
Draw crosshair at tap or short hold point
ewired Oct 13, 2024
6ad34f2
Merge branch 'master' of https://github.com/baskerville/plato
ewired Dec 10, 2024
1d4a69e
Merge remote-tracking branch 'upstream/master'
ewired Mar 22, 2025
cc5d11f
Improve detection of mismatched pixmaps on render to prevent panic
ewired Mar 28, 2025
8e59cc4
Enhanced scrolling in webextension
ewired Apr 1, 2025
dfb98bc
Change image format to QOI keyframes and bidiff interframes with JPEG…
ewired Apr 3, 2025
c97647a
Wait for animations to complete after interaction and send extra disp…
ewired Apr 3, 2025
0287461
Better click and pointer simulation in webextension
ewired Apr 4, 2025
12f94ed
Tap on headers with ID to navigate in webextension
ewired Apr 4, 2025
9bef882
Open new tabs in same window with openerTabId in webextension
ewired Apr 4, 2025
d145a05
Move image decoding to MQTT loop thread in Remote Display
ewired Apr 4, 2025
a9d66e2
Add performance tracking to webextension
ewired Apr 4, 2025
2e8ae04
Use shared pixmap between threads and reduce copying in Remote Display
ewired Apr 4, 2025
65a8d8e
Reuse existing Event enum for display size message in Remote Display
ewired Apr 4, 2025
6b7c0fe
Change dependencies in background script
ewired May 29, 2025
df41bd5
Ignore zipped webext
ewired May 29, 2025
1f8251f
MultiArrow moves tabs to start or end of window
ewired May 29, 2025
07b7ebb
MultiSwipe to scroll horizontally
ewired May 29, 2025
c0084bb
Swap MultiSwipe and Swipe behavior so Swipe only scrolls
ewired May 29, 2025
35779ac
SlantedSwipe handling
ewired May 29, 2025
293ebc7
Handle north/south MultiSwipe by switching to first/last tab
ewired May 29, 2025
bc4b7a2
Refined tab switch after closing behavior
ewired Jun 11, 2025
c6b32bc
Switch tabs on horizontal swipe without scrolling
ewired Jun 11, 2025
29c2d61
Text selection with web search and note
ewired Jun 14, 2025
d827706
Clear selection after note/search
ewired Jun 15, 2025
b9a4a6c
Improved on page animation detection
ewired Jun 16, 2025
c0d7125
Navigate to text fragment from selection
ewired Jun 17, 2025
da8fa2f
Listen to scrollend for smooth scrolling sites
ewired Jun 17, 2025
397e371
Stop remote display connection on sleep and restart on wake
ewired Jun 17, 2025
369e27c
Navigate to hash of nearest semantic parent of tapped header
ewired Jun 17, 2025
66cc912
Open new tab in background properly
ewired Jun 18, 2025
f4ef8b5
Fallback to empty when no permission to get text selection
ewired Jun 19, 2025
35f5ffd
Soft disable sending images on device disconnect
ewired Jun 19, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
860 changes: 773 additions & 87 deletions Cargo.lock
View file
Open in desktop

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ members = [
"crates/emulator",
"crates/importer",
"crates/fetcher",
"crates/remote-display-video"
]

[profile.release-minsized]
Expand Down
2 changes: 2 additions & 0 deletions contrib/remote-display-webext/.gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
webext.zip
*.bundle.mjs
12 changes: 12 additions & 0 deletions contrib/remote-display-webext/Makefile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
.PHONY: all build clean

all: build

fragment-generation-utils.bundle.mjs:
wget https://esm.sh/text-fragments-polyfill@6.4.1/es2022/dist/fragment-generation-utils.bundle.mjs -O fragment-generation-utils.bundle.mjs

build: fragment-generation-utils.bundle.mjs
zip -r -FS ./webext.zip * --exclude webext.zip

clean:
rm -f webext.zip fragment-generation-utils.bundle.mjs
Loading