Feature: Video Support

[JW-CH]

Discussion for #499

[kdy1968]

edge browser will throw following error in dev console, when it stops:
2.CP0lzG2d.js:7 Uncaught (in promise) TypeError: Cannot read properties of undefined (reading '1')
at 2.CP0lzG2d.js:7:26786
at un (doAnGi5V.js:1:19862)
at dt (doAnGi5V.js:1:11120)
at $t (doAnGi5V.js:1:11169)
at re (doAnGi5V.js:1:21561)
at Object.play (2.CP0lzG2d.js:7:27881)
at Proxy.play (2.CP0lzG2d.js:29:1496)
at async Object.ne [as onDone] (2.CP0lzG2d.js:33:2681)

[simowilso]

@JW-CH I get this error in chrome too, when it stops. Have not seen this in the released immichframe, it's run for a few hours now.

2.B60KXuTk.js:7 Uncaught (in promise) TypeError: Cannot read properties of undefined (reading '1')
at 2.B60KXuTk.js:7:26846
at un (doAnGi5V.js:1:19862)
at dt (doAnGi5V.js:1:11120)
at $t (doAnGi5V.js:1:11169)
at re (doAnGi5V.js:1:21561)
at Proxy.z (2.B60KXuTk.js:7:28114)
at Proxy.play (2.B60KXuTk.js:29:1581)
at async Object.ee [as onDone] (2.B60KXuTk.js:33:2860)

[JoeRu]

ups.. if i've seen this earlier...
ok.. I've made another implementation. Most parts are nearly the same. On some we differ from our Idea. I've implemented a test-feature Videos-only..
https://github.com/JoeRu/ImmichFrame/tree/Video

This is naturally a branch from my PR - as it was my base to start from.

[kdy1968]

Is there a docker image

[JoeRu]

i pushed one

    image: jayar79/immichframe-video
#ghcr.io/immichframe/immichframe:latest

You need to set

Accounts:
#    ShowVideosOnly: true
    ShowVideos: true

[kdy1968]

awesome thanks! seems to be running very good

[JoeRu]

You could check the other feature included:
"ChronologicalImagesCount": 3
Then there is shown a set of pictures/Videos of 3 (for example) in historical line up.

[simowilso]

Thanks for this - I've noticed two issues with ghcr.io/immichframe/immichframe:video_playback

1. any image following a video playback seems to only display very quickly, less than the interval time (my interval is 3 sec)
2. playback stops after a while, no error in log

[simowilso]

Yes, subsequent image after a video is only shown very briefly, possibly less than one second. The immich-frame container is hosted on the same device as immich, it's a Proxmox virtual machine running Ubuntu. It's not super powerful but also not slow. 4 cpu/12Gb ram.

[simowilso]

I lied - interval is now set to 20 secs not 3. Could it be the issue that the video clips I have are longer than the interval time, so somehow the timer is being started for the next image even though the video is still playing?

[JW-CH]

@simowilso I just pushed another version to the ghcr.io/immichframe/immichframe:video_playback, can you test the 'skipping' again? Also, I added support for audio.

[simowilso]

Just did a quick test: skipping appears to be fixed, thanks! Sound not tested yet. It still seems to stop fairly frequently without any error in the container log. Strangely if I open developer tools (chrome) then the playback so far hasn't stopped.

[JW-CH]

@simowilso I am building another version with some more fixes, pull again in like 10 minutes :P

[JW-CH]

@kdy1968 @simowilso @3rob3 I updated the image/tag ghcr.io/immichframe/immichframe:video_playback with my latest changes. If you are still available for testing, feel free to do so :) I did not test this on a frameo so far! Video assets do get streamed from the server, so a relatively good connection is required.

[simowilso]

If I use the back arrow, then the previous image animates as before, but it freezes every time at the end of the animation on the subsequent image. Also, during the animation there is no progress bar.

If I skip forward to the next asset, then back to the asset that freezes, it will display the progress bar and continue. But, If I skip forward, then back to the prior asset that freezes, it will freeze again. https://streamable.com/rwaige

[JW-CH]

It will stop (and resume) if the video is loading/buffering. It is also recommended to have an encoded version on the immich server.

[JW-CH]

If I use the back arrow, then the previous image animates as before, but it freezes every time at the end of the animation on the subsequent image. Also, during the animation there is no progress bar.

If I skip forward to the next asset, then back to the asset that freezes, it will display the progress bar and continue. But, If I skip forward, then back to the prior asset that freezes, it will freeze again. https://streamable.com/rwaige

Thank you for the video! I think there is a misunderstanding here. The 'animation' is not a video. This feature request is about being able to display/play videos in immichframe. The animation (Ken Burns effect) is for images and yes, the animation is not stopped when you click the pause button.

I also noticed that the progressbar sometimes gets hidden, but that is also not what I tackled in this PR.

[simowilso]

Hi yes I know that asset is an image, not a video. My concern is that adding video may have caused a regression. The issue is that in that particular example, the playback stops altogether. I was not trying to pause the animation effect.

[simowilso]

@JW-CH I just changed my compose file to use the current immich (removed the video_playback tag).
Nothing else is changed, same album etc.

This one appears to play without any pause, so it does indeed look to me like some regression has crept in.

[simowilso]

I'm itching to build/buy a wall display but waiting for this before I do. I'm ready to test if there's any update. Thanks.

[asfixia]

I think I've selected to transcode everything too:

Transcoding policy: to "All Videos" or something like it.
Video Codec options: Codec video to h264 and Codec audio mp3 resolution 480p

Yet it doesnt work idk why.

[asfixia]

I think I've selected to transcode everything too:

Transcoding policy: to "All Videos" or something like it. Video Codec options: Codec video to h264 and Codec audio mp3 resolution 480p

Yet it doesnt work idk why.

I removed the password on immichframe and now its working.

I Found the bug, it is when i use the AuthenticationSecret on the yaml config, the video fails to include the password/token:

General:
AuthenticationSecret: '------'

[3rob3]

I think I've selected to transcode everything too:
Transcoding policy: to "All Videos" or something like it. Video Codec options: Codec video to h264 and Codec audio mp3 resolution 480p
Yet it doesnt work idk why.

I removed the password on immichframe and now its working.

I Found the bug, it is when i use the AuthenticationSecret on the yaml config, the video fails to include the password/token:

General: AuthenticationSecret: '------'

Nice catch. I think @JW-CH may have mentioned this.

[JW-CH]

@asfixia you are probably not on the newest version, I have fixed this.

[asfixia]

I've updated to the latest version but the problem persists.

I did a docker compose pull on the folder with:
image: ghcr.io/immichframe/immichframe:main

The option is like:

General:
AuthenticationSecret: '------------------' #some string here.

Despite the update when i enable this option again the videos assets are not shown by an 500 error.

The bug seems to happens on the second time i access it (the first time it asks for the password). The second time it accessed without asking the password and the bug happens again.

[duckdude555]

This is fantastic - works great for me on Chrome (desktop), but does not seem to work on Safari (desktop), Chrome (iOS), or FullyKiosk browser (Android). ChatGPT is trying to tell me it could be an issue with safari enforcing the whole file to load whereas Chrome will allow partial content, but take that with a grain of salt. The Safari web inspector for the video object gives me a Code 4 error. All my videos are transcoded h264.

[3rob3]

This is fantastic - works great for me on Chrome (desktop), but does not seem to work on Safari (desktop), Chrome (iOS), or FullyKiosk browser (Android). ChatGPT is trying to tell me it could be an issue with safari enforcing the whole file to load whereas Chrome will allow partial content, but take that with a grain of salt. The Safari web inspector for the video object gives me a Code 4 error. All my videos are transcoded h264.

Yes, am seeing same thing on iOS/MacOS Safari and iOS Webview. Works fine in Chrome and Firefox, and Android Webview in ImmichFrame app.

[duckdude555]

Thanks, yeah I’ve confirmed this on my end too - my videos work fine in with the immichFrame app, so I don’t think this is a transcoding issue.

[3rob3]

I submitted a PR yesterday with the fix for iOS and Safari (and probably others we just haven’t seen yet).

[JW-CH]

Video support has been merged and is still a experimental feature. It will be included in the next version or can be tested on ghcr.io/immichframe/immichframe:main

[simowilso]

@3rob3 re video not working in immichframe app running on echo show 5 using ghcr.io/immichframe/immichframe:dev.3rob3.autorefreshonerror

I have never altered the video transcoding options in immich. It looks like it is set to transcode anything that is not h264, to h264 720p

[3rob3]

make sure you also set this: