DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
The Sisyphus client rewrite continues after a bit of a break. The ffmpeg module is mostly finished and should serve as a good template for handbrake, av1an, mkvmerge, and cleanup modules. Logging is progressing pretty well. The config has been expanded slightly and can now pull from TOML files on top of the standard environment variables.
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
So, got the server in place but discovered that the Docker image that I created that has the Sisyphus client and all of the binaries like ffmpeg, av1an was not very happy. Ffmpeg crashed because it couldn’t find the libSvtAvcEnc.so.4 library which was because I had a custom version of it installed (svt-av1-psyex).
Got the Dockerfile fixed by installing svt-av1-psyex and then compiling ffmpeg against those libraries, then installing both svt-av1-psyex and ffmpeg into the final container which makes ffmpeg happy. Also saw an issue where the Vapoursynth lsmash module wasn’t being found, but that got tracked down to a stale Docker image (forgot to pull the latest from the repo).
I have two encodes going: one ffmpeg and one av1an which should be the real final test. If they turn out well, attachments where they’re supposed to be, etc., etc. then I’ll probably start working on documentation and get this out there.
#sisyphus #encoding #av1an #vapoursynth #ffmpeg #svtAv1Psyex
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
So, decided to get them rookie /queue numbers up so did a quick bit of caching. For a 12-job queue, I went from 240 RPS (Python/Flask) to 680 (Golang/Gin) then to 3400 RPS with some proper caching. The /workers endpoint would benefit as well, but I think its performant enough though I may end up adding a bit of caching later.
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
DevOps Engineer, electronics tinkerer, Linux and Homelab enthusiast. Also a big fan of anime, a good book, and the occasional short circuit...
Work on the Sisyphus server rewrite in #golang has begun, and I forgot how much I enjoyed Gin. All of the GET routes have been implemented, and only a few random crashes had to be figured out…next up is the rest of the routes…lol
https://git.jamesthebard.net/jweatherly/sisyphus-server-golang
Really just four archetypes (an Academic, an Artist, an Activist and an Adventurer) piled on top of each other in a trench coat. Cover pic of the season: Bluebells blooming in Hallerbos forest, Belgium.
You've seen all posts