Thanks to @slomo the #gstreamer gtk4-paintable-sink just got support for video rotations. This is nice for video apps, making playback of video recorded on phones (portrait mode) more easy or faster (avoiding a copy compared to using a dedicated gst videoflip element).
The change is even better for Snapshot, the #gnome camera app: it uses the sink for its viewfinder and avoiding additional copies here has quite an impact on #mobilelinux devices.
I'm quite happy how upcoming performance improvements for #gnome Snapshot and #libcamera are shaping up. This is how things are now running for me on a #librem5:
If you use #pipewire for cameras you can now (in the upcoming 1.2) enforce specific rotations via node rules. This is useful on devices with rotated cameras that don't use a DT and #libcamera or for testing (e.g. to find out the correct rotation of a phone camera). The rotation is respected by an increasing number of apps, notably #gstreamer based ones (like Snapshot - but not Cheese) and #firefox (if you enable PW cameras via `media.webrtc.camera.allow-pipewire`).
PipeWire version (pipewire --version): 1.0.7. Distribution and distribution version (PRETTY_NAME from /etc/os-release): Ubuntu Oracular Oriole (development branch). Desktop Environment: Sway Wayland...
The Rust+Gnome hackfest sponsored by gtk-rs (opencollective.com/gtk-rs) just ended, it allowed us to make great improvements like:
rewrite the clone! macro so it can now be formatted and have rust-analyzer run on it
rewrite rustdoc-stripper so it now uses rustc internal API directly and can be called with cargo. Some work remains to be done but it's already useable.
finally finished the release blog post (we're months late but better late than never :p)
Last week I attended the GStreamer spring hackfest in Thessaloniki. It was very nice to meet all the usual people again, as it’s been a while (I last attended a GStreamer event in 2022), and we had a great time!
Just want to quickly share with #linuxmobile folks that the new #libcamera softwareISP does indeed work with the #librem5 - and with a #PipeWire + #GStreamer pipeline. Here's a first image running Warp (from Flathub).
There's still some stuff to iron out to make this work reliably and ship to users - but things are falling into place.
This will allow to make video playback in various apps much faster. And, if everything works out, allow the same for Camera viewfinders in apps like #gnome camera / snapshot 🤞
Friends of energy efficiency - the Light Video 0.1.0 #Flathub update is out, build with #gtk4 4.14 and #GStreamer 1.24.1.
This should be the first app targeting the #linux / FDO desktop enabling Wayland video offloading (think zero-copy playback) by default. In many cases (actually more than I expected) this can improve battery lifetime - and on low-end devices even playback performance - significantly.
I've been working on a new app to use your #Linux phones and tablets as secondary wireless "side displays" (not mirrors). This is based on #GStreamer, x264, #Mutter APIs, and low-latency UDP streaming, and will be designed to work on both ARM and Intel, regardless of hardware acceleration support. (Testing on a #librem5)
This is still at an early stage, and will take some time to become usable. Thoughts and feedback?
The new GStreamer 1.24 release is also the first that has a Rust component as part of core, in addition to all the plugins that were already part of previous releases.
#FOSDEM: While efficient video playback has long been possible in the embedded #Linux world, desktop applications have been lagging behind. Here's a look at the state of video offloading on the Linux desktop, by Robert Mader: youtube.com/watch?v=SMCMZwAiw2… #GStreamer #GTK #Chromium
While efficient video playback has long been possible in the embedded Linux world, desktop applications have been lagging behind other platforms. In the last...
Update regarding #wayland zero-copy video playback (using hardware planes): with a few small patches it works with #Chromium, both with #vaapi (Intel/AMD) and #v4l2 stateless.
Here a short video using a #rk3399 - the #PINE64 #PinebookPro - playing a 4k 60fps video - only possible with hardware plane offloading. Playback is *almost* smooth already (~50fps), the goal is to catch up with #GStreamer where we get stable 60.
I hope this will all get upstreamed in the coming months.
Take for example these examples of a #PinebookPro (rk3399 / v4l2 stateless) playing 4k content or the #RaspberryPi 4b (v4l2 stateful / m2m) playing 1080p@60fps (the limit of the hardware decoder) on a 2560x1440 screen. My videos probably don't fully capture the effect, but especially in the later case the difference is pretty visible). This is using the gtk video player demo with some extra patches and #gstreamer.
My personal vision with all of this is to see #wayland desktop technologies not only catching up with what other OSs offer, but becoming leading players - just like what other FLOSS projects already archived (or are in the process of becoming) in their areas. I'm thinking of #mesa, #pipewire, #gstreamer, #systemd, the kernel of course, and many others.
I've spent a good part of my weekend working on upgrading the GStreamer Rust bindings on Servo. The presentation by Martin Robinson from @igalia at @rustnl was a real inspiration.
I've upgraded the version of the GStreamer Rust bindings. I've tried to make the minimal possible changes to the code, keeping all previous logic and behavior.
Please let me know if I've missed any...
Over the Easter holidays I experimented a bit with building Rust code with meson instead of cargo.
Specifically I tried building a GStreamer plugin with a few dozen Rust dependencies, but the same applies in a similar way to GTK/GNOME applications or literally anything else.
✨ GStreamer Rust bindings 0.20 and Rust plugins 0.10 release is out
This release features the addition of a few convenience APIs, the addition of bindings for some minor APIs and a lot of internal changes to improve performance and code generation.
A year ago I started working on supporting GL Textures in the rusty @GStreamer Paintable @GTK Sink and now its merged 🎉 This should dramatically reduce the CPU usage consumed and allow for zero-copy rendering when used with hardware decoders. gitlab.freedesktop.org/gstream…
GObject subclassing in Rust for extending GTK+ & GStreamer Or: How to safely implement subclassing in Rust while making use of a C libraryby Sebastian DrögeA...
