ffmpeg-5.0.1

[Bruce Dubbs]

New major version.

[martyj19]

It would appear there is a pending and buggy merge request for gstreamer that will block ffmpeg-5.0 due to removal of deprecated avcodec_get_context_defaults3.

​https://gitlab.freedesktop.org/gstreamer/gst-libav/-/issues/97

​https://gitlab.freedesktop.org/gstreamer/gst-libav/-/merge_requests/139

Also, I find that Chromium as bundled with webengine will need quite a few adjustments.

[Xi Ruoyao]

gst-libav port done at ​https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1531.

Another issue is the removal of libavresample. Not sure how to deal with transcode-1.1.7.

[ken@…]

Arch (staging) has a patch for building qtwebengine with ffmpeg-5 ​https://github.com/archlinux/svntogit-packages/blob/packages/qt5-webengine/trunk/qt5-webengine-ffmpeg5.patch

[Xi Ruoyao]

gst-libav upstream says they won't backport ffmpeg-5.0 support to 1.18.6.

[ken@…]

xine-lib wants libavcodec/vaapi.h which ffmpeg-5 has not installed in my test build.

[martyj19]

Also need to patch ffmpeg for a tweak needed to build Chromium as included in qtwebengine

​https://github.com/archlinux/svntogit-packages/blob/packages/ffmpeg/trunk/add-av_stream_get_first_dts-for-chromium.patch

[ken@…]

vlc fails to build:

in file included from access/avio.c:37:
access/../codec/avcodec/avcommon.h: In function 'vlc_init_avformat':
access/../codec/avcodec/avcommon.h:108:5: error: implicit declaration of function 'av_register_all' [-Werror=implicit-function-declaration]
  108 |     av_register_all();
      |     ^~~~~~~~~~~~~~~
access/../codec/avcodec/avcommon.h: In function 'vlc_init_avcodec':
access/../codec/avcodec/avcommon.h:122:5: error: implicit declaration of function 'avcodec_register_all' [-Werror=implicit-function-declaration]
  122 |     avcodec_register_all();
      |     ^~~~~~~~~~~~~~~~~~~~

[ken@…]

A report at gentoo that k3b ftbfs, ​https://bugs.gentoo.org/831621

[Bruce Dubbs]

What version of k3b? I have downloaded the latest, k3b-21.12.2.tar.xz, and plan to put that into BLFS in a week when kf5-5.91 is released.

[ken@…]

Replying to Bruce Dubbs:

What version of k3b? I have downloaded the latest, k3b-21.12.2.tar.xz, and plan to put that into BLFS in a week when kf5-5.91 is released.

k3b-21.12.1 so maybe you'll be ok with that one.

[ken@…]

Replying to ken@…:

vlc fails to build:

Apparently fixed in vlc3 git, see ​https://code.videolan.org/videolan/vlc/-/merge_requests/1245

[Douglas R. Reno]

Too late for 11.1, but xine has a patch at ​https://github.com/archlinux/svntogit-community/blob/packages/xine-lib/trunk/020-xine-lib-ffmpeg-5.0-fix.patch

[Xi Ruoyao]

gstreamer-1.20 is in the book.

[Douglas R. Reno]

What is the status of testing xine-lib, vlc, k3b/kdenlive, qtwebengine, and transcode?

[Xi Ruoyao]

Replying to Douglas R. Reno:

What is the status of testing xine-lib, vlc, k3b/kdenlive, qtwebengine, and transcode?

I think we've already have solutions for xine, vlc, and qtwebengine in this ticket.

For transcode we can add a libavresample.xml page, building libavresample only from a ffmpeg 4.x tarball. But I'd suggest to archive transcode: I think it's possible to do everything transcode can do with a ffmpeg command line.

Not sure about k3b.

[ken@…]

Replying to ken@…:

Arch (staging) has a patch for building qtwebengine with ffmpeg-5 ​https://github.com/archlinux/svntogit-packages/blob/packages/qt5-webengine/trunk/qt5-webengine-ffmpeg5.patch

Trying to get the patch in a raw version from Arch (rather than an html page) beats me. Found it at ​https://git.alpinelinux.org/aports/tree/community/qt5-qtwebengine

Based on Marty's comment 8, not sure if this wil be adequate on its own. I hope to try in the next few days (I've kept the system from late January with ffmpeg5 for testing).

[ken@…]

Replying to Xi Ruoyao:

Replying to Douglas R. Reno:

What is the status of testing xine-lib, vlc, k3b/kdenlive, qtwebengine, and transcode?

I think we've already have solutions for xine, vlc, and qtwebengine in this ticket.

For transcode we can add a libavresample.xml page, building libavresample only from a ffmpeg 4.x tarball. But I'd suggest to archive transcode: I think it's possible to do everything transcode can do with a ffmpeg command line.

Not sure about k3b

For xine-lib I can confirm that 1.2.12 with ffmpeg5 works as well as previous versions worked on ffmpeg4. That is to say that on this machine it can play ogv (theora), mp4 and wmv fiels (only). Some of those might crash, resuming from pause or using the control to change to a different position also crashes (that might differ with different xorg video drivers)

I had planned to look at preparing a hint for tccat (transcode) using old ffmpeg4 in /opt. Starting to look at that now. I had not thought that the vob files were available without tccat|transcode, but I see various pages for windows users on copying the video_ts (and audio_ts) files. If I mount a DVD as iso9660 I can see the vob files in the video_ts/ directory (there is also an audio_ts/ directory), but trying to copy one of them reports 'Input/output error' probably from the content scrambling.

​https://www.benhup.com/technology/dvd-original-one-file-rip-deinterlace-and-add-chapters-with-ffmpeg/ looks the most useful guide to doing this (and why - DVDs degrade), but all I get is 40mS of output.

For libavresample from ffmpeg4, it uses libavutil >= 56.70.100, I would not be at all surprised if it fails with libavutil-57.17.100 fro mcurrent ffmpeg5.

[ken@…]

For qtwebengine, with that patch from Arch the failure is the usual for qtwebengine "I can't find what failed", but after resuming the build it is:

In file included from gen/media/filters/filters_jumbo_5.cc:6:
./../../../../src/3rdparty/chromium/media/filters/ffmpeg_demuxer.cc: In function ‘base::TimeDelta media::ExtractStartTime(AVStream*)’:
./../../../../src/3rdparty/chromium/media/filters/ffmpeg_demuxer.cc:101:7: error: ‘av_stream_get_first_dts’ was not declared in this scope; did you mean ‘av_stream_get_side_data’?
  101 |   if (av_stream_get_first_dts(stream) != kNoFFmpegTimestamp &&
      |       ^~~~~~~~~~~~~~~~~~~~~~~
      |       av_stream_get_side_data

I don't think this is going to run. I suspect that qt6 probably also doesn't build with ffmepg5.

In theory, qtwebengine5 can be build without the system ffmpeg, but I suspect that adds a large overhead to what is already a dreadfully slow package.

[ken@…]

Please note that I've got an initial build of tccat, using ffmpeg4 in /opt, working as a preliminary for a hint.

But given the problem with qtwebengine (which needs to be updated re CVEs for the upcoming 5.15.9 release ​https://www.techtarget.com/searchsecurity/news/252515092/North-Korean-hackers-exploited-Chrome-zero-day-bug-for-six-weeks) I am unwilling to see the book move to ffmpeg5 at this point, and I will not be looking at vlc.

[ken@…]

Replying to ken@…:

In theory, qtwebengine5 can be build without the system ffmpeg, but I suspect that adds a large overhead to what is already a dreadfully slow package.

I decided to try that. Please note that ffmpeg, whether system or shipped in qtwebengine, can only use the codecs available when it was compiled, so the essential codec deps for ffmpeg need to be installed even when not using system ffmpeg.

To my surprise, the difference in elapsed build time is lost in the noise, and the extra size is only a few MB. So that might be a way forward.

[ken@…]

With that piece of possibly good news, there is one item I'd forgotten about - on my normal builds (ffmpeg4 installed after firefox) firefox can play mp4 files. With ffmpeg5 that is not the case.

I saw a link the other day that fedora had rebuilt firefox to work with ffmpeg5, but that was a firefox-98 version, at the moment I have no idea what they did, nor whether it can be ported to 91esr.

[ken@…]

Replying to Douglas R. Reno:

What is the status of testing xine-lib, vlc, k3b/kdenlive, qtwebengine, and transcode?

vlc-3.0.17.3 plays everything I threw at it. As with all other tests on this machine, I'm only looking at the videos, sound is not connected.

[ken@…]

Replying to ken@…:

With that piece of possibly good news, there is one item I'd forgotten about - on my normal builds (ffmpeg4 installed after firefox) firefox can play mp4 files. With ffmpeg5 that is not the case.

I saw a link the other day that fedora had rebuilt firefox to work with ffmpeg5, but that was a firefox-98 version, at the moment I have no idea what they did, nor whether it can be ported to 91esr.

The diffs are from Fedora's Martin Stránský and were applied to firefox-99.0alpha. The initial release candidate for 99.0 builds and can play both mp4 and mov files. The bug report is ​https://bugzilla.mozilla.org/show_bug.cgi?id=1750760. Unfortunately, a LOT has changed between firefox-91 and 99. I've made some attempts to copy the ffmpeg and ffvpx changes, but could not get a combination which compiled.

[ken@…]

Replying to ken@…:

Replying to ken@…:

With that piece of possibly good news, there is one item I'd forgotten about - on my normal builds (ffmpeg4 installed after firefox) firefox can play mp4 files. With ffmpeg5 that is not the case.

I saw a link the other day that fedora had rebuilt firefox to work with ffmpeg5, but that was a firefox-98 version, at the moment I have no idea what they did, nor whether it can be ported to 91esr.

The diffs are from Fedora's Martin Stránský and were applied to firefox-99.0alpha. The initial release candidate for 99.0 builds and can play both mp4 and mov files. The bug report is ​https://bugzilla.mozilla.org/show_bug.cgi?id=1750760. Unfortunately, a LOT has changed between firefox-91 and 99. I've made some attempts to copy the ffmpeg and ffvpx changes, but could not get a combination which compiled.

I spent more time on this, trying to copy all the ffvpx and ffmpeg code from 99.0 (the VAAPI code has been updated) and fixing up enough for mach's configure to complete - in the end I got lucky and google found a mozilla bug which told me where to look to get mozva included in the libs. But after that the build fails in ffmpeg vaapi files with C++ errors of the form class ... has no member named ...'. Looking for some of the field names in google I got links to file versions post-commit at mozilla-central from earlier this year and discovered that other parts of the code were changed. I don't think it will be practical to fix this in something that can reasonably still be called 91esr.

The alternatives for getting working firefox with ffmpeg5 are to move to firefox-current (99.0 next week) or to wait for firefox-102esr (end of June).

[Bruce Dubbs]

Please review why we use esr releases instead of current. Current changes too frequently?

[ken@…]

Replying to ken@…:

Replying to ken@…:

In theory, qtwebengine5 can be build without the system ffmpeg, but I suspect that adds a large overhead to what is already a dreadfully slow package.

I decided to try that. Please note that ffmpeg, whether system or shipped in qtwebengine, can only use the codecs available when it was compiled, so the essential codec deps for ffmpeg need to be installed even when not using system ffmpeg.

To my surprise, the difference in elapsed build time is lost in the noise, and the extra size is only a few MB. So that might be a way forward.

However, now that I'm looking at the qtwebengine chromium code I can see from commit 552906b0f222 that it was last updated on 2020-07-16. The version is apparently 4.3.git, and in chromium/third_party/ffmpeg/doc/APIchanges the versions were initially labelled as 2017-10-21, but API changes apparently picked up (some of) libavutil 56.58.100, libavcodec 58.88.100, libavformat 58.37.100.

On a system with current 4.4.1 the versions are 56.70.100, 58.134.100, 58.76.100 (sic) which suggests the code might be quite old - in a 4.3.1 system (BLFS-10.0) the versions were 56.51.100, 58.91.100, 58.45.100.

Looking at ​https://ffmpeg.org/security.html there have been vulnerability fixes in 4.3, 4.3.1, 4.3.2, 4.3.3, 4.4 and 4.4.1 so in the absence of wasting a LOT of time trying to look at those, I feel very uncomfortable about using the shipped ffmpeg from qtwebengine.

[ken@…]

Replying to Bruce Dubbs:

Please review why we use esr releases instead of current. Current changes too frequently?

Not so much that it changes more often than esr (probably two or three extra out-of-band updates compared to esr over the life of a book), more that it has tended to need newer versions of rustc.

The last time we updated rustc (because of llvm-13) we updated rustc before firefox-current needed it. I read Pierre's comment that rust ftbfs with llvm-14, and Xi's comment in the llvm ticket about which rust version should build with llvm-14.

But updating rustc has often caused breakage in esr, thunderbird (which follows esr) and seamonkey.

In our 11.0-11.1 timespan, looking at the beta versions of firefox: firefox-94 needed rust >= 1.53.0, I avoided trying to build the betas until (I think) we had upgraded to 1.56.0. Then in january firefox-97 needed >= 1.57.0 - I apparently built 1.58.0 after its release on 13th Jan, and then updated to 1.58.1 because of a rust CVE.

[Douglas R. Reno]

Now 5.0.1

Not sure if this has the patch for ffmpeg which helps fix build issues in Chromium / QtWebEngine though. Don't have time to take a look at the moment, but I'll look on Tuesday while I'm upgrading my systems.

[Douglas R. Reno]

Looking at ffmpeg-5.0.1, the patch for building Chromium/QtWebEngine against system ffmpeg will still be needed.

See ​https://github.com/archlinux/svntogit-packages/blob/packages/ffmpeg/trunk/add-av_stream_get_first_dts-for-chromium.patch

[ken@…]

If transcode turns out to be the hold-up, I'll got back to preparing a hint for compiling (only) tccat using the current version of ffmpeg4 in /opt - very few dependencies, and in particular libquicktime seems to only be in the book as a dep for transcode, but using only tccat libquicktime provides nothing and could go.

[Douglas R. Reno]

For transcode, I was thinking of just disabling ffmpeg with --disable-ffmpeg - would that work for your use case?

[ken@…]

Replying to Douglas R. Reno:

For transcode, I was thinking of just disabling ffmpeg with --disable-ffmpeg - would that work for your use case?

Dunno, haven't tried ithat and not close to having time for it. I didn't see any options about pointing to ffmpeg in the configure script, let alone disabling it, so does that build ?

Apart from pointing to old ffmpeg in /opt with CFLAGS and LD_LIBRARY_PATH and using our current patches I'm using

./configure --prefix=/usr
make -C avilib
make -C aclib
make -C libtc
make -C import tccat

and for the install

install -v -m755 import/tccat /usr/bin
install -v -m644 docs/man/tccat.1 /usr/share/man/man1

The use depends on the particular (encrypted) DVD, which is why I use lsdvd to find the long titles, but something like 'tccat -i /dev/sr0 -T 2,-1 >title2.vob' if title 2 is one of the variants of the main item.

The only build deps I'm using for this, I think (other deps already present) are, libdvdread and libmpeg2. Runtime dep of libdvdcss of course.

[Douglas R. Reno]

Replying to ken@…:

Replying to Douglas R. Reno:

For transcode, I was thinking of just disabling ffmpeg with --disable-ffmpeg - would that work for your use case?

Dunno, haven't tried ithat and not close to having time for it. I didn't see any options about pointing to ffmpeg in the configure script, let alone disabling it, so does that build ?

Apart from pointing to old ffmpeg in /opt with CFLAGS and LD_LIBRARY_PATH and using our current patches I'm using

./configure --prefix=/usr
make -C avilib
make -C aclib
make -C libtc
make -C import tccat

and for the install

install -v -m755 import/tccat /usr/bin
install -v -m644 docs/man/tccat.1 /usr/share/man/man1

The use depends on the particular (encrypted) DVD, which is why I use lsdvd to find the long titles, but something like 'tccat -i /dev/sr0 -T 2,-1 >title2.vob' if title 2 is one of the variants of the main item.

The only build deps I'm using for this, I think (other deps already present) are, libdvdread and libmpeg2. Runtime dep of libdvdcss of course.

With --disable-ffmpeg, it does seem to build for me. Configure doesn't talk about any missing/unrecognized options, and I can see this in the log:

FFmpeg support                 no

Looking at the installed programs shows:

renodr [ /tmp/transcode-1.1.7/install/usr ]$ ls -al bin
total 13228
drwxrwxr-x 2 renodr renodr    4096 Apr 13 16:30 .
drwxrwxr-x 5 renodr renodr    4096 Apr 13 16:30 ..
-rwxr-xr-x 1 renodr renodr  895672 Apr 13 16:30 avifix
-rwxr-xr-x 1 renodr renodr  941016 Apr 13 16:30 aviindex
-rwxr-xr-x 1 renodr renodr  940464 Apr 13 16:30 avimerge
-rwxr-xr-x 1 renodr renodr  949696 Apr 13 16:30 avisplit
-rwxr-xr-x 1 renodr renodr  939048 Apr 13 16:30 avisync
-rwxr-xr-x 1 renodr renodr  444760 Apr 13 16:30 tccat
-rwxr-xr-x 1 renodr renodr  811112 Apr 13 16:30 tcdecode
-rwxr-xr-x 1 renodr renodr  944328 Apr 13 16:30 tcdemux
-rwxr-xr-x 1 renodr renodr 1076440 Apr 13 16:30 tcextract
-rwxr-xr-x 1 renodr renodr 1085128 Apr 13 16:30 tcmodinfo
-rwxr-xr-x 1 renodr renodr  107400 Apr 13 16:30 tcmp3cut
-rwxr-xr-x 1 renodr renodr 1368352 Apr 13 16:30 tcprobe
-rwxr-xr-x 1 renodr renodr  893944 Apr 13 16:30 tcscan
-rwxr-xr-x 1 renodr renodr  118432 Apr 13 16:30 tcxmlcheck
-rwxr-xr-x 1 renodr renodr  103088 Apr 13 16:30 tcxpm2rgb
-rwxr-xr-x 1 renodr renodr   71240 Apr 13 16:30 tcyait
-rwxr-xr-x 1 renodr renodr 1811560 Apr 13 16:30 transcode

Running 'ldd bin/* | grep libav' and 'ldd bin/* | grep resample' returns no hits either.

I'll go look tonight/tomorrow to see if I have an encrypted DVD handy.

[Douglas R. Reno]

Seeing as the only thing that we're waiting on is Firefox MP4 support (which will likely be taken care of in June with the next ESR), I'm going to proceed with the motions of fixing the breakage in other packages and update the book to ffmpeg-5. This should be done today or tomorrow.

[Douglas R. Reno]

Status report:

Here's a list of things that I've noticed using ffmpeg:

• gegl
• opencv
• imagemagick
• tracker3-miners
• k3b
• kdenlive
• mlt
• gst-libav
• pipewire
• alsa-plugins
• xine-lib/xine-ui
• libquicktime
• mplayer
• vlc
• transcode
• audacious
• gtk4
• qtwebengine
• firefox

I'm almost done with everything in that list. There are several patches required, including one for ffmpeg itself (so that QtWebEngine will build, although QtWebEngine *also* needs a patch).

For transcode, I will add --disable-ffmpeg.

I would like to propose dropping libquicktime if at all possible. I don't know if that package will ever see another update.

Note that with ffmpeg5, VLC does not have any video acceleration through libva. It looks like it's known upstream but will never be fixed for the 3.x series, only in VLC-4.

For k3b, upstream has removed the plugin that used ffmpeg outright. I'm not sure how to handle that in the book, or if we're better off waiting on that until KDE Applications is updated in the book again (I think that'll be in June).

It also does not look like libvdpau-va-gl uses ffmpeg at all, grepping for 'libav' or 'ffmpeg' in the source tree returns no results, nor does a search on Arch Linux. I'll drop that dependency at my next commit.

[Douglas R. Reno]

libvdpau-va-gl's ffmpeg dependency dropped at a1bdb6526170e4d662b698be7923da5a8df456b1

[Douglas R. Reno]

Waiting for Firefox ESR 102

[Douglas R. Reno]

Hi Ken,

When you have a chance, can you check for that MP4 playback problem with Firefox-102ESR now that it's out? I'm going to be unavailable for the next couple of days but I will get to this soon now that 102esr is out.

[ken@…]

Replying to Douglas R. Reno:

Hi Ken,

When you have a chance, can you check for that MP4 playback problem with Firefox-102ESR now that it's out? I'm going to be unavailable for the next couple of days but I will get to this soon now that 102esr is out.

Sorry Doug,

I don't have 5.0.1 installed on a machine with sound, and my fast sound machine is currently working through updates to previous systems for firefox and qt/webengine. Doing other things tomorrow and thursday, then after that I'll mostly be watching the cycling on TV for the next 3+ weeks. I might be able to drop 5.0.1 onto my newest sound system at the weekend, but no promises and I think you might commit this before then.

[Douglas R. Reno]

Replying to ken@…:

Replying to Douglas R. Reno:

Hi Ken,

When you have a chance, can you check for that MP4 playback problem with Firefox-102ESR now that it's out? I'm going to be unavailable for the next couple of days but I will get to this soon now that 102esr is out.

Sorry Doug,

I don't have 5.0.1 installed on a machine with sound, and my fast sound machine is currently working through updates to previous systems for firefox and qt/webengine. Doing other things tomorrow and thursday, then after that I'll mostly be watching the cycling on TV for the next 3+ weeks. I might be able to drop 5.0.1 onto my newest sound system at the weekend, but no promises and I think you might commit this before then.

That's totally good with me, no rush! I'm good with waiting for the weekend since I'll be mostly AFK for the next few days trying to wrap some things up here, so I probably won't have it done by then. Enjoy your cycling!

I know you've got the proper stuff to reproduce it so that's why I'd rather you try. :)

[ken@…]

Replying to Douglas R. Reno:

Replying to ken@…:

Replying to Douglas R. Reno:

Hi Ken,

That's totally good with me, no rush! I'm good with waiting for the weekend since I'll be mostly AFK for the next few days trying to wrap some things up here, so I probably won't have it done by then. Enjoy your cycling!

I know you've got the proper stuff to reproduce it so that's why I'd rather you try. :)

From memory, mp4 and possibly mov files were the things that didn't play in firefox. You can find versions of big buck bunny in both formats. I'm hoping to get to this, but this weekend is looking less likely. I've just played both mov and mp4 versions of that from local copies in 102esr with our current ffmpeg4.

[Bruce Dubbs]

Replying to ken@…:

From memory, mp4 and possibly mov files were the things that didn't play in firefox. You can find versions of big buck bunny in both formats. I'm hoping to get to this, but this weekend is looking less likely. I've just played both mov and mp4 versions of that from local copies in 102esr with our current ffmpeg4.

I have ffmpeg5 on my system and BBB.mp4 played fine with FF102.

[Joe Locash]

I'm also using ffmpeg5 now and these are my notes:

Firefox-102.0 - no problems playing mp4 or mov files.

gegl-0.4.36 - needs a patch. This was merged in upstream with ​https://gitlab.gnome.org/GNOME/gegl/-/merge_requests/114

mplayer - no issues for me but I grab the latest from their svn repo. mplayer-1.5 was released 2/27 with support for ffmpeg5. I would update the release used in the book. I'm using svn revision 38369.

alsa-plugins-1.2.7.1 - no issues

gst-libav-1.20.3 - no issues

I don't build the other packages so can't comment on them

[ken@…]

I've finally dropped ffmpeg-5.0.1 on top of a recent system, as everyone said - no problems with firefox-102.

[Douglas R. Reno]

Audacious has been fixed, and for libquicktime, I will disable ffmpeg support.

[Douglas R. Reno]

Fixed at commits 99c73727c9f3bd0bfccb12fa899ee381fd226ba4 69b7d08758e1097843fdb1a8e314e651570b224a cac1034913a51f03080e9c3199d00c5d95903e45 e1af972cd36cdb7af26812062a02beede32b9a44 71db115735e7e236c5649d3c7ec42aa1c18085e6 f2b4c825fd76cfcf1321b57c0853e3347320a501 3df23984b4715e8446ed3bd7ebc9c018b03b78db and aebb527112aa5410647d1597e34fd5a1c591d53f