Repository navigation
Vulkan Video Decoding: Usage Guide and FAQ #13909
Replies: 250 comments 95 replies
|
AMD on Windows appears to be 5000/6000 series according to https://www.amd.com/en/support/kb/release-notes/rn-rad-win-22-11-2-vlk-video-code-decode (possibly 7000 works?). It doesn't work on Polaris: |
|
Reliably crashes driver for me with this sample: https://0x0.st/HbHJ.mkv |
|
Sounds like you probably need to file a mesa issue for that - and even if it was an mpv issue, please open a separate one. This FAQ isn't the place to report it. |
|
@aufkrawall AMD currently needs https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23227 to avoid crashes, which also fixes quite a lot of bugs |
what does this error mean, my device has amd and i used the following config |
I don't know if that specific driver is required, they may have been included in 23.2.1 where they added other extensions, the driver notes aren't clear. 7000 series wasn't launched when the 22-11-2 Vulkan video drivers were released so that driver doesn't officially support them. If they did include the video extensions in newer drivers then they may support 7000 series but someone with those GPUs will need to test. |
|
Yeah, I've reported to nvidia months ago that their descriptor buffer implementation is broken, but they haven't fixed it yet. |
Github claims you attached an audio-only file... |
|
That file is also broken on anv, it's glitchy and the decode is very slow while utilizing 100% of Render/3D engine. |
It's an HEVC file. My experience on ANV is that any HEVC playback pegs the GPU at 100% |
|
Also: This is a highly questionable sample. |
|
Will this work with hasvk in the future? I tried using it through wine (I dont want to have to compile everything) and got this error |
|
NVIDIA 1650 Super, Tested on windows with: mpv --vo=gpu-next --gpu-api=vulkan --hwdec=vulkan --gpu-context=winvk This video has problem: https://4kmedia.org/sony-whale-in-tonga-hdr-uhd-4k-demo/
|
|
for fedora, you need to edit mesa.spec and rebuild with codecs enabled https://themaister.net/blog/2023/01/05/vulkan-video-shenanigans-ffmpeg-radv-integration-experiments/ https://forum.endeavouros.com/t/compiling-mesa-22-2-with-codec-support-the-easy-way/30390 |
|
No need to recompile, install |
|
Hi there, i have an AMD GPU (RADV) that is builtin into my Ryzen 7 5700G and i noticed that mpv now uses waylandvk by default on my system where it used just wayland as context until recently. I noticed it, because it is horribly slow, its barely usable. Using --profile=best causes most of the frames to be dropped and using profile=fast gets me through with 90% GPU usage and a few frame drops here and there. For comparison with --gpu-context=wayland, profile=fast uses like 5~10% GPU and profile=best works without frame drops at ~90% GPU usage. So i put gpu-context=wayland into my mpv.conf now but i am wondering what causes this insane frame drop. Its a FullHD Video i watch on a 4K Screen (so it is using the upscaling), H.264 (with vaapi decoding) and a pretty low bit-rate. Like 3mbps or so (YouTube Quality). So not sure what exactly is the issue here, but waylandvk is not usable for me, at all. |
|
Do you use hwdec? And if so, does disabling/enabling it changes overall performance? Also this probably should be a separate issue with a log file to help us troubleshoot. Vulkan shouldn't be significantly slower than opengl, but there may be some specificities in the driver that makes Vulkan hwdec not work well for example with native rendering, but we have not enough Info to know that. |
|
Could someone that knows a bit more about this than me figure out if AMD GPUs still require RADV_PERFTEST? I do not know where to look at to find that information. According to another comment in this discussion it depends on a certain Mesa version, and also on the VCN version. So it would be nice to know which Mesa versions with which VCN versions don't require the flag to work. The Arch Wiki does not mention RADV_PERFTEST itself as a requirement to get Vulkan Video Decoding to work, only Mesa 25.1 or higher. (On the KDE page under the HDR section) |
|
Guess what specifically? I will be getting an RX 9070 XT. |
|
So, how hard is it to set the variable? Not sure what you are even worrying about. |
Maybe someone help me but for me and the 9070 xt the extensions aren't showing ... even with RADV_PERFTEST set :( |
|
You need to set |
|
let me correct what i wrote so it's easier to understand the echo and the vulkaninfo is going into the pasti so you see how $RADV_PERFTEST is set and what is the current vulkaninfo ;) Sorry i forget to mark code. Thank you for taking your time and trying to help. |
|
does glsl shaders like KrigBilateral and SSimDownscaler support in vulkan backend or i should keep using openGL to use them |
|
this has nothing to do with vulkan decoding. |
|
I'm trying to use vulkan video instead of nvdec due to it being inefficient, forcing the GPU into a high power profile.
Specs are: 5070ti, Version: 570.144, Arch Linux, Wayland, Plasma, Open GPU Kernel Modules. Hope someone can help, unsure if this is a driver thing with the new 50 series..
|
|
@adolfotregosa please don't use vdpau in any case. Unless something drastically changed in the past year, nvdec should always be preferred for nvidia, as vdpau is on its deathbed. |
https://forums.developer.nvidia.com/t/wayland-support-for-the-575-release-series/333827 """VDPAU support on Wayland.""" Nvdec uses more power because gpu P state stays locked in P3. Vdpau let's gpu P state go higher using less power. |
|
NVIDIA Driver version 580.76.05 appears to have finally fixed this, i can now use vulkan hwdec with mpv. https://www.nvidia.com/en-us/drivers/details/252613/
|
|
Thank you for sharing. Even AV1 decoding works with vulkan ! It still fails with vdpau-copy but it's progress. |
|
To avoid the power wastage, you can use this: https://gist.github.com/Ristovski/c81502f850ba095320353ec2094b14cf |
|
ANV_VIDEO_DECODE=1 to ANV_DEBUG=video-decode |
|
@philipl is it possible to get an update in the main post about this? I can see this tripping a lot of people up. For anyone curious, the list of Mesa environment vars are at https://docs.mesa3d.org/envvars.html ; with Intel (ANV) in particular at https://docs.mesa3d.org/envvars.html#anvil-anv-driver-environment-variables |
|
Khronos Announces Vulkan Video Decode VP9 Extension |
What do you mean by that? Work where? |
|
As in, radv supports that extension now https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/35398 ffmpeg doesn't have a patch yet, but gstreamer does https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/9204 |
Sir, this is an mpv repository. I doubt anything will work until there are patches in both ffmpeg and mpv to enable VP9 extension. |
|
mpv should move to gstreamer anyway |
|
With new enough Vulkan headers, ffmpeg, and mpv, it should work today. I don't have the headers and haven't bothered installing them, so can't confirm. |
|
I can't get vulkan decode working on my 9070. |
|
Eh, found this after the fact. Guess it's either wait for mesa 25.2 or switch to mesa-git. |
|
I'm on Intel (i3 1215u iGPU)+Arch Linux with current Mesa. Vulkan decoding works, but fast forwarding/skipping any H265 file makes it crash with this error: H264 files work without issues. |
|
Report it to mesa. |
|
@cih89 Have you already reported it? If yes, please the link. I have a similar problem even with H264 files on Fedora 42, Mesa 25.1.9 and Intel i7-9750H (9th gen). |
|
I was wondering what else is needed for this to work with virtio-gpu via venus driver |
|
For reference my RX 570 decodes h264 5 times slower under vulkan than vaapi, on CachyOS. |
|
Sad to see that AMD doesn't care about video decoding! |
|
@fredgido: Did you report a bug to Mesa? It has to be reported for someone to care I'd guess. |
|
On an Intel UHD 620 I'm getting a weird error: |
|
My GPU doesn't have AV1 decoding and playing AV1 Videos work just fine. In my experience, GPU Decoding is an (almost) useless feature. On my CPU, it saves me 1~2% CPU Usage on one core... at least with the codecs i tested, i found almost no difference and hence i don't really care that my GPU doesn't support AV1 and again, it works flawless. But what you're getting is a warning, not an error |
|
My laptop has that Intel UHD 620 iGPU and an R5 dGPU and neither have AV1 HW decoding. And that error seems to be a bug somewhere: |
I'm guessing that's just lower resolution? 4k30 is ~14% CPU usage of my 5700X but that's just with a low bitrate sample from Youtube, higher bitrates are more expensive. 4k60 HDR (also from Youtube) is 45-60% CPU usage... I mean there's a lot faster processors out there but I feel like if you have them then they'll likely have AV1 decoding or you'd have a GPU capable of it. |
But i have the same issue, with all Video Formats, even if HW Decode is supported. I am using profile=fast for these which works fine. Sadly most of 4K Videos also have HDR and HDR is starting to look bad with profile=fast, hence i created my own hdr profile This is my current config With that, i just use --profile=fast for normal 4K and --profile=hdr for HDR and it works perfect. I am mostly watching BluRay, so ~40mbit/s on FullHD and ~130mbit/s on 4K and my 5700G with iGPU is able to handle it without issues. |
You are absolutely right. I just checked my screenshots from when i tested and that wasn't AV1. With AV1 i have roughly the same as you. Not as high but almost. So AV1 actually is more expensive on the CPU, sorry for mixing that up. |
|
For AMD users on linux there will be change in env variable. https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/40646 |
|
It has worked without |
|
I think it depends on gpu and firmware, if it is vulkan compliant it would be enabled by default, but for older hardware you may still need to force enable it. |
|
Yeah, but https://wiki.archlinux.org/title/Hardware_video_acceleration#Configuring_Vulkan_Video recommends to not forcibly enable it on old GPUs. |
|
Older GCN-based GPUs don't support vulkan video decoding. The cutoff is somewhere around Fiji (UVD 6.0) and Polaris (UVD 6.3). Polaris-based GPUs initially had some artifacting issues with decoding which were finally fixed last year. According to reports Fiji-based GPUs seem to be hit-or-miss. So at least Polaris, Vega and iGPUs using VCN 1.0 hardware would still require this new environment variable. |
|
Mesa devs have made some progress regarding the default enablement of the VK Video for some GCN cards (polaris and vega). |
|
When it works, it works quite good, but getting this too often recently: dmesg shows:
Latest Arch (updated 2 days ago) |
|
Here is logs. HWdec Vulcan Windows 11 25H2, license, all updates. not working. Nvidia RTX 3070 TI. fresh drivers. 
|
|
@fidodido48 please report this to mesa @Cryosim your comment is off topic, and I don't know what you're trying to say |
Done. |
|
Ever since I switched from the proprietary driver to Nouveau/NVK for my Nvidia card, Vulkan Video no longer works with my Intel iGPU and mpv. I had been following the Arch Wiki instructions before, and as I said, it worked perfectly. This error message appears: here is the vulkaninfo: These are my mpv.conf settings: |
|
You need to set |
|
Thanks Ilyyr for replying. Oh, i did not know you can already utilize the Nvidia Card with NVK for Vulkan Video? I actually just wanted to use my Intel card for that as before. So i tried while adding the For now i have only enabled Besides, |
|
Provide full vulkaninfo output without any env vars or options set. And also mpv output when you attempt to use vulkan decoding. |
|
|
We can't see device extensions if you pass --summary to vulkaninfo. Please just run the command and pipe the output to a log file and upload the file here. Similarly for mpv, run it with --log-file=mpvsucks.log and upload that file too |
|
For Intel you need |
and others
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Vulkan Video Decoding: Usage Guide and FAQ
On the 28th of May, we reached the significant milestone of finally merging all the required functionality into ffmpeg, libplacebo, and mpv to do end-to-end Vulkan video decoding and presentation. Although the functionality is now all there, we still have a complex landscape in terms of what is supported on what hardware and with what drivers. This document attempts to lay out all the requirements and limitations, so you have a chance of successfully using the feature.
Why should I even care about Vulkan video decoding?
It's a fair question. Right now, the actual functionality you gain access to is not terribly different from what you would get with existing video decoding APIs that ffmpeg and mpv already support. However, Vulkan video decoding has the potential to be a credible cross-vendor, cross-platform API that is well supported, and can work efficiently with Vulkan based filtering and post-processing. In the short term, there will be rough edges, and a narrower set of supported codecs (don't hold your breath for mpeg2 and vp8), but in the future, it will hopefully be the most performant and capable way to do hardware decoding and processing.
Software Requirements
We have finally reached the point where all the required components have made official releases. Ensure you are running with the following releases or newer:
These requirements mean you will likely have to compile everything for yourself (especially on Linux), but Shinchiro's windows builds appear to be functional.
Hardware and Driver Requirements
Usage
The basic command line arguments:
Depending on your system configuration, you may additionally need to force the right
gpu-context:--gpu-context=winvk--gpu-context=x11vk--gpu-context=waylandvkCapabilities
ANV_DEBUG=video-decodein your environment to expose video decodingRADV_PERFTEST=video_decodein your environment to expose video decodingAll reactions