AMD Boosting AI/LLM Performance For Radeon iGPUs As Much As 18~23% With Linux 7.4
Next up was looking at the impact on Strix Point with the AMD Ryzen AI 9 365 running within the ASUS Zenbook S16 with 16GB of LPDDR5-7500 memory.
Well, this is much more interesting... With the smaller memory carve out, Lemonade with Llama.cpp was enjoying much greater gains out of AMD PerfOpt.
Across many different benchmarks conducted with Lemonade using both the AMD ROCm and Vulkan back-ends of Llama.cpp, there were gains as high as 23% from this new feature coming in Linux 7.4.
Some very nice improvements for throughput and lower latency with AMD PerfOpt on Strix Point with the Radeon 890M integrated graphics. Linux 7.4 just got a whole lot more exciting.
