https://jackliusr.github.io/tags/dflash/ Recent content in dflash on My learning and diary Hugo -- gohugo.io en-us Sat, 03 Oct 2026 13:00:00 +0800 https://jackliusr.github.io/posts/2026/10/testing-magnitude-vs-llama.cpp-is-it-really-2x-faster/ Sat, 03 Oct 2026 13:00:00 +0800 https://jackliusr.github.io/posts/2026/10/testing-magnitude-vs-llama.cpp-is-it-really-2x-faster/ Several days ago, I came across a claim from Magnitude stating that it’s up to 2x faster than llama.cpp, and—more interestingly for me—that it supports AMD GPUs as well. Naturally, I was skeptical. A 2x speedup over llama.cpp is a bold claim, especially on AMD hardware where the ROCm ecosystem can be hit-or-miss. So today, I decided to give it a try and run my own benchmarks. Setup I used the following build for Magnitude: