Finally got ROCm to install
With the latest release of ROCm 7.1 I decided to attempt an install again. Currently, I am running Kubuntu 25.04 which is not technically a supported version. Previous attempts at installing had failed due to 25.04 having a newer kernel. Also, previous versions of amdgpu-install
were throwing errors left and right.
The team at AMD has been doing a fantastic job of stabilizing things, so I decided to give it a go again.
To my surprise the installation worked smoothly, installing 26 gigs of stuff on my machine. My goal was to be able to compile llama.cpp with HIP support so that I can run inference on my Radeon RX9070 XT. So that is waht I did and it worked great. I did some quick tests and managed to run gpt-oss-20b
with offloading just a few layers as the model just barelly exceeds the VRAM of my GPU. I'm getting an impressive 112 tokens/s.
One thing that got broken was btop
. It started segfaulting when I run it. The solution was to download and compile the latest version since the one comming from the ubuntu package is not up to date.
I will try to experiment with different models and different configurations to see if I can squeeze the most out of my GPU.