AMD 9070 performance slow

[z0mbi32]

Running 0.1.9 on an AMD 9070. Pleased to see the GPU is being used, however only seeing around 3 TPS.

Under the 7800 XT I upgraded from I was seeing much better performance.

This was somewhat expected as I get the ROCM for support 9070 isn't there yet, however I was surpised to see the GPU being used at all so wondering if there's something else going on here?

[rifkybujana]

@z0mbi32 Does any previous version work fine? Do you have multiple GPU on your machine?

[javon27]

If you're running the latest AMD Adrenalin drivers, this could be the issue. Version 25.5.1 is getting me less than 1 tps with LM Studio. Downgrading drivers to version 25.3.1 results in over 50 tps. I'm going to try Kolosal to see if I can't get a more lightweight LLM server running on my machine.