Skip to content

ollama for amd

Pre-release
Pre-release
Compare
Choose a tag to compare
@likelovewant likelovewant released this 06 May 13:55
· 1854 commits to main since this release
a1c646a

This is a example release for the unoffical support amd gpu on windows .which nativly supportgfx1103. for others ("gfx803" "gfx902" "gfx904""gfx940" "gfx941" "gfx942" "gfx1010" "gfx1011" "gfx1012" "gfx1030" "gfx1031" "gfx1032""gfx1034" "gfx1035" "gfx1036" "gfx1103") also supported .
however ,you need to have your supported rocblas, download somewhere on github or build yourself .following the wiki file for development guide .Place rocblas.dll into C:\Program Files\AMD\ROCm\5.7\bin( this fold will appear after install HIP SKD ) replace the origianl one ,replace library within rocblas\library , also relace files in the ollama program folder with your rocblas.dll and library folder,eg(C:\Users\usrname\AppData\Local\Programs\Ollama\rocm) this report will not update regulary ,serve an example only .