Skip to content

v0.6.0
Compare
Choose a tag to compare
@likelovewant likelovewant released this 12 Mar 06:35
· 223 commits to main since this release
v0.6.0
88ab587
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm6.2 [hipsdk 6.2.4]， make sure to replace the libs with v0.6.2.4

Tip

ROCm5.7 version * available at limited arches

ollama-windows-amd64-rocm5.7z for ROCm5.7
Support lists gfx803 gfx900:xnack- gfx902 gfx1103

ROCmlibs for 5.7 available at ROCmlibs for 5.7

ollama-windows-amd64.7z for ROCm6.2.4
ROCmlibs for 6.2 available at ROCmlibs for 6.2.4

Support lists gfx906:xnack- gfx1010:xnack- gfx1011 gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150

Note

1st, Install OllamaSetup.exe or download and upzip ollama-windows-amd64.7z . 2nd, replace the rocm libs in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm or your ollama-windows-amd64 , replace files in your Ollama program ROCm folder with the rocblas.dll and delete rocblas/library folder put your arches library matches your GPU architecture (Don't overwrite library , simply delete it and put the new in there) with the correct ROCmlibs for 6.2.4 or ROCmlibs for 5.7 for ollama-windows-amd64-rocm5.7z .(eg. use OllamaSetup.exe , by run ollama run model names or use package ollama-windows-amd64.7z , by run ./ollama serve )

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases
Full Changelog: v0.5.13...v0.6.0

Assets 5
Loading