Skip to content

v0.6.1

Compare
Choose a tag to compare
@likelovewant likelovewant released this 17 Mar 07:08
· 182 commits to main since this release
4575767
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm6.2 [hipsdk 6.2.4], make sure to replace the libs with v0.6.2.4

Tip

ROCm5.7 version * available at limited arches

ollama-windows-amd64-rocm5.7z for ROCm5.7
Support lists gfx803 gfx900:xnack- gfx902 gfx1103

ROCmlibs for 5.7 available at ROCmlibs for 5.7

ollama-windows-amd64.7z for ROCm6.2.4
ROCmlibs for 6.2 available at ROCmlibs for 6.2.4

Support lists gfx906:xnack- gfx1010:xnack- gfx1011 gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150

Note

Let's get Ollama set up!

  1. Install or Extract: You can either run the OllamaSetup.exe file, or download the
    ollama-windows-amd64.7z file and unzip it.

  2. Update ROCm Libraries:

    • Find the rocblas.dll file and the rocblas/library folder within your Ollama installation folder (usually
      located at C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm).
    • Delete the existing rocblas/library folder.
    • Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
      them here: ROCmLibs for 6.2.4 or ROCmLibs for 5.7
  3. Start Ollama: Once the ROCm libraries are updated, you can start using Ollama. You can either run ollama run model names or use the command ./ollama serve (depending on how you installed it).

or use One Click Installer Ollama-For-AMD-Installer by ByronLeeeee

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases
Full Changelog: v0.6.0...v0.6.1