devops : Add main-rocm Dockerfile - #3975
Merged
Merged
Conversation
danbev
approved these changes
Aug 24, 2026
danbev
left a comment
Member
There was a problem hiding this comment.
I tried this locally and it worked for me 👍
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds a Dockerfile for a ROCm build.
Based off code from https://github.com/kyuz0/amd-strix-halo-toolboxes/blob/main/toolboxes/Dockerfile.rocm-7.14.
The build and runtime targets:
gfx1100gfx1101gfx1102gfx1103gfx1150gfx1151gfx1152gfx1200gfx1201This pull request introduces a new multi-stage Dockerfile,
.devops/main-rocm.Dockerfile, to support building and running the project with AMD ROCm 7.14 for GPU acceleration. The Dockerfile is split into build and runtime stages, ensuring a clean and efficient image for deployment.ROCm Dockerfile addition:
.devops/main-rocm.Dockerfilewith a build stage based on Fedora 44, installing ROCm 7.14 development packages and compiling the project with HIP and AMDGPU targets enabled.ROCM_PATH,HIP_PATH,PATH,LD_LIBRARY_PATH) for ROCm compatibility in both build and runtime stages./opt/rocmto ensure compatibility with ROCm tools and libraries.Testing
gfx1151this works.In my testing I did notice a transcription difference between running main-vulkan-306c88f4d1286aec1bf96e544632897886af5501 v.1.9.2 docker image and main-rocm. Multiple runs would provide consistent output, but the output of vulkan and rocm differed - I'm not sure why. For the most part it was little differences, where I feel ROCm was more accurate, but there was a chunk near the end that ROCm skipped that Vulkan did not. My testing was with
-m ggml-large-v3-turbo-q5_0.binand--vad --vad-model ggml-silero-v6.2.0.binExample small difference - first vulkan (less accurate) then ROCm (more accurate):
The VAD segments are the same in both Vulkan and ROCm.