Skip to content

Add ROCm Dockerfile - #2094

Open
robertosw wants to merge 1 commit into
leejet:masterfrom
robertosw:add-rocm-dockerfile
Open

robertosw wants to merge 1 commit into
leejet:masterfrom
robertosw:add-rocm-dockerfile

Conversation

@robertosw

@robertosw robertosw commented Oct 3, 2026 •

Copy link
Copy Markdown

Summary

Added the Dockerfile for building a ROCm image. I am using this image locally for the cli - it works as expected.

I can run it with

$ podman run --rm \
     --device /dev/dri \
     --device /dev/kfd \
     --group-add video \
     -v ./models:/models:ro \
     -v ../output:/output \
     -v ./ref-images:/ref-images:ro \
     localhost/sd-rocm --color <and more cli args>

This was AI generated - if thats relevant for this repo.

@leejet leejet left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please address the following before merging:

  • Disable GGML_NATIVE or use the dynamic CPU variants setup from the Vulkan/CUDA Dockerfiles. The default -march=native ties the image to the build host’s CPU features and can cause Illegal instruction on another machine.
  • Add a ROCm run example to docs/docker.md, including --device=/dev/kfd --device=/dev/dri and any required group permissions. The existing generic run command does not expose the AMD GPU to the container.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants