Issues

• Upgrade to transformers v5

  foundation-model-stack/fms-hf-tuning#687 · Filter by author dushyantbehl opened on Oct 1, 2026

• Showcase / question: a board-proven offline language runtime on ESP32-C3, and whether some language capability may eventually diverge from dense tuning paths

  foundation-model-stack/fms-hf-tuning#672 · Filter by author Juemian-Deng opened on Mar 18, 2026

• feature-request: proceed with tuning even if ClearML (or other trackers) fail

  wontfix
  foundation-model-stack/fms-hf-tuning#653 · Filter by author HarikrishnanBalagopal opened on Jan 21, 2026
  

• Support arbitrary batch size in ODM

  foundation-model-stack/fms-hf-tuning#639 · Filter by author romitjain opened on Nov 21, 2025
  1

• Remove vim-minimal and vim packages from fms-hf-tuning image

  foundation-model-stack/fms-hf-tuning#623 · Filter by author dushyantbehl opened on Oct 28, 2025
  1

• Bug: tuning vision models raises TypeError: apply_tokenizer_chat_template() missing 1 required positional argument: 'formatted_text_column_name'

  foundation-model-stack/fms-hf-tuning#606 · Filter by author VassilisVassiliadis opened on Sep 11, 2025

• QLoRA finetuning of granite-34b-code-base-gptq model fails on fms-hf-tuning 2.6.0

  foundation-model-stack/fms-hf-tuning#479 · Filter by author sutaakar opened on Feb 25, 2025
  1

• Would like to use --fast_moe but the v2.5.0 image is missing the acceleration plugin moe

  foundation-model-stack/fms-hf-tuning#457 · Filter by author VassilisVassiliadis opened on Feb 6, 2025
  1

• Log and/or exit on unknown args

  foundation-model-stack/fms-hf-tuning#420 · Filter by author ChanderG opened on Dec 16, 2024

• Bug: lora_post_process_for_vllm has no effect

  foundation-model-stack/fms-hf-tuning#414 · Filter by author achillefokoue opened on Dec 11, 2024

• RFC: Allow Default Behavior for Specified Plugins of FMS Accel

  foundation-model-stack/fms-hf-tuning#334 · Filter by author fabianlim opened on Sep 9, 2024

• feat: Need a way to execute some cleanup calls before the program exits or crashes.

  foundation-model-stack/fms-hf-tuning#271 · Filter by author dushyantbehl opened on Jul 31, 2024
  1

• bug: warnings when building the Dockerfile

  foundation-model-stack/fms-hf-tuning#228 · Filter by author HarikrishnanBalagopal opened on Jul 3, 2024
  1

• Improve Acceleration Framework Integration

  foundation-model-stack/fms-hf-tuning#205 · Filter by author fabianlim opened on Jun 20, 2024
  

• NCCL ENV support

  foundation-model-stack/fms-hf-tuning#200 · Filter by author bbenshab opened on Jun 18, 2024

• feat: [Trainer controller] Extend trainer controller capabilities to have fine-grained control in multi-node-multi-gpu scenario

  feat:instructlab
  foundation-model-stack/fms-hf-tuning#182 · Filter by author seshapad opened on Jun 11, 2024

• feat: support for robust benchmarking of fms-hf-tuning

  foundation-model-stack/fms-hf-tuning#142 · Filter by author VassilisVassiliadis opened on Apr 25, 2024
  9

• feat: standardize the format for metrics, operations, controls in the yamls used by TrainerControllerCallback

  foundation-model-stack/fms-hf-tuning#129 · Filter by author HarikrishnanBalagopal opened on Apr 23, 2024

• Prompt Tuning returns low-quality results

  foundation-model-stack/fms-hf-tuning#103 · Filter by author weidotwisc opened on Mar 28, 2024
  33

  

• bug: Boolean values are represented as strings in default fsdp config translates to True

  foundation-model-stack/fms-hf-tuning#80 · Filter by author kmehant opened on Mar 6, 2024
  8

• Add unit tests for tuning/utils/merge_model_utils.py

  good first issue
  foundation-model-stack/fms-hf-tuning#76 · Filter by author tedhtchang opened on Mar 5, 2024
  4

  

• Add unit tests to tuning/utils/config_utils.py

  good first issue
  foundation-model-stack/fms-hf-tuning#75 · Filter by author tedhtchang opened on Mar 5, 2024
  5

  

• Add unit tests for tuning/data/tokenizer_data_utils.py

  foundation-model-stack/fms-hf-tuning#73 · Filter by author tedhtchang opened on Mar 5, 2024
  1

• Add unit tests for tuning/config/configs.py

  foundation-model-stack/fms-hf-tuning#72 · Filter by author tedhtchang opened on Mar 5, 2024
  2

• Ensure Huggingface, Torch Packages Up-to-Date with Necessary Improvements/Fixes

  foundation-model-stack/fms-hf-tuning#60 · Filter by author fabianlim opened on Feb 27, 2024
  5