Repository navigation
[None][refactor] Route per-step device copies through a model-declared copy plan - #20972
WeiHaocheng wants to merge 2 commits into
Conversation
df4d844 to
c2d423d
Compare
|
Note Reviews pausedIt looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the Use the following commands to manage reviews:
Use the checkboxes below for quick actions:
WalkthroughThis pull request replaces legacy step-input and H2D-cache copy paths with a new ChangesDevice-copy and MiniMax M3 migration
Estimated code review effort: 5 (Critical) | ~120 minutes Change: Refactor Sequence Diagram(s)sequenceDiagram
participant DecoderRunner
participant DeviceCopier
participant AttentionMetadata
participant device_copy_scatter
DecoderRunner->>DeviceCopier: activate copy plan
AttentionMetadata->>DeviceCopier: submit site-tagged copies
DecoderRunner->>DeviceCopier: flush before replay or after graph step
DeviceCopier->>device_copy_scatter: launch merged staged copies
Possibly related issues
Suggested reviewers: Merge Risk:
|
|
PR_Github #85511 [ run ] completed with state
|
090bf6e to
6fbd8ba
Compare
|
/bot run --disable-fail-fast |
|
PR_Github #85645 [ run ] triggered by Bot. Commit: |
|
PR_Github #85645 [ run ] completed with state
|
553d764 to
2a005b4
Compare
|
/bot run --disable-fail-fast |
|
PR_Github #85782 [ run ] triggered by Bot. Commit: |
|
PR_Github #85782 [ run ] completed with state
|
2a005b4 to
4e0cfd5
Compare
87fa5bf to
fc4fdd7
Compare
|
/bot run --disable-fail-fast |
|
PR_Github #86048 [ run ] triggered by Bot. Commit: |
|
PR_Github #86048 [ run ] completed with state |
A model may declare a CopyPlan (copy_plan) naming the copy sites whose per-step copies are staged into one pack and issued as one upload and one scatter launch, up to plan-declared barriers and at the latest at the decode graph replay, optionally by the graph's own prologue (device_copy.py). Buffer owners skip their unchanged uploads with device_copy.DeviceCopyBuffer; TLLM_DEVICE_COPY_CHECK=1 verifies both. The plan is off by default and coexists with the step-input pack: * An engine has a copier only when its model declares a plan; the runner and CUDA graph runner open, flush, capture and discard it beside the step-input pack. * The shared sites that gain a CopySite (graph static inputs, decoder position ids, attention prompt/KV lengths, speculative RNG uploads) go through the plan only while a copier is active and otherwise keep their original path, so a model without a plan is unchanged. * A model that declares a plan and also turns on the step-input pack or the skip cache is refused (check_one_copy_path). * The pack is issued with the existing trtllm::step_inputs_scatter op. Tests cover the plan, the in-graph final flush, changed-span and pool-shared uploads, the owner-side record, and the coexistence. Signed-off-by: Fred Wei <20514172+WeiHaocheng@users.noreply.github.com>
A developer guide page describes the copy plan, how a model adopts it, and how it coexists with the step-input pack until every model has moved. AGENTS.md points new per-step copies at device_copy and asks for the same additive approach whenever a shared runtime mechanism is replaced: add the new one beside the old, opt-in and off by default, move models in follow-ups, and remove the old one last. Signed-off-by: Fred Wei <20514172+WeiHaocheng@users.noreply.github.com>
fc4fdd7 to
6351166
Compare
|
/bot run --disable-fail-fast |
|
PR_Github #86526 [ run ] triggered by Bot. Commit: |
Description
Problem
Between two decode CUDA graph replays, a step's inputs and metadata reach their graph-stable buffers as a chain of tiny host-to-device and device-to-device copies. Each copy is a separate operation the next graph waits for, so the GPU idles for the whole chain. MiniMax-M3 removed this idle time in #20306 and went further for Rubin in #20623, but each optimization was wired through shared runtime code. The cost of that is not the optimizations themselves; it is how they are switched on.
Every per-target optimization adds a
RuntimeHooksfield and anifbranch in shared files. On main (a7e88dee4a):RuntimeHookshas 24 fields:pack_step_inputs,pack_parallel_scatter,pack_in_graph,pack_early_copy,pack_step_epoch,pack_prologue_op,skip_unchanged_h2d,h2d_changed_span,pack_spec_rng_uploadsandspec_small_h2d;MsaRuntimePolicy.skip_unchanged_block_offsetsand the derivedskips_unchanged_metadata_uploads;msa(a 5-fieldMsaRuntimePolicy),sampler_d2h_side_stream,kv_lens_update_onceandskip_greedy_rng_upload. The last two are read nowhere.runner.py11, decodermetadata.py11,spec_sampler_base.py5,_util.py3 andspeculative/interface.py3. In addition, the MSA backend and KV cache manager have 23 lines that switch on the policy.pack=arguments and three helpers:copy_h2d_if_changed,copy_h2d_pool_sharedandstep_inputs.copy_. They appear in the graph runner, decoder inputs, TRTLLM attention, speculative metadata and MSA.pack_in_graphneedspack_parallel_scatter,pack_early_copyneedspack_in_graph, andpack_prologue_opneedspack_early_copy. A wrong combination is silently downgraded.SUBPAGE_IN_GRAPH,SKIP_UNCHANGED_BLOCK_TABLEandTAIL_FILL_IN_FORWARDin MSA, andSKIP_POOL_SHARED_UPLOADSinh2d_cache.py.[M3 host]log lines, inrunner.py,metadata.py,_util.pyandprofiling.py.Each enabled or disabled combination is a path through shared code that someone must keep working and testing, although only the sm_103 and sm_107 MiniMax-M3 targets turn any of it on.
How this PR fixes it: who decides what
device_copy.copy(CopySite.ATTN_KV_LENS, dst, src). It does not decide whether the copy is packed or skipped._COPY_PLAN = CopyPlan(merge=..., flush_after=..., changed_span=..., parallel_scatter=..., final_flush=InGraph(...)). The plan is validated when it is built:flush_after ⊆ merge,InGraphneedsparallel_scatter, andprologue_opneedsearly_copy.unchanged=Trueitself, or uses aDeviceCopyBufferrecord with the copy's site.RuntimeHookskeeps only executor and step-loop opt-ins and model extension points:decode_prologue,executor_events,spec_offsets_op,spec_step_fold,loop_on_execution_stream,merge_tuned_tactics_across_ranks,first_content_emit_iters,mxfp8_pinned_tactics,late_compile_detectanditeration_timing_one_event.Consequences:
TLLM_DEVICE_COPY_CHECK=1turns the invariants that were only comments into runtime checks:unchangedcopy is stale;expect_landedthat its copy has landed.Before and after (main
a7e88dee4aagainst this PR)RuntimeHooksfieldsmsa.skip_unchanged_block_offsets,skips_unchanged_metadata_uploads)msa×5 subfields,sampler_d2h_side_stream,kv_lens_update_once,skip_greedy_rng_upload)_util.py, spec metadata/sampler)pack=arguments and choice of skip helper at call sitespack=across graph runner, decoder inputs, attention, spec, MSA[M3 host]logs in shared runtime code[device copy]plan lineSKIP_POOL_SHARED_UPLOADS)step_inputs.py501 +h2d_cache.py235 +_device_copy.py91 = 827device_copy.py1269runtime_hooks.pylinesThe copy mechanism itself is not smaller. It moves into one module and gains merge-up-to-barrier,
flush_after, plan validation and check mode. This PR does not reduce code overall. What it changes:Changing a target's optimization
Before. Turning on the in-graph pack for another target meant:
pack_step_inputs,pack_parallel_scatter,pack_in_graph,pack_early_copyandpack_prologue_op(andskip_unchanged_h2d,h2d_changed_span) in the target'sRuntimeHooks, in the order the comments describe;pack=Trueor uses the right helper;RuntimeHooksfield plus its reads inrunner.py/metadata.py/_util.pyfor any new copy that should be packed (aspack_spec_rng_uploadsandspec_small_h2ddid).Now.
device_copy.copy(site, dst, src)) and one enum member. No runtime file changes.TLLM_DEVICE_COPY_CHECK=1.Design reference
CopySiteEnummembers are(key, direction)with directionH2D,D2DorFILL; the copier checks the source device against it.CopySite: graph inputs, decoder inputs, TRTLLM attention, speculative RNG and theDeviceCopyBufferusers.MsaCopySite, andM3SpecCopySitefor the M3 spec fold's arming.merge: the copy is staged into the step's pack. A flush issues one upload plus one scatter, serial or, withparallel_scatter, one program per copy when order-free. A merged copy lands before the next barrier; the replay is the final barrier.flush_after ⊆ merge: the pack flushes right after a call whose copy was staged. This is the mechanism for a device reader that runs before the replay. The current M3 plans need none: MSA expands the sub-page table inside the forward, so no merged destination is read before the replay.changed_span ⊆ merge: aDeviceCopyBuffer.update(..., changed_span=True)stages only each row's changed span. This is not done through a barrier site.final_flush=InGraph(early_copy, prologue_op, step_epoch):early_copythe window is uploaded on a side copy stream;prologue_opis the model's one-launch prologue;step_epochthe prologue keeps a per-replay device counter, read throughdevice_copy.step_epoch().copy(..., unchanged=True)is refused during capture and verified in check mode.DeviceCopyBuffer(tensor, *, site)records only issued copies and drops its record when a merged copy is discarded (on_drop). It supports views and tail fills.device_copy.CHECK_MODEis read once fromTLLM_DEVICE_COPY_CHECK=1orTLLM_DEBUG_MODE=1.unchangedcopies, and backsexpect_landedat readers.DeviceCopyBuffer, check modetensorrt_llm/_torch/pyexecutor/device_copy.pycuda_graph_runner.py(graph inputs, final flush, prologue capture),engine/runners/decoder/inputs.py,attention/backends/trtllm.py,speculative/interface.py(RNG)DeviceCopyBufferusers with a site (none merged except below)eagle3.py,dflash.py,spec_sampler_base.py, Mamba managers,mamba2_metadata.py, decoderinputs.pyMsaCopySiteinsparse/minimax_m3/common.py;msa_backend.py;cache_manager.py;kernels/msa_kv_update.pycpp/tensorrt_llm/kernels/deviceCopyScatter.cu,thop/deviceCopyScatterOp.cppflush_afterbarrier)_COPY_PLANinminimax_m3_nvfp4__sm_103__{tp4,tp8}(eager final flush) andminimax_m3_nvfp4__sm_107__{tp2,tp4,tp8}(InGraph(early_copy, m3_step_prologue);step_epochandchanged_span={BLOCK_TABLE}on tp4/tp8; spec RNG andM3SpecCopySitemerged)Behaviour changes
modeling_minimaxm3withimplementation="msa"now gets them: TP4 c1 TPOT is 6.10 against 6.57 ms, Eagle3 TPOT is −6%, and GSM8K is 89.7 against 89.8.ATTN_PROMPT_LENStomerge.out_cache_loctail in the forward. This matches main's defaults; the three kill switches, the prepare()-time expansion and the eager tail fill are removed.DeviceCopyBufferusers:TLLM_DEBUG_MODE=1also turns on the plan checks.Test Coverage
All results are on GB300 (sm_103), container
pytorch-26.09-…-202611020300-19783. There is no Rubin (sm_107) hardware here.Unit tests.
test_msa_metadata_clears_padded_cache_slot_tail, whose cases are deleted with that path.test_msa_backend.pyandtest_msa_runtime_policy.pyrerun on the final head: 147 passed.test_device_copy_in_graph.py: parallel scatter, in-graph window, early copy, step epoch and prologue capture;test_device_copy_changed_span.py;test_device_copy_pool_shared.py;test_rng_upload_pack.py;test_kv_lens_update_once.py, now without the flag;test_copy_plans.py, which checks every M3 target's plan.test_rng_upload_packand 6test_spec_sampler_step_foldtests)._torch/speculative: the same failures as main (missing checkpoints).End to end, MiniMax-M3 NVFP4 modeling_v2 TP4, chat GSM8K:
TLLM_DEVICE_COPY_CHECK=1reports no violations.Performance against main.
The refactor costs nothing at runtime.
Not covered here:
PR Checklist
🤖 Generated with Claude Code
Dev Engineer Review
StepInputPack,H2DSkipCache, and copy-relatedRuntimeHooksfields with model-declaredCopyPlanand namedCopySitevalues.DeviceCopiernow owns staging, barriers, graph prologues, changed-span copies, skipped-copy records, tail fills, and optionalCHECK_MODEvalidation.step_inputs_scattertodevice_copy_scatter. Verify build registration, fake-op registration, and all callers.QA Engineer Review
H2DSkipCache,StepInputPack, and MSA hook interfaces. Replacement coverage exists, but direct legacy API compatibility coverage was removed.tests/integration/test_lists/file changed. Existing list entries cover some changed Kimi, Mamba, Eagle3, and MiniMax-M3 contract tests. Most newdevice_copyand MSA unit-test files had no matchingtest-db/orqa/entry in the inspected lists.test_eagle3_gsm8k_and_acceptance, Kimi Mamba metadata tests, M3 block-table andn_validcontract tests, and the M3 TP4 drift test.test_gen_preemption.pyappears inwaives.txt.Per-File QA Perspective
Source and documentation files
cpp/tensorrt_llm/kernels/minimaxM3/stepInputsScatter.cu→cpp/tensorrt_llm/kernels/deviceCopyScatter.cu: Renames the CUDA kernel and launcher. Verify symbol references and runtime dispatch.cpp/tensorrt_llm/kernels/minimaxM3/stepInputsScatter.h→cpp/tensorrt_llm/kernels/deviceCopyScatter.h: Renames the exported declaration. Verify ABI consistency.cpp/tensorrt_llm/kernels/minimaxM3Sm107/stepPrologue.h: Updates prologue documentation and references. Verify documentation matches the new graph path.cpp/tensorrt_llm/thop/CMakeLists.txt: Adds the renamed operator source. Verify build and link coverage.cpp/tensorrt_llm/thop/minimaxM3/stepInputsScatterOp.cpp→cpp/tensorrt_llm/thop/deviceCopyScatterOp.cpp: Renames the Torch operator and preserves validation. Verify schema, fake-op, and caller consistency.docs/source/features/torch_compile_and_piecewise_cuda_graph.md: DocumentsDeviceCopyBuffer, owner updates, skipped uploads, fills, and check mode. Verify examples match runtime behavior.tensorrt_llm/_device_copy.py: Removes the legacyDeviceCopyBuffer. Verify no stale imports remain.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_103__tp4/modeling.py: Adds the SM103 TP4 copy plan. Verify graph-input, attention, and MSA site membership.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_103__tp4/ops/attention/msa_kv_update.py: Removes the target-local MSA wrapper. Verify backend migration.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_103__tp4/ops/msa_kv_update.py: Removes the target-local validated wrapper. Verify invalid-input fallback coverage.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_103__tp8/modeling.py: Adds the SM103 TP8 copy plan. Verify TP8 site parity with TP4.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_103__tp8/ops/attention/msa_kv_update.py: Removes the target-local wrapper. Verify imports and dispatch.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_103__tp8/ops/msa_kv_update.py: Removes the target-local validation wrapper. Verify no callers remain.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp2/modeling.py: Adds SM107 TP2 speculative and graph copy settings. Verify fold buffers and early-copy behavior.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp2/ops/spec/m3_step_prologue.py: Migrates prologue references todevice_copy. Verify ordering and epoch handling.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp4/modeling.py: Adds SM107 TP4 copy-plan settings. Verify changed-span and prologue configuration.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp4/ops/spec/m3_step_prologue.py: Migrates prologue references. Verify graph launch behavior.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp8/modeling.py: Adds SM107 TP8 copy-plan settings. Verify TP8-specific epoch and changed-span behavior.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp8/ops/spec/m3_step_prologue.py: Migrates prologue references. Verify graph compatibility.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/ops/attention/msa_kv_update.py: Updates MSA reference documentation. Verify documentation remains accurate.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/ops/attention/msa_kv_update_hook.py: Removes the shared MSA hook. Verify all hook callers use the backend kernel.tensorrt_llm/_torch/_experimental/modeling_v2/models/minimax_m3/ops/spec/copy_sites.py: AddsFOLD_SLOTSandFOLD_CTRL. Verify both sites use H2D direction and appear in applicable plans.tensorrt_llm/_torch/attention/ATTENTION_DEVELOPER_GUIDE.md: Documents unchanged-upload metadata and sparse graph thresholds. Verify the contract matches implementation.tensorrt_llm/_torch/attention/backends/sparse/minimax_m3/cache_manager.py: Moves buffers to the new copy module and removes shortcut configuration. Verify pooled-view reuse and selective skipping.tensorrt_llm/_torch/attention/backends/sparse/minimax_m3/common.py: Adds named MSA copy sites. Verify site names and directions.tensorrt_llm/_torch/attention/backends/sparse/minimax_m3/kernels/msa_kv_update.py: Adds shared MSA dispatch and reference code. Verify dtype, layout, size guards, optional outputs, and fallback.tensorrt_llm/_torch/attention/backends/sparse/minimax_m3/msa_backend.py: Routes MSA transfers throughdevice_copy. Verify changed spans, tail fills, reader ordering, and short-decode selection.tensorrt_llm/_torch/attention/backends/trtllm.py: Addsskips_unchanged_uploads. Verify default behavior and private metadata buffers.tensorrt_llm/_torch/custom_ops/cpp_custom_ops.py: Adds the fakedevice_copy_scatterop. Verify import-only and CPU tests.tensorrt_llm/_torch/modules/mamba/mamba2_metadata.py: Tags state-index copies. Verify site routing and pinned memory.tensorrt_llm/_torch/pyexecutor/_util.py: Stops propagating removed sampler copy settings. Verify sampler defaults.tensorrt_llm/_torch/pyexecutor/cuda_graph_runner.py: Routes capture and replay throughdevice_copy. Verify copier identity, flushes, quiescing, and cleanup.tensorrt_llm/_torch/pyexecutor/device_copy.py: Adds the central copy-plan implementation. Verify plan validation, eager fallback, barriers, graph prologues, descriptor limits, record invalidation, source lifetime, andCHECK_MODE.tensorrt_llm/_torch/pyexecutor/engine/runners/decoder/inputs.py: Tags gather-ID and position-ID uploads. Verify destination selection and ordering.tensorrt_llm/_torch/pyexecutor/engine/runners/decoder/metadata.py: Removes runtime-hook and MSA-policy wiring. Verify metadata initialization and speculative metadata.tensorrt_llm/_torch/pyexecutor/engine/runners/decoder/runner.py: Activates model-derived copiers and flushes or discards them around forward execution. Verify exception handling and graph replay.tensorrt_llm/_torch/pyexecutor/h2d_cache.py: Removes the legacy H2D cache. Verify migration completeness.tensorrt_llm/_torch/pyexecutor/kv_cache/mamba_cache_manager/legacy.py: Tags legacy Mamba buffers. Verify state-index and dummy-mask uploads.tensorrt_llm/_torch/pyexecutor/kv_cache/mamba_cache_manager/mamba_cache_manager_v2.py: Tags hybrid Mamba buffers. Verify site routing.tensorrt_llm/_torch/pyexecutor/profiling.py: Renames an iteration-timing label. Verify log consumers.tensorrt_llm/_torch/pyexecutor/runtime_hooks.py: Removes copy, sampler, and MSA fields and adds speculative/timing fields. Verify API compatibility and defaults.tensorrt_llm/_torch/pyexecutor/step_inputs.py: Removes legacy packing. Verify all deferred-copy users migrated.tensorrt_llm/_torch/speculative/dflash.py: Tags DFlash buffers. Verify batch-index and batch-to-slot routing.tensorrt_llm/_torch/speculative/eagle3.py: Tags Eagle3 buffers. Verify batch-index and slot-ID uploads.tensorrt_llm/_torch/speculative/interface.py: Removes RNG packing flags and uses named sites. Verify request-level and token-level RNG uploads.tensorrt_llm/_torch/speculative/spec_sampler_base.py: UsesDeviceCopyBufferfor slot IDs. Verify cache reuse and scatter behavior.tensorrt_llm/llmapi/llm_args.py: Adds sparse threshold methods. Verify MSA, Triton, and sequence-length-aware results.Test files
Unless noted otherwise, the inspected
test-db/andqa/lists had no matching entry for the changed test file.tests/unittest/_torch/attention/sparse/msa/test_minimax_m3_shared_draft_layers.py: Initializes pool views before buffer tests. No matching list entry was found.tests/unittest/_torch/attention/sparse/msa/test_msa_backend.py: Covers kernel dispatch, taken and declined updates, fallback, disabled dynamic lengths, and tail behavior. No matching list entry was found.tests/unittest/_torch/attention/sparse/msa/test_msa_kv_update.py: Covers kernel reference parity, accepted layouts, optional outputs, and rejected strided or non-int32inputs. No matching list entry was found.tests/unittest/_torch/attention/sparse/msa/test_msa_runtime_policy.py: Covers MSA table uploads, tail fills, default skipping, and shared graph metadata. No matching list entry was found.tests/unittest/_torch/attention/sparse/msa/test_msa_skip_cache_routing.py: Updates source scanning fordevice_copywrites and pooled buffers. No matching list entry was found.tests/unittest/_torch/kernels/parallel_hw_agnostic/test_custom_ops.py: Removes the deletedstep_inputsimport. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/kimi_k3_vl/_kimi_k3_decode_step.py: Tags DSpark batch-to-slot buffers. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/kimi_k3_vl/kimi_k3_mxfp4__sm_100__tp16_moetp4ep4/test_k3_decode_worker.py: Tags the KDA dummy-request mask. It is referenced bytest-db/l0_cpu.yml.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_103__tp4/attention/_m3_attn_runtime_tp4.py: Removes explicit MSA policy setup. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_103__tp4/attention/test_modeling_v2_msa_kv_update.py: Deletes target-local hook tests. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_103__tp8/attention/_m3_attn_runtime_tp8.py: Removes explicit MSA policy setup. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_103__tp8/test_modeling_v2_m3_tp4_drift.py: Removes deleted MSA files from drift comparison. It is referenced bytest-db/l0_cpu.yml.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp2/attention/_m3_attn_runtime_tp2.py: Uses default MSA preparation. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp2/attention/test_modeling_v2_m3_block_table_contract.py: Updates write-site scanning fordevice_copy. It is referenced bytest-db/l0_cpu.yml.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp2/attention/test_modeling_v2_m3_n_valid_contract.py: Updates destination detection for new writers. It is referenced bytest-db/l0_cpu.yml.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp2/attention/test_modeling_v2_msa_kv_update.py: Removes hook tests and retains operator certification and guards. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp2/spec/test_modeling_v2_m3_step_prologue.py: Migrates prologue tests toCopyPlanandDeviceCopier. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp4/attention/_m3_attn_runtime_tp4.py: Uses default MSA preparation. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp4/attention/test_modeling_v2_m3_n_valid_contract.py: Updates writer detection. It is referenced bytest-db/l0_cpu.yml.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp4/attention/test_modeling_v2_msa_kv_update.py: Removes hook tests. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp4/spec/test_modeling_v2_m3_step_prologue.py: Migrates prologue tests. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp8/attention/_m3_attn_runtime_tp8.py: Uses default MSA preparation. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp8/attention/test_modeling_v2_m3_n_valid_contract.py: Updates writer detection. It is referenced bytest-db/l0_cpu.yml.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp8/attention/test_modeling_v2_msa_kv_update.py: Removes hook tests. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/minimax_m3_nvfp4__sm_107__tp8/spec/test_modeling_v2_m3_step_prologue.py: Migrates prologue tests. No matching list entry was found.tests/unittest/_torch/modeling_v2/models/minimax_m3/test_copy_plans.py: Adds plan reconstruction and target-specific plan assertions. No matching list entry was found.tests/unittest/_torch/modules/kimi_kda/test_kimi_k3_mamba_metadata.py: Tags Mamba state-index buffers. It is referenced bytest-db/l0_b200.ymlandtest-db/l0_gb300.yml.tests/unittest/_torch/modules/kimi_kda/test_kimi_kda_verify_parity.py: Tags Mamba state-index buffers. It is referenced bytest-db/l0_b200.ymlandtest-db/l0_gb300.yml.tests/unittest/_torch/modules/mamba/test_mamba2_metadata.py: Covers named state-index sites and skipped-copy corruption checks. No matching list entry was found.tests/unittest/_torch/pyexecutor/engine/test_decoder_forward_scopes.py: Covers copier scope, no-copier behavior, exception discard, and record invalidation. No matching list entry was found.tests/unittest/_torch/pyexecutor/engine/test_decoder_runtime_hooks.py: Covers sparse threshold selection after hook removal. No matching list entry was found.tests/unittest/_torch/pyexecutor/kv_cache/test_mamba_cache_manager.py: Covers named Mamba sites and skipped-copy checks. It is referenced bytest-db/l0_b200.yml.tests/unittest/_torch/pyexecutor/kv_cache/test_mamba_model_managers.py: Covers Mamba buffer site assignment. No matching list entry was found.tests/unittest/_torch/pyexecutor/test_cuda_graph_runner.py: Covers replay with active and captured copiers. No matching list entry was found.tests/unittest/_torch/pyexecutor/test_device_copy.py: Adds plan, ordering, barrier, discard, graph, check-mode, and callback tests. No matching list entry was found.tests/unittest/_torch/pyexecutor/test_device_copy_buffer.py: Covers records, snapshots, site validation, failures, and tail fills. No matching list entry was found.tests/unittest/_torch/pyexecutor/test_h2d_changed_span.py→tests/unittest/_torch/pyexecutor/test_device_copy_changed_span.py: Migrates changed-span tests and adds eager, discard, and barrier coverage. No matching list entry was found.tests/unittest/_torch/pyexecutor/test_device_copy_in_graph.py: Covers parallel scatter, in-graph flushes, epochs, replay, and source lifetime. No matching list entry was found.tests/unittest/_torch/pyexecutor/test_device_copy_pool_shared.py: Covers pooled graph buffers, stale records, invalidation, and unconditional copies. No matching list entry was found.tests/unittest/_torch/pyexecutor/test_gen_preemption.py: Tags DFlash buffers in preemption fixtures. It appears intest_lists/waives.txt.tests/unittest/_torch/pyexecutor/test_h2d_cache.py: Removes legacy H2D-cache tests. No matching list entry was found.tests/unittest/_torch/pyexecutor/test_kv_lens_update_once.py: Removes comparisons of the deletedkv_lens_update_oncehook option. No matching list entry was found.tests/unittest/_torch/pyexecutor/test_runtime_hooks.py: Updates defaults, valid fields, invalid declarations, and immutability checks. No matching list entry was found.tests/unittest/_torch/pyexecutor/test_step_inputs.py: Removes legacy step-input packing tests. No matching list entry was found.tests/unittest/_torch/speculative/hw_agnostic/test_dflash_copy_skip.py: Tags DFlash copy buffers. No matching list entry was found.tests/unittest/_torch/speculative/hw_agnostic/test_dflash_dummy_slot.py: Tags DFlash dummy-slot buffers. No matching list entry was found.tests/unittest/_torch/speculative/hw_agnostic/test_dflash_worker.py: Tags DFlash worker buffers. No matching list entry was found.tests/unittest/_torch/speculative/hw_agnostic/test_dspark_model_engine_runtime.py: Tags overlap-offset buffers. No matching list entry was found.tests/unittest/_torch/speculative/test_eagle3.py: Tags Eagle3 batch-index and slot-ID buffers. It is referenced bytest-db/l0_b200.ymlandtest-db/l0_h100.yml.tests/unittest/_torch/speculative/test_rng_upload_pack.py: Migrates RNG upload tests toDeviceCopierplans. No matching list entry was found.tests/unittest/_torch/speculative/test_spec_sampler_step_fold.py: Removes tests for deleted sampler side-stream and static-slot flags. No matching list entry was found.tests/unittest/conftest.py: Routes skipped-copy verification throughdevice_copy.CHECK_MODE. It is referenced bytest-db/l0_cpu.yml.