Skip to content

[None][perf] Overlap TRTLLM-Gen FMHA JIT warmup compilation with engine warmup (opt-in) - #18542

Open
aaronmeoded-b10 wants to merge 21 commits into
NVIDIA:mainfrom
aaronmeoded-b10:fmha-async-jit-warmup
Open

aaronmeoded-b10 wants to merge 21 commits into
NVIDIA:mainfrom
aaronmeoded-b10:fmha-async-jit-warmup

[None][fix] Address review on the async FMHA JIT warmup

e7624d0
Select commit
Loading
Failed to load commit list.