Repository navigation

Fix R-GSP-N: LSTM hidden state + vectorized learning + stored state (R2D2) - #20

Merged

jdbloom merged 4 commits into

mainfrom

feat/rddpg-lstm-fix

Apr 9, 2026

Merged

Fix R-GSP-N: LSTM hidden state + vectorized learning + stored state (R2D2)#20
jdbloom merged 4 commits into
mainfrom
feat/rddpg-lstm-fix

Commits on Apr 8, 2026
- fix(lstm): propagate LSTM hidden state through EnvironmentEncoder and RDDPG networks
  
  Joshua Bloom
  and
  claude
  committed
  c446128
- feat(buffer): store LSTM hidden state at sequence boundaries (R2D2-style)
  
  Joshua Bloom
  and
  claude
  committed
  b2d232e
- feat(rddpg): vectorize learn_RDDPG with burn-in for 10x speedup
  
  Joshua Bloom
  and
  claude
  committed
  1f48730
- feat(device): remove MPS CPU fallback for recurrent — vectorized RDDPG works on MPS (80ms vs 150ms CPU)
  Joshua Bloom
  committed
  2074805