Skip to content

fix(mcts): follow tree selection through to a leaf - #339

Merged
codelion merged 1 commit into
algorithmicsuperintelligence:mainfrom
liuzhengyang699:fix/mcts-leaf-selection
Oct 10, 2026
Merged

codelion merged 1 commit into
algorithmicsuperintelligence:mainfrom
liuzhengyang699:fix/mcts-leaf-selection

Conversation

@liuzhengyang699

Copy link
Copy Markdown
Contributor

MCTS.select stopped after choosing one child of the root. Once that child had already been expanded, later simulations expanded it again instead of selecting among its existing descendants. With one available action and three simulations, the action generator received the root once and the same first-level state twice.

Continue applying the existing UCT rule until reaching a leaf. This lets later simulations grow deeper branches and use the statistics already collected below the root, without changing the exploration formula or simulation budget.

Validation: python -m pytest tests/test_mcts_selection.py tests/test_conversation_logging_approaches.py -q — 9 passed, with no model calls. Two new regression tests fail before the fix. Ruff passed for the new test file; git diff --check passed.

@CLAassistant

CLAassistant commented Oct 10, 2026 •

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@codelion
codelion merged commit 5a5d7e5 into algorithmicsuperintelligence:main Oct 10, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants