Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions design/mongodb-operator-audits.md
Original file line number Diff line number Diff line change
Expand Up @@ -792,6 +792,9 @@ corrections and 38 `EXTRACTION`/`SHELL_SYNTAX` locks that the new pipeline handl
(generated Giza extracts included), each
proven against the historical documentation the fixture came
from ([form migration](operator-audits-form-migration.md)).
Step 5 follows the [test generation design](operator-audits-test-generation.md): a descriptor-driven
runner with separate serialization, behavior and published checks, legacy cases joining it through
a compatibility adapter against their documented references, then generation for unowned examples.

Track progress with explicit metrics rather than a speculative “100% automatic” target:
all discovered capabilities accounted for; all 235 locks plus `lockd` and 17 exclusions
Expand Down
19 changes: 19 additions & 0 deletions design/operator-audits-progress.md
Original file line number Diff line number Diff line change
Expand Up @@ -1994,3 +1994,22 @@ no product-documentation changes. Legacy operator AsciiDoc tables are intentiona
- Totals: 138 overrides, 96 unresolved; inventory 138 OVERRIDDEN, 96 PRESERVED_CURATED, 98
locked.
- Review round 1 (independent agent): nothing to fix. The binding fires only for a top-level `name = ...` statement; the model is stricter than JavaScript where a lexical or `var` redeclaration follows (only adds gaps).

- PR #4540 (branch audits-js-bindings, base #4539) published. Step 4's exit criterion holds: every
locked example has a disposition (138 retired, 96 kept with a recorded gap).

## Step 5 design (2026-11-21)

- Branch audits-test-generation-design from #4540: `design/operator-audits-test-generation.md`.
- Measured against a 2025 `mongodb/docs` checkout: about 550 documented operator examples, about
521 owned by legacy cases, about 29 unowned (mostly environment-bound admin stages and the
positional update operators). Generating only for unowned examples would cover almost nothing, so
legacy cases join a new runner through a compatibility adapter, with their documented sources
(form-migration overrides, pinned pages) as independent references.
- Three review rounds (independent agent): identity contract; slice 1 restricted to exact
expectations; scenario and descriptor fields; separate databases for behavior parity;
composition on `TestBase`; completeness test; candidate attestation and rollback; curated BSON
never treated as a reference (`CURATED_REFERENCE`); converted scenarios replace legacy files and
are manifest-owned; a migrated-fixture ledger for the audits checks that guard fixture bytes;
harness collection-name corrections reverted; form rules and printed constraints ported before
cutover.
Loading