Skip to content

Rewrite the observability investigate and alert-investigation guides around the current MCP tools - #241

Merged
Vadman97 merged 4 commits into
mainfrom
termag-vkorolik/cmw2uja9ob4ngjy83vmxi7472
Nov 6, 2026
Merged

Vadman97 merged 4 commits into
mainfrom
termag-vkorolik/cmw2uja9ob4ngjy83vmxi7472

Conversation

@Vadman97

@Vadman97 Vadman97 commented Nov 5, 2026 •

Copy link
Copy Markdown
Contributor

Demo

Replay of im-live incidents 1 and 3 on catfood following the new guides: demo.md (team-o11y:artifacts/im-guides/demo.md). INC-298 took 12 calls instead of 14, and the version was ruled out at call 7 instead of 13. Alert 166 took 6 calls instead of 13, with the chronic-noise verdict at call 3.

Rewrites observability/investigate (0.3.0) around a "first five minutes" sequence: onset, chronic check, get-changes, a breakdown against a baseline with compareTo, evidence, and blast radius, plus a warning about sampled percentiles. Rewrites observability/alert-investigation (0.2.0) to start from get-alerts and get-alert-firing-history instead of injected alert variables.

The guides also use the fields from launchdarkly/mcp#449, each with a fallback for older servers. Merge this after #449 deploys. It conflicts with #231 in the observability files; resolve those by taking this PR's version, which already uses the stable search-* names.

Asked by vkorolik through termag ask; follow up with termag ask … --thread cmw2uja9ob4ngjy83vmxi7472.

🤖 Generated with Claude Code

Opened from termag


Note

Overview
investigate 0.3.0 replaces the old cross-product workflow with a ordered “first five minutes” playbook: scope/onset (including ingest completeness), chronic vs regression checks with compareTo, get-changes, dimensional over-representation (host, version, route, flag variation), then evidence and blast radius via search-service-map, search-log-patterns, get-trace, get-error-group, etc. It drops the old “50-entry limit first” framing in favor of aggregate-then-page guidance, adds sampling/percentile (low_sample) warnings, structured output, and documents launchdarkly/mcp#449 response fields with fallbacks for older servers.

alert-investigation 0.2.0 no longer assumes alert variables injected on the first turn. Agents now start from get-alerts and get-alert-firing-history (replay via bundled search-aggregations args, chronic/episodes from summary, optional get-investigation), add a Verdict section (noise/chronic/new), and delegate root-cause steps to the shared investigate sequence. Per-product companions (logs, traces, errors, metrics, sessions) are aligned to replay, baseline comparison, and the new tools.

skills.json descriptions and versions are updated; CHANGELOG records the release notes. Intended to ship after MCP #449 deploys.

Reviewed by Cursor Bugbot for commit 46e1e7e. Bugbot is set up for automated code reviews on this repo. Configure here.

… tools

investigate gets a first-five-minutes sequence (scope and onset, chronic
or noise, get-changes, breakdown against a baseline with compareTo, evidence,
blast radius) and a sampling warning for percentiles. alert-investigation
starts from get-alerts and get-alert-firing-history instead of injected
alert variables. Companions use the stable search-* tool names.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Generated-by: termag
@Vadman97
Vadman97 marked this pull request as ready for review November 5, 2026 01:27

@cursor cursor Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stale Bugbot comment from a previous run.

@Vadman97

Vadman97 commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

bugbot run

@github-actions

github-actions Bot commented Nov 5, 2026 •

Copy link
Copy Markdown

Skill eval results

Skill Before After Δ
agentcontrol/configs-create 100/100 (4/4) 75/100 (3/4) -25
agentcontrol/configs-update 80/100 (4/5) 80/100 (4/5) no change
agentcontrol/configs-variations 80/100 (4/5) 80/100 (4/5) no change
agentcontrol/tools 75/100 (3/4) 75/100 (3/4) no change
aws-devops-agent/experiment-orchestration - 100/100 (9/9) new
experiments/launchdarkly-experiment-guide - 100/100 (5/5) new
experiments/launchdarkly-experiment-hypothesis-builder - 100/100 (13/13) new
experiments/launchdarkly-experiment-setup - 100/100 (8/8) new
feature-flags/flag-and-release-change - 100/100 (4/4) new
feature-flags/flag-release - 80/100 (4/5) new
feature-flags/launchdarkly-flag-command - 100/100 (3/3) new
feature-flags/launchdarkly-flag-create 100/100 (3/3) 100/100 (4/4) no change
feature-flags/launchdarkly-flag-drift - 100/100 (4/4) new
feature-flags/should-flag-change - 100/100 (17/17) new
onboarding - 100/100 (7/7) new
release-autopilot/launchdarkly-release-autopilot-onboarding - 96/100 (24/25) new

Only suites whose source actually changed since their last recorded score were re-run. Soft-failing while we stabilise the baseline.

@cursor cursor Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stale Bugbot comment from a previous run.

Firing-history summary (chronic, episodes) and get-changes alert_episode
rows in alert-investigation; get-trace self_ms, critical_path and
top_self_time; project-wide search-flag-evaluations and the FLAG FILTERS
keys; the low_sample warning; get-error-group include and _pivots;
sort spike; and the ingest block with completeness_note. Each names a
fallback for servers that predate it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Generated-by: termag

@ccschmitz-launchdarkly ccschmitz-launchdarkly left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Conflicts were main's query-* to search-* tool rename (#231) in files
this branch already rewrote with the search-* names and camelCase
parameters; kept the branch versions. CHANGELOG keeps both sides' entries.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Generated-by: termag
@Vadman97

Vadman97 commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

bugbot run

@cursor cursor Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stale Bugbot comment from a previous run.

…ja9ob4ngjy83vmxi7472

Generated-by: termag

# Conflicts:
#	CHANGELOG.md
@Vadman97

Vadman97 commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

bugbot run

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

Reviewed by Cursor Bugbot for commit 46e1e7e. Configure here.

@Vadman97
Vadman97 merged commit 19be6e8 into main Nov 6, 2026
23 checks passed
@Vadman97
Vadman97 deleted the termag-vkorolik/cmw2uja9ob4ngjy83vmxi7472 branch November 6, 2026 00:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants