Skip to content

Make the run time report work again - #399

Merged
schlessera merged 1 commit into
mainfrom
perf/measure-run-times
Nov 2, 2026
Merged

schlessera merged 1 commit into
mainfrom
perf/measure-run-times

Conversation

@schlessera

Copy link
Copy Markdown
Member

Addresses the first two steps of #384.

With WP_CLI_TEST_LOG_RUN_TIMES set, the report printed at the end of a run was invisible with the default progress formatter, and its per-scenario part was always empty ("Top 20 (of 0) scenario run times"). The scenario part of RUN_DIR names was missing for the same reason.

Now the report shows up in every run and lists the slowest scenarios, which is the data needed to compare the other changes in #394 and to balance parallel runs later.

A new scenario checks that run directories are named after their scenario again.

Scenario nodes no longer expose their feature file, so per-scenario run times
and the scenario part of run directory names were empty. Take the file from
the feature instead.

The report is written from an after-suite hook, whose output Behat only
prints for failed scenarios. Write it to the output stream directly so it
shows up with the default progress formatter.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@coderabbitai

coderabbitai Bot commented Oct 30, 2026 •

Copy link
Copy Markdown

Warning

Review limit reached

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Next included review available in 59 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

Learn how review limits work.

Review configuration:

Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 471c031c-658b-4afe-a9ea-40cbd0e6018c
Commits

Reviewing files that changed from the base of the PR and between 9298472 and 1765639.

Files selected for processing: 2
  • features/behat-steps.feature
  • src/Context/FeatureContext.php
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

@github-actions github-actions Bot added bug Something isn't working scope:testing Related to testing labels Oct 30, 2026
@codecov

codecov Bot commented Oct 30, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 0% with 6 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
src/Context/FeatureContext.php 0.00% 6 Missing ⚠️

📢 Thoughts on this report? Let us know!

@schlessera
schlessera marked this pull request as ready for review November 2, 2026 02:22
@schlessera
schlessera requested a review from a team as a code owner November 2, 2026 02:22
@schlessera
schlessera merged commit 9ed5cd4 into main Nov 2, 2026
71 of 72 checks passed
@schlessera
schlessera deleted the perf/measure-run-times branch November 2, 2026 02:22
@schlessera schlessera added this to the 5.4.0 milestone Nov 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working scope:testing Related to testing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant