Skip to content

test(e2e): Add Mastra Jev classifier test to node-mastra - #25115

Open
andreiborza wants to merge 2 commits into
ab/mastra-classifier-evaluate-spansfrom
ab/mastra-classifier-e2e
Open

andreiborza wants to merge 2 commits into
ab/mastra-classifier-evaluate-spansfrom
ab/mastra-classifier-e2e

Conversation

@andreiborza

@andreiborza andreiborza commented Oct 7, 2026 •

Copy link
Copy Markdown
Member

What

Adds a node-mastra e2e test that runs a real Jev evaluation through a Mastra Classifier (via OpenRouter) and checks the gen_ai.evaluate span.

Why

Covers the classifier instrumentation from #25044 against the real provider, not only a mock model.

@andreiborza
andreiborza added this pull request to stack #25116 October 7, 2026 08:16
@andreiborza andreiborza changed the title ab/mastra classifier e2e test(e2e): Add Mastra Jev classifier test to node-mastra Oct 7, 2026

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit d3c4b79. Configure here.

Comment thread dev-packages/e2e-tests/test-applications/node-mastra/package.json
@github-actions

github-actions Bot commented Oct 7, 2026 •

Copy link
Copy Markdown
Contributor

size-limit report 📦

Path Size % Change Change
@sentry/browser 29.6 kB - -
@sentry/browser - with treeshaking flags 27.75 kB - -
@sentry/browser - with treeshaking flags tracing without tracing 27.65 kB - -
@sentry/browser (incl. Tracing) 51.52 kB - -
@sentry/browser (incl. Tracing + Span Streaming) 51.52 kB - -
@sentry/browser (incl. Tracing, Profiling) 54.5 kB - -
@sentry/browser (incl. Tracing, Replay) 91.23 kB - -
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags 80.18 kB - -
@sentry/browser (incl. Tracing, Replay with Canvas) 95.93 kB - -
@sentry/browser (incl. Tracing, Replay, Feedback) 108.89 kB - -
@sentry/browser (incl. Feedback) 47.12 kB - -
@sentry/browser (incl. sendFeedback) 34.65 kB - -
@sentry/browser (incl. FeedbackAsync) 39.76 kB - -
@sentry/browser (incl. Metrics) 30.61 kB - -
@sentry/browser (incl. Logs) 30.89 kB - -
@sentry/browser (incl. Metrics & Logs) 31.55 kB - -
@sentry/react 31.43 kB - -
@sentry/react (incl. Tracing) 53.84 kB - -
@sentry/vue 37.55 kB - -
@sentry/vue (incl. Tracing) 54.4 kB - -
@sentry/svelte 29.63 kB - -
@sentry/remix (Remix 3 client bundle) 56.54 kB - -
CDN Bundle 31.33 kB - -
CDN Bundle (incl. Tracing) 52.07 kB - -
CDN Bundle (incl. Logs, Metrics) 33.56 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) 54.03 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) 74.38 kB - -
CDN Bundle (incl. Tracing, Replay) 89.74 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) 91.69 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) 95.9 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) 97.87 kB - -
CDN Bundle - uncompressed 92.46 kB - -
CDN Bundle (incl. Tracing) - uncompressed 154.77 kB - -
CDN Bundle (incl. Logs, Metrics) - uncompressed 99.04 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) - uncompressed 160.72 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) - uncompressed 228.98 kB - -
CDN Bundle (incl. Tracing, Replay) - uncompressed 274.89 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) - uncompressed 280.83 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed 288.59 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) - uncompressed 294.52 kB - -
@sentry/nextjs (client) 56.19 kB - -
@sentry/sveltekit (client) 51.9 kB - -
@sentry/core/server 40.65 kB - -
@sentry/core/browser 13.51 kB - -
@sentry/node 145.98 kB +0.29% +412 B 🔺
@sentry/node/import (ESM hook with diagnostics-channel injection) 83.26 kB +0.05% +37 B 🔺
@sentry/node - without tracing 93.5 kB +0.06% +49 B 🔺
@sentry/node - without channel injection 124.13 kB +0.34% +413 B 🔺
@sentry/aws-serverless 101.73 kB +0.05% +42 B 🔺
@sentry/cloudflare (withSentry) - minified 209.09 kB +0.04% +64 B 🔺
@sentry/cloudflare (withSentry) 517.95 kB +0.04% +156 B 🔺

View base workflow run

@andreiborza
andreiborza marked this pull request as ready for review October 7, 2026 08:58
@andreiborza
andreiborza force-pushed the ab/mastra-classifier-e2e branch from 7a5851d to 3b82bae Compare October 7, 2026 09:11
@andreiborza
andreiborza force-pushed the ab/mastra-classifier-e2e branch from 3b82bae to 8fd928f Compare October 7, 2026 09:40
Comment thread dev-packages/e2e-tests/test-applications/node-mastra/package.json

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant