Skip to content

MCP Serverless - #348

Closed
qyy2003 wants to merge 2 commits into
spcl:masterfrom
anveba:mcp
Closed

qyy2003 wants to merge 2 commits into
spcl:masterfrom
anveba:mcp

Conversation

@qyy2003

@qyy2003 qyy2003 commented Nov 18, 2026

Copy link
Copy Markdown

As the title

qyy2003 and others added 2 commits November 18, 2026 14:52
A benchmark with an mcp.json tool definition can be called over the Model
Context Protocol (Streamable HTTP, stateless, JSON responses) from the same
deployed function that serves plain invocations, so the two can be compared.

- wrappers/mcp/python/mcp_shim.py: minimal MCP server (initialize, ping,
  tools/list, tools/call), standard library only; SeBS measurements are
  returned in the tool result's _meta.sebs
- AWS Python handler: JSON-RPC bodies go to the shim; cold-start detection
  moved into cold_test() and also reported on initialize and tools/list;
  both paths report cpu_us and import_us
- local Python server: POST /mcp route
- configs/systems.json: ship the shim with AWS and local Python packages
- sebs/benchmark.py: copy mcp.json into the package; include it and the
  shim in the package hash
- tool definitions for 010.sleep and 110.dynamic-html

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Two benchmarks for the most common kinds of MCP tools, both calling an
upstream HTTP service (SEBS_MOCK_UPSTREAM) whose delay and response size
are set per call:

- 610.api-proxy: wraps a REST API; waits on the upstream, then filters and
  sorts its JSON
- 620.fetch-markdown: downloads an HTML page and converts it to markdown,
  modeled on the reference fetch MCP server

Both keep the upstream connection across warm invocations and report the
time split (upstream connect, upstream wait, local processing). Standard
library only. Documented in their READMEs and docs/benchmarks.md.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@coderabbitai

coderabbitai Bot commented Nov 18, 2026 •

Copy link
Copy Markdown

Explain Change →

Caution

Review failed

The pull request is closed.

  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

@qyy2003 qyy2003 closed this Nov 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant