Skip to content

[Feature Request] - Allow For Local Evals #2047

Description

@nxf5025

Description

Currently the agentcore CLI requires a deployed agent to execute evals. Considering the agentcore dev command can spin up the agent locally and stores the telemetry in the .cli folder it would be great if the agentcore CLI supported local evaluation executions.

Acceptance Criteria

  • When an agent and evaluator exists in the agentcore.json a user is able to run evals without first deploying the agent to their AWS account

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions