Skip to main content
Available on versions 0.9.16+ of the client This command creates a new replay simulation from a set of existing conversations and starts a Snowglobe session with your chatbot connected to it. In this session your chatbot will only process scenarios from the newly launched replay and no others. Once the replay is in a terminal state, your chatbot will disconnect from Snowglobe and the session will automatically close.

Prerequisites

  • Installed and authenticated snowglobe-connect
  • Wrapper created and tested
  • .snowglobe/agents.json and .snowglobe/config.rc exist (created by init)
  • A valid replay config yaml file
  • A set of existing conversation IDs to replay

What this does

  • Creates a new replay simulation using the conversation IDs provided in the yaml config file
  • Binds your wrapper so it can call Snowglobe during a session
  • Replays the specified conversations and sends them to your chatbot
  • Sends the chatbot’s response back to Snowglobe
  • Streams basic status to your terminal while active
  • Exits once the replay is in a terminal state

Usage

snowglobe-connect replay ./config.yml

Replay Configuration File

version: int # Required, currently only supports 1
conversations: # Required, list of conversation groups to replay
  - conversation_ids: list[str] # Required, list of conversation IDs to replay
    failure_mode: str # Required, the failure mode to test against

Example

version: 1
conversations: # uses existing conversations
    - conversation_ids: [f03c3585-1a9f-4038-bda6-41c1f8adafa1] 
      failure_mode: assistant did not send a confirmation

CLI Options

All of the below options are required in order to successfully start a replay. If they are not provided in the command, and there are no reasonable defaults, you will be prompted to make selections using the CLI.

--agent-id

The UUID for the Agent the replay should target. If you do not provide a value and you only have one agent configured, that agent will be automatically selected. If you do not provide a value and you have more than one agent configured, you will be prompted to interactively select an agent.

--name

A name for the replay.

--agent-profile

Skip auto-tuning and pin a specific Agent Profile by version number (e.g. ‘5’) or UUID. The profile must already exist and be approved on the selected agent. Requires exactly one agent to be selected. Mutually exclusive with —no-agent-profile. If you do not provide a value, do not specify —no-agent-profile, and you only have one agent profile available, that agent profile will be automatically selected. If you do not provide a value, do not specify —no-agent-profile, and you have more than one agent profile available for the selected agent, you will be prompted to interactively select an agent profile.

--no-agent-profile

Skip the Agent Profile (tuning) preflight and launch the replay without an Agent Profile. Use this when the wrapper should never participate in the tool-mock tuning pipeline.

--organization-id

The organization to create this replay in. The specified org must have access to the agent. If you do not provide a value and do not have SNOWGLOBE_ORG_ID specified either in .snowglobe/config.rc or via an environment variable, you will be prompted to interactively select an organization. You can interactively configure a default organization beforehand with the snowglobe-connect select-organization command.