Skip to main content
When an AI agent gives an unexpected or incorrect reply in the Agent Inbox, the fastest way to understand what went wrong is to reproduce the exact conversation in the Playground and inspect the sources used. This guide shows you how to safely reproduce a conversation, identify which instructions or sources influenced the answer, and fix the underlying issue.

Why Reproducing Conversations Matters

Reproducing the exact user message in the Playground lets you see what the agent actually used to generate its answer—such as instructions, websites, XML feeds, or files.
This makes it much faster to pinpoint whether an issue is caused by:
  • unclear or overly broad instructions
  • outdated or incorrect sources
  • missing or conflicting data
Instead of guessing, you can debug agent behavior with full transparency.
For the smoothest workflow, open Watermelon in:
  • One normal browser window → to view the conversation in the Agent Inbox
  • One incognito browser window → to reproduce the message in the Playground
This avoids session or caching issues and lets you compare both views side by side.
1

Open the conversation in the Inbox

Guide Finding Root Of Issue
  • Navigate to the conversation where the agent’s response did not meet expectations.
  • Identify the user message that triggered the response.
  • Copy the message exactly as sent.
2

Reproduce the message in the Playground

Guides Finding Root Of Issue 1
  • Open the Playground for the same agent used in the conversation.
  • Make sure the agent configuration matches the one that was active when the conversation happened.
  • Paste the copied user message into the input field and send it.
If your agent setup has changed since the conversation, keep in mind that the reproduced answer may differ.
3

Inspect the sources used by the agent

  • Under the agent’s response, locate the Source: label.
  • Click one of the source chips/buttons (for example: Instructions, Website, XML feed).
Expand the dropdown to see which information was used to generate the answer.
Guides Finding Root Of Issue 2

Next Steps: Fix and Confirm

Once you’ve identified the cause:
  • Unclear instructions → Edit the agent instructions and make them more specific
  • Broken or outdated URLs → Update or remove them, then re-crawl if applicable
  • Incorrect XML feed data → Validate the feed and refresh the connection
  • Unexpected sources → Remove the source or tighten instructions to restrict usage
After making changes, reproduce the same message again in the Playground to confirm the fix before monitoring future Inbox conversations.