Use Firegoat
Slack
Ask about your evals in Slack and get digests.
The Firegoat bot brings your eval data into Slack: ask about your evals from any channel and get digests of how your prompts are doing.
Add the bot
Open Settings in the dashboard and click Add to Slack under Slack Integration. A workspace admin installs it; your org is linked through the workspace's approved email domain.
Ask about your evals
Mention @firegoat in a channel, or send it a direct message, and ask in plain language: "how did last night's runs go?", "why did the Next.js prompt fail?". It answers with the same tools as the MCP server, scoped to your org.
Digests
Digests are posted to a Slack channel bound to your org. Once the channel is set, the Slack digest settings on the Settings page control them:
- Format: Short, a what-to-fix punch list with trace links, or Full, the whole narrative.
- Competitors: whether digests compare you with the competitors your prompts run against, or cover only your own product.
- Frequency: how often digests arrive. Auto follows how often your prompts run; Off stops them.
If Slack is connected but no channel is bound yet, the Settings page says so; ask us to pick the channel.