emploidai Marketplace
Add-onsAppletsPlugins
Search tools, teams, and capabilitiesPublish
MarketplacePluginsConvoProbe
Plugin
Limited listing

ConvoProbe

by soitto · v0.0.17

Multi-turn chatbot QA testing for Dify chatbots. Run scenario tests on your apps and view results in ConvoProbe.

58 installsUpdated May 27, 2026
Publisher information is incomplete

This community listing does not yet include every recommended support, privacy, pricing, and permission disclosure. Review the available package permissions before installing.

Capabilities

Tools

Available inside your emploidai workspace after installation.

Data sources

Available inside your emploidai workspace after installation.

Endpoints

Available inside your emploidai workspace after installation.

Category

tool

Version

0.0.17soitto

Requirements

Maximum memory 256MB

Pricing

Not disclosed by publisher

Security & access

Review before installing

CompatibleRequires emploidai 1.0.0+

Permissions

  • Uses app capability
  • Uses endpoint capability
  • Uses model capability
  • Uses tool capability
  • Requires encrypted tool credentials

Dependencies

No additional dependencies

Resources

Privacy policy
emploidai Marketplace

Discover capabilities. Review access. Install inside your workspace.

DocumentationSecuritySupportPrivacyTerms

ConvoProbe Dify Plugin

Multi-turn chatbot QA testing for Dify chatbots. Run scenario tests against your apps in Dify Studio and view results in ConvoProbe.

What it does

  • Reads a multi-turn test scenario stored in ConvoProbe
  • Executes it against a Dify chatbot in your workspace via Reverse Invocation
  • Maintains conversation continuity across turns (conversation_id)
  • Posts results back to ConvoProbe for LLM-as-Judge scoring and review

Requirements

  • Dify v1.0+ (Plugin runtime support)
  • A ConvoProbe account (sign up)
  • A Chat-type App in the same Dify workspace

Install

Via Marketplace (recommended once published)

Search for "ConvoProbe" in Dify Studio → Plugins → Marketplace.

Via local debug (developer)

  1. cp .env.example .env.local and fill REMOTE_INSTALL_KEY from Dify Studio → Plugins → Debug
  2. python -m venv .venv && source .venv/bin/activate && pip install -r requirements.txt
  3. python -m main
  4. The plugin will appear under "Local debug plugins" in your workspace

Configure

SettingRequiredDescription
convoprobe_api_tokenYesIssue from ConvoProbe Web UI → Settings → Plugin
target_appYesThe Dify chatbot to test (workspace scope)
judge_llm_api_keyNoOptional fallback. Leave empty to use Dify's model provider
convoprobe_api_base_urlNoSelf-hosted ConvoProbe URL (defaults to SaaS)

Privacy

See PRIVACY.md. The plugin transfers scenario inputs and chatbot responses to ConvoProbe Backend for evaluation. No raw API keys are stored on ConvoProbe.

Development

make test       # pytest with coverage
make lint       # ruff
make package    # build .difypkg for Marketplace submission

Source & Contact

  • Repository: https://github.com/ShuntaroOkuma/convoprobe-plugin
  • Issues: https://github.com/ShuntaroOkuma/convoprobe-plugin/issues
  • Author: soitto (Shuntaro Okuma) — shuntaro.okuma@soitto.jp

License

MIT — see LICENSE.

ConvoProbe · emploidai Marketplace