Lepton AI

Lepton AI provides hosted large language models that can be selected and used directly from Dify.

Features

• Provides llm models in Dify.
• Includes predefined llm models such as gemma-7b, mistral-7b, llama2-7b.
• Supports predefined model configuration.

Setup

1. Install this plugin from the Dify Marketplace.
2. Get the required credentials from Lepton AI.
3. Add the credentials in the plugin settings.
4. Save the configuration.

Usage

Select Lepton AI as the model provider in Dify, choose an available model, and use it in applications, agents, or workflows.

Privacy

This plugin sends the inputs required by the selected operation to the upstream service. Review the upstream service's privacy policy before use.