Conversation overview

Mon, 01 Jan 0001 00:00:00 +0000

Alpha

The conversation API is currently in alpha.

Dapr’s conversation API reduces the complexity of securely and reliably interacting with Large Language Models (LLM) at scale. Whether you’re a developer who doesn’t have the necessary native SDKs or a polyglot shop who just wants to focus on the prompt aspects of LLM interactions, the conversation API provides one consistent API entry point to talk to underlying LLM providers.

In addition to enabling critical performance and security functionality (like caching and PII scrubbing), the conversation API also provides:

How-To: Converse with an LLM using the conversation API

Mon, 01 Jan 0001 00:00:00 +0000

Alpha

The conversation API is currently in alpha.

Let’s get started using the conversation API. In this guide, you’ll learn how to:

Set up one of the available Dapr components (echo) that work with the conversation API.
Add the conversation client to your application.
Run the connection using dapr run.

Set up the conversation component

Create a new configuration file called conversation.yaml and save to a components or config sub-folder in your application directory.

Conversation on Dapr Docs

Conversation overview

Alpha

How-To: Converse with an LLM using the conversation API

Alpha

Set up the conversation component