AI SDKs

Overview

This category contains documentation topics explaining LaunchDarkly’s AI SDKs. LaunchDarkly’s AI SDKs are designed for use with LaunchDarkly’s AI Configs. They are currently in a pre-1.0 release and under active development.

About AI SDKs

While LaunchDarkly server-side, client-side, and edge SDKs focus on interacting with feature flags, the LaunchDarkly AI SDKs interact with AI Configs. AI Configs are resources that you create in LaunchDarkly and use to customize, test, and roll out new large language models (LLMs) within your generative AI applications. You can use the AI SDKs to customize each AI Config based on the context that you provide. This means both the message and the model evaluation are specific to each end user, at runtime. You can also use the AI SDKs to record metrics from your AI model generation, including duration and tokens. AI metrics and traces are recorded differently. AI metrics are captured through the AI SDK tracker methods. If you use the LaunchDarkly observability plugin to capture traces, run your model calls inside an active span so LaunchDarkly can associate traces with the evaluated AI Config.

[