.NET (AI) SDK reference

Overview

This topic documents how to get started with the .NET (AI) SDK, and links to reference information on all of the supported features.

Get started

LaunchDarkly AI SDKs interact with AI configs. AI configs are the LaunchDarkly resources that manage your AI prompts and model configurations.

You can use the .NET (AI) SDK to customize your AI config based on the context that you provide. This means both the prompt and the model evaluation in your generative AI application are specific to each end user, at runtime. You can also use the AI SDKs to record metrics from your AI model generation, including duration and tokens.

Follow these instructions to start using the .NET (AI) SDK in your application.

Install the SDK

First, install the AI SDK as a dependency in your application using your application's dependency manager. If you want to depend on a specific version, refer to the SDK releases page to identify the latest version.

The .NET (AI) SDK is built on the .NET (server-side) SDK, so you'll need to install that as well. The .NET (AI) SDK requires version 8 or higher of the .NET (server-side) SDK.

Here's how:

Install-Package LaunchDarkly.ServerSdk
Install-Package LaunchDarkly.ServerSdk.Ai
COPY

Next, import the namespaces in your application code. The namespace is not the same as the package name:

using LaunchDarkly.Sdk.Server.Ai;
using LaunchDarkly.Sdk.Server.Ai.Adapters;
using LaunchDarkly.Sdk.Server.Ai.Config;
COPY

Initialize the client

After you install and import the SDK, create a single, shared instance of LdClient. When the LdClient is initialized, use it to initialize the LdAiClient. The LdAiClient is how you interact with AI configs. Specify the SDK key to authorize your application to connect to a particular environment within LaunchDarkly.

Here's how:

var baseClient = new LdClient(Configuration.Builder("sdk-key-123").StartWaitTime(TimeSpan.FromSeconds(5)).Build()));
var aiClient = new LdAiClient(new LdClientAdapter(baseClient));
COPY

Configure the context

Next, configure the context that will use the AI config, that is, the context that will encounter generated AI content in your application. The context attributes determine which version of the AI config LaunchDarkly serves to the end user, based on the targeting rules in your AI config. If you are using template variables in the prompts in your AI config's versions, the context attributes also fill in values for the template variables.

Here's how:

var context = Context.Builder("context-key-123abc")
  .Name("Sandy")
  .Build();
COPY

Customize an AI config

Then, use ModelConfig to customize the AI config. This function returns the customized prompt and model. Customization means that any variables you include in the prompt when you define the AI config version have their values set to the context attributes and variables you pass to ModelConfig. Then, you can pass the customized prompt directly to your AI.

The customization process within the AI SDK is similar to evaluating flags in one of LaunchDarkly's client-side, server-side, or edge SDKs, in that the SDK completes the customization without a separate network call.

Here's how:

var tracker = aiClient.ModelConfig(
  "ai-config-key-123abc",
  context,
  LdAiConfig.Disabled,
  new Dictionary<string, object> {
    { "exampleCustomVariable", "exampleCustomValue" }
  }
);
COPY

To learn more, read Customizing AI configs.

Record metrics from AI model generation

Finally, use the TrackRequest function to record metrics from your AI model generation.

Here's how:

var response = tracker.TrackRequest(Task.Run(() =>
  {
    // Make request to a provider, which automatically tracks metrics in LaunchDarkly.
    // When sending the request to a provider, use details from tracker.Config.
    // For instance, you can pass tracker.Config.Model and tracker.Config.Prompt.
    // Optionally, return response metadata, for example to do your own additional logging.
    return new Response
    {
      Usage = new Usage { Total = 1, Input = 1, Output = 1 }, /* Token usage data */
      Metrics = new Metrics { LatencyMs = 100 } /* Metrics data */
    };
  }
));
COPY

If you would like to do any additional tracking, besides what LaunchDarkly provides, it is your responsibility to fill in the Response object with the data you want to track.

To learn more, read Tracking AI metrics.

Supported features

This SDK supports the following features:

• Anonymous contexts
• Context configuration
• Customizing AI configs
• Private attributes
• Tracking AI metrics