crestapps-core-ai-runtime

CrestApps.Core AI Runtime - Prompt Templates

Configure the AI Runtime

You are a CrestApps.Core expert. Generate code and configuration for the provider-agnostic AI runtime in CrestApps.Core.

Guidelines

• Use AddCoreAIServices() only when the host needs the raw service registrations.
• Prefer AddCrestAppsCore(...).AddAISuite(...) for application composition.
• Program against IAIClientFactory, IAICompletionService, and IAICompletionContextBuilder.
• Treat connections as provider credentials and endpoints.
• Treat deployments as named model selections.
• Resolve deployments through the runtime instead of hardcoding model calls in business logic.

Raw Service Registration

builder.Services
    .AddCoreAIServices()
    .AddCoreAIOrchestration()
    .AddCoreAIOpenAI();

Builder-Based Registration

builder.Services.AddCrestAppsCore(crestApps => crestApps
    .AddAISuite(ai => ai
        .AddOpenAI()
    )
);

Key Runtime Services

Service	Use
IAIClientFactory	Create typed chat, embedding, image, speech, and other provider clients
IAICompletionService	Send deployment-aware completions without the full orchestration loop
IAICompletionContextBuilder	Build enriched AI completion contexts through handlers
IAIDeploymentStore	Read named deployments from config and store sources
IAIProviderConnectionStore	Read provider connections from config and store sources

Example Completion Service

using CrestApps.Core.AI.Completions;
using CrestApps.Core.AI.Deployments;
using CrestApps.Core.AI.Models;
using Microsoft.Extensions.AI;

public sealed class QuestionService(
    IAICompletionService completionService,
    IAICompletionContextBuilder completionContextBuilder,
    IAIDeploymentManager deploymentManager)
{
    public async Task<string> AskAsync(
        string question,
        CancellationToken cancellationToken = default)
    {
        var deployment = await deploymentManager.ResolveOrDefaultAsync(
            AIDeploymentPurpose.Chat,
            cancellationToken: cancellationToken)
            ?? throw new InvalidOperationException("No chat deployment is configured.");

        var completionContext = await completionContextBuilder.BuildAsync(
            deployment,
            cancellationToken: cancellationToken);

        var messages = new List<ChatMessage>
        {
            new(ChatRole.System, "You are a helpful assistant."),
            new(ChatRole.User, question),
        };

        var response = await completionService.CompleteAsync(
            deployment,
            messages,
            completionContext,
            cancellationToken);

        return response.Text;
    }
}