AugusteVN.Ollama.Client 1.0.7

Ollama Client

A C# client library for interacting with your Ollama API setup. This package provides simple and easy-to-use APIs for generating model responses, listing local models, ...

Interact with your own Ollama API setup by passing an accessible host URL.

You can use Ngrok to temporarily, publicly expose your local setup.

• Local setup video
• Implementation video
• Official API Docs

Configuration

Program.cs

builder.Services.AddOllamaHttpClient(builder.Configuration);

// --- Or --- //

builder
    .AddOptions<OllamaClientConfig>()
    .BindConfiguration(nameof(OllamaClientConfig));

builder.Services.AddHttpClient(); // Registers the IHttpClientFactory
builder.Services.AddScoped<OllamaHttpClient>();

// Or
builder.Services.AddHttpClient<OllamaHttpClient>(); // Registers the IHttpClientFactory

// Or
var ollamaClient = new OllamaHttpClient(
    new HttpClient(),
    new OllamaClientConfig { HostUrl = "<optionally-set-here-or-pass-as-param-in-method>" }
);

List Models

class Example(OllamaHttpClient ollamaClient)
{
    public async Task ListModelsAsync()
    {
        var result = await ollamaClient.ListLocalModelsAsync(hostUrl: "http://localhost:11434");
        if (!result.IsFailure && result.Value.Models?.Any() == true)
        {
            Console.WriteLine(result.Value.Models.Select(model => model.Name));
        }
    }
});

Generate Model Response

class Example(OllamaHttpClient ollamaClient)
{
    public async Task GenerateResponseAsync()
    {
        var result = await ollamaClient.GenerateModelResponseAsync(
            new OllamaGenerateRequest
            {
                Model = "llama3",
                Stream = false,
                Prompt = "Document this C# method as XML comment format: ```csharp ...```"
            }, hostUrl: "http://localhost:11434");
        if (!result.IsFailure)
        {
            Console.WriteLine(result.Value.Response);
        }
    }
}
    

Get the original code of my package, here:

• kiss-code.com
• Patreon