Panlingo.LanguageIdentification.FastText 0.5.0

Panlingo.LanguageIdentification.FastText

Welcome to Panlingo.LanguageIdentification.FastText, a .NET wrapper for the FastText library by Facebook AI Research (FAIR). This package seamlessly integrates language identification capabilities into .NET applications, leveraging the powerful and efficient FastText library to recognize and classify texts in multiple languages. Ideal for applications that require fast and accurate language detection.

Requirements

• Runtime: .NET >= 5.0
• OS: Linux (Ubuntu, Debian), Windows 10+ or Windows Server 2019+, macOS
• Arch: AMD64 (or ARM for macOS)

Installation

To integrate the FastText functionality, follow these steps:

Install the NuGet package:

dotnet add package Panlingo.LanguageIdentification.FastText

Usage

Integrating the FastText library into your .NET application is straightforward. Here’s a quick guide to get you started:

1. Install the Package: Ensure you have added the Panlingo.LanguageIdentification.FastText package to your project using the provided installation command.
2. Download the Models: Follow the provided commands to download the pretrained language identification models.
3. Initialize the Library: Follow the example snippet to initialize and use the FastText library for detecting languages.

using Panlingo.LanguageIdentification.FastText;

class Program
{
    static void Main()
    {
        using var fastText = new FastTextDetector();
        fastText.LoadDefaultModel();

        var predictions = fastText.Predict(
            text: "Привіт, як справи?", 
            count: 10
        );

        foreach (var prediction in predictions)
        {
            Console.WriteLine($"{prediction.Label}: {prediction.Probability}");
        }

        var dimensions = fastText.GetModelDimensions();
        var labels = fastText.GetLabels();
    }
}

Custom models

The default model for this package is quantized lid.176.ftz (see below). You can use the default model by calling the LoadDefaultModel() method.

We recommend using the following models, but you can use any model depending on your needs. It could even be a model for another text classinfiction tasks, e.g: supervised models

Use custom model in codes

You can use the model included in this NuGet package:

using var fastText = new FastTextDetector();
fastText.LoadDefaultModel();

You can specify the path to the model file:

using var fastText = new FastTextDetector();

var modelPath = "/path/to/model/fasttext176.bin";
fastText.LoadModel(modelPath);

Also you can also load the model as a memory stream:

using var fastText = new FastTextDetector();

var modelPath = "/path/to/model/fasttext176.bin";
using var stream = File.Open(modelPath, FileMode.Open);
fastText.LoadModel(stream);

Alternatives

If you are exploring other options, here are some alternatives to consider:

• theolivenbaum/fastText: An unmaintained wrapper for .NET.
• olegtarasov/FastText.NetWrapper: Another unmaintained wrapper for .NET.

Sources

1. Original FastText Repository
2. Enriching Word Vectors with Subword Information
3. Language identification at Wikipedia

License

This project is licensed under the MIT License © 2024–2025 Alexander Gluschenko.

Includes software from the following project(s):

• FastText — © 2016–present Meta Platforms, Inc., licensed under MIT

See the LICENSE file for full details.

We value your feedback. Feel free to open issues or contribute to the repository. Let’s make language detection in .NET even more powerful and versatile! 🌍📝

Happy coding! 👩‍💻👨‍💻

Stay updated by following our repository. For any inquiries or support, reach out through the issues page.