Gravicode.ScrapyNet.Playwright 0.1.0

.NET 10.0

dotnet add package Gravicode.ScrapyNet.Playwright --version 0.1.0

NuGet\Install-Package Gravicode.ScrapyNet.Playwright -Version 0.1.0

This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.

<PackageReference Include="Gravicode.ScrapyNet.Playwright" Version="0.1.0" />

For projects that support PackageReference, copy this XML node into the project file to reference the package.

<PackageVersion Include="Gravicode.ScrapyNet.Playwright" Version="0.1.0" />
                    

                            Directory.Packages.props

<PackageReference Include="Gravicode.ScrapyNet.Playwright" />
                    

                            Project file

For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.

paket add Gravicode.ScrapyNet.Playwright --version 0.1.0

The NuGet Team does not provide support for this client. Please contact its maintainers for support.

#r "nuget: Gravicode.ScrapyNet.Playwright, 0.1.0"

#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.

#:package Gravicode.ScrapyNet.Playwright@0.1.0

#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.

#addin nuget:?package=Gravicode.ScrapyNet.Playwright&version=0.1.0
                    

                            Install as a Cake Addin

#tool nuget:?package=Gravicode.ScrapyNet.Playwright&version=0.1.0
                    

                            Install as a Cake Tool

The NuGet Team does not provide support for this client. Please contact its maintainers for support.

Scrapy.Net

Scrapy for .NET 10 — the web crawling and scraping framework, rewritten in C#.

Dibuat oleh Gravicode Studios dipimpin oleh Kang Fadhil. · Made by Gravicode Studios, led by Kang Fadhil.

Scrapy Gallery

Same engine architecture, component names and setting keys as Scrapy, with async callbacks, typed items and compile-time checked components.

using ScrapyNet;

public sealed class QuotesSpider : Spider
{
    public override IReadOnlyList<string> StartUrls => ["https://quotes.toscrape.com/"];

    public override async IAsyncEnumerable<object> Parse(Response response)
    {
        foreach (var quote in response.Css("div.quote"))
            yield return new { Text = quote.Css("span.text::text").Get(), Author = quote.Css("small.author::text").Get() };

        if (response.Css("li.next a::attr(href)").Get() is { } next)
            yield return response.Follow(next, Parse);
        await Task.CompletedTask;
    }
}

var settings = new Settings();
settings.Feeds.Add("quotes.jsonl");
Console.WriteLine(await Scrapy.CrawlAsync(new QuotesSpider(), settings));

Packages

Package	Adds
`Gravicode.ScrapyNet`	Engine, spiders (Crawl/Sitemap/XML/CSV), CSS/XPath selectors, items, loaders, middlewares (retry, redirect, cookies, proxies, robots.txt, cache, AutoThrottle), pipelines (files, images, databases), feed exports, pause/resume, signals, stats, CLI runner
`Gravicode.ScrapyNet.Playwright`	JavaScript rendering with page actions
`Gravicode.ScrapyNet.AI`	Extraction, chunking, dedup, embeddings, vector search, RAG with OpenAI/Azure/DeepSeek/Ollama
`Gravicode.ScrapyNet.Platform`	Declarative spiders, jobs, cron, secrets, monitoring, alerts
`Gravicode.ScrapyNet.Server`	REST API with roles (scrapyd-style)
`Gravicode.ScrapyNet.Sandbox`	Offline practice website for learning and tests
`Gravicode.ScrapyNet.Cli`	`scrapynet` tool: startproject, genspider, crawl, shell, fetch, parse, bench

Documentation

English: https://github.com/DotNetVibeCoderz/Vibe_Library/tree/main/ScrapyNet/docs/en
Bahasa Indonesia: https://github.com/DotNetVibeCoderz/Vibe_Library/tree/main/ScrapyNet/docs/id
Scrapy Gallery (desktop demo app), samples and notebooks: https://github.com/DotNetVibeCoderz/Vibe_Library/tree/main/ScrapyNet

Product	Compatible and additional computed target framework versions.
.NET	net10.0 is compatible. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed.