Parquet.Net
3.3.0
See the version list below for details.
dotnet add package Parquet.Net --version 3.3.0
NuGet\Install-Package Parquet.Net -Version 3.3.0
<PackageReference Include="Parquet.Net" Version="3.3.0" />
paket add Parquet.Net --version 3.3.0
#r "nuget: Parquet.Net, 3.3.0"
// Install Parquet.Net as a Cake Addin #addin nuget:?package=Parquet.Net&version=3.3.0 // Install Parquet.Net as a Cake Tool #tool nuget:?package=Parquet.Net&version=3.3.0
Pure .NET library to read and write Apache Parquet files, targeting .NET 4.5 and .NET Standand 1.4 and up. Linux, Windows and Mac are first class citizens, but also works everywhere .NET is running (Android, iOS, IOT). Has zero dependencies on thrid-party libraries or any native code. Provides both low-level access to Apache Parquet files, and high-level utilities for more traditional and humanly understandable row-based access. Includes automatic serializer/deserializer from C# classes into parquet files that works by generating MSIL (bytecode) on the fly and is therefore super fast.
Product | Versions Compatible and additional computed target framework versions. |
---|---|
.NET | net5.0 was computed. net5.0-windows was computed. net6.0 was computed. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. |
.NET Core | netcoreapp1.0 was computed. netcoreapp1.1 was computed. netcoreapp2.0 was computed. netcoreapp2.1 was computed. netcoreapp2.2 was computed. netcoreapp3.0 was computed. netcoreapp3.1 was computed. |
.NET Standard | netstandard1.4 is compatible. netstandard1.5 was computed. netstandard1.6 was computed. netstandard2.0 was computed. netstandard2.1 was computed. |
.NET Framework | net45 is compatible. net451 was computed. net452 was computed. net46 was computed. net461 was computed. net462 was computed. net463 was computed. net47 was computed. net471 was computed. net472 was computed. net48 was computed. net481 was computed. |
MonoAndroid | monoandroid was computed. |
MonoMac | monomac was computed. |
MonoTouch | monotouch was computed. |
Tizen | tizen30 was computed. tizen40 was computed. tizen60 was computed. |
Universal Windows Platform | uap was computed. uap10.0 was computed. |
Xamarin.iOS | xamarinios was computed. |
Xamarin.Mac | xamarinmac was computed. |
Xamarin.TVOS | xamarintvos was computed. |
Xamarin.WatchOS | xamarinwatchos was computed. |
-
.NETFramework 4.5
- System.Buffers (>= 4.5.0)
- System.Memory (>= 4.5.1)
- System.Reflection.Emit.Lightweight (>= 4.3.0)
-
.NETStandard 1.4
- NETStandard.Library (>= 1.6.1)
- System.Buffers (>= 4.5.0)
- System.Memory (>= 4.5.1)
- System.Reflection.Emit.Lightweight (>= 4.3.0)
NuGet packages (27)
Showing the top 5 NuGet packages that depend on Parquet.Net:
Package | Downloads |
---|---|
ChoETL.Parquet
Parquet extension to Cinchoo ETL framework |
|
Microsoft.DataPrep
Microsoft Azure Machine Learning Data Preparation SDK. |
|
Komodo.Core
Komodo core libraries for crawling (file, object, web, database), parsing (JSON, XML, SQL, Sqlite, HTML, text), postings (inverted index, token extraction), indexing (search), metadata generation, and integrating within your application. Komodo is an information search, metadata, storage, and retrieval platform. |
|
Microsoft.ML.Parquet
ML.NET components for Apache Parquet support. |
|
PCAxis.Serializers
Paxiom serializers for formats like Excel, jsonstat, jsonstat2, sdmx |
GitHub repositories (8)
Showing the top 5 popular GitHub repositories that depend on Parquet.Net:
Repository | Stars |
---|---|
dotnet/machinelearning
ML.NET is an open source and cross-platform machine learning framework for .NET.
|
|
ravendb/ravendb
ACID Document Database
|
|
Cinchoo/ChoETL
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
|
|
mukunku/ParquetViewer
Simple Windows desktop application for viewing & querying Apache Parquet files
|
|
compomics/ThermoRawFileParser
Thermo RAW file parser that runs on Linux/Mac and all other platforms that support Mono
|
Version | Downloads | Last updated |
---|---|---|
5.0.2 | 625 | 11/14/2024 |
5.0.2-pre.2 | 62 | 11/12/2024 |
5.0.2-pre.1 | 60 | 11/11/2024 |
5.0.1 | 38,650 | 10/14/2024 |
5.0.1-pre.1 | 544 | 10/3/2024 |
5.0.0 | 14,336 | 10/3/2024 |
5.0.0-pre.4 | 58 | 10/2/2024 |
5.0.0-pre.3 | 56 | 10/2/2024 |
5.0.0-pre.2 | 527 | 9/30/2024 |
5.0.0-pre.1 | 123 | 9/23/2024 |
4.25.0 | 79,270 | 9/9/2024 |
4.25.0-pre.3 | 132 | 9/6/2024 |
4.25.0-pre.2 | 2,286 | 6/11/2024 |
4.25.0-pre.1 | 97 | 6/7/2024 |
4.24.0 | 295,927 | 6/6/2024 |
4.24.0-pre.8 | 72 | 6/4/2024 |
4.24.0-pre.7 | 70 | 6/4/2024 |
4.24.0-pre.6 | 69 | 6/3/2024 |
4.24.0-pre.5 | 54 | 6/3/2024 |
4.24.0-pre.4 | 84 | 5/31/2024 |
4.24.0-pre.3 | 70 | 5/31/2024 |
4.24.0-pre.2 | 504 | 5/28/2024 |
4.24.0-pre.1 | 113 | 5/22/2024 |
4.23.5 | 223,359 | 4/4/2024 |
4.23.4 | 435,745 | 2/2/2024 |
4.23.3 | 19,889 | 1/25/2024 |
4.23.2 | 8,724 | 1/22/2024 |
4.23.1 | 6,733 | 1/19/2024 |
4.23.0 | 2,561 | 1/18/2024 |
4.22.1 | 8,615 | 1/17/2024 |
4.22.0 | 56,528 | 1/11/2024 |
4.20.1 | 4,809 | 1/10/2024 |
4.20.0 | 13,871 | 1/8/2024 |
4.19.0 | 23,353 | 1/5/2024 |
4.18.1 | 10,522 | 12/31/2023 |
4.18.0 | 23,441 | 12/22/2023 |
4.17.0 | 291,848 | 11/14/2023 |
4.16.4 | 511,739 | 9/11/2023 |
4.16.3 | 28,295 | 9/4/2023 |
4.16.2 | 96,221 | 8/22/2023 |
4.16.1 | 4,212 | 8/21/2023 |
4.16.0 | 2,601 | 8/17/2023 |
4.15.0 | 146,913 | 6/30/2023 |
4.14.0 | 28,359 | 6/28/2023 |
4.13.0 | 88,642 | 6/20/2023 |
4.12.0 | 132,949 | 5/22/2023 |
4.11.3 | 10,772 | 5/18/2023 |
4.11.2 | 50,360 | 5/16/2023 |
4.11.1 | 34,736 | 5/10/2023 |
4.11.0 | 4,914 | 5/9/2023 |
4.10.1 | 37,298 | 5/2/2023 |
4.10.0 | 30,860 | 4/26/2023 |
4.9.2 | 2,810 | 4/25/2023 |
4.9.1 | 3,421 | 4/21/2023 |
4.9.0 | 2,166 | 4/21/2023 |
4.8.1 | 10,585 | 4/19/2023 |
4.8.0 | 2,481 | 4/18/2023 |
4.8.0-alpha-00 | 1,553 | 4/17/2023 |
4.7.1 | 6,246 | 4/14/2023 |
4.7.0 | 7,378 | 4/13/2023 |
4.6.2 | 67,222 | 3/28/2023 |
4.6.1 | 5,592 | 3/23/2023 |
4.6.0 | 12,105 | 3/21/2023 |
4.5.4 | 323,917 | 2/23/2023 |
4.5.3 | 16,425 | 2/22/2023 |
4.5.2 | 10,945 | 2/20/2023 |
4.5.1 | 7,960 | 2/14/2023 |
4.5.0 | 7,378 | 2/13/2023 |
4.4.7 | 12,958 | 2/8/2023 |
4.4.6 | 47,881 | 1/31/2023 |
4.4.5 | 3,220 | 1/30/2023 |
4.4.4 | 2,529 | 1/27/2023 |
4.4.3 | 3,405 | 1/26/2023 |
4.4.2 | 1,726 | 1/26/2023 |
4.4.1 | 2,088 | 1/25/2023 |
4.4.0 | 3,116 | 1/24/2023 |
4.3.4 | 1,963 | 1/23/2023 |
4.3.3 | 2,146 | 1/20/2023 |
4.3.2 | 2,044 | 1/19/2023 |
4.3.1 | 1,682 | 1/19/2023 |
4.3.0 | 2,664 | 1/18/2023 |
4.2.3 | 6,596 | 1/16/2023 |
4.2.2 | 10,031 | 1/11/2023 |
4.2.1 | 7,397 | 1/10/2023 |
4.2.0 | 1,954 | 1/10/2023 |
4.1.3 | 64,675 | 12/21/2022 |
4.1.2 | 28,143 | 12/1/2022 |
4.1.1 | 117,410 | 11/10/2022 |
4.1.0 | 229,620 | 10/13/2022 |
4.0.2 | 10,497 | 10/12/2022 |
4.0.1 | 26,992 | 10/11/2022 |
4.0.0 | 57,024 | 9/22/2022 |
3.10.0 | 304,627 | 9/20/2022 |
3.9.1 | 1,535,654 | 10/14/2021 |
3.9.0 | 371,177 | 6/25/2021 |
3.8.6 | 458,161 | 3/5/2021 |
3.8.5 | 26,357 | 2/23/2021 |
3.8.4 | 271,599 | 12/13/2020 |
3.8.3 | 2,390 | 12/10/2020 |
3.8.2 | 1,939 | 12/10/2020 |
3.8.1 | 31,826 | 11/6/2020 |
3.8.0 | 4,315 | 11/6/2020 |
3.7.7 | 327,900 | 6/25/2020 |
3.7.6 | 25,657 | 6/16/2020 |
3.7.5 | 14,395 | 6/8/2020 |
3.7.4 | 187,712 | 5/19/2020 |
3.7.2 | 3,866 | 5/18/2020 |
3.7.1 | 48,740 | 4/21/2020 |
3.7.0 | 57,217 | 4/19/2020 |
3.6.0 | 5,437,561 | 1/23/2020 |
3.5.3 | 14,065 | 1/8/2020 |
3.5.2 | 3,518 | 1/3/2020 |
3.5.1 | 2,225 | 12/31/2019 |
3.5.0 | 9,679 | 12/18/2019 |
3.4.3 | 7,365 | 12/16/2019 |
3.4.2 | 3,771 | 12/13/2019 |
3.4.1 | 2,175 | 12/11/2019 |
3.4.0 | 2,987 | 12/11/2019 |
3.3.11 | 6,881 | 12/1/2019 |
3.3.10 | 48,796 | 11/6/2019 |
3.3.9 | 188,017 | 8/15/2019 |
3.3.8 | 8,772 | 8/1/2019 |
3.3.7 | 2,157 | 8/1/2019 |
3.3.6 | 2,271 | 7/31/2019 |
3.3.5 | 33,141 | 7/5/2019 |
3.3.4 | 184,482 | 3/11/2019 |
3.3.3 | 20,389 | 2/1/2019 |
3.3.2 | 26,456 | 1/21/2019 |
3.3.1 | 4,592 | 1/14/2019 |
3.3.0 | 3,706 | 1/11/2019 |
3.2.6 | 2,881 | 1/11/2019 |
3.2.5 | 4,540 | 1/3/2019 |
3.2.4 | 10,387 | 11/21/2018 |
3.2.3 | 50,957 | 11/7/2018 |
3.2.2 | 5,367 | 10/30/2018 |
3.2.1 | 2,461 | 10/30/2018 |
3.2.0 | 3,155 | 10/24/2018 |
3.1.4 | 2,493 | 10/15/2018 |
3.1.3 | 2,376 | 10/15/2018 |
3.1.2 | 46,922 | 10/11/2018 |
3.1.1 | 2,851 | 10/4/2018 |
3.1.0 | 2,796 | 10/3/2018 |
3.1.0-preview-390 | 2,069 | 10/3/2018 |
3.1.0-preview-373 | 2,329 | 10/2/2018 |
3.0.5 | 9,000 | 8/13/2018 |
3.0.4 | 2,525 | 7/25/2018 |
3.0.3 | 2,378 | 7/25/2018 |
3.0.2 | 2,829 | 7/24/2018 |
3.0.1 | 2,375 | 7/24/2018 |
3.0.0 | 3,321 | 7/19/2018 |
2.1.4 | 95,417 | 6/7/2018 |
2.1.3 | 260,694 | 3/30/2018 |
2.1.2 | 441,591 | 1/10/2018 |
2.1.1 | 116,496 | 12/1/2017 |
2.1.0 | 2,711 | 11/29/2017 |
2.0.1 | 2,515 | 11/27/2017 |
2.0.0 | 3,449 | 11/27/2017 |
1.5.1 | 3,330 | 11/14/2017 |
1.4.0 | 6,630 | 10/23/2017 |
1.3.0 | 5,346 | 9/12/2017 |
1.2.139 | 3,442 | 9/6/2017 |
1.1.128 | 3,313 | 8/15/2017 |
1.0.114 | 2,673 | 7/31/2017 |
3.2.3:
- bug fixed: multiple nesting levels were not correctly read by row-based helpers (#363)
- bug fixed: Equals method on Row didn't compare list elements correctly (#361)
- bug fixed: multi-page columns were not read to end if their order is not what parquet-dotnet expects (#370)
3.2.0:
- new feature: POCO serialiser support for repeatable fields POCO (#358)
- bug fixed: --max-rows 10 not honored by PARQ Global Tool 📺 (#357)
- bug fixed: failure to read columns if data page is larger than it should be (supposably padded by Spark) 🐛
(#330)
- improvement: Limit number of rows printed by parq. By default only show the first 10 rows in PARQ Global Tool 📺
(#351)
3.1.3, 3.1.4:
- includes massive performance improvements in parquet reader, now we are faster than fastparquet (python lib)
3.1.2:
- new feature: replaced default ToString() method in Table and Row object to produce json (#346)
- new feature: parquet CLI supports conversion from parquet to json (#341)
3.1.1:
parq cli improvements
3.1.0:
- re-introducing utilities for row-based access allowing you to access and create parquet files in more readable format.
- Field class now supports MaxRepetitionLevel and MaxDefinitionLevel
- fixed bug #334 preventing reading generated files in Impala
- parquet.net library supports SourceLink
3.0.5:
- #321 bug fixed: a nullable field should support all-non-nullable values
- performance improvement around packing definition levels
3.0.4:
- bug fixed: Cannot read schema where map elements are structures (#320)
3.0.3
- critical bug fixed: reading parquet files with multiple pages doesn't read beyond 1st page (#318)
3.0.2
- performance improvements (#317)
3.0.1
- improvement: better column validation in row group writer
- bug fixed: Snappy compression writer fails on certain encodings (#315)
3.0.0
the first release of a major rewrite