N.EntityFrameworkCore.Extensions 8.0.0.12

N.EntityFrameworkCore.Extensions

Bulk data support data support for EntityFrameworkCore v8.0.0+

N.EntityFrameworkCore.Extensions extends your DbContext with high-performance bulk operations: BulkDelete, BulkFetch, BulkInsert, BulkMerge, BulkSaveChanges, BulkSync, BulkUpdate, Fetch, FromSqlQuery, DeleteFromQuery, InsertFromQuery, UpdateFromQuery, QueryToCsvFile, SqlQueryToCsvFile

Supports: Multiple Schemas, Complex Properties, Value Converters, Transactions, Synchronous & Asynchronous Execution

Inheritance Models: Table-Per-Concrete, Table-Per-Hierarchy, Table-Per-Type

Supports Databases: SQL Server

Installation

The latest stable version is available on NuGet.

dotnet add package N.EntityFrameworkCore.Extensions

Usage

BulkInsert() - Performs an insert operation with a large number of entities

var dbContext = new MyDbContext();  
var orders = new List<Order>();  
for(int i=0; i<10000; i++)  
{  
   orders.Add(new Order { OrderDate = DateTime.UtcNow, TotalPrice = 2.99 });  
}  
dbContext.BulkInsert(orders);  

BulkDelete() - Performs a delete operation with a large number of entities

var dbContext = new MyDbContext();  
var orders = dbContext.Orders.Where(o => o.TotalPrice < 5.35M);  
dbContext.BulkDelete(orders);

BulkFetch() - Retrieves entities that are contained in a list

var ids = new List<int> { 10001, 10002, 10003, 10004, 10005 };
var products = dbContext.Products.BulkFetch(ids, options => { options.JoinOnCondition = (s, t) => s.Id == t.Id; }).ToList();

BulkUpdate() - Performs an update operation with a large number of entities

var dbContext = new MyDbContext();  
var products = dbContext.Products.Where(o => o.Price < 5.35M);
foreach(var product in products)
{
    order.Price = 6M;
}
dbContext.BulkUpdate(products);

BulkMerge() - Performs a merge operation with a large number of entities

var dbContext = new MyDbContext();
var products = new List<Product>();
var existingProducts = dbContext.Products.Where(o => o.Price < 5.35M);
foreach(var product in existingProducts)
{
    product.Price = 6M;
}
products.AddRange(existingProducts);
products.Add(new Product { Name="Hat", Price=10.25M });
products.Add(new Product { Name="Shirt", Price=20.95M });
dbContext.BulkMerge(products);

BulkSaveChanges() - Saves all changes using bulk operations

var dbContext = new MyDbContext();  
var orders = new List<Order>();  
for(int i=0; i<10000; i++)  
{  
   orders.Add(new Order { Id=-i,OrderDate = DateTime.UtcNow, TotalPrice = 2.99 });  
}
dbContext.Orders.AddRange(orders);
dbContext.BulkSaveChanges();  

BulkSync() - Performs a sync operation with a large number of entities.

By default any entities that do not exists in the source list will be deleted, but this can be disabled in the options.

var dbContext = new MyDbContext();
var products = new List<Product>();
var existingProducts = dbContext.Products.Where(o => o.Id <= 1000);
foreach(var product in existingProducts)
{
    product.Price = 6M;
}
products.AddRange(existingProducts);
products.Add(new Product { Name="Hat", Price=10.25M });
products.Add(new Product { Name="Shirt", Price=20.95M });
//All existing products with Id > 1000 will be deleted
dbContext.BulkSync(products);

Fetch() - Retrieves data in batches.

var dbContext = new MyDbContext();  
var query = dbContext.Products.Where(o => o.Price < 5.35M);
query.Fetch(result =>
  {
    batchCount++;
    totalCount += result.Results.Count();
  }, 
  new FetchOptions { BatchSize = 1000 }
);
dbContext.BulkUpdate(products);

DeleteFromQuery() - Deletes records from the database using a LINQ query without loading data into DbContext

var dbContext = new MyDbContext(); 

//This will delete all products  
dbContext.Products.DeleteFromQuery() 

//This will delete all products that are under $5.35  
dbContext.Products.Where(x => x.Price < 5.35M).DeleteFromQuery()  

InsertFromQuery() - Inserts records from the database using a LINQ query without loading data into DbContext

var dbContext = new MyDbContext(); 

//This will take all products priced under $10 from the Products table and 
//insert it into the ProductsUnderTen table
dbContext.Products.Where(x => x.Price < 10M).InsertFromQuery("ProductsUnderTen", o => new { o.Id, o.Price });

UpdateFromQuery() - Updates records from the database using a LINQ query without loading data into DbContext

var dbContext = new MyDbContext(); 

//This will change all products priced at $5.35 to $5.75 
dbContext.Products.Where(x => x.Price == 5.35M).UpdateFromQuery(o => new Product { Price = 5.75M }) 

Options

Transaction

When using any of the following bulk data operations (BulkDelete, BulkInsert, BulkMerge, BulkSaveChanges, BulkSync, BulkUpdate, DeleteFromQuery, InsertFromQuery), if an external transaction exists, then it will be utilized.

var dbContext = new MyDbContext(); 
var transaction = context.Database.BeginTransaction();
try
{
   dbContext.BulkInsert(orders);
   transaction.Commit();
}
catch
{
   transaction.Rollback();
}

Documentation

Donations

If you found this project helpful and you would like to support it, feel free to donate through paypal or bitcoin.

Paypal	Bitcoin
	<center> <br />bc1qxqpymnf4gj22nt4wj3wy56ks48fw59v8y9sg9z</center>