您的当前位置:首页正文

DataTable数据批量写入数据库三种方法比较

来源:九壹网


DataTable数据批量写入数据库三种方法比较 以及方法介绍 收藏

最近在将excel中的文件导入到数据库中,用程序进行编写,由于数据量较大所以速度很慢,后来采用了SqlBulkCopy类,解决了速度的问题,我就insert语句,sqldataadapter.update(dataset,tablename);sqlbulkcopy.WriteToServer(datatable);三个方法的性能进行比较:

1、生成测试的datatable表,表结构如下:

UniqueID(主键,自动增长) | CompanyName | CompanyCode | Address | Owner | Memo

共6个字段。

SqlConnection sqlconnection = new SqlConnection(connectionString);

SqlDataAdapter sqldataadapter = new SqlDataAdapter(\"select * from Table_1 where 1=2\

DataSet dataset = new DataSet();

sqldataadapter.Fill(dataset, \"Table_1\");

DataTable datatable = dataset.Tables[0];

//生成20000条记录

for (int i = 0; i < 20000; i++)

{

DataRow datarow = datatable.NewRow();

datarow[\"CompanyName\"] \"companyname\"+string.Format(\"{0:0000}\

=

datarow[\"CompanyCode\"] = \"companycode\" + string.Format(\"{0:0000}\i);

datarow[\"Address\"] = \"address\" + string.Format(\"{0:0000}\

datarow[\"Owner\"] = \"owner\" + string.Format(\"{0:0000}\

datarow[\"Memo\"] = \"memo\" + string.Format(\"{0:0000}\

datatable.Rows.Add(datarow);

}

2、使用sqlcommand.executenonquery()方法插入

foreach (DataRow datarow in datatable.Rows)

{

string sql = \"INSERT INTO [Table_1]

([CompanyName],[CompanyCode],[Address],[Owner],[Memo])\" +

\"VALUES('\" + datarow[\"CompanyName\"].ToString() + \"'\" +

\oString() + \"'\" +

\

\oString() + \"'\" +

\oString() + \"')\";

using (SqlConnection sqlconn = new SqlConnection(connectionString))

{

sqlconn.Open();

SqlCommand sqlcommand = new SqlCommand(sql, sqlconn);

sqlcommand.ExecuteNonQuery();

sqlconn.Close();

}

}

插入20000条记录时间:00:00:29.7336000

3、使用sqldataadapter.update(dataset,tablename);

SqlCommand insertcommand = new SqlCommand(\"INSERT INTO

[Table_1]([CompanyName],[CompanyCode],[Address],[Owner],[Memo])\" +

\"VALUES(@CompanyName,

@CompanyCode,@Address,@Owner,@Memo)\SqlConnection(connectionString));

insertcommand.Parameters.Add(\"@CompanyName\SqlDbType.NChar, 50, \"CompanyName\");

insertcommand.Parameters.Add(\"@CompanyCode\SqlDbType.NChar, 25, \"CompanyCode\");

insertcommand.Parameters.Add(\"@Address\\"Address\");

SqlDbType.NChar, 255,

insertcommand.Parameters.Add(\"@Owner\

insertcommand.Parameters.Add(\"@Memo\

sqldataadapter.InsertCommand = insertcommand;

sqldataadapter.Update(dataset, \"Table_1\");

插入20000条记录时间:00:00:22.8938000

4、使用sqlbulkcopy.writetoserver(datatable)

SqlBulkCopy sqlbulkcopy = new SqlBulkCopy(connectionString,

SqlBulkCopyOptions.UseInternalTransaction);

sqlbulkcopy.DestinationTableName = \"Table_1\";//数据库中的表名

sqlbulkcopy.WriteToServer(dataset.Tables[0]);

插入20000条记录时间:00:00:00.3276000

所以说速度是sqlbulkcopy最快,sqldataadapter.update()次之,

sqlcommand.ExecuteNonQuery()最慢。

本文来自CSDN博客,转载请标明出处:

http://blog.csdn.net/humozhi/archive/2009/03/31/4039868.aspx

-------------------------------------------------------------------------------------------------

1.大批量数据操作

可以利用SqlBulkCopy类快速写入大批量数据,针对SQL Server的优化,可以写入DataRow数据,DataTable,DataReader

WriteToServer(DataTable)写入数据表

WriteToServer(DataRow[])批次写入数据行

WriteToServer(DataTable ,DataRowState)按行状态写入数据库表

WriteToServer(IDataReader)写入DataReader对象

string connstr = \"server=(local);database=northwind;integrated

security=true;async=true\";

// Fill up a DataSet

DataSet ds = new DataSet();

SqlConnection conn = new SqlConnection(connstr);

SqlDataAdapter dadp = new SqlDataAdapter(\"select * from customers\

dadp.Fill(ds);

// Copy the Data to SqlServer

SqlBulkCopy bcp = new SqlBulkCopy(connstr);

bcp.DestinationTableName = \"customers1\";

bcp.WriteToServer(ds.Tables[0]);

2.多个动态的结果集

Multiple Active Result Sets(MARS)

这个只能在SQL Server 2005中使用

可以在一个Command对象上同时打开多个DataReader

string connstr = \"server=(local);database=northwind;integrated

security=true;async=true\";

SqlConnection conn = new SqlConnection(connstr);

conn.Open();

SqlCommand cmd1 = new SqlCommand(\"select * from customers\

SqlCommand cmd2 = new SqlCommand(\"select * from orders\

SqlDataReader rdr1 = cmd1.ExecuteReader();

// next statement causes an error prior to SQL Server 2005

SqlDataReader rdr2 = cmd2.ExecuteReader();

// now you can reader from rdr1 and rdr2 at the same time.

因篇幅问题不能全部显示,请点此查看更多更全内容

Top