sql-server – SQL Server 8 – 加速插入

2019年7月28日 182次阅读

是否有可能在SQL Server 8中为此插入加速INSERT INTO – 我已对查询进行匿名处理,这是一个非常简单的语句.

每个项目都是不同的 – 有时我需要插入5k行,有时我必须插入250k-600k行 – 这一切都取决于我的要求.较大的插入物需要很长时间.

当需要更大的插件时,有没有办法加快速度？

Declare @MyVariable_I as int
Set @MyVariable_I = 15


INSERT INTO ExistingTable 
            -- there is a field in this table called UID that has a clustered index on it
            -- Currently has 106.8 Million rows in it
            -- Only has 7 fields in it and they're small fields
(
    Field1            -- non-unique, non-clustered on this field already exists
    ,Field2
    ,Field3            -- non-unique, non-clustered on this field already exists
    ,Field4            -- non-unique, non-clustered on this field already exists
    ,Field5            -- non-unique, non-clustered on this field already exists
    ,Field6
    ,Field7
)
    SELECT
        Field1
        , @MyVariable_I
        ,Field3
        ,0
        ,Field5
        , NULL
        ,Field7
    FROM
        SomeOtherTable WITH (nolock) 
        -- can have anywhere from 5,000 to 250,000 rows - each project is different

《sql-server – SQL Server 8 – 加速插入》

《sql-server – SQL Server 8 – 加速插入》

– 好的,这就是我对如何进行批量插入的猜测
– 在这里找到这个项目：http://sqlserverplanet.com/data-warehouse/transferring-large-amounts-of-data-using-batch-inserts

[cc lang=”sql”]
DECLARE @BatchSize int = 10000

SELECT 1                      -- @Larnu
WHILE @@ROWCOUNT > 0          -- @Larnu
BEGIN

INSERT INTO [dbo].[Destination] –WITH (TABLOCK) — Uncomment for 2008
(
    Field1   
    ,Field2
    ,Field3  
    ,Field4  
    ,Field5  
    ,Field6
    ,Field7
)
SELECT TOP(@BatchSize)
    SELECT
        Field1
        , @MyVariable_I
        ,Field3
        ,0
        ,Field5
        , NULL
        ,Field7
    FROM
        SomeOtherTable SOT
    ORDER BY                                      -- @Larnu
        FIELD1,FIELD2,FIELD3                      -- @Larnu
    WHERE
        NOT EXISTS (                              -- @Larnu FROM HERE DOWN
            SELECT 1
            FROM dbo.Destination DEST
            WHERE 
                DEST.FIELD1 = SOT.FIELD1 AND 
                DEST.FIELD2 = SOT.FIELD2 AND
                DEST.FIELD3 = SOT.FIELD3 
                    )

--commented next item as it is not needed due to @Larnu suggestions
--IF @@ROWCOUNT < @BatchSize BREAK 

END 
[/cc]

最佳答案 我不确定这是否还需要一个答案,但是当我将一个重复的表中的大量数据从一个服务器移动到另一个服务器时,我最近遇到了类似的问题.我修改了我用你的例子做的事情.

SET NOCOUNT ON;
DECLARE @MyVariable_I AS INT = 15

insert_more_rows:
INSERT INTO ExistingTable (
    Field1, Field2, Field3, Field4, Field5, Field6, Field7
)
SELECT TOP 100
    Field1
    , @MyVariable_I
    , Field3
    , 0
    , Field5
    , NULL
    , Field7
FROM
    SomeOtherTable WITH ( NOLOCK )
WHERE 
    Field1 > ( SELECT MAX( Field1 ) FROM ExistingTable )
ORDER BY
    Field1;

IF EXISTS ( SELECT * FROM SomeOtherTable WHERE Field1 > ( SELECT MAX( Field1 ) FROM ExistingTable ) )
    GOTO insert_more_rows;

我们的想法是将插入分解为可管理的“批处理”,这样您就不会在运行时终止服务器并锁定数据库.

在这种情况下,我假设“Field1”是插入“ExistingTable”的“SomeOtherTable”中的唯一ID.通过这个假设并在Field1上对SELECT进行排序,我可以通过将其Field1 max值与SomeOtherTable.Field1值进行比较来确定是否需要将更多记录插入到ExistingTable中.然后,如果还有更多行要插入,则调用GOTO insert_more_rows,插入另外100行.

点赞