Showing posts with label load. Show all posts
Showing posts with label load. Show all posts

Wednesday, March 21, 2012

Parallel SQL Destination Load Pre-Process error

I cannot find any information on this error. It occurs on packages that are writing to the same table using a sql server destination. I suppose it would be a good exercise in error handling, but I'd rather avoid it.

Error: Unable to prepare the SSIS bulk insert for data insertion.
Error: component "FACT_BillingLineItem Destination" (22652) failed the pre-execute phase and returned error code 0xC0202071.
The cause of these errors, I eventually determined, was that SQL Server/SSIS by default uses up system memory until it goes loopy, unless you tell it not to by configuring the SQL Server "Maximum Server Memory" property.

Parallel SQL Destination Load Pre-Process error

I cannot find any information on this error. It occurs on packages that are writing to the same table using a sql server destination. I suppose it would be a good exercise in error handling, but I'd rather avoid it.

Error: Unable to prepare the SSIS bulk insert for data insertion.
Error: component "FACT_BillingLineItem Destination" (22652) failed the pre-execute phase and returned error code 0xC0202071.The cause of these errors, I eventually determined, was that SQL Server/SSIS by default uses up system memory until it goes loopy, unless you tell it not to by configuring the SQL Server "Maximum Server Memory" property.

Tuesday, March 20, 2012

parallel data load using bcp

i did a parallel load into a single table using bcp from 2 machines. as
suggested in the docs i used the TABLOCK hint. as a result i observed that:
a) first all the data from machine1 is inserted. When this is finished then
all the data from machine2 is inserted
b) i don't see any parallelism in this . Is there any other way of acheiving
true paralellism.
NOTE: SQL Server is running on a dual cpu machine
Vivek T S
Member Technical Staff (Inucom)
Did you satisfy all the other requirements for parallel bulk loading?
Database is using BULK_LOGGED or SIMPLE recovery model and the destination
table does not have any indexes?
GertD@.SQLDev.Net
Please reply only to the newsgroups.
This posting is provided "AS IS" with no warranties, and confers no rights.
You assume all risk for your use.
Copyright SQLDev.Net 1991-2004 All rights reserved.
"Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
news:409D8E47-D422-48C7-B076-0A9CAE5D39AE@.microsoft.com...
> i did a parallel load into a single table using bcp from 2 machines. as
> suggested in the docs i used the TABLOCK hint. as a result i observed
> that:
> a) first all the data from machine1 is inserted. When this is finished
> then
> all the data from machine2 is inserted
> b) i don't see any parallelism in this . Is there any other way of
> acheiving
> true paralellism.
> NOTE: SQL Server is running on a dual cpu machine
> --
> Vivek T S
> Member Technical Staff (Inucom)
|||iam using Simple recovery model. the target table does not have any indexes
(and is empty). what are the other requirements for parallel bulk loading ?
"Gert E.R. Drapers" wrote:

> Did you satisfy all the other requirements for parallel bulk loading?
> Database is using BULK_LOGGED or SIMPLE recovery model and the destination
> table does not have any indexes?
> GertD@.SQLDev.Net
> Please reply only to the newsgroups.
> This posting is provided "AS IS" with no warranties, and confers no rights.
> You assume all risk for your use.
> Copyright ? SQLDev.Net 1991-2004 All rights reserved.
> "Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
> news:409D8E47-D422-48C7-B076-0A9CAE5D39AE@.microsoft.com...
>
>
|||iam using the Simple recovery model. The target table does not have indexes
(and is empty). What are the other reuquirements for parallel bulk loading ?
thanks.
"Gert E.R. Drapers" wrote:

> Did you satisfy all the other requirements for parallel bulk loading?
> Database is using BULK_LOGGED or SIMPLE recovery model and the destination
> table does not have any indexes?
> GertD@.SQLDev.Net
> Please reply only to the newsgroups.
> This posting is provided "AS IS" with no warranties, and confers no rights.
> You assume all risk for your use.
> Copyright ? SQLDev.Net 1991-2004 All rights reserved.
> "Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
> news:409D8E47-D422-48C7-B076-0A9CAE5D39AE@.microsoft.com...
>
>
|||This ought to work. Are you using the version of BCP that shipped with SQL
2000?
Hope this helps.
Dan Guzman
SQL Server MVP
"Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
news:3728504E-A17E-414A-BF02-3CF45291C45D@.microsoft.com...[vbcol=seagreen]
> iam using Simple recovery model. the target table does not have any
> indexes
> (and is empty). what are the other requirements for parallel bulk loading
> ?
> "Gert E.R. Drapers" wrote:
|||Look up "minimally logged bulk copy" in BOL for the requirements.
Andrew J. Kelly SQL MVP
"Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
news:3728504E-A17E-414A-BF02-3CF45291C45D@.microsoft.com...
> iam using Simple recovery model. the target table does not have any
indexes
> (and is empty). what are the other requirements for parallel bulk loading
?[vbcol=seagreen]
> "Gert E.R. Drapers" wrote:
destination[vbcol=seagreen]
rights.[vbcol=seagreen]
as[vbcol=seagreen]

parallel data load using bcp

i did a parallel load into a single table using bcp from 2 machines. as
suggested in the docs i used the TABLOCK hint. as a result i observed that:
a) first all the data from machine1 is inserted. When this is finished then
all the data from machine2 is inserted
b) i don't see any parallelism in this . Is there any other way of acheiving
true paralellism.
NOTE: SQL Server is running on a dual cpu machine
--
Vivek T S
Member Technical Staff (Inucom)Did you satisfy all the other requirements for parallel bulk loading?
Database is using BULK_LOGGED or SIMPLE recovery model and the destination
table does not have any indexes?
GertD@.SQLDev.Net
Please reply only to the newsgroups.
This posting is provided "AS IS" with no warranties, and confers no rights.
You assume all risk for your use.
Copyright © SQLDev.Net 1991-2004 All rights reserved.
"Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
news:409D8E47-D422-48C7-B076-0A9CAE5D39AE@.microsoft.com...
> i did a parallel load into a single table using bcp from 2 machines. as
> suggested in the docs i used the TABLOCK hint. as a result i observed
> that:
> a) first all the data from machine1 is inserted. When this is finished
> then
> all the data from machine2 is inserted
> b) i don't see any parallelism in this . Is there any other way of
> acheiving
> true paralellism.
> NOTE: SQL Server is running on a dual cpu machine
> --
> Vivek T S
> Member Technical Staff (Inucom)|||iam using Simple recovery model. the target table does not have any indexes
(and is empty). what are the other requirements for parallel bulk loading ?
"Gert E.R. Drapers" wrote:
> Did you satisfy all the other requirements for parallel bulk loading?
> Database is using BULK_LOGGED or SIMPLE recovery model and the destination
> table does not have any indexes?
> GertD@.SQLDev.Net
> Please reply only to the newsgroups.
> This posting is provided "AS IS" with no warranties, and confers no rights.
> You assume all risk for your use.
> Copyright © SQLDev.Net 1991-2004 All rights reserved.
> "Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
> news:409D8E47-D422-48C7-B076-0A9CAE5D39AE@.microsoft.com...
> >
> > i did a parallel load into a single table using bcp from 2 machines. as
> > suggested in the docs i used the TABLOCK hint. as a result i observed
> > that:
> > a) first all the data from machine1 is inserted. When this is finished
> > then
> > all the data from machine2 is inserted
> > b) i don't see any parallelism in this . Is there any other way of
> > acheiving
> > true paralellism.
> >
> > NOTE: SQL Server is running on a dual cpu machine
> > --
> > Vivek T S
> > Member Technical Staff (Inucom)
>
>|||This ought to work. Are you using the version of BCP that shipped with SQL
2000?
--
Hope this helps.
Dan Guzman
SQL Server MVP
"Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
news:3728504E-A17E-414A-BF02-3CF45291C45D@.microsoft.com...
> iam using Simple recovery model. the target table does not have any
> indexes
> (and is empty). what are the other requirements for parallel bulk loading
> ?
> "Gert E.R. Drapers" wrote:
>> Did you satisfy all the other requirements for parallel bulk loading?
>> Database is using BULK_LOGGED or SIMPLE recovery model and the
>> destination
>> table does not have any indexes?
>> GertD@.SQLDev.Net
>> Please reply only to the newsgroups.
>> This posting is provided "AS IS" with no warranties, and confers no
>> rights.
>> You assume all risk for your use.
>> Copyright © SQLDev.Net 1991-2004 All rights reserved.
>> "Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
>> news:409D8E47-D422-48C7-B076-0A9CAE5D39AE@.microsoft.com...
>> >
>> > i did a parallel load into a single table using bcp from 2 machines. as
>> > suggested in the docs i used the TABLOCK hint. as a result i observed
>> > that:
>> > a) first all the data from machine1 is inserted. When this is finished
>> > then
>> > all the data from machine2 is inserted
>> > b) i don't see any parallelism in this . Is there any other way of
>> > acheiving
>> > true paralellism.
>> >
>> > NOTE: SQL Server is running on a dual cpu machine
>> > --
>> > Vivek T S
>> > Member Technical Staff (Inucom)
>>|||Look up "minimally logged bulk copy" in BOL for the requirements.
--
Andrew J. Kelly SQL MVP
"Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
news:3728504E-A17E-414A-BF02-3CF45291C45D@.microsoft.com...
> iam using Simple recovery model. the target table does not have any
indexes
> (and is empty). what are the other requirements for parallel bulk loading
?
> "Gert E.R. Drapers" wrote:
> > Did you satisfy all the other requirements for parallel bulk loading?
> > Database is using BULK_LOGGED or SIMPLE recovery model and the
destination
> > table does not have any indexes?
> >
> > GertD@.SQLDev.Net
> >
> > Please reply only to the newsgroups.
> > This posting is provided "AS IS" with no warranties, and confers no
rights.
> > You assume all risk for your use.
> > Copyright © SQLDev.Net 1991-2004 All rights reserved.
> >
> > "Vivek T S" <VivekTS@.discussions.microsoft.com> wrote in message
> > news:409D8E47-D422-48C7-B076-0A9CAE5D39AE@.microsoft.com...
> > >
> > > i did a parallel load into a single table using bcp from 2 machines.
as
> > > suggested in the docs i used the TABLOCK hint. as a result i observed
> > > that:
> > > a) first all the data from machine1 is inserted. When this is finished
> > > then
> > > all the data from machine2 is inserted
> > > b) i don't see any parallelism in this . Is there any other way of
> > > acheiving
> > > true paralellism.
> > >
> > > NOTE: SQL Server is running on a dual cpu machine
> > > --
> > > Vivek T S
> > > Member Technical Staff (Inucom)
> >
> >
> >