Download Creating Simple and Parallel Data Loads With DTS

Creating Simple and
Parallel Data Loads
With DTS
DTS Package Components

Connections Access Data Sources and Destinations

Tasks Describe Data Transformations or Functions

Steps Define the Order of Task Operations or Workflow

Global Variables Store Data that Can Be Shared Across
Tasks
Using DTS to Load the Product Dimension
DTS
SQL Server
Polaris Database
SQL Server
Northwind Database
Understanding Connections



Possible Data Sources

OLE DB – Microsoft Data Access Components + 3rd Party

ODBC – Microsoft Data Access Components + 3rd Party
Types of Connections

File connections – Access, Excel, delimited, fixed width files

Database connections – SQL Server, Oracle

Microsoft Data Links – UDL files
Connection Information Stored in the Package
Task Groups

Tasks That Transform Data

Tasks That Copy and Manage Data

Tasks That Function As Jobs
Supplied tasks AND user-defined custom tasks…
Tasks That Transform Data

Transform Data Task Transforms and Inserts Data

Data Driven Query Task Performs Flexible
Transact-SQL Operations

ParallelDataPumpTask Processes Hierarchical
Rowsets
Tasks That Copy and Manage Data

Bulk Insert Task Loads Files into
SQL Server

Transfer Jobs Task Copies
SQL Server Agent Jobs

Execute SQL Task Runs SQL
Statements

Transfer Logins Task Copies
SQL Server Logins

Copy SQL Server Objects Task
Copies Objects Between
SQL Server Databases

Transfer Master Stored Procedures
Task Copies SQL Server Master
Database Stored Procedures

Transfer Databases Task Copies a
SQL Server Database

Transfer Error Messages Task
Copies SQL Server User-specified
Error Messages
Tasks That Function As Jobs

ActiveX Script Task Performs UserDefined Logic

Execute Process Task Runs
Executable Files

FTP Task Transfers Files


Analysis Services Task Processes
Cubes
Message Queue Task Sends
and Receives Messages

Data Mining Task Processes Data
Mining Models
Execute Package Task Executes
DTS Packages

Dynamic Properties Task
Changes Package Properties


Send Mail Task Sends Email
Messages
Defining Step Components

A Task Determines the Action of a Step

Precedence Constraints Define When a Step Executes

Types of Precedence Constraints


On Completion

On Success

On Failure
Step Execution Based on Precedence

Using zero, one, or multiple precedence constraints

Satisfying all precedence constraint conditions
Advanced Step Properties (Workflow Properties)


Transaction Settings

Joining a step to package transaction

Committing a transaction

Rolling back a transaction
Execution Settings

Executing a step on the main package thread

Failing a package based on step failure

Disabling a step
Storing and Executing Packages


Storing Packages

SQL Server

SQL Server Meta Data Services

Structured storage file

Visual Basic file
Executing Packages

Executing packages interactively

Reviewing execution results
Creating Parallel Data Loads
DTS
Add a parallel data load
to product_dim
Excel
Polaris
SQL
Server
Pitfalls and Guidelines for Parallel Task Execution
Pitfall
Guideline
Do Not Reuse Connections
Among Tasks that Need to
Run in Parallel
Use Separate Connections
Verify Max Number of Tasks
Executed in Parallel
Rule of Thumb = 2 x the
Number of Processors
Custom Tasks Created in
Visual Basic Do Not Support
Parallel Execution
Execute VB Tasks on the
Main Package Thread
Some OLE DB Providers Do
Not Support Parallelism
Verify that the OLE DB
Provider Supports Parallelism