Download SSIS Packages

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project

Document related concepts
no text concepts found
Transcript
The ABC of ETL with SSIS
James Beresford
www.bimonkey.com
AIM
To cover the basics of ETL
using Microsoft BI tools
Agenda
 Tools
 Database Structure
 SSIS
 Package Level
 Components
SQL Server Tools for ETL
SQL Server
GUI Tools
Command
Line
• Database Engine
• Integration Server
• SQL Agent
• SSMS: SQL Server Management Studio
• BIDS: Business Intelligence Development Studio
• SQL Profiler
• dtexec
• dtutil
SQL Server
•Database Engine
stores data – optional
•Integration Server
executes packages
•SQL Agent
schedules packages - optional
GUI Tools – SSMS
GUI Tools – BIDS
Where you will spend 95% of your time
GUI Tools – SQL Profiler
Command Line
dtutil - moves
dtexec - does
Database Structure
Audit and Control
Staging
Persistent
Consumed
Control Structures
Audit and Control
Control Mechanisms
Logging
Deployment
BIDS doesn’t work properly!
Use dtutil batch scripts
Deployment
File System
vs
Package Store
vs
SQL Server
Execution
Create an Execution Account
Do not use SA account
SSIS
SSIS functional units are Packages…
…then within Packages:
Control Flow
Data Flow
SSIS Packages
• Connection managers
• Checkpoints
• Event Handlers
• Configurations
• Variables & Expressions
• Logging
Connection Managers
Components which refer to a data source or destination
Checkpoints
Key Properties at Package Level:
• CheckpointFileName
• CheckpointUsage
• SaveCheckpoints
FailPackageOnFailure = True for all restart points
Event Handlers
As packages execute, a series of events occur, e.g:
• Validation Completing
• Errors
• Variable values changing
Configurations
Configurations are External Sources
of
Package Execution Settings
Variables & Expressions
Variables provide changeable
values to be used by packages
SSIS has its own expression
language
Logging
Logging Providers record execution details
SSIS Packages
Control Flow
&
Data Flow
Control Flow
Mission Control!
Control Flow
Containers
Precedence Constraints
Non Data Tasks
Containers
Provide looping
Support Transactions
Precedence Constraints
Control flow of package
Success / Failure & Expressions
Non Data Tasks
• Execute SQL
• Execute Package
• FTP
• Send Mail
• Process SSAS Objects
• etc…
Data Flow
• Sources and Destinations
• SCD
• Lookup
• Data Conversion
• Derived Columns
• OLEDB Command
• Custom components
Learning Resources
learnintegrationservices.com
http://blogs.conchango.com/jamiethomson/
Related documents