Ísis Santos Costa’s Reviews > The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling > Status Update
Ísis Santos Costa
is on page 525 of 608
p. 491
19 • ETL Subsystems and Techniques (cont.)
↳ The 34 Subsystems of ETL (cont.)
... ↳ Managing the ETL Environment (cont.)
... ... ⇒ Reliability
... ... ⇒ Availability
... ... ⇒ Manageability
... ... ↳ Subsystem 30: Problem Escalation System
— Jan 29, 2026 05:57AM
19 • ETL Subsystems and Techniques (cont.)
↳ The 34 Subsystems of ETL (cont.)
... ↳ Managing the ETL Environment (cont.)
... ... ⇒ Reliability
... ... ⇒ Availability
... ... ⇒ Manageability
... ... ↳ Subsystem 30: Problem Escalation System
Like flag
Ísis’s Previous Updates
Ísis Santos Costa
is on page 543 of 608
p. 509
20 • ETL System Design + Dev Process & Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop One-Time Historic Load Processing
... ... ↳ Step 6: Perform the Fact Table Historic Load (cont.)
... ... ... ↳ Fact Table Transformations
« A lot of time (is spent) improving the dimension table, facts usually require modest transformation. »
System values like -1 shall be replaced by NULL. All FKs be NOT NULL.
— 6 hours, 51 min ago
20 • ETL System Design + Dev Process & Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop One-Time Historic Load Processing
... ... ↳ Step 6: Perform the Fact Table Historic Load (cont.)
... ... ... ↳ Fact Table Transformations
« A lot of time (is spent) improving the dimension table, facts usually require modest transformation. »
System values like -1 shall be replaced by NULL. All FKs be NOT NULL.
Ísis Santos Costa
is on page 542 of 608
p. 508
20 • ETL System Design + Dev Process & Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop One-Time Historic Load Processing
... ... ↳ Step 6: Perform the Fact Table Historic Load
... ... ... ↳ Historic Fact Table Extracts
... ... ... ↳ Audit Statistics
It is not always possible to tie the data back to source systems; in these cases, it is crucial that reasons for differences be documented clearly.
— Feb 15, 2026 06:34AM
20 • ETL System Design + Dev Process & Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop One-Time Historic Load Processing
... ... ↳ Step 6: Perform the Fact Table Historic Load
... ... ... ↳ Historic Fact Table Extracts
... ... ... ↳ Audit Statistics
It is not always possible to tie the data back to source systems; in these cases, it is crucial that reasons for differences be documented clearly.
Ísis Santos Costa
is on page 541 of 608
p. 507
20 • ETL System Design + Dev Process & Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop One-Time Historic Load Processing
... ... ↳ Step 5: Populate Dim Tables w Historic Data (cont.)
... ... ... ↳ Dim Table Loading
... ... ... ↳ Load Type 2 Dimension Table History
... ... ... ↳ Populate Date and Other Static Dimensions
— Feb 14, 2026 05:58AM
20 • ETL System Design + Dev Process & Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop One-Time Historic Load Processing
... ... ↳ Step 5: Populate Dim Tables w Historic Data (cont.)
... ... ... ↳ Dim Table Loading
... ... ... ↳ Load Type 2 Dimension Table History
... ... ... ↳ Populate Date and Other Static Dimensions
Ísis Santos Costa
is on page 540 of 608
p. 506
20 • ETL System Design + Dev Process & Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop One-Time Historic Load Processing
... ... ↳ Step 5: Populate Dim Tables w Historic Data
... ... ... ↳ Populate Type 1 Dim Tables
... ... ... ↳ Dim Transformations
➤ Simple Data Transformations
➤ Combine from Separate Sources
➤ Decode Production Codes
➤ Validate M2M one-to-one
➤ Dimension Surrogate Key Assignment
— Feb 10, 2026 09:06AM
20 • ETL System Design + Dev Process & Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop One-Time Historic Load Processing
... ... ↳ Step 5: Populate Dim Tables w Historic Data
... ... ... ↳ Populate Type 1 Dim Tables
... ... ... ↳ Dim Transformations
➤ Simple Data Transformations
➤ Combine from Separate Sources
➤ Decode Production Codes
➤ Validate M2M one-to-one
➤ Dimension Surrogate Key Assignment
Ísis Santos Costa
is on page 536 of 608
p. 502
20 • ETL System Design and Development Process and Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop the ETL Plan (cont.)
... ... ↳ Step 4: Drill Down by Target Table (cont.)
... ... ... ↳ Develop the ETL Specification Document
➤ Develop a Sandbox Source System
— Feb 08, 2026 04:29AM
20 • ETL System Design and Development Process and Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop the ETL Plan (cont.)
... ... ↳ Step 4: Drill Down by Target Table (cont.)
... ... ... ↳ Develop the ETL Specification Document
➤ Develop a Sandbox Source System
Ísis Santos Costa
is on page 535 of 608
p. 501
20 • ETL System Design and Development Process and Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop the ETL Plan (cont.)
... ... ↳ Step 4: Drill Down by Target Table
... ... ... ↳ Ensure Clean Hierarchies*
... ... ... ↳ Develop Detailed Table Schematics
« *If the source is an Excel spreadsheet on a business user's desktop—you must either clean it up or acknowledge that it is not a hierarchy. »
— Feb 07, 2026 09:43AM
20 • ETL System Design and Development Process and Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop the ETL Plan (cont.)
... ... ↳ Step 4: Drill Down by Target Table
... ... ... ↳ Ensure Clean Hierarchies*
... ... ... ↳ Develop Detailed Table Schematics
« *If the source is an Excel spreadsheet on a business user's desktop—you must either clean it up or acknowledge that it is not a hierarchy. »
Ísis Santos Costa
is on page 534 of 608
p. 500
20 • ETL System Design and Development Process and Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop the ETL Plan (cont.)
... ... ↳ Step 3: Develop Default Strategies
... ... ... ↳ Extract
... ... ... ↳ Keep extracted & staged d
... ... ... ↳ Police dim, fact DQ
... ... ... ↳ Manage changes to attributes
... ... ... ↳ Ensure availability
... ... ... ↳ Design auditing
... ... ... ↳ Organize the staging
— Feb 06, 2026 05:33AM
20 • ETL System Design and Development Process and Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop the ETL Plan (cont.)
... ... ↳ Step 3: Develop Default Strategies
... ... ... ↳ Extract
... ... ... ↳ Keep extracted & staged d
... ... ... ↳ Police dim, fact DQ
... ... ... ↳ Manage changes to attributes
... ... ... ↳ Ensure availability
... ... ... ↳ Design auditing
... ... ... ↳ Organize the staging
Ísis Santos Costa
is on page 532 of 608
p. 499
20 • ETL System Design and Development Process and Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop the ETL Plan (cont.)
... ... ↳ Step 2: Choose an ETL Tool
« Don't expect to recoup the investment in an ETL tool (fast). (Sometimes it feels it'd be) implemented faster by coding. The big advantages come with future phases, and particularly with future modifications to existing systems. »
— Feb 05, 2026 11:22AM
20 • ETL System Design and Development Process and Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop the ETL Plan (cont.)
... ... ↳ Step 2: Choose an ETL Tool
« Don't expect to recoup the investment in an ETL tool (fast). (Sometimes it feels it'd be) implemented faster by coding. The big advantages come with future phases, and particularly with future modifications to existing systems. »
Ísis Santos Costa
is on page 532 of 608
p. 498
20 • ETL System Design and Development Process and Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop the ETL Plan
... ... ↳ Step 1: Draw the High-Level Plan
« (it) deliberately highlights contemporary questions and unresolved issues; (...) frequently updated and released. You might sometimes keep two versions (work & communication). »
— Feb 03, 2026 05:14AM
20 • ETL System Design and Development Process and Tasks (cont.)
↳ ETL Process Overview (cont.)
... ↳ Develop the ETL Plan
... ... ↳ Step 1: Draw the High-Level Plan
« (it) deliberately highlights contemporary questions and unresolved issues; (...) frequently updated and released. You might sometimes keep two versions (work & communication). »
