Skip to main content
Delphix

Masking and Transformation Order (DB) (KBA6208)

 

KBA

KBA# 6208

 

At a Glance

Summary: This page describes all transformation auxiliary jobs in a Database Masking Job and the execution sequence of these auxiliary jobs.
Auxiliary jobs: The Pre Auxiliary jobs are: 
  1. CREATE IDENTITY TRANSFORMATION (optional)
  2. DROP INDEX TRANSFORMATION
  3. PRESCRIPT TRANSFORMATION (see below)

Masking tables.

The Post Auxiliary jobs are: 
  1. POSTSCRIPT TRANSFORMATION  (see below)
  2. CREATE INDEX TRANSFORMATION
  3. DROP IDENTITY TRANSFORMATION
Pre/PostScript: The Pre- and PostScript Transformations (Auxiliary jobs) includes (in order): 
    a. Custom Scripts
    b. Triggers
    c. Constraints

 

This Knowledge Article describes the job execution and the order of sub auxiliary jobs.

Worth noting are: 

  • Only the masking operations are tracked in the Job Monitor.
  • The Auxiliary job might take a long time to complete (neither the progress nor any errors are indicated in the Job Monitor).

Transformation Order

 

KBA-Masking Transformations Pre Post.png

 

Pre Processing
1. CREATE IDENTITY TRANSFORMATION
2. DROP INDEX TRANSFORMATION
3. PRESCRIPT TRANSFORMATION
    a. Custom Scripts
    b. Disable Triggers
    c. Disable Constraints

Masking Transformation
1. INNER_JOB
    a. Mask Stream S0
        - Table/File 1, Table/File 2, ...
    b. Mask Stream S1
        - Table/File Tx, Table/File Tx+1, ...
    n. Mask Stream Sn
        - Table/File Ty, Table/File Ty+1, ...
    
Post Processing
1. POSTSCRIPT TRANSFORMATION
    a. Custom Scripts
    b. Enable Triggers
    c. Enable Constrains
2. CREATE INDEX TRANSFORMATION
3. DROP IDENTITY TRANSFORMATION

 

Main Masking Auxilary Job

Sub: INNER_JOB

The transformation INNER_JOB manages streams and the execution of each Masking transformation. 

Note

Note:

Details about which stream is used and the table/file order are unknown and can be different between executions. 

 

Auxiliary Jobs

Listed below are short descriptions of each auxiliary job.

Note

Notes:

  • These steps can take a long time.
  • These steps will neither show the Progress Bar nor any errors in the Job Monitor.

 

Sub: CREATE IDENTITY TRANSFORMATION

If a table does not have a Primary Key (PK), or a Logical Key has not been defined, the masking engine will create an Identity Column called 'DMS_ROW_ID' together with an Index called 'i_DMS_ROW_ID'. 

This feature is available on some database connectors. 

Additional note: Some databases (i.e. Oracle and DB2 (optional)) have an identifier that can be used as the Unique Row Identifier (URI). The identifier in Oracle is called ROWID and is technically the address to the record. If this identifier exists, it is best to set this column as the Logical Key in the Rule Set.

Sub: DROP INDEX TRANSFORMATION

If selected, and the feature is available, this transformation drops indexes on masked columns. 

Drop Indexes feature availability is dependent on the database connector type. It is executed through ALTER TABLE statements. 

The feature is a tickbox in the Job configuration popup. 

Sub: PRESCRIPT TRANSFORMATION

This transformation executes three SQL statements in the following order: 

  1. Custom (Pre) Script
  2. Disable Triggers 
  3. Disable Constrains

Disable Triggers/Constraints are dependent on the database connector type and executed through ALTER TABLE statements. 

Custom Pre-Script is a Transaction SQL script added in the Job configuration popup and the Disable Triggers and Disable Constraints features are enabled through tickboxes in the Job configuration popup. 

Note

Note:

Some of the Constraints might be implemented through an Index. To disable those, the index needs to be dropped. 

 

 

Sub: POSTSCRIPT TRANSFORMATION

This transformation executes three SQL statements in the following order: 

  1. Custom (Post) Script
  2. Enable Triggers
  3. Enable Constrains

Sub: CREATE INDEX TRANSFORMATION

If Drop Indexes is selected, any dropped indexes are re-enabled in this transformation. 

Sub: DROP IDENTITY TRANSFORMATION

If created in the first transformation, this transformation will drop the index 'i_DMS_ROW_ID' and the Identity column 'DMS_ROW_ID'.

Applicable Delphix Versions

Click here to view the versions of the Delphix engine to which this article applies
Major Release All Sub Releases
6.0 6.0.0.0, 6.0.1.0, 6.0.1.1, 6.0.2.0, 6.0.3.0, 6.0.4.0, 6.0.4.1, 6.0.4.2, 6.0.5.0

5.3

5.3.0.0, 5.3.0.1, 5.3.0.2, 5.3.0.3, 5.3.1.0, 5.3.1.1, 5.3.1.2, 5.3.2.0, 5.3.3.0, 5.3.3.1, 5.3.4.0, 5.3.5.0 5.3.6.0, 5.3.7.0, 5.3.7.1, 5.3.8.0, 5.3.8.1, 5.3.9.0

5.2

5.2.2.0, 5.2.2.1, 5.2.3.0, 5.2.4.0, 5.2.5.0, 5.2.5.1, 5.2.6.0, 5.2.6.1

5.1

5.1.0.0, 5.1.1.0, 5.1.2.0, 5.1.3.0, 5.1.4.0, 5.1.5.0, 5.1.5.1, 5.1.6.0, 5.1.7.0, 5.1.8.0, 5.1.8.1, 5.1.9.0, 5.1.10.0

5.0

5.0.1.0, 5.0.1.1, 5.0.2.0, 5.0.2.1, 5.0.2.2, 5.0.2.3, 5.0.3.0, 5.0.3.1, 5.0.4.0, 5.0.4.1 ,5.0.5.0, 5.0.5.1, 5.0.5.2, 5.0.5.3, 5.0.5.4

4.3

4.3.1.0, 4.3.2.0, 4.3.2.1, 4.3.3.0, 4.3.4.0, 4.3.4.1, 4.3.5.0

4.2

4.2.0.0, 4.2.0.3, 4.2.1.0, 4.2.1.1, 4.2.2.0, 4.2.2.1, 4.2.3.0, 4.2.4.0 , 4.2.5.0, 4.2.5.1

4.1

4.1.0.0, 4.1.2.0, 4.1.3.0, 4.1.3.1, 4.1.3.2, 4.1.4.0, 4.1.5.0, 4.1.6.0

 

 


Related Articles

The following articles may provide more information or related information to this article: