TB119 Performance Regression May Occur When Masking String Data
Alert Type
Functional Regression
Impact
Continuous Compliance Engines may see significant performance reductions in database masking jobs that operate on certain String data types. Worst-case performance of masking jobs is 25% of normal, i.e., masking jobs may take up to four times as long.
Correctness of masking results is not impacted.
This issue does not affect the performance of file or mainframe dataset masking.
Contributing Factors
This article applies to the following versions of Delphix engines:
Date | Release |
---|---|
Apr 17, 2024 | 22.0.0.0 |
Mar 20, 2024 | Apr 2, 2024 | 21.0.0.0 | 21.0.0.1 |
Feb 21, 2024 | 20.0.0.0 |
Only Continuous Compliance Engines are affected by the issue.
The issue may affect a large spectrum of jobs involving masking of string data such as varchar types. Character String data encoded in CHAR, VARCHAR, or TEXT (non-Unicode) is affected. Strings encoded in Unicode are not impacted, nor are non-String types such as DATE and INT.
The issue is known to affect all Advanced and Basic connectors.
Oracle and MS SQL Server connectors are known to be affected by the issue, and it's presumed that a broad collection of other connector types could be similarly affected.
Performance degrades as more columns are involved in masking affected String types. For example, masking ten such columns may result in twice the performance degradation as masking four columns.
Symptoms
Jobs may take significantly longer than they took before upgrading to an affected release.
Relief/Workaround
Defer upgrades of Continuous Compliance engines to any of the affected releases.
For systems already running an affected release, upgrading to 22.0.0.1 or later will correct the issue.
Resolution
The issue is resolved in DevOps Data Platform release 22.0.0.1 (May 8, 2024) and subsequent releases.
Additional Information
N/A
Related Documents
N/A