Skip to main content
Delphix

Algorithm: Summary (KBA4066)

 

KBA

KBA# 4066

At a Glance  

Versions: Applicable Delphix Masking versions: 4.x, 5.0.x, 5.1.x, 5.2.x, 5.3.x
Location: UI: Settings - Algorithms
UI: Settings - Custom Algorithms
Algorithm Types:
  • Predefined Out-of-the-Box Algorithms.
  • Customer created using Delphix Algorithm Framework.
  • Custom Algorithms1.

1Custom Algorithms, are created by Delphix Techincal Services or by one of our partners. These were previously called Mapplets

Predefined Out of the Box Algorithms 

These algorithms are predefined, Out-of-the-Box and ready to be used upon deployment of the Delphix Masking Engine. There are a total of 30 predefined algorithms, which are grouped below by algorithm type.  

Algorithm Count Type Ref.Int. Mapping Encoding Docs
Date Shift (Discrete) - Code based Yes No ASCII Num KBA1812
Date Shift (Fixed) - Code based Yes Yes ASCII Num KBA1812
Date Shift (Variable) - Code based No Random ASCII Num KBA1812
Secure Lookup 21 Lookup Yes No ASCII KBA1243
Tokenization  3 Code based Yes Yes ASCII * KBA1002
Credit Card - Code based No Random ASCII Num KBA4068
Zip-4 - Code based Yes No ASCII Num KBA4071
Secure Shuffle - Code based No No Any KBA4088
  • Count - The number of Out-of-the-Box algorithms using this algorithm type. Where a specific algorithm is documented a '-' is used. 
  • Type - How the masked value is generated:
    • Code based - uses a hard-coded algorithm.
    • Lookup - uses a hashed lookup table.  
  • Ref.Int: - Referential Integrity - This defines that the input value will be masked to the same output value, even across tables and between different job executions.
  • Mapping - Describes if the algorithm will map input values to a unique masked value.
    • Yes - means the mapping is unique. (For example, only the value Fred will mask to George). 
    • No - means that the mapping isn't unique and collisions are possible/likely. (Multiple input values could mask to the same masked value).  
    • Random - means that the output value is randomly generated so it is indeterminate, but not guaranteed to be unique within a single run or between runs. 
  • Encoding - The output character encoding. 
  • Docs - Links to more specific information about the algorithm.  

* Note: When the algorithm is used in masking, the encoding is only ASCII. When this algorithm is used in Tokenization, it works on all encodings. 

Customer Created using Delphix Algorithm Frameworks 

These algorithms are versions of the basic algorithm types defined by the engine's framework that the customer creates according to their own needs.  For example, a customer can create their own version of a secure lookup algorithm by supplying their own lookup file.

Algorithm Type Ref.Int Mapping Encoding Lookup Limit Docs
Binary Lookup Lookup Yes -- Binary - TBC
Data Cleansing Lookup Yes Yes All < 500,000 TBC
Free Text Redaction Lookup Yes -- All1 - TBC
Mapping Lookup Yes Yes All < 5,000,000 KBA1328
Min-Max Code based Yes No US-ASCII 7 Not applicable KBA1754
Secure Lookup Lookup Yes No All < 500,000 KBA1243
Segment Mapping Lookup Yes Yes US-ASCII 7 < 10,000 KBA1775
Tokenization Code based Yes Yes All / US-ASCII 7 No limit KBA1002
  • Type - How the masked value is generated:
    • Code based - uses a hard-coded algorithm.
    • Lookup - uses a hashed lookup table.  
  • Ref.Int: - Referential Integrity - This defines that the input value will be masked to the same output value, even across tables and between different job executions.
  • Mapping - Describes if the algorithm will map input values to a unique masked value.
    • Yes - means the mapping is unique. (For example, only the value Fred will mask to George). 
    • No - means that the mapping isn't unique and collisions are possible/likely. (Multiple input values could mask to the same masked value).  
    • Random - means that the output value is randomly generated so it is indeterminate, but not guaranteed to be unique within a single run or between runs. 
  • Encoding - The output character encoding. 
  • Docs - Links to more specific information about the algorithm.  

 1 Encoding - Words in Free Text Redaction have to be separated by space (or be the first or last word). This might limit the use in some languages where words are represented by one single character. 

Custom Algorithms 

If none of the Algorithms above meet your needs, you might need to get Delphix or a Delphix Partner to create a Custom Algorithm.

Examples of special requirements can be:

  • Retaining case from input to masked value.
  • Masking of consistently different fields with first, surname and full name.
  • Masking large lookup pool of Credit Card number or ID numbers containing special rules or mathematical formula. 
  • Addresses with locality rules. 
  • Multi-data type fields - for example, phone, mobile, and email in the same field.

 

Related Articles