Available for Enterprise Edition only.
- Output rows equality
- Output predicates
Output rows equality
Automatically takes a snapshot of the data for the component and allows to continuously test that the logic performs as intended. This would simply check the equality of the output rows.Example
In the below example we would create below unit tests:- To check the join condition correctly for one-to-one mappings.
- To check the join condition correctly for one-to-many mappings.
Output predicates
These are more advanced unit tests where multiple rules need to pass in order for the test as a whole to pass. Requires Spark expression to be used as predicates.Example
In the below example we will create below unit tests:- Check that the value of amount column is
>0. - Check whether first name is not equal to last name.
Generating sample data for test cases automatically
To generate sample input data automatically from the source DataFrame, this option can be enabled while creating unit test.Pipeline needs to run once, to generate units test based on auto-generated sample data.

