Skip to main content
This gem runs in the SQL warehouse.

Overview

Use the DataCleansing gem to standardize data formats and address missing or null values in the data.
The DataCleansing gem has a corresponding interactive gem example. See Interactive gem examples to learn how to run sample pipelines for this and other gems.

Prerequisites

  • Add prophecy_basics package version 1.0.0 or higher to your project.

Parameters

Example

Assume you have a dataset that includes all entries from a feedback survey.
The following is one way to configure a DataCleansing gem for this table:
  1. Select columns to clean: Name
  2. Replace null values in column: Not provided
  3. Modify case: Title Case

Result

After the transformation, the table will look like: