Amazon Redshift external table gem

Create a Redshift gem

To create a Redshift Source or Target gem in your pipeline:

Add a Source or Target gem to the pipeline

Open your pipeline in the Studio.
Click on Source/Target in the canvas.
Select Source or Target from the dropdown.
Click on the gem to open the configuration.

Select Redshift format

In the Type tab, select Redshift. Then, click Next.

Set location details

In the Location tab, set your connection details and table location. To learn more, jump to Source location and Target location.

Set table properties

In the Properties tab, set the table properties. To learn more, jump to Source properties and Target properties.

Preview data (Source only)

In the Preview tab, load a sample of the data and verify that it looks correct.

Source configuration

Use these settings to configure a Redshift Source gem for reading data.

Source location

Parameter	Description
Format type	Table format for the source. For Amazon Redshift tables, set to `redshift`.
Select or create connection	Select or create a new Redshift connection in the Prophecy fabric you will use.
Database	Database containing the table you want to read from.
Schema	Schema within the database where the table is located.
Name	Exact name of the Amazon Redshift table to read data from.

Source properties

Infer or manually configure the schema of your Source gem. Optionally, add a description for your table. Additional properties are not supported at this time.

Target configuration

Use these settings to configure a Redshift Target gem for writing data.

Target location

Parameter	Description
Format type	Table format for the source. For Amazon Redshift tables, set to `redshift`.
Select or create connection	Select or create a new Amazon Redshift connection in the Prophecy fabric you will use.
Database	Database where the target table will be created or updated.
Schema	Schema within the database where the target table resides or will be created.
Name	Name of the Amazon Redshift table to write data to. If the table doesn’t exist, it will be created automatically.

Target properties

Property	Description	Default
Description	Description of the table.	None
Write Mode	Whether to overwrite the table, append new data to the table, or throw an error if the table exists.	None

Overview

Sources and targets

Data processing

Reporting

Advanced

Overview

Create a Redshift gem

Source configuration

Source location

Source properties

Target configuration

Target location

Target properties

​Overview

​Create a Redshift gem

​Source configuration

​Source location

​Source properties

​Target configuration

​Target location

​Target properties

Overview

Create a Redshift gem

Source configuration

Source location

Source properties

Target configuration

Target location

Target properties