Skip to main content
When you migrate an DataStage workflow to a Prophecy pipeline, the transpiler first reads uploaded files. Then, the transpiler internally maps the DataStage components to the Prophecy-supported gems to create the visual pipeline and open-source code. DataStage components are a core part of the workflow. They perform data operations such as reading data from the source table, performing transformations, and writing data into the destination table. The following tables list all the DataStage components that Prophecy supports and the corresponding Prophecy gem it maps to in a Spark project:

​
Pipeline Components

Below is a list of DataStage workflow components that are supported by Prophecy and have corresponding Prophecy gems. These components are core part of the workflow as they perform data operations like reading data from source table, performing transformations, and writing data into the destination table.

​
Orchestration Components

The following table describes components of DataStage sequence jobs that can be migrated to Prophecy. Note that all jobs are converted into Airflow jobs in Prophecy.
If you don’t see a particular component on this list, you can include custom abilities beyond custom scripting. To learn more, see Gem Builder for Spark.