Prerequisites
Prophecy connects to PostgreSQL using the database credentials you provide. These credentials are used to authenticate your session and authorize all data operations during pipeline execution. To use a Postgres connection effectively, your user account must have:SELECT,INSERT,UPDATE, andDELETEon the tables used in your Prophecy pipelines.- Access to the database and schema where tables are located.
Feature support
The table below outlines whether the connection supports certain Prophecy features.| Feature | Supported |
|---|---|
| Read data with a Source gem | Yes |
| Write data with a Target gem | Yes |
| Browse data in the Environment browser | Yes |
| Index tables in the Knowledge Graph | Optional |
Connection parameters
To create a connection with PostgreSQL, enter the following parameters:| Parameter | Description |
|---|---|
| Connection Name | Name to identify your connection |
| Server | Address of the PostgreSQL server |
| Port | Port to use for the connection |
| Database | PostgreSQL database name |
| Username | Username for your PostgreSQL instance |
| Password (Secret required) | Password for your PostgreSQL instance |
| Knowledge Graph Indexer | Enable or disable Knowledge Graph indexing |
Data type mapping
When Prophecy processes data from PostgreSQL using SQL warehouses such as Databricks or BigQuery, it converts PostgreSQL-specific data types to formats compatible with your target warehouse. This table shows common mappings and may vary depending on your configured warehouse.| PostgreSQL | Databricks | BigQuery |
|---|---|---|
| smallint | INT Alias: Integer | INT64 Alias: Integer |
| integer | INT Alias: Integer | INT64 Alias: Integer |
| bigint | BIGINT Alias: Bigint | INT64 Alias: Integer |
| decimal / numeric | DOUBLE Alias: Double | FLOAT64 Alias: Float |
| real | DOUBLE Alias: Double | FLOAT64 Alias: Float |
| double precision | DOUBLE Alias: Double | FLOAT64 Alias: Float |
| boolean | BOOLEAN Alias: Boolean | BOOL Alias: Boolean |
| char | STRING Alias: String | STRING Alias: String |
| varchar | STRING Alias: String | STRING Alias: String |
| text | STRING Alias: String | STRING Alias: String |
| date | TIMESTAMP Alias: Timestamp | TIMESTAMP Alias: Timestamp |
| time | TIMESTAMP Alias: Timestamp | TIMESTAMP Alias: Timestamp |
| timestamp | TIMESTAMP Alias: Timestamp | TIMESTAMP Alias: Timestamp |
| timestamptz | TIMESTAMP Alias: Timestamp | TIMESTAMP Alias: Timestamp |
| bytea | BINARY Alias: Binary | BYTES Alias: Bytes |
| uuid | STRING Alias: String | STRING Alias: String |
| json / jsonb | STRING Alias: String | STRING Alias: String |
Learn more in Supported data types.

