Skip to main content
This gem runs in .

Overview

In Prophecy, datasets stored in the SQL Warehouse Connection defined in your fabric are accessed using Table gems. Unlike Source and Target gems, Table gems run directly within the data warehouse, eliminating extra orchestration steps and improving performance. This page explains how to read from a Snowflake table, view, or seed using the Table gem. To write to a Snowflake table or view instead, see Write to Snowflake tables.

Table types

The following table types are supported for Snowflake connections.

Configure table

Once you create a Table gem, you can reuse the table throughout your project. All created tables appear in the Project tab in the left sidebar. To read from a table in your pipeline:
1

Add a table gem to the pipeline

  1. Open your pipeline in the Studio.
  2. Click on Source/Target in the canvas.
  3. Select Table from the dropdown.
  4. Click on the gem to open the configuration.
2

Select a table

Choose the table, view, or seed you want to read from the list.
Seeds configure differently from Tables and Views — see Configure seeds below.
3

Configure location

Specify the table’s location using database, schema, and name.
For a View, enter the database, schema, and view name here instead.
4

Configure properties

Define or infer schema. Add a description if needed.
5

Preview data

Load a sample of the data before saving.
For a View, this loads data based on the view’s underlying query rather than stored data.
6

(Optional) Create and run data tests for the table

See Table tests vs. project tests to decide which approach fits your validation needs.

Configure seeds

Seeds are lightweight CSV datasets defined in your project. Seeds are source-only.
Seeds are implemented as dbt seeds under the hood. The CSV data you define is stored in your Prophecy project files and materialized as a table in your Snowflake data warehouse. This table is created in the default database and schema specified in your Snowflake connection.

Reusing and sharing tables

After you create a table in Prophecy, you can reuse its configuration across your entire project. All created tables appear in the Project tab in the left sidebar. To make tables available to other teams, you can share your project as a package in the Package Hub. Other users will be able to use the shared table configuration, provided they have the necessary permissions in Snowflake to access the underlying data.

Limitations

Currently, Snowflake tables do not support:
  • Case-sensitive identifiers.
  • Creating new partitioned tables.
  • Modifying partitioning of existing tables.