Skip to main content
You can add a source table to your primary SQL warehouse by uploading a file directly onto the visual canvas. This gives you greater control over your data and how you incorporate it into your model transformation. When you upload your file through Prophecy, it’s added directly to your SQL warehouse as a table.
The recommended maximum file size is 100 MB.
You can upload the following file formats:
  • CSV
  • Excel (XLS, XLSX)
  • JSON
  • Parquet
  • XML

​
File upload

To upload your file:
  1. Open a pipeline.
  2. Drag and drop your file onto the canvas. This opens a new Source gem.
Upload file by dragging and dropping

​
Type and format

Once the Source gem opens, you can review the type and format of the file.
  1. Optional: Replace or delete your uploaded file.
  2. Optional: Change the type and format of the file.
  3. Click Next.
Select your file type and format

​
Location

Now, set the location where the table will be stored in the primary SQL warehouse configured in your fabric.
  1. Choose the database.
  2. Choose the schema.
  3. Choose the table. You can either select an existing table or create a new one.
Select the table location
If you select an existing table, Prophecy deletes and recreates the table with your uploaded file.

​
Properties

You can configure the table properties before completing the file upload.
  1. Review the file’s options. Depending on the file type and format, common defaults are already chosen for you.
  2. Optional: Modify the options. For example, you can change the header row by selecting First row is header.
  3. Optional: If you made any changes to the options, click Infer Schema. This will update the schema according to the defined options.
Configure the table properties
Excel files (XLS, XLSX) expose additional options in the Properties panel:After you configure these options, click Infer Schema to populate the column list. Column names, types (such as String or Bigint), and other metadata are editable.

​
Extract multiple tables from one workbook

You can mark multiple regions of an Excel workbook as separate tables. Each marked table becomes its own output port on the gem, and you can:
  • Edit the schema for each table independently.
  • Set drift-handling behavior per table.
  • Unmark or delete a table you no longer need.

​
Preview

The preview step shows your table data and gives you the option to download it.
  1. To generate the preview, click Load. This loads the data.
  2. Check that your preview looks correct and click Done.
  3. If you selected a table to write your uploaded file to, you’ll need to confirm the upload in the pop-up window by clicking Proceed.
Preview the table
For Excel files, the preview grid loads additional rows and columns as you scroll, rather than fetching the entire sheet at once. Merged cells and blank rows in the source sheet are handled automatically.
The new table is now in your environment and available in Source/Target gems. You can upload another file or start working with your new source gem.

​
Connect extracted tables to your pipeline

Once a table is extracted, connect it into the canvas like any other dataset using the standard add-connection menu. Hover over an output port to see a schema hint before connecting it.