Skip to main content
The easiest way to add data sources to your pipeline is through the Environment tab in the left sidebar. This method automatically configures the gem settings, so you can start using the data immediately without manually creating and configuring Source and Table gems.

​
Add data from the Environment tab

The Environment tab displays all tables and files available through connections defined in your attached fabric. You can browse by connection type or use the search bar to find specific datasets.
1

Open the Environment tab

  1. Open your pipeline in the Studio.
  2. Click the Environment tab in the left sidebar.
  3. Expand the connection that contains your data source.
2

Add the data source to your pipeline

You can add data to your pipeline using either method:
  • Drag and drop: Drag the table or file onto the canvas.
  • Add button: Hover over the table or file and click Add.
The gem appears on your canvas with all configuration settings already applied. The gem type depends on where your data is stored:
  • Table gems: For datasets from your SQL warehouse
  • Source gems: For tables or files from external systems

​
Modify gem configuration

After adding a data source from the Environment tab, you can adjust any configuration settings:
  1. Click the gem on the canvas to open its configuration panel.
  2. Modify location paths, schema definitions, format properties, or connection settings as needed.
  3. Save your changes.
Changes you make to the gem configuration only affect that specific gem instance. The original data source remains unchanged.

​
Alternative: Create gems from scratch

If you need to create a gem manually, you can add Source, Target, or Table gems directly from the canvas:
  1. Click Source/Target in the gem drawer at the top of the canvas.
  2. Select the gem type from the dropdown.
  3. Click the gem to open the configuration panel.
  4. Configure all settings manually, including selecting connections, defining paths, and setting up schemas.
Creating gems from scratch requires you to configure all settings manually. This approach is more time-consuming and error-prone than using the Environment tab, which automatically applies the correct configuration based on your existing connections.