Skip to main content
This gem runs in .

​
Overview

Use the Intersect gem to return only the rows that appear in all input tables. This is useful for identifying overlapping data, such as customers who are active on multiple platforms, or transactions that appear across different systems or logs.
The gem has a corresponding interactive gem example. See Interactive gem examples to learn how to run sample pipelines for this and other gems.

​
Input and Output

To add additional input ports, click + next to Ports. All input tables must have identical schemas (matching column names and data types).

​
Parameters

​
Example

Let’s say you’re working with two tables: Table A and Table B.
  • Both tables contain order-related data.
  • Table A contains order information from customer 1, 2, and 3.
  • Table B contains order information from customer 1, 2, 3, and 4.
  • Tables A and B each contain some identical records (duplicates).

​
Table A

​
Table B

​
Result

​
Default

The table that results from the Intersect gem only includes the records present in all the input tables.
The output indicates that order 101 and 104 appear in both Table A and Table B. By default, the duplicate row for order 101 is removed from the output.

​
Preserve duplicates

If the preserve duplicates option is selected, the duplicates present in all inputs are preserved.
The output is the same as above, except the duplicate order 101 is retained.