> ## Documentation Index
> Fetch the complete documentation index at: https://docs.prophecy.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Lineage

> Understand and explore project lineage

Available for [Enterprise Edition](https://docs.prophecy.ai/data-engineering/administration/platform/editions.md) only.

Data lineage visualizes the complete journey of your data from source to destination, including all transformations it undergoes along the way. This visibility provides critical context for data operations and governance.

Understanding data lineage delivers multiple benefits for your engineering team:

| Benefit | Description |
| - | - |
| Error Tracking | Quickly trace issues back to their source |
| Quality Assurance | Verify data integrity throughout its lifecycle |
| Change Management | Plan system migrations with complete visibility |
| Discovery | Find and understand available data assets |
| Governance | Maintain compliance with data policies |

> [!TIP]
>
> Lineage is computed on-demand directly from Git code. This means you can experiment in branches
> and immediately see how changes affect overall lineage before committing.

> [!NOTE]
>
> Prophecy supports lineage for Python/PySpark and Scala projects.

## Accessing lineage

There are two ways to access the lineage view:

* Option 1: Hover over your pipeline in the **Pipeline** tab of the **Metadata** page.
* Option 2: For SQL projects where the default transformation is Model, open **Project Lineage** from the project settings dropdown.

![How to Open Lineage](https://mintcdn.com/prophecy-62973bd0/820NYl25fNinaqQc/data-engineering/lineage/img/lineage-open-from-metadata.png?fit=max\&auto=format\&n=820NYl25fNinaqQc\&q=85\&s=63050c69d63381bad7bc7ddd7a0117f7)

When you open Lineage, you are brought to the lineage search page. Once you enter a search query, you can see a list of matching **entities** and a list of **columns**. You can filter these lists by:

* Entity type
* Project
* Author
* Last modified time period

Once you click an entity or column, you'll see the lineage visualization.

![Lineage Search](https://mintcdn.com/prophecy-62973bd0/820NYl25fNinaqQc/data-engineering/lineage/img/lineage-search-high-level-view.png?fit=max\&auto=format\&n=820NYl25fNinaqQc\&q=85\&s=6b757e964ebf9c7751481b6a9e98b08b)

## Lineage Summary

The **Summary** tab visually illustrates the flow of data through pipelines, models, and datasets depending on the entities in your project. Use the **Browse Datasets** panel to search for and select the column or entity that you want to inspect.

![Browse Datasets](https://mintcdn.com/prophecy-62973bd0/820NYl25fNinaqQc/data-engineering/lineage/img/lineage-browse-dataset.png?fit=max\&auto=format\&n=820NYl25fNinaqQc\&q=85\&s=56e6c45f10cbe69ce57595d4dab86eab)

> [!NOTE]
>
> Clicking the project icon or project name opens the project landing page in the canvas. To open
> lineage, use the lineage navigation described here.

### Column-level lineage

Column-level lineage tracks the flow and transformation of individual data columns through the pipeline, demonstrating how they are processed at each stage. When you select a column in the lineage view, Prophecy provides the column's upstream and downstream transformations.

![Lineage View](https://mintcdn.com/prophecy-62973bd0/820NYl25fNinaqQc/data-engineering/lineage/img/lineage-column-level-view.png?fit=max\&auto=format\&n=820NYl25fNinaqQc\&q=85\&s=6daf37b77caa92c2c7351f0d3fe4798e)

## Lineage Zoom In

The **Zoom In** tab allows you to dive deeper into specific components of your pipeline or dataset to examine detailed information.

### Pipeline lineage

For pipelines, you can see code-level information about each component present in the pipeline. Select a component to view its:

* Transformation code
* Input columns
* Output columns

![pipeline zoom-in](https://mintcdn.com/prophecy-62973bd0/820NYl25fNinaqQc/data-engineering/lineage/img/lineage-pipeline-zoom-in.png?fit=max\&auto=format\&n=820NYl25fNinaqQc\&q=85\&s=1f38a864fcf05293a7cf1aae6dcbf87a)

### Dataset lineage

For datasets, you can find information around all the upstream and downstream transformations (if any) for all the columns of the selected dataset.

![Dataset zoom-in](https://mintcdn.com/prophecy-62973bd0/820NYl25fNinaqQc/data-engineering/lineage/img/lineage-dataset-zoom-in.png?fit=max\&auto=format\&n=820NYl25fNinaqQc\&q=85\&s=f097ca52b57a34142b406db4a41a5717)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.