> ## Documentation Index
> Fetch the complete documentation index at: https://docs.prophecy.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Data profiling for Data Analysts

> See statistics for data samples in your pipeline

Data profiling allows you to view statistics on interim datasets in your pipeline. When you open a dataset's profile in the [Data Explorer](/data-analysis/development/runs/data-explorer/data-explorer), you can visualize value distributions and data completeness to ensure your data matches expectations.

## Quick profile

The Data Explorer includes data profiles that are generated on your sample data. You'll be able to see high-level statistics for each column, including:

* **Percent of non-blank values:** The percentage of values in the column that are not blank.
* **Percent of null values:** The percentage of values in the column that are null.
* **Percent of blank values:** The percentage of values in the column that are blank.
* **Most common values:** Displays the top four most frequent values in the column, along with the percentage of occurrences for each.

To view these statistics for your sample data, click **Profile** in the Data Explorer (1) to open the Data Profile view. Initially, Prophecy calculates Data Profile statistics using only the first 10,000 rows of data, but you can ask Prophecy to expand this calculation to the full data set.

Before you do so, we recommend checking total row count by clicking the **Total Row Count** button at the bottom of the Data Explorer (2). Next, click **Load Full Profile** to calculate statistics for the entire dataset (3).

<img src="https://mintcdn.com/prophecy-62973bd0/MBI2Y9i0JBSUdMdn/data-analysis/development/runs/data-explorer/img/quick-data-profile.png?fit=max&auto=format&n=MBI2Y9i0JBSUdMdn&q=85&s=8ea405fb82a2d68a5b725668ce904fe2" alt="Quick profile" width="3104" height="2024" data-path="data-analysis/development/runs/data-explorer/img/quick-data-profile.png" />

## Expanded profile

You can view a more detailed profile for any column in your dataset. When you open the expanded profile, Prophecy generates a deeper analysis of the column based on your sample data.

<Note>
  All statistics in the expanded profile are computed on the same sample used in the Data Explorer.
</Note>

To view the expanded profile:

1. Click the dropdown arrow on the column you want to expand.
2. Select **Show Expanded Profile**.

<img src="https://mintcdn.com/prophecy-62973bd0/88t3kPk63E5ZR9Oi/data-analysis/development/runs/data-explorer/img/open-expanded-profile.png?fit=max&auto=format&n=88t3kPk63E5ZR9Oi&q=85&s=43cd84548a84a995dfe3af2687dad819" alt="Show Expanded Profile" width="2866" height="1610" data-path="data-analysis/development/runs/data-explorer/img/open-expanded-profile.png" />

When you load the expanded data profile, Prophecy generates a more in-depth analysis on the sample data.

<img src="https://mintcdn.com/prophecy-62973bd0/88t3kPk63E5ZR9Oi/data-analysis/development/runs/data-explorer/img/expanded-profile.png?fit=max&auto=format&n=88t3kPk63E5ZR9Oi&q=85&s=c13c02ce113ac8ec3f5b41a881e911d0" alt="Expanded profile" width="2866" height="1610" data-path="data-analysis/development/runs/data-explorer/img/expanded-profile.png" />

The expanded profile displays the following metrics:

| Metric                   | Description                                                       |
| ------------------------ | ----------------------------------------------------------------- |
| **Data type**            | Data type of the column.                                          |
| **Unique values**        | Number of unique values in the column.                            |
| **Longest value**        | Longest value in the column and its length.                       |
| **Shortest value**       | Shortest value in the column and its length.                      |
| **Most frequent value**  | Most frequent value in the column and its number of occurrences.  |
| **Least frequent value** | Least frequent value in the column and its number of occurrences. |
| **Minimum value**        | Minimum value in the column.                                      |
| **Maximum value**        | Maximum value in the column.                                      |
| **Average value length** | Average length of each value in the column.                       |
| **Null values**          | Percent and number of null values in the column.                  |
| **Blank values**         | Percent and number of blank values in the column.                 |
| **Non-blank values**     | Percent and number of non-blank values in the column.             |
| **Data summary**         | Overview of the most common values in the column.                 |

<Tip>You can click between columns in the expanded profile for quick access.</Tip>
