Publication workflow
Projects move through three lifecycle stages:Publishing does not automatically run pipelines. After deployment, you can schedule pipelines independently for each fabric. Schedules are associated with deployments, not published versions.
Save a draft
As you develop and edit your project, you can save drafts to store in-progress project changes before publication. Use drafts to:- Save work while continuing development.
- Collaborate with other users.
- Review changes before publication.
- Prepare a version for deployment.
Draft pipelines
When you mark a pipeline as draft, Prophecy excludes its in-progress changes from the project’s next published version — it doesn’t remove the pipeline itself. For example, if a project includes pipelinesa, b, and c, and you mark b as draft, the next published version includes your latest changes to a and c, while b remains unchanged in that version unchanged, frozen at whatever was last published for it. If b had never been published before you marked it as draft, it’s simply left out of every published version until you remove the draft designation.
“Save a draft” and “draft pipelines” both use the word draft but mean different things by the term. Saving a draft records in-progress changes to the whole project. Marking a pipeline as draft excludes that pipeline from publication.
- Continue developing a pipeline while excluding in-progress changes from the next release.
- Publish other pipelines in the project without waiting on unfinished work.
- Any in-progress changes are not included in the next published version. If it’s already been published before, it ships unchanged in the new version; if it hasn’t, it’s left out of the version entirely.
- Any app built on that pipeline is held back the same way.
- The pipeline can’t be renamed or deleted while it’s a draft.
Publishing the project doesn’t remove the pipeline or interrupt it. Its last published version carries into the new release unchanged, and any existing schedule on it keeps running. That is, Prophecy redeploys that schedule’s job with the same, unchanged definition as part of the release.
Publish a version
Publishing creates a versioned release of your project. A published release can be deployed to one or more environments, but publishing alone does not deploy it. Until deployment occurs, the published version remains available in Prophecy but is not yet available in a development or production environment. When you publish a version, Prophecy:- Assigns a version number and description.
- Packages the project.
- Makes the version available for deployment.
- Track project changes over time.
- Deploy consistent versions across environments.
- Roll back to earlier project versions if necessary.
Deploy a project
When you deploy a project,you make a published version available for execution in a specific deployment environment. In Prophecy, deployment environments are called fabrics. Examples include development, staging, and production environments for platforms such as Databricks, Snowflake, or BigQuery. Different environments often require different configurations, such as connections, schemas, or runtime parameters. You can use project parameter sets to apply environment-specific configuration during deployment. During deployment, Prophecy:- Builds the project in the selected environment.
- Applies the selected project parameter set.
- Creates or updates the deployment for that environment.
1.1 while production continues to run version 1.0 until validation is complete.
Each environment (such as Dev or Prod) can contain only one deployed version of a project at a time.
After deployment, you can schedule pipelines independently for each environment.
