Documentation Index
Fetch the complete documentation index at: https://docs.prophecy.ai/llms.txt
Use this file to discover all available pages before exploring further.
The gem has a corresponding interactive gem example. See Interactive gem
examples to learn how to run sample pipelines
for this and other gems. Where the script runs
The execution environment for the Script gem depends on the SQL warehouse configured in your Prophecy fabric.
| SQL warehouse provider | Execution environment |
|---|
| Databricks | Databricks Serverless |
| Prophecy In Memory | Prophecy Automate |
| BigQuery | Prophecy Automate |
| Snowflake | Prophecy Automate |
Parameters
| Parameter | Description |
|---|
| Script | Where you will write your Python script |
Number of inputs and outputs can be changed as needed by clicking the + button on the respective
tab.
Troubleshooting
Permission error with service principals
When using a fabric with service principal authentication for Databricks, you may encounter the following error:
Failed due to: Unable to get run status for job id: INTERNAL_ERROR
Cannot read the python file dbfs:/prophecy_tmp/prophecy_script_gem_[uuid].py
User does not have permission SELECT on ANY File
SELECT permission on ANY FILE:
GRANT SELECT ON ANY FILE TO <your_service_principal_uuid>;
Granting SELECT ON ANY FILE provides broad read access to the file system. Consider the security
implications for your environment before implementing this workaround.
