Skip to main content
The gem has a corresponding interactive gem example. See Interactive gem examples to learn how to run sample pipelines for this and other gems.

​
Where the script runs

The execution environment for the Script gem depends on the SQL warehouse configured in your Prophecy fabric.
SQL warehouse providerExecution environment
DatabricksDatabricks Serverless
Prophecy In MemoryProphecy Automate
BigQueryProphecy Automate
This ensures your Python logic runs in an environment optimized for your data platform.

​
Parameters

ParameterDescription
ScriptWhere you will write your Python script
Number of inputs and outputs can be changed as needed by clicking the + button on the respective tab.

​
Troubleshooting

​
Permission error with service principals

When using a fabric with service principal authentication for Databricks, you may encounter the following error: 
Failed due to: Unable to get run status for job id: INTERNAL_ERROR
Cannot read the python file dbfs:/prophecy_tmp/prophecy_script_gem_[uuid].py
User does not have permission SELECT on ANY File
This occurs because the Script gem uploads Python scripts to DBFS for execution. Service principals require explicit permissions to read files from DBFS. To solve this, contact your Databricks administrator for assistance. One workaround is to grant the service principal SELECT permission on ANY FILE: 
GRANT SELECT ON ANY FILE TO <your_service_principal_uuid>;
Granting SELECT ON ANY FILE provides broad read access to the file system. Consider the security implications for your environment before implementing this workaround.