The gem has a corresponding interactive gem example. See Interactive gem
examples to learn how to run sample pipelines
for this and other gems. Where the script runs
The execution environment for the Script gem depends on the SQL warehouse configured in your Prophecy fabric.
This ensures your Python logic runs in an environment optimized for your data platform.
Parameters
Number of inputs and outputs can be changed as needed by clicking the + button on the respective
tab.
Troubleshooting
Permission error with service principals
When using a fabric with service principal authentication for Databricks, you may encounter the following error:
This occurs because the Script gem uploads Python scripts to DBFS for execution. Service principals require explicit permissions to read files from DBFS.
To solve this, contact your Databricks administrator for assistance. One workaround is to grant the service principal SELECT permission on ANY FILE:
Granting SELECT ON ANY FILE provides broad read access to the file system. Consider the security
implications for your environment before implementing this workaround.
