Skip to main content
Dependencies:
  • ProphecySparkBasicsPython 0.0.1+
  • ProphecySparkBasicsScala 0.0.1+
Cluster requirements:
  • UC dedicated clusters 14.3+ supported
  • UC standard clusters 14.3+ supported
  • Livy clusters 3.0.1+ supported
Sorts a DataFrame on one or more columns in ascending or descending order.

​
Parameters

ParameterDescriptionRequired
DataFrameInput DataFrame to be sortedTrue
Order columnsColumns to sort DataFrame byTrue
SortOrder of sorting - ascending or descendingTrue

​
Example

Example usage of OrderBy

​
Spark Code

def Sort(spark: SparkSession, in0: DataFrame) -> DataFrame:
 return in0.orderBy(col("name").asc(), col("updated_at").desc())