How to sort by column in descending order in Spark SQL

Question

I tried df orderBy  col1   show 10  but it sorted in ascending order  df sort  col1   show 10  also sorts in descending order  I looked on stackoverflow and the answers I found were all outdated or referred to RDDs  I d like to use the native dataframe in spark

User · Answer

PySpark only   I came across this post when looking to do the same in PySpark  The easiest way is to just add the parameter ascending False   df orderBy  col1   ascending False  show 10    Reference  http   spark apache org docs 2 1 0 api python pyspark sql html pyspark sql DataFrame orderBy

User · Answer

In the case of Java   If we use DataFrames  while applying joins  here Inner join   we can sort  in ASC  after selecting distinct elements in each DF as   Dataset lt Row gt  d1   e data distinct   join s data distinct     e id   orderBy  salary      where e id is the column on which join is applied while sorted by salary in ASC   Also  we can use Spark SQL as   SQLContext sqlCtx   spark sqlContext    sqlCtx sql  select   from global temp salary order by salary desc   show      where    spark nbsp  -  SparkSession    salary -  GlobalTemp View

User · Answer

import org apache spark sql functions desc  df orderBy desc  columnname1   desc  columnname2   asc  columnname3

User · Answer

You can also sort the column by importing the spark sql functions  import org apache spark sql functions   df orderBy asc  col1      Or   import org apache spark sql functions   df sort desc  col1      importing sqlContext implicits    import sqlContext implicits   df orderBy   col1  desc    Or   import sqlContext implicits   df sort   col1  desc

User · Answer

It s in org apache spark sql DataFrame for sort method   df sort   col1     col2  desc    Note   and  desc inside sort for the column to sort the results by

User · Answer

df sort   ColumnName  desc  show

[scala] How to sort by column in descending order in Spark SQL?

Examples related to scala

Examples related to apache-spark

Examples related to apache-spark-sql