PLEASE HELP: Spark query through Zeppelin 0.7.3 runs so much slower than the same query through spark-shell

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

PLEASE HELP: Spark query through Zeppelin 0.7.3 runs so much slower than the same query through spark-shell

amersheik@gmail.com
Hello there

This questions relates to a previous query. Im filtering a single row from a 5 million row dataframe.

Through Zeppelin the query takes 7minutes.

Through spark-shell, it takes 1.5minutes.

I need help with this to see why the Zeppelin query is taking a much slower path.

Please help

Amer