How to debug spark.dep job?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

How to debug spark.dep job?

Serega Sheypak
Hi, seems like I was able to start Zeppelin. I have inhouse artifactory and I want zeppelin to download my artifacts from artifactory and use classes in spark job afterwards. 

Notebook submission hangs %spark.dep and never finishes. Zeppelin outputs to log that DepInterpreter job has been staerted. What is the rgiht way to figure out what it tires t do?
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: How to debug spark.dep job?

Jongyoul Lee
Hi,

All sparkinterpreter's logs are stored in logs/zeppelin-interpreter-spark-*.log.

On Thu, Apr 27, 2017 at 11:14 PM, Serega Sheypak <[hidden email]> wrote:
Hi, seems like I was able to start Zeppelin. I have inhouse artifactory and I want zeppelin to download my artifacts from artifactory and use classes in spark job afterwards. 

Notebook submission hangs %spark.dep and never finishes. Zeppelin outputs to log that DepInterpreter job has been staerted. What is the rgiht way to figure out what it tires t do?



--
이종열, Jongyoul Lee, 李宗烈
Loading...