Spark jobs are not started from zeppelin.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Spark jobs are not started from zeppelin.

ÐΞ€ρ@Ҝ (๏̯͡๏)
There is no other information apart from. Spark Over YARN. ZEppelin code is from git (latest)

When i submit a zeppelin paragraph, it try a AM container and fails as below

AM Container for appattempt_1443143851429_0009_000002 exited with exitCode: 1
For more detailed output, check application tracking page:http://RM.com:8088/cluster/app/application_1443143851429_0009Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_e04_1443143851429_0009_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
Failing this attempt


AM:

Error: Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher

--
Deepak