Zeppelin build from source

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Zeppelin build from source

Swapnil Shinde
Hello Everyone
     I am new to zeppelin world and trying to build zeppelin source code for the first time. I am building it in windows platform. Below are the steps I followed to build and difficuties/workaround I faced-

1. Update pom.xml to use scala 2.11. (Successful)

./dev/change_scala_version.sh 2.11


2. Build (Error)

mvn clean package -DskipTests -Pmapr51 -Pspark-2.0 -Dspark.version=2.0.1 -Phadoop-2.7 -Pscala-2.11 -Pr -Pexamples

    Above command was running until zepplin-web build. zeppelin-web was stuck at log "npm clean run" at "yarn run build" for very long time. I tried to build it using cygwin just in case but no luck. 

Workaround - Then I followed instructions in readme.md to build it step by step -


# install required depepdencies and bower packages (only once)
$ npm install -g yarn
$ yarn install

# build zeppelin-web for production
$ yarn run build

Above commands run fine but "mvn clean package" under zeppelin-web is still hanging. 

Therefore, I build zepplin-web with step by step commands and then removed zeppling web as module from parent pom. If I run "mvn clean package -DskipTests" on parent pom (entire zeppeling project) it throws error while building zeppelin-server. 


Error message - 


INFO] Reactor Summary:
[INFO]
[INFO] Zeppelin .......................................... SUCCESS [  3.193 s]
[INFO] Zeppelin: Interpreter ............................. SUCCESS [  4.445 s]
[INFO] Zeppelin: Zengine ................................. SUCCESS [  3.456 s]
[INFO] Zeppelin: Display system apis ..................... SUCCESS [  0.772 s]
[INFO] Zeppelin: Spark dependencies ...................... SUCCESS [ 47.962 s]
[INFO] Zeppelin: Groovy interpreter ...................... SUCCESS [  0.349 s]
[INFO] Zeppelin: Spark ................................... SUCCESS [  4.724 s]
[INFO] Zeppelin: Markdown interpreter .................... SUCCESS [  0.503 s]
[INFO] Zeppelin: Angular interpreter ..................... SUCCESS [  0.341 s]
[INFO] Zeppelin: Shell interpreter ....................... SUCCESS [  0.345 s]
[INFO] Zeppelin: Livy interpreter ........................ SUCCESS [  4.095 s]
[INFO] Zeppelin: HBase interpreter ....................... SUCCESS [  1.838 s]
[INFO] Zeppelin: Apache Pig Interpreter .................. SUCCESS [  1.681 s]
[INFO] Zeppelin: JDBC interpreter ........................ SUCCESS [  0.678 s]
[INFO] Zeppelin: File System Interpreters ................ SUCCESS [  0.602 s]
[INFO] Zeppelin: Flink ................................... SUCCESS [  1.255 s]
[INFO] Zeppelin: Apache Ignite interpreter ............... SUCCESS [  0.427 s]
[INFO] Zeppelin: Kylin interpreter ....................... SUCCESS [  0.312 s]
[INFO] Zeppelin: Python interpreter ...................... SUCCESS [  1.918 s]
[INFO] Zeppelin: Lens interpreter ........................ SUCCESS [  1.325 s]
[INFO] Zeppelin: Apache Cassandra interpreter ............ SUCCESS [  5.904 s]
[INFO] Zeppelin: Elasticsearch interpreter ............... SUCCESS [  1.269 s]
[INFO] Zeppelin: BigQuery interpreter .................... SUCCESS [  0.457 s]
[INFO] Zeppelin: Alluxio interpreter ..................... SUCCESS [  1.118 s]
[INFO] Zeppelin: Scio .................................... SUCCESS [ 17.768 s]
[INFO] Zeppelin: Server .................................. FAILURE [  1.681 s]
[INFO] Zeppelin: Packaging distribution .................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:48 min
[INFO] Finished at: 2017-04-21T10:43:26-05:00
[INFO] Final Memory: 106M/1708M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:1.3.1:enforce (enforce) on project zeppelin-server: org.apache.maven.plugins.enforcer.DependencyConvergence failed with message:
[ERROR] Failed while enforcing releasability the error(s) are [
[ERROR] Dependency convergence error for org.scala-lang.modules:scala-xml_2.11:1.0.4 paths to dependency are:
[ERROR] +-org.apache.zeppelin:zeppelin-server:0.8.0-SNAPSHOT
[ERROR] +-org.scala-lang:scala-compiler:2.11.7
[ERROR] +-org.scala-lang.modules:scala-xml_2.11:1.0.4
[ERROR] and
[ERROR] +-org.apache.zeppelin:zeppelin-server:0.8.0-SNAPSHOT
[ERROR] +-org.scalatest:scalatest_2.11:2.2.4
[ERROR] +-org.scala-lang.modules:scala-xml_2.11:1.0.2
[ERROR] ]
[ERROR] -> [Help 1]


I am not sure how to fix this enforcer plugin issue. It would nice if you guys let me know if I am building it wrong from the beginning or how to solve this enforcer error.
Thank you very much and let me know if you need any further information.

-
Swapnil
Reply | Threaded
Open this post in threaded view
|

Re: Zeppelin build from source

Raffaele S
This might be a bug with the latest master on git, could you try building Zeppelin stable (0.7.1)?

2017-04-21 17:59 GMT+02:00 Swapnil Shinde <[hidden email]>:
Hello Everyone
     I am new to zeppelin world and trying to build zeppelin source code for the first time. I am building it in windows platform. Below are the steps I followed to build and difficuties/workaround I faced-

1. Update pom.xml to use scala 2.11. (Successful)

./dev/change_scala_version.sh 2.11


2. Build (Error)

mvn clean package -DskipTests -Pmapr51 -Pspark-2.0 -Dspark.version=2.0.1 -Phadoop-2.7 -Pscala-2.11 -Pr -Pexamples

    Above command was running until zepplin-web build. zeppelin-web was stuck at log "npm clean run" at "yarn run build" for very long time. I tried to build it using cygwin just in case but no luck. 

Workaround - Then I followed instructions in readme.md to build it step by step -


# install required depepdencies and bower packages (only once)
$ npm install -g yarn
$ yarn install

# build zeppelin-web for production
$ yarn run build

Above commands run fine but "mvn clean package" under zeppelin-web is still hanging. 

Therefore, I build zepplin-web with step by step commands and then removed zeppling web as module from parent pom. If I run "mvn clean package -DskipTests" on parent pom (entire zeppeling project) it throws error while building zeppelin-server. 


Error message - 


INFO] Reactor Summary:
[INFO]
[INFO] Zeppelin .......................................... SUCCESS [  3.193 s]
[INFO] Zeppelin: Interpreter ............................. SUCCESS [  4.445 s]
[INFO] Zeppelin: Zengine ................................. SUCCESS [  3.456 s]
[INFO] Zeppelin: Display system apis ..................... SUCCESS [  0.772 s]
[INFO] Zeppelin: Spark dependencies ...................... SUCCESS [ 47.962 s]
[INFO] Zeppelin: Groovy interpreter ...................... SUCCESS [  0.349 s]
[INFO] Zeppelin: Spark ................................... SUCCESS [  4.724 s]
[INFO] Zeppelin: Markdown interpreter .................... SUCCESS [  0.503 s]
[INFO] Zeppelin: Angular interpreter ..................... SUCCESS [  0.341 s]
[INFO] Zeppelin: Shell interpreter ....................... SUCCESS [  0.345 s]
[INFO] Zeppelin: Livy interpreter ........................ SUCCESS [  4.095 s]
[INFO] Zeppelin: HBase interpreter ....................... SUCCESS [  1.838 s]
[INFO] Zeppelin: Apache Pig Interpreter .................. SUCCESS [  1.681 s]
[INFO] Zeppelin: JDBC interpreter ........................ SUCCESS [  0.678 s]
[INFO] Zeppelin: File System Interpreters ................ SUCCESS [  0.602 s]
[INFO] Zeppelin: Flink ................................... SUCCESS [  1.255 s]
[INFO] Zeppelin: Apache Ignite interpreter ............... SUCCESS [  0.427 s]
[INFO] Zeppelin: Kylin interpreter ....................... SUCCESS [  0.312 s]
[INFO] Zeppelin: Python interpreter ...................... SUCCESS [  1.918 s]
[INFO] Zeppelin: Lens interpreter ........................ SUCCESS [  1.325 s]
[INFO] Zeppelin: Apache Cassandra interpreter ............ SUCCESS [  5.904 s]
[INFO] Zeppelin: Elasticsearch interpreter ............... SUCCESS [  1.269 s]
[INFO] Zeppelin: BigQuery interpreter .................... SUCCESS [  0.457 s]
[INFO] Zeppelin: Alluxio interpreter ..................... SUCCESS [  1.118 s]
[INFO] Zeppelin: Scio .................................... SUCCESS [ 17.768 s]
[INFO] Zeppelin: Server .................................. FAILURE [  1.681 s]
[INFO] Zeppelin: Packaging distribution .................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:48 min
[INFO] Finished at: 2017-04-21T10:43:26-05:00
[INFO] Final Memory: 106M/1708M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:1.3.1:enforce (enforce) on project zeppelin-server: org.apache.maven.plugins.enforcer.DependencyConvergence failed with message:
[ERROR] Failed while enforcing releasability the error(s) are [
[ERROR] Dependency convergence error for org.scala-lang.modules:scala-xml_2.11:1.0.4 paths to dependency are:
[ERROR] +-org.apache.zeppelin:zeppelin-server:0.8.0-SNAPSHOT
[ERROR] +-org.scala-lang:scala-compiler:2.11.7
[ERROR] +-org.scala-lang.modules:scala-xml_2.11:1.0.4
[ERROR] and
[ERROR] +-org.apache.zeppelin:zeppelin-server:0.8.0-SNAPSHOT
[ERROR] +-org.scalatest:scalatest_2.11:2.2.4
[ERROR] +-org.scala-lang.modules:scala-xml_2.11:1.0.2
[ERROR] ]
[ERROR] -> [Help 1]


I am not sure how to fix this enforcer plugin issue. It would nice if you guys let me know if I am building it wrong from the beginning or how to solve this enforcer error.
Thank you very much and let me know if you need any further information.

-
Swapnil