How to add Cassandra Interpreter to Zeppelin on EMR?

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

How to add Cassandra Interpreter to Zeppelin on EMR?

shyla
Directory /usr/lib/zeppelin/interpreter/cassandra already exists.

But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
What are the properties name and value I should specify. Any dependencies I should add?

Appreciate your help
Thanks
-shyla
Reply | Threaded
Open this post in threaded view
|

Re: How to add Cassandra Interpreter to Zeppelin on EMR?

shyla
I think the problem is, I don't see cassandra Interpreter group. How do I add cassandra Intepreter grouo? 
Screen Shot 2018-12-21 at 2.36.51 PM.png

On Fri, Dec 21, 2018 at 2:24 PM shyla deshpande <[hidden email]> wrote:
Directory /usr/lib/zeppelin/interpreter/cassandra already exists.

But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
What are the properties name and value I should specify. Any dependencies I should add?

Appreciate your help
Thanks
-shyla
Reply | Threaded
Open this post in threaded view
|

Re: How to add Cassandra Interpreter to Zeppelin on EMR?

Xun Liu
hi, shyla deshpande

You can check if the cassandra interpreter is registered in zeppelin's startup log in the zeppelin/logs/zeppelin-{hostname}.log file.
You may need to restart zeppelin and you can easily see the interpreter registration information.

 INFO [2018-12-21 21:36:18,967] ({Thread-13} RemoteInterpreterEventServer.java[run]:103) - InterpreterEventServer is starting at 10.120.196.234:48573
 INFO [2018-12-21 21:36:19,455] ({main} RemoteInterpreterEventServer.java[start]:127) - RemoteInterpreterEventServer is started
 INFO [2018-12-21 21:36:19,492] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hazelcastjet
 INFO [2018-12-21 21:36:19,497] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: flink
 INFO [2018-12-21 21:36:19,501] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: ignite
 INFO [2018-12-21 21:36:19,509] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: kylin
 INFO [2018-12-21 21:36:19,512] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: angular
 WARN [2018-12-21 21:36:19,546] ({main} InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:335) - No interpreter-setting.json found in /home/hadoop/zeppelin-current/interpreter/scio
 INFO [2018-12-21 21:36:19,550] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: cassandra
 INFO [2018-12-21 21:36:19,553] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: scalding
 INFO [2018-12-21 21:36:19,555] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: lens
 INFO [2018-12-21 21:36:19,559] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: livy
 INFO [2018-12-21 21:36:19,562] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: java
 INFO [2018-12-21 21:36:19,565] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sh
 INFO [2018-12-21 21:36:19,567] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: alluxio
 INFO [2018-12-21 21:36:19,570] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: beam
 INFO [2018-12-21 21:36:19,572] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: elasticsearch
 INFO [2018-12-21 21:36:19,575] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: md
 INFO [2018-12-21 21:36:19,578] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: spark
 INFO [2018-12-21 21:36:19,580] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: file
 INFO [2018-12-21 21:36:19,584] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: submarine
 INFO [2018-12-21 21:36:19,586] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: geode
 INFO [2018-12-21 21:36:19,588] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: bigquery
 INFO [2018-12-21 21:36:19,590] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: pig
 INFO [2018-12-21 21:36:19,593] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: neo4j
 INFO [2018-12-21 21:36:19,595] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hbase
 INFO [2018-12-21 21:36:19,597] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: groovy
 INFO [2018-12-21 21:36:19,599] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sap
 INFO [2018-12-21 21:36:19,602] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: python
 INFO [2018-12-21 21:36:19,604] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: jdbc
 INFO [2018-12-21 21:36:19,610] ({main} FileSystemConfigStorage.java[loadInterpreterSettings]:75) - Load Interpreter Setting from file: <a href="hdfs://mldev/user/hadoop/zeppelin/conf/interpreter.json" class="">hdfs://mldev/user/hadoop/zeppelin/conf/interpreter.json
 INFO [2018-12-21 21:36:19,835] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting ignite from interpreter.json
 INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting beam from interpreter.json
 INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting geode from interpreter.json
 INFO [2018-12-21 21:36:19,837] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting jdbc from interpreter.json
 INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting lens from interpreter.json
 INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting pig from interpreter.json
 INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting file from interpreter.json
 INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting java from interpreter.json
 INFO [2018-12-21 21:36:19,840] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting elasticsearch from interpreter.json
 INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting submarine from interpreter.json
 INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sh from interpreter.json
 INFO [2018-12-21 21:36:19,842] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting spark from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting md from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hazelcastjet from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting alluxio from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting bigquery from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hbase from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting python from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sap from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting scalding from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting flink from interpreter.json
 INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting angular from interpreter.json
 INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting livy from interpreter.json
 INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting neo4j from interpreter.json
 INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting groovy from interpreter.json
 INFO [2018-12-21 21:36:19,848] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting cassandra from interpreter.json


在 2018年12月22日,上午6:39,shyla deshpande <[hidden email]> 写道:

I think the problem is, I don't see cassandra Interpreter group. How do I add cassandra Intepreter grouo? 
<Screen Shot 2018-12-21 at 2.36.51 PM.png>

On Fri, Dec 21, 2018 at 2:24 PM shyla deshpande <[hidden email]> wrote:
Directory /usr/lib/zeppelin/interpreter/cassandra already exists.

But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
What are the properties name and value I should specify. Any dependencies I should add?

Appreciate your help
Thanks
-shyla

Reply | Threaded
Open this post in threaded view
|

Re: How to add Cassandra Interpreter to Zeppelin on EMR?

shyla
Hi Xun,

Thank you for your response. You set me in the right direction and I made some progress.
I still have 2 issues.
1. I was able to add the cassandra interpreter. But now I am getting the following error. 
Screen Shot 2018-12-22 at 7.51.35 AM.png
2. I am unable to add spark-cassandra-connector 
Screen Shot 2018-12-22 at 7.44.50 AM.png

I appreciate your help.
Thanks
-Shyla

On Fri, Dec 21, 2018 at 7:21 PM Xun Liu <[hidden email]> wrote:
hi, shyla deshpande

You can check if the cassandra interpreter is registered in zeppelin's startup log in the zeppelin/logs/zeppelin-{hostname}.log file.
You may need to restart zeppelin and you can easily see the interpreter registration information.

 INFO [2018-12-21 21:36:18,967] ({Thread-13} RemoteInterpreterEventServer.java[run]:103) - InterpreterEventServer is starting at 10.120.196.234:48573
 INFO [2018-12-21 21:36:19,455] ({main} RemoteInterpreterEventServer.java[start]:127) - RemoteInterpreterEventServer is started
 INFO [2018-12-21 21:36:19,492] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hazelcastjet
 INFO [2018-12-21 21:36:19,497] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: flink
 INFO [2018-12-21 21:36:19,501] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: ignite
 INFO [2018-12-21 21:36:19,509] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: kylin
 INFO [2018-12-21 21:36:19,512] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: angular
 WARN [2018-12-21 21:36:19,546] ({main} InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:335) - No interpreter-setting.json found in /home/hadoop/zeppelin-current/interpreter/scio
 INFO [2018-12-21 21:36:19,550] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: cassandra
 INFO [2018-12-21 21:36:19,553] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: scalding
 INFO [2018-12-21 21:36:19,555] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: lens
 INFO [2018-12-21 21:36:19,559] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: livy
 INFO [2018-12-21 21:36:19,562] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: java
 INFO [2018-12-21 21:36:19,565] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sh
 INFO [2018-12-21 21:36:19,567] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: alluxio
 INFO [2018-12-21 21:36:19,570] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: beam
 INFO [2018-12-21 21:36:19,572] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: elasticsearch
 INFO [2018-12-21 21:36:19,575] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: md
 INFO [2018-12-21 21:36:19,578] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: spark
 INFO [2018-12-21 21:36:19,580] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: file
 INFO [2018-12-21 21:36:19,584] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: submarine
 INFO [2018-12-21 21:36:19,586] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: geode
 INFO [2018-12-21 21:36:19,588] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: bigquery
 INFO [2018-12-21 21:36:19,590] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: pig
 INFO [2018-12-21 21:36:19,593] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: neo4j
 INFO [2018-12-21 21:36:19,595] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hbase
 INFO [2018-12-21 21:36:19,597] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: groovy
 INFO [2018-12-21 21:36:19,599] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sap
 INFO [2018-12-21 21:36:19,602] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: python
 INFO [2018-12-21 21:36:19,604] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: jdbc
 INFO [2018-12-21 21:36:19,610] ({main} FileSystemConfigStorage.java[loadInterpreterSettings]:75) - Load Interpreter Setting from file: hdfs://mldev/user/hadoop/zeppelin/conf/interpreter.json
 INFO [2018-12-21 21:36:19,835] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting ignite from interpreter.json
 INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting beam from interpreter.json
 INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting geode from interpreter.json
 INFO [2018-12-21 21:36:19,837] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting jdbc from interpreter.json
 INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting lens from interpreter.json
 INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting pig from interpreter.json
 INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting file from interpreter.json
 INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting java from interpreter.json
 INFO [2018-12-21 21:36:19,840] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting elasticsearch from interpreter.json
 INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting submarine from interpreter.json
 INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sh from interpreter.json
 INFO [2018-12-21 21:36:19,842] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting spark from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting md from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hazelcastjet from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting alluxio from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting bigquery from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hbase from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting python from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sap from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting scalding from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting flink from interpreter.json
 INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting angular from interpreter.json
 INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting livy from interpreter.json
 INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting neo4j from interpreter.json
 INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting groovy from interpreter.json
 INFO [2018-12-21 21:36:19,848] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting cassandra from interpreter.json


在 2018年12月22日,上午6:39,shyla deshpande <[hidden email]> 写道:

I think the problem is, I don't see cassandra Interpreter group. How do I add cassandra Intepreter grouo? 
<Screen Shot 2018-12-21 at 2.36.51 PM.png>

On Fri, Dec 21, 2018 at 2:24 PM shyla deshpande <[hidden email]> wrote:
Directory /usr/lib/zeppelin/interpreter/cassandra already exists.

But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
What are the properties name and value I should specify. Any dependencies I should add?

Appreciate your help
Thanks
-shyla

Reply | Threaded
Open this post in threaded view
|

Re: How to add Cassandra Interpreter to Zeppelin on EMR?

shyla
I wanted to add that I am using
            emr-5.20.0
Applications:Spark 2.4.0, Zeppelin 0.8.0, 
Thanks 

On Sat, Dec 22, 2018 at 7:56 AM shyla deshpande <[hidden email]> wrote:
Hi Xun,

Thank you for your response. You set me in the right direction and I made some progress.
I still have 2 issues.
1. I was able to add the cassandra interpreter. But now I am getting the following error. 
Screen Shot 2018-12-22 at 7.51.35 AM.png
2. I am unable to add spark-cassandra-connector 
Screen Shot 2018-12-22 at 7.44.50 AM.png

I appreciate your help.
Thanks
-Shyla

On Fri, Dec 21, 2018 at 7:21 PM Xun Liu <[hidden email]> wrote:
hi, shyla deshpande

You can check if the cassandra interpreter is registered in zeppelin's startup log in the zeppelin/logs/zeppelin-{hostname}.log file.
You may need to restart zeppelin and you can easily see the interpreter registration information.

 INFO [2018-12-21 21:36:18,967] ({Thread-13} RemoteInterpreterEventServer.java[run]:103) - InterpreterEventServer is starting at 10.120.196.234:48573
 INFO [2018-12-21 21:36:19,455] ({main} RemoteInterpreterEventServer.java[start]:127) - RemoteInterpreterEventServer is started
 INFO [2018-12-21 21:36:19,492] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hazelcastjet
 INFO [2018-12-21 21:36:19,497] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: flink
 INFO [2018-12-21 21:36:19,501] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: ignite
 INFO [2018-12-21 21:36:19,509] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: kylin
 INFO [2018-12-21 21:36:19,512] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: angular
 WARN [2018-12-21 21:36:19,546] ({main} InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:335) - No interpreter-setting.json found in /home/hadoop/zeppelin-current/interpreter/scio
 INFO [2018-12-21 21:36:19,550] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: cassandra
 INFO [2018-12-21 21:36:19,553] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: scalding
 INFO [2018-12-21 21:36:19,555] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: lens
 INFO [2018-12-21 21:36:19,559] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: livy
 INFO [2018-12-21 21:36:19,562] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: java
 INFO [2018-12-21 21:36:19,565] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sh
 INFO [2018-12-21 21:36:19,567] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: alluxio
 INFO [2018-12-21 21:36:19,570] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: beam
 INFO [2018-12-21 21:36:19,572] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: elasticsearch
 INFO [2018-12-21 21:36:19,575] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: md
 INFO [2018-12-21 21:36:19,578] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: spark
 INFO [2018-12-21 21:36:19,580] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: file
 INFO [2018-12-21 21:36:19,584] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: submarine
 INFO [2018-12-21 21:36:19,586] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: geode
 INFO [2018-12-21 21:36:19,588] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: bigquery
 INFO [2018-12-21 21:36:19,590] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: pig
 INFO [2018-12-21 21:36:19,593] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: neo4j
 INFO [2018-12-21 21:36:19,595] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hbase
 INFO [2018-12-21 21:36:19,597] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: groovy
 INFO [2018-12-21 21:36:19,599] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sap
 INFO [2018-12-21 21:36:19,602] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: python
 INFO [2018-12-21 21:36:19,604] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: jdbc
 INFO [2018-12-21 21:36:19,610] ({main} FileSystemConfigStorage.java[loadInterpreterSettings]:75) - Load Interpreter Setting from file: hdfs://mldev/user/hadoop/zeppelin/conf/interpreter.json
 INFO [2018-12-21 21:36:19,835] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting ignite from interpreter.json
 INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting beam from interpreter.json
 INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting geode from interpreter.json
 INFO [2018-12-21 21:36:19,837] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting jdbc from interpreter.json
 INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting lens from interpreter.json
 INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting pig from interpreter.json
 INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting file from interpreter.json
 INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting java from interpreter.json
 INFO [2018-12-21 21:36:19,840] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting elasticsearch from interpreter.json
 INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting submarine from interpreter.json
 INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sh from interpreter.json
 INFO [2018-12-21 21:36:19,842] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting spark from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting md from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hazelcastjet from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting alluxio from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting bigquery from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hbase from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting python from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sap from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting scalding from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting flink from interpreter.json
 INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting angular from interpreter.json
 INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting livy from interpreter.json
 INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting neo4j from interpreter.json
 INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting groovy from interpreter.json
 INFO [2018-12-21 21:36:19,848] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting cassandra from interpreter.json


在 2018年12月22日,上午6:39,shyla deshpande <[hidden email]> 写道:

I think the problem is, I don't see cassandra Interpreter group. How do I add cassandra Intepreter grouo? 
<Screen Shot 2018-12-21 at 2.36.51 PM.png>

On Fri, Dec 21, 2018 at 2:24 PM shyla deshpande <[hidden email]> wrote:
Directory /usr/lib/zeppelin/interpreter/cassandra already exists.

But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
What are the properties name and value I should specify. Any dependencies I should add?

Appreciate your help
Thanks
-shyla

Reply | Threaded
Open this post in threaded view
|

Re: How to add Cassandra Interpreter to Zeppelin on EMR?

Xun Liu
I don't have Cassandra in my zeppelin, so I can only help you guess where the problem is from the log.

From your log, These two questions should all be caused by the lack of dependent JAR packages that Cassandra runs. You may not be setting up the runtime environment for Cassandra(or scala) correctly.
You can look at the missing class according to the log, then download the JAR package from the class name to the `zeppelin/interpreter/Cassandra/…` directory and try to solve the problem.


在 2018年12月23日,上午12:03,shyla deshpande <[hidden email]> 写道:

I wanted to add that I am using
            emr-5.20.0
Applications:Spark 2.4.0, Zeppelin 0.8.0, 
Thanks 

On Sat, Dec 22, 2018 at 7:56 AM shyla deshpande <[hidden email]> wrote:
Hi Xun,

Thank you for your response. You set me in the right direction and I made some progress.
I still have 2 issues.
1. I was able to add the cassandra interpreter. But now I am getting the following error. 
<Screen Shot 2018-12-22 at 7.51.35 AM.png>
2. I am unable to add spark-cassandra-connector 
<Screen Shot 2018-12-22 at 7.44.50 AM.png>

I appreciate your help.
Thanks
-Shyla

On Fri, Dec 21, 2018 at 7:21 PM Xun Liu <[hidden email]> wrote:
hi, shyla deshpande

You can check if the cassandra interpreter is registered in zeppelin's startup log in the zeppelin/logs/zeppelin-{hostname}.log file.
You may need to restart zeppelin and you can easily see the interpreter registration information.

 INFO [2018-12-21 21:36:18,967] ({Thread-13} RemoteInterpreterEventServer.java[run]:103) - InterpreterEventServer is starting at 10.120.196.234:48573
 INFO [2018-12-21 21:36:19,455] ({main} RemoteInterpreterEventServer.java[start]:127) - RemoteInterpreterEventServer is started
 INFO [2018-12-21 21:36:19,492] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hazelcastjet
 INFO [2018-12-21 21:36:19,497] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: flink
 INFO [2018-12-21 21:36:19,501] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: ignite
 INFO [2018-12-21 21:36:19,509] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: kylin
 INFO [2018-12-21 21:36:19,512] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: angular
 WARN [2018-12-21 21:36:19,546] ({main} InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:335) - No interpreter-setting.json found in /home/hadoop/zeppelin-current/interpreter/scio
 INFO [2018-12-21 21:36:19,550] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: cassandra
 INFO [2018-12-21 21:36:19,553] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: scalding
 INFO [2018-12-21 21:36:19,555] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: lens
 INFO [2018-12-21 21:36:19,559] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: livy
 INFO [2018-12-21 21:36:19,562] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: java
 INFO [2018-12-21 21:36:19,565] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sh
 INFO [2018-12-21 21:36:19,567] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: alluxio
 INFO [2018-12-21 21:36:19,570] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: beam
 INFO [2018-12-21 21:36:19,572] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: elasticsearch
 INFO [2018-12-21 21:36:19,575] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: md
 INFO [2018-12-21 21:36:19,578] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: spark
 INFO [2018-12-21 21:36:19,580] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: file
 INFO [2018-12-21 21:36:19,584] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: submarine
 INFO [2018-12-21 21:36:19,586] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: geode
 INFO [2018-12-21 21:36:19,588] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: bigquery
 INFO [2018-12-21 21:36:19,590] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: pig
 INFO [2018-12-21 21:36:19,593] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: neo4j
 INFO [2018-12-21 21:36:19,595] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hbase
 INFO [2018-12-21 21:36:19,597] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: groovy
 INFO [2018-12-21 21:36:19,599] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sap
 INFO [2018-12-21 21:36:19,602] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: python
 INFO [2018-12-21 21:36:19,604] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: jdbc
 INFO [2018-12-21 21:36:19,610] ({main} FileSystemConfigStorage.java[loadInterpreterSettings]:75) - Load Interpreter Setting from file: hdfs://mldev/user/hadoop/zeppelin/conf/interpreter.json
 INFO [2018-12-21 21:36:19,835] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting ignite from interpreter.json
 INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting beam from interpreter.json
 INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting geode from interpreter.json
 INFO [2018-12-21 21:36:19,837] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting jdbc from interpreter.json
 INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting lens from interpreter.json
 INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting pig from interpreter.json
 INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting file from interpreter.json
 INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting java from interpreter.json
 INFO [2018-12-21 21:36:19,840] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting elasticsearch from interpreter.json
 INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting submarine from interpreter.json
 INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sh from interpreter.json
 INFO [2018-12-21 21:36:19,842] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting spark from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting md from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hazelcastjet from interpreter.json
 INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting alluxio from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting bigquery from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hbase from interpreter.json
 INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting python from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sap from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting scalding from interpreter.json
 INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting flink from interpreter.json
 INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting angular from interpreter.json
 INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting livy from interpreter.json
 INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting neo4j from interpreter.json
 INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting groovy from interpreter.json
 INFO [2018-12-21 21:36:19,848] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting cassandra from interpreter.json


在 2018年12月22日,上午6:39,shyla deshpande <[hidden email]> 写道:

I think the problem is, I don't see cassandra Interpreter group. How do I add cassandra Intepreter grouo? 
<Screen Shot 2018-12-21 at 2.36.51 PM.png>

On Fri, Dec 21, 2018 at 2:24 PM shyla deshpande <[hidden email]> wrote:
Directory /usr/lib/zeppelin/interpreter/cassandra already exists.

But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
What are the properties name and value I should specify. Any dependencies I should add?

Appreciate your help
Thanks
-shyla