Re: future plans for Zeppelin

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: future plans for Zeppelin

moon
Administrator
Can you make sure, Application State is 'RUNNING' in your spark master UI? like,


And can you make sure you workers registered with 'ALIVE' State?



Thanks,
moon


On Wed, Jun 24, 2015 at 3:55 AM Wood, Dean Jr (GE Oil & Gas) <[hidden email]> wrote:
Hi,

Is this related to the issue I had Moon? It sounds like nearly the same thing.

Also, check on your cluster to see if an application has failed to terminate. I had the same issue and it was a hung process.

Dean



On 24 Jun 2015, at 09:52, Victor Manuel Garcia <[hidden email]<mailto:[hidden email]>> wrote:

Hi moon,
I have enough resources in the cluster, when I run in local [*] mode
no problems, but when I try a standalone cluster in aws gives the
following error, when try to execute the tutorial zeppelin in the part
of sql:

Granted executor ID app-20150623103023-0000/5 on hostPort
ip-172-31-17-217.ec2.internal:44733 with 2 cores, 512.0 MB RAM
INFO [2015-06-23 12:33:06,511]
({sparkDriver-akka.actor.default-dispatcher-3}
Logging.scala[logInfo]:59) - Executor updated:
app-20150623103023-0000/5 is now LOADING
INFO [2015-06-23 12:33:06,639]
({sparkDriver-akka.actor.default-dispatcher-3}
Logging.scala[logInfo]:59) - Executor updated:
app-20150623103023-0000/5 is now RUNNING
WARN [2015-06-23 12:33:20,459] ({Timer-0}
Logging.scala[logWarning]:71) - Initial job has not accepted any
resources; check your cluster UI to ensure that workers are registered
and have sufficient resources

thks

2015-06-23 20:01 GMT+02:00 moon soo Lee <[hidden email]<mailto:[hidden email]>>:
Hi,

Your error message has an instruction. "Check your cluster UI to ensure that
workers are registered and have sufficient resources".
Could you make sure if your spark cluster have enough resources?

Thanks,
moon


On Tue, Jun 23, 2015 at 3:51 AM Victor Manuel Garcia
<[hidden email]<mailto:[hidden email]>> wrote:

Hi guys,
when try to execute the tutorial in zeppelin in the part of sql no
working fine, the error is:

Granted executor ID app-20150623103023-0000/5 on hostPort
ip-172-31-17-217.ec2.internal:44733 with 2 cores, 512.0 MB RAM
INFO [2015-06-23 12:33:06,511]
({sparkDriver-akka.actor.default-dispatcher-3}
Logging.scala[logInfo]:59) - Executor updated:
app-20150623103023-0000/5 is now LOADING
INFO [2015-06-23 12:33:06,639]
({sparkDriver-akka.actor.default-dispatcher-3}
Logging.scala[logInfo]:59) - Executor updated:
app-20150623103023-0000/5 is now RUNNING
WARN [2015-06-23 12:33:20,459] ({Timer-0}
Logging.scala[logWarning]:71) - Initial job has not accepted any
resources; check your cluster UI to ensure that workers are registered
and have sufficient resources

any idea

thks

2015-06-23 10:20 GMT+02:00 Borisa Zivkovic <[hidden email]<mailto:[hidden email]>>:
great.. thanks for the answers... code completion is very good - I
just could not find it documented anywhere...

I think this project is great - but documentation could be improved in
few places...

thanks again for your help

Borisa Zivkovic

----------------
"Believe you can, believe you can't; either way, you're right."


On Mon, Jun 22, 2015 at 4:50 PM, Kevin (Sangwoo) Kim
<[hidden email]<mailto:[hidden email]>> wrote:
Hi Borisa,

You can see Z's roadmap docs here:
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_incubator-2Dzeppelin_blob_master_Roadmap.md&d=AwIFaQ&c=IV_clAzoPDE253xZdHuilRgztyh_RiV3wUrLrDQYWSI&r=C6rdvMYZDOvgGg5mqGWcidO2RK8DHopadY7gNniB1Do&m=WBvxcirgfIRyNX_TPULyOgdgmb6rd9M-WIV_r988-ms&s=IxQBqNOX2SnDH2k_KNOVcXxEWPvxzcvmHX_jN8ewxXw&e=

Here's some answers
1) code completion:
Z already has code completion feature, which can be accessed with
CTRL+.
(It's not really mature though, you can always contribute for it!)

2) NFLabs, a company leading development of Zeppelin is preparing a
internal
product called Zeppelin hub.
https://urldefense.proofpoint.com/v2/url?u=https-3A__www.zeppelinhub.com_&d=AwIFaQ&c=IV_clAzoPDE253xZdHuilRgztyh_RiV3wUrLrDQYWSI&r=C6rdvMYZDOvgGg5mqGWcidO2RK8DHopadY7gNniB1Do&m=WBvxcirgfIRyNX_TPULyOgdgmb6rd9M-WIV_r988-ms&s=yYs0_yX_xb7zz3py-YyUR88NoNITFyUw8lAcVPhBqvE&e=

3) You can easily change name of a notebook, as tog answered :)

Cheers,
Kevin


2015년 6월 22일 (월) 오후 11:33, IT CTO <[hidden email]<mailto:[hidden email]>>님이 작성:

If i recall the original zepplin had autocomplete feature which was
never
a complete feature.  I don't know if it was ported to apache.
Moon?
Eran


בתאריך יום ב׳, 22 ביונ 2015, 16:55 מאת Borisa Zivkovic
<[hidden email]<mailto:[hidden email]>>:

great...

1) thanks for renaming hint... I guess I did not try that :)
2) I will file feature request regarding versioning and exporting,
thanks

I would appreciate if someone can let me know if code completion is
planned or at least if it would be accepted if someone added it?

thanks

Borisa Zivkovic

----------------
"Believe you can, believe you can't; either way, you're right."


On Mon, Jun 22, 2015 at 1:39 PM, IT CTO <[hidden email]<mailto:[hidden email]>> wrote:
About exporting, you can find a previous thread mail about this
issue.
it is
supported (somewhat) with script and you should log it as feature
request.
Eran

On Mon, Jun 22, 2015 at 3:28 PM tog <[hidden email]<mailto:[hidden email]>>
wrote:

Hi Borisa

I will not answer 1 and 2 but as far as notebook names is
concerned,
you
can freely rename them by clicking in the assigned name.

Cheers

On 22 June 2015 at 12:05, Borisa Zivkovic
<[hidden email]<mailto:[hidden email]>>
wrote:

Hi,

I am investigating how to use Zeppelin in our environment. I
could
not
find any written plans for Zeppelin, is there any page with this?
I
tried to figure this out from JIRA but could not find too many
new
feature requests.

Are there any plans to add any of the following features:

1) code completion

2) some kind of exporting and versioning of notebooks, so that it
is
easier to collaborate with others and have versioning support.
Maybe
some integration with git?

3) better naming of notebooks - because today it is very hard to
figure out where is what, names are randomly assigned and it is
not
possible to change that.
Maybe to use something similar to how docker names containers, or
offer to users ability to rename notebooks if they want



thanks

Borisa




--
PGP KeyID: 2048R/EA31CFC9  subkeys.pgp.net<http://subkeys.pgp.net>



--
Victor Manuel García
Ingeniero de Software

[+34] 672104297  | [hidden email]<mailto:[hidden email]>



--
Victor Manuel García
Ingeniero de Software

[+34] 672104297  | [hidden email]<mailto:[hidden email]>

Loading...