note.json or interpreter.json format change?

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

note.json or interpreter.json format change?

Ruslan Dautkhanov
Testing a newer Zeppelin version from yesterday's zeppelin snapshot.
Noticed it doesn't see majority of my notebooks.
Our previous Zeppelin version is ~end of April snapshot of Zeppelin.
Did the format of note.json or interpreter.json expected format change
in a way that made those note.json notebooks not show up?


Thanks,
Ruslan Dautkhanov
Reply | Threaded
Open this post in threaded view
|

Re: note.json or interpreter.json format change?

Ruslan Dautkhanov
I guess exception in the log might be why- see [1].
Any fixes/ workarounds for this issue?


[1]

ERROR [2017-08-28 11:25:52,628] ({main} VFSNotebookRepo.java[list]:151) - Can't read note file:///home/rdautkha/zeppelin/notebooks/2CJW01020
com.google.gson.JsonSyntaxException: 2017-08-27 19:56:22.229
        at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:81)
        at com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:66)
        at com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:41)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
        at com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.read(TypeAdapterRuntimeTypeWrapper.java:40)
        at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:81)
        at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:60)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
        at com.google.gson.Gson.fromJson(Gson.java:791)
        at com.google.gson.Gson.fromJson(Gson.java:757)
        at com.google.gson.Gson.fromJson(Gson.java:706)
        at com.google.gson.Gson.fromJson(Gson.java:678)
        at org.apache.zeppelin.notebook.Note.fromJson(Note.java:898)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNote(VFSNotebookRepo.java:178)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNoteInfo(VFSNotebookRepo.java:201)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.list(VFSNotebookRepo.java:146)
        at org.apache.zeppelin.notebook.repo.NotebookRepoSync.list(NotebookRepoSync.java:158)
        at org.apache.zeppelin.notebook.Notebook.loadAllNotes(Notebook.java:553)
        at org.apache.zeppelin.notebook.Notebook.<init>(Notebook.java:124)
        at org.apache.zeppelin.server.ZeppelinServer.<init>(ZeppelinServer.java:158)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:382)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.init(CXFNonSpringJaxrsServlet.java:93)
        at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
        at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:396)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:871)
        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:298)
        at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:163)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.server.Server.start(Server.java:387)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.Server.doStart(Server.java:354)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:195)
Caused by: java.text.ParseException: Unparseable date: "2017-08-27 19:56:22.229"
        at java.text.DateFormat.parse(DateFormat.java:357)
        at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:79)
        ... 50 more




--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 11:32 AM, Ruslan Dautkhanov <[hidden email]> wrote:
Testing a newer Zeppelin version from yesterday's zeppelin snapshot.
Noticed it doesn't see majority of my notebooks.
Our previous Zeppelin version is ~end of April snapshot of Zeppelin.
Did the format of note.json or interpreter.json expected format change
in a way that made those note.json notebooks not show up?


Thanks,
Ruslan Dautkhanov

Reply | Threaded
Open this post in threaded view
|

Re: note.json or interpreter.json format change?

Ruslan Dautkhanov
There is a date format change 

current zeppelin snapshot note.json date format example
      "dateUpdated": "2017-08-27 19:56:22.229",

~May-1st zeppelin note.json date format example
      "dateUpdated": "May 5, 2017 2:55:34 PM",

This breaks note.json compatibility.
Can somebody please point me to PR / jria for this change?
Any workarounds that would make an upgrade easier?
Also, this change makes reverting zeppelin upgrades impossible. 




--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 11:35 AM, Ruslan Dautkhanov <[hidden email]> wrote:
I guess exception in the log might be why- see [1].
Any fixes/ workarounds for this issue?


[1]

ERROR [2017-08-28 11:25:52,628] ({main} VFSNotebookRepo.java[list]:151) - Can't read note file:///home/rdautkha/zeppelin/notebooks/2CJW01020
com.google.gson.JsonSyntaxException: 2017-08-27 19:56:22.229
        at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:81)
        at com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:66)
        at com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:41)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
        at com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.read(TypeAdapterRuntimeTypeWrapper.java:40)
        at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:81)
        at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:60)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
        at com.google.gson.Gson.fromJson(Gson.java:791)
        at com.google.gson.Gson.fromJson(Gson.java:757)
        at com.google.gson.Gson.fromJson(Gson.java:706)
        at com.google.gson.Gson.fromJson(Gson.java:678)
        at org.apache.zeppelin.notebook.Note.fromJson(Note.java:898)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNote(VFSNotebookRepo.java:178)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNoteInfo(VFSNotebookRepo.java:201)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.list(VFSNotebookRepo.java:146)
        at org.apache.zeppelin.notebook.repo.NotebookRepoSync.list(NotebookRepoSync.java:158)
        at org.apache.zeppelin.notebook.Notebook.loadAllNotes(Notebook.java:553)
        at org.apache.zeppelin.notebook.Notebook.<init>(Notebook.java:124)
        at org.apache.zeppelin.server.ZeppelinServer.<init>(ZeppelinServer.java:158)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:382)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.init(CXFNonSpringJaxrsServlet.java:93)
        at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
        at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:396)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:871)
        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:298)
        at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:163)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.server.Server.start(Server.java:387)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.Server.doStart(Server.java:354)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:195)
Caused by: java.text.ParseException: Unparseable date: "2017-08-27 19:56:22.229"
        at java.text.DateFormat.parse(DateFormat.java:357)
        at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:79)
        ... 50 more




--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 11:32 AM, Ruslan Dautkhanov <[hidden email]> wrote:
Testing a newer Zeppelin version from yesterday's zeppelin snapshot.
Noticed it doesn't see majority of my notebooks.
Our previous Zeppelin version is ~end of April snapshot of Zeppelin.
Did the format of note.json or interpreter.json expected format change
in a way that made those note.json notebooks not show up?


Thanks,
Ruslan Dautkhanov


Reply | Threaded
Open this post in threaded view
|

Re: note.json or interpreter.json format change?

Jianfeng (Jeff) Zhang

Do you use the latest zeppelin master branch ? I see this issue before, but believe it has been fixed.


Best Regard,
Jeff Zhang


From: Ruslan Dautkhanov <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Tuesday, August 29, 2017 at 1:50 AM
To: Zeppelin Users <[hidden email]>
Subject: Re: note.json or interpreter.json format change?

There is a date format change 

current zeppelin snapshot note.json date format example
      "dateUpdated": "2017-08-27 19:56:22.229",

~May-1st zeppelin note.json date format example
      "dateUpdated": "May 5, 2017 2:55:34 PM",

This breaks note.json compatibility.
Can somebody please point me to PR / jria for this change?
Any workarounds that would make an upgrade easier?
Also, this change makes reverting zeppelin upgrades impossible. 




--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 11:35 AM, Ruslan Dautkhanov <[hidden email]> wrote:
I guess exception in the log might be why- see [1].
Any fixes/ workarounds for this issue?


[1]

ERROR [2017-08-28 11:25:52,628] ({main} VFSNotebookRepo.java[list]:151) - Can't read note file:///home/rdautkha/zeppelin/notebooks/2CJW01020
com.google.gson.JsonSyntaxException: 2017-08-27 19:56:22.229
        at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:81)
        at com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:66)
        at com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:41)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
        at com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.read(TypeAdapterRuntimeTypeWrapper.java:40)
        at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:81)
        at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:60)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
        at com.google.gson.Gson.fromJson(Gson.java:791)
        at com.google.gson.Gson.fromJson(Gson.java:757)
        at com.google.gson.Gson.fromJson(Gson.java:706)
        at com.google.gson.Gson.fromJson(Gson.java:678)
        at org.apache.zeppelin.notebook.Note.fromJson(Note.java:898)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNote(VFSNotebookRepo.java:178)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNoteInfo(VFSNotebookRepo.java:201)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.list(VFSNotebookRepo.java:146)
        at org.apache.zeppelin.notebook.repo.NotebookRepoSync.list(NotebookRepoSync.java:158)
        at org.apache.zeppelin.notebook.Notebook.loadAllNotes(Notebook.java:553)
        at org.apache.zeppelin.notebook.Notebook.<init>(Notebook.java:124)
        at org.apache.zeppelin.server.ZeppelinServer.<init>(ZeppelinServer.java:158)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:382)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.init(CXFNonSpringJaxrsServlet.java:93)
        at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
        at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:396)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:871)
        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:298)
        at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:163)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.server.Server.start(Server.java:387)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.Server.doStart(Server.java:354)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:195)
Caused by: java.text.ParseException: Unparseable date: "2017-08-27 19:56:22.229"
        at java.text.DateFormat.parse(DateFormat.java:357)
        at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:79)
        ... 50 more




--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 11:32 AM, Ruslan Dautkhanov <[hidden email]> wrote:
Testing a newer Zeppelin version from yesterday's zeppelin snapshot.
Noticed it doesn't see majority of my notebooks.
Our previous Zeppelin version is ~end of April snapshot of Zeppelin.
Did the format of note.json or interpreter.json expected format change
in a way that made those note.json notebooks not show up?


Thanks,
Ruslan Dautkhanov


Reply | Threaded
Open this post in threaded view
|

Re: note.json or interpreter.json format change?

Ruslan Dautkhanov
This problem only happens when trying to upgraded Zeppelin (yes, from yesterday's snapshot) and then switching back
to May-old Zeppelin.
Date format has changed in all fields - "dateCreated", "dateStarted", "dateFinished"
Impact limited to only notebooks modified in the newer version of Zeppelin - they'll not show up in list of available notebooks.



--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 6:07 PM, Jianfeng (Jeff) Zhang <[hidden email]> wrote:

Do you use the latest zeppelin master branch ? I see this issue before, but believe it has been fixed.


Best Regard,
Jeff Zhang


From: Ruslan Dautkhanov <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Tuesday, August 29, 2017 at 1:50 AM
To: Zeppelin Users <[hidden email]>
Subject: Re: note.json or interpreter.json format change?

There is a date format change 

current zeppelin snapshot note.json date format example
      "dateUpdated": "2017-08-27 19:56:22.229",

~May-1st zeppelin note.json date format example
      "dateUpdated": "May 5, 2017 2:55:34 PM",

This breaks note.json compatibility.
Can somebody please point me to PR / jria for this change?
Any workarounds that would make an upgrade easier?
Also, this change makes reverting zeppelin upgrades impossible. 




--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 11:35 AM, Ruslan Dautkhanov <[hidden email]> wrote:
I guess exception in the log might be why- see [1].
Any fixes/ workarounds for this issue?


[1]

ERROR [2017-08-28 11:25:52,628] ({main} VFSNotebookRepo.java[list]:151) - Can't read note file:///home/rdautkha/zeppelin/notebooks/2CJW01020
com.google.gson.JsonSyntaxException: 2017-08-27 19:56:22.229
        at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:81)
        at com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:66)
        at com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:41)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
        at com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.read(TypeAdapterRuntimeTypeWrapper.java:40)
        at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:81)
        at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:60)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
        at com.google.gson.Gson.fromJson(Gson.java:791)
        at com.google.gson.Gson.fromJson(Gson.java:757)
        at com.google.gson.Gson.fromJson(Gson.java:706)
        at com.google.gson.Gson.fromJson(Gson.java:678)
        at org.apache.zeppelin.notebook.Note.fromJson(Note.java:898)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNote(VFSNotebookRepo.java:178)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNoteInfo(VFSNotebookRepo.java:201)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.list(VFSNotebookRepo.java:146)
        at org.apache.zeppelin.notebook.repo.NotebookRepoSync.list(NotebookRepoSync.java:158)
        at org.apache.zeppelin.notebook.Notebook.loadAllNotes(Notebook.java:553)
        at org.apache.zeppelin.notebook.Notebook.<init>(Notebook.java:124)
        at org.apache.zeppelin.server.ZeppelinServer.<init>(ZeppelinServer.java:158)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:382)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.init(CXFNonSpringJaxrsServlet.java:93)
        at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
        at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:396)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:871)
        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:298)
        at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:163)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.server.Server.start(Server.java:387)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.Server.doStart(Server.java:354)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:195)
Caused by: java.text.ParseException: Unparseable date: "2017-08-27 19:56:22.229"
        at java.text.DateFormat.parse(DateFormat.java:357)
        at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:79)
        ... 50 more




--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 11:32 AM, Ruslan Dautkhanov <[hidden email]> wrote:
Testing a newer Zeppelin version from yesterday's zeppelin snapshot.
Noticed it doesn't see majority of my notebooks.
Our previous Zeppelin version is ~end of April snapshot of Zeppelin.
Did the format of note.json or interpreter.json expected format change
in a way that made those note.json notebooks not show up?


Thanks,
Ruslan Dautkhanov



Reply | Threaded
Open this post in threaded view
|

Re: note.json or interpreter.json format change?

Jeff Zhang

Yeah, that bug happens in around May. But it should only happen in the snapshot version, not in any release version. 


Ruslan Dautkhanov <[hidden email]>于2017年8月29日周二 下午1:01写道:
This problem only happens when trying to upgraded Zeppelin (yes, from yesterday's snapshot) and then switching back
to May-old Zeppelin.
Date format has changed in all fields - "dateCreated", "dateStarted", "dateFinished"
Impact limited to only notebooks modified in the newer version of Zeppelin - they'll not show up in list of available notebooks.



--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 6:07 PM, Jianfeng (Jeff) Zhang <[hidden email]> wrote:

Do you use the latest zeppelin master branch ? I see this issue before, but believe it has been fixed.


Best Regard,
Jeff Zhang


From: Ruslan Dautkhanov <[hidden email]>
Reply-To: "[hidden email]" <[hidden email]>
Date: Tuesday, August 29, 2017 at 1:50 AM
To: Zeppelin Users <[hidden email]>
Subject: Re: note.json or interpreter.json format change?

There is a date format change 

current zeppelin snapshot note.json date format example
      "dateUpdated": "2017-08-27 19:56:22.229",

~May-1st zeppelin note.json date format example
      "dateUpdated": "May 5, 2017 2:55:34 PM",

This breaks note.json compatibility.
Can somebody please point me to PR / jria for this change?
Any workarounds that would make an upgrade easier?
Also, this change makes reverting zeppelin upgrades impossible. 




--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 11:35 AM, Ruslan Dautkhanov <[hidden email]> wrote:
I guess exception in the log might be why- see [1].
Any fixes/ workarounds for this issue?


[1]

ERROR [2017-08-28 11:25:52,628] ({main} VFSNotebookRepo.java[list]:151) - Can't read note file:///home/rdautkha/zeppelin/notebooks/2CJW01020
com.google.gson.JsonSyntaxException: 2017-08-27 19:56:22.229
        at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:81)
        at com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:66)
        at com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:41)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
        at com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.read(TypeAdapterRuntimeTypeWrapper.java:40)
        at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:81)
        at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:60)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
        at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
        at com.google.gson.Gson.fromJson(Gson.java:791)
        at com.google.gson.Gson.fromJson(Gson.java:757)
        at com.google.gson.Gson.fromJson(Gson.java:706)
        at com.google.gson.Gson.fromJson(Gson.java:678)
        at org.apache.zeppelin.notebook.Note.fromJson(Note.java:898)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNote(VFSNotebookRepo.java:178)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNoteInfo(VFSNotebookRepo.java:201)
        at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.list(VFSNotebookRepo.java:146)
        at org.apache.zeppelin.notebook.repo.NotebookRepoSync.list(NotebookRepoSync.java:158)
        at org.apache.zeppelin.notebook.Notebook.loadAllNotes(Notebook.java:553)
        at org.apache.zeppelin.notebook.Notebook.<init>(Notebook.java:124)
        at org.apache.zeppelin.server.ZeppelinServer.<init>(ZeppelinServer.java:158)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:382)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
        at org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.init(CXFNonSpringJaxrsServlet.java:93)
        at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
        at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:396)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:871)
        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:298)
        at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:163)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at org.eclipse.jetty.server.Server.start(Server.java:387)
        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at org.eclipse.jetty.server.Server.doStart(Server.java:354)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:195)
Caused by: java.text.ParseException: Unparseable date: "2017-08-27 19:56:22.229"
        at java.text.DateFormat.parse(DateFormat.java:357)
        at com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:79)
        ... 50 more




--
Ruslan Dautkhanov

On Mon, Aug 28, 2017 at 11:32 AM, Ruslan Dautkhanov <[hidden email]> wrote:
Testing a newer Zeppelin version from yesterday's zeppelin snapshot.
Noticed it doesn't see majority of my notebooks.
Our previous Zeppelin version is ~end of April snapshot of Zeppelin.
Did the format of note.json or interpreter.json expected format change
in a way that made those note.json notebooks not show up?


Thanks,
Ruslan Dautkhanov