"Reload notes from storage" button overwrites recent edits

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

"Reload notes from storage" button overwrites recent edits

Partridge, Lucas (GE Aviation)

When a user clicks on this button on the Zeppelin homepage:

Screen Clipping

…which notebooks are reloaded from storage: all the notebooks, or only the notebooks that belong to the user who clicked the refresh button?

 

Unfortunately in our setup, where all the notebooks are backed up on S3, it appears to be all the notebooks. This means that if any user on the multi-user system hits that button, then any notebook edits made since the last backup to S3 made by any user will be overwritten by the old copies.  This is immensely frustrating for the users who lose their edits! So, is this a known issue in Zeppelin; or is there a recommended way of syncing with S3 so that only the notebooks of the user who hits that button get refreshed?

 

BTW when the sync with S3 or wherever occurs, aren’t the timestamps of the individual files compared first to determine which ways the files should be copied? If the S3 copy is newer then the local notebook should be overwritten (assuming times are in sync between the zeppelin host and S3). If the local copy is newer than that should be used to overwrite the copy in S3.  If this process were followed then it wouldn’t matter if everyone’s notebooks were updated when someone hits that button. This assumes Zeppelin can tell if someone is actively editing a paragraph that hasn’t even been executed yet though.

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

FW: "Reload notes from storage" button overwrites recent edits

Partridge, Lucas (GE Aviation)

Bump: “is this a known issue in Zeppelin; or is there a recommended way of syncing with S3 so that only the notebooks of the user who hits that button get refreshed?”

 

Has no one else encountered this problem of notebook refreshing overwriting other users’ edits?

 

Dropbox, Box, Steam, etc handle syncing of files between devices and cloud storage without the need for a refresh button at all, but I guess it would be a big job to replicate this behaviour in Zeppelin.

 

From: Partridge, Lucas (GE Aviation)
Sent: 25 July 2017 10:10
To: [hidden email]
Subject: EXT: "Reload notes from storage" button overwrites recent edits

 

When a user clicks on this button on the Zeppelin homepage:

Screen Clipping

…which notebooks are reloaded from storage: all the notebooks, or only the notebooks that belong to the user who clicked the refresh button?

 

Unfortunately in our setup, where all the notebooks are backed up on S3, it appears to be all the notebooks. This means that if any user on the multi-user system hits that button, then any notebook edits made since the last backup to S3 made by any user will be overwritten by the old copies.  This is immensely frustrating for the users who lose their edits! So, is this a known issue in Zeppelin; or is there a recommended way of syncing with S3 so that only the notebooks of the user who hits that button get refreshed?

 

BTW when the sync with S3 or wherever occurs, aren’t the timestamps of the individual files compared first to determine which ways the files should be copied? If the S3 copy is newer then the local notebook should be overwritten (assuming times are in sync between the zeppelin host and S3). If the local copy is newer than that should be used to overwrite the copy in S3.  If this process were followed then it wouldn’t matter if everyone’s notebooks were updated when someone hits that button. This assumes Zeppelin can tell if someone is actively editing a paragraph that hasn’t even been executed yet though.

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: "Reload notes from storage" button overwrites recent edits

David Howell

My experience is that to save to S3, you don't need to press that button at all. Just executing any paragraph seems to be enough, doesn't matter which interpreter. I often run a markdown paragraph if I want to save spark code that I am not ready to execute.

That button is more of a workbook reload

 

From: [hidden email]
Sent: Friday, 28 July 2017 12:17 AM
To: [hidden email]
Subject: FW: "Reload notes from storage" button overwrites recent edits

 

Bump: “is this a known issue in Zeppelin; or is there a recommended way of syncing with S3 so that only the notebooks of the user who hits that button get refreshed?”

 

Has no one else encountered this problem of notebook refreshing overwriting other users’ edits?

 

Dropbox, Box, Steam, etc handle syncing of files between devices and cloud storage without the need for a refresh button at all, but I guess it would be a big job to replicate this behaviour in Zeppelin.

 

From: Partridge, Lucas (GE Aviation)
Sent: 25 July 2017 10:10
To: [hidden email]
Subject: EXT: "Reload notes from storage" button overwrites recent edits

 

When a user clicks on this button on the Zeppelin homepage:

Screen Clipping

…which notebooks are reloaded from storage: all the notebooks, or only the notebooks that belong to the user who clicked the refresh button?

 

Unfortunately in our setup, where all the notebooks are backed up on S3, it appears to be all the notebooks. This means that if any user on the multi-user system hits that button, then any notebook edits made since the last backup to S3 made by any user will be overwritten by the old copies.  This is immensely frustrating for the users who lose their edits! So, is this a known issue in Zeppelin; or is there a recommended way of syncing with S3 so that only the notebooks of the user who hits that button get refreshed?

 

BTW when the sync with S3 or wherever occurs, aren’t the timestamps of the individual files compared first to determine which ways the files should be copied? If the S3 copy is newer then the local notebook should be overwritten (assuming times are in sync between the zeppelin host and S3). If the local copy is newer than that should be used to overwrite the copy in S3.  If this process were followed then it wouldn’t matter if everyone’s notebooks were updated when someone hits that button. This assumes Zeppelin can tell if someone is actively editing a paragraph that hasn’t even been executed yet though.

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: "Reload notes from storage" button overwrites recent edits

Partridge, Lucas (GE Aviation)

@David – I understand that button is for reloading rather than saving notebooks.  Unfortunately your suggestion didn’t work for me in Zeppelin 0.7.0 – edits to one (unexecuted) paragraph were lost when the notebooks were reloaded, even after running another (%md) paragraph in the same notebook.

 

I did some other experiments and found that if you execute the paragraph after the edits then your latest edits in that paragraph won’t be lost when the notebooks are reloaded. But any edits made to a paragraph since it has last been executed will be lost when any user presses the Notebook refresh. And the point is you don’t know when any other user could do that.

 

However someone told me that the keyboard combo Ctrl-Shift-= saves a paragraph without executing it. This appears to be true from the tests I’ve done. Note that it will only save edits made to the current paragraph you’re in; edits made to any other paragraphs that haven’t been executed will still be lost when someone refreshes the notebooks.

 

(Ctrl-Shift-= is missing from the list of keyboard shortcuts, so I don’t know how they discovered it.)

 

From: David Howell [mailto:[hidden email]]
Sent: 27 July 2017 23:42
To: Partridge, Lucas (GE Aviation) <[hidden email]>; [hidden email]
Subject: EXT: RE: "Reload notes from storage" button overwrites recent edits

 

My experience is that to save to S3, you don't need to press that button at all. Just executing any paragraph seems to be enough, doesn't matter which interpreter. I often run a markdown paragraph if I want to save spark code that I am not ready to execute.

That button is more of a workbook reload

 

From: [hidden email]
Sent: Friday, 28 July 2017 12:17 AM
To: [hidden email]
Subject: FW: "Reload notes from storage" button overwrites recent edits

 

Bump: “is this a known issue in Zeppelin; or is there a recommended way of syncing with S3 so that only the notebooks of the user who hits that button get refreshed?”

 

Has no one else encountered this problem of notebook refreshing overwriting other users’ edits?

 

Dropbox, Box, Steam, etc handle syncing of files between devices and cloud storage without the need for a refresh button at all, but I guess it would be a big job to replicate this behaviour in Zeppelin.

 

From: Partridge, Lucas (GE Aviation)
Sent: 25 July 2017 10:10
To: [hidden email]
Subject: EXT: "Reload notes from storage" button overwrites recent edits

 

When a user clicks on this button on the Zeppelin homepage:

Screen Clipping

…which notebooks are reloaded from storage: all the notebooks, or only the notebooks that belong to the user who clicked the refresh button?

 

Unfortunately in our setup, where all the notebooks are backed up on S3, it appears to be all the notebooks. This means that if any user on the multi-user system hits that button, then any notebook edits made since the last backup to S3 made by any user will be overwritten by the old copies.  This is immensely frustrating for the users who lose their edits! So, is this a known issue in Zeppelin; or is there a recommended way of syncing with S3 so that only the notebooks of the user who hits that button get refreshed?

 

BTW when the sync with S3 or wherever occurs, aren’t the timestamps of the individual files compared first to determine which ways the files should be copied? If the S3 copy is newer then the local notebook should be overwritten (assuming times are in sync between the zeppelin host and S3). If the local copy is newer than that should be used to overwrite the copy in S3.  If this process were followed then it wouldn’t matter if everyone’s notebooks were updated when someone hits that button. This assumes Zeppelin can tell if someone is actively editing a paragraph that hasn’t even been executed yet though.

Loading...