Skip to content

**MOVED** Data Archiving and Sharing

Utku Kaya edited this page Feb 10, 2021 · 1 revision

All recording sessions need to be backed up and logged in the lab spreadsheet for easy access and sharing. How do we do this? There are 3 basic steps.

1) Back it up immediately!

After a recording, immediately transfer your data from the hard drive to cloud storage on your personal google drive and then copy it over to the "Diba Lab Data" team drive (accessible from your umich.edu google drive). You can do this by:

  • a) (Not recommended) drag-and-drop directly to BOTH google drives from your local (recording) computer, or
  • b) (Recommended) dragging and dropping to your personal drive and then copying over to the team drive using rclone via the command line.

Option b will probably minimize the number of errors we see while archiving. See the rclone setup and usage pages. (DON'T WORRY ABOUT COPYING OVER TO THE TEAM DRIVE UNTIL WE FIGURE OUT HOW TO COPY DATA SAFELY AND EFFICIENTLY. If you have time, however, trying to copy over from your personal drive to the team drive using rclone and giving Nat feedback on what worked would be awesome!)

2) Log the session

Log all pertinent info in the lab spreadsheet, including a link to the folder where all the required data lives (preferably on the team drive). If you are linking directly to your personal drive, make sure to include everyone in the lab on the share list as VIEW ONLY and select the "OFF - only specific people can access" option under "link sharing" (default setting is to allow editing). See example screenshots here:

3) Upload any post-processed data

After post-processing such as clustering/sleep scoring, upload all the pertinent files to the shared folder. Check out here for helpful files to use with rclone for transferring over clustering specific files.

Data to archive/share

Here is a list of data we DEFINITELY want on the shared drive.