R&D Data Organization

• Standard format for test/experiment outputs
• Standard place we store outputs
• Potentially, some rendered graphs stored with data

1. Name each measurement set for each experiment with a descriptive deployment identifier
2. Pull data from devices, clean, and format as CSV with appropriate header
   • cat .CSV | sed -n '/^__./p' > data.csv (in each deployment folder)
   • rename data.csv. to an appropriate name (such as the deployment identifier and the data, or something reasonable)
   • put the headers onto the file (such as duuid,uuid,time.s,time.h,battery.V,sensor.V,data3,data4,data5,data6,conductivity.mS )
3. Put the files into folders using https://dvc.org/doc/start/data-versioning ?
   • Create a folder for the experiment
   • Put the data into the folder
   • Also create plots of relevant data in jupyter and place them in the folder, named with the deployment identifier of each file

Note the deployment identifiers should be unique per device per experiment.