You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The eventual plan is to have an archive daemon (in addition to a garbage collection daemon that then cleans up after it, and cleans up other stuff; #107) that will, a bit after a flight has ended, pack up all the relevant documents into a flat file or two and put it somewhere, thereby reducing the load on the database/making them easier to back up/making viewing that data super fast/whatever. Then the plan was to have it add a 'shell' document with some aggregated stats (number of lines uploaded by who, etc.) so that reduce/stats views may still work over all the data.
This issue mainly holds TODOs/notes on things that will need to be cleaned up. There's not much point importing old data into the database and then archiving it, we may as well take the old dumps of RJH's SQL and the old habitat database and convert them straight to the eventual archive format. Therefore the creation of the archive daemon will probably coincide with cleaning up old data, hence the list.
The eventual plan is to have an archive daemon (in addition to a garbage collection daemon that then cleans up after it, and cleans up other stuff; #107) that will, a bit after a flight has ended, pack up all the relevant documents into a flat file or two and put it somewhere, thereby reducing the load on the database/making them easier to back up/making viewing that data super fast/whatever. Then the plan was to have it add a 'shell' document with some aggregated stats (number of lines uploaded by who, etc.) so that reduce/stats views may still work over all the data.
This issue mainly holds TODOs/notes on things that will need to be cleaned up. There's not much point importing old data into the database and then archiving it, we may as well take the old dumps of RJH's SQL and the old habitat database and convert them straight to the eventual archive format. Therefore the creation of the archive daemon will probably coincide with cleaning up old data, hence the list.
The text was updated successfully, but these errors were encountered: