You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In order to have a simple and clean backend, data.gov admins wants all extras_rollup data removed.
Acceptance Criteria
[ACs should be clearly demoable/verifiable whenever possible. Try specifying them using BDD.]
GIVEN a dataset exists in catalog
WHEN the data is queried in any form (SOLR, DB, etc)
THEN the data is in a standard CKAN format of key fields and extras
Background
The fact that all extras are stored as extras_rollup caused a bug when integrating GSA/ckanext-datajson#115, and required this mind-bending PR that was only able to be tested once integrated with ckanext-geodatagov on catalog: GSA/ckanext-datajson#120.
We believe the only location of this is in ckanext-geodatagov: https://github.com/GSA/ckanext-geodatagov/search?q=extras_rollup
We could consider implementing this in a much cleaner format, by utilizing the IDatasetForm: http://docs.ckan.org/en/2.9/extensions/adding-custom-fields.html. This would require extensive testing however, and evaluating how our other extensions parse data. Essentially I believe this could eliminate "extras", and simplify our responses via API's and make for a cleaner/simpler backend and frontend. It could also be useful in "standardizing" data, such as the fact that we have a "geospatial unique identifier" and a "datajson unique identifier" that are separate. They serve the same function and should/could be combined in CKAN, and it makes it hard for users and us to parse and requires knowing 2 different standards. See datajson example and geospatial example.
The text was updated successfully, but these errors were encountered:
User Story
In order to have a simple and clean backend, data.gov admins wants all extras_rollup data removed.
Acceptance Criteria
[ACs should be clearly demoable/verifiable whenever possible. Try specifying them using BDD.]
WHEN the data is queried in any form (SOLR, DB, etc)
THEN the data is in a standard CKAN format of key fields and extras
Background
The fact that all extras are stored as
extras_rollup
caused a bug when integrating GSA/ckanext-datajson#115, and required this mind-bending PR that was only able to be tested once integrated with ckanext-geodatagov on catalog: GSA/ckanext-datajson#120.Security Considerations (required)
None
Sketch
We believe the only location of this is in ckanext-geodatagov: https://github.com/GSA/ckanext-geodatagov/search?q=extras_rollup
We could consider implementing this in a much cleaner format, by utilizing the IDatasetForm: http://docs.ckan.org/en/2.9/extensions/adding-custom-fields.html. This would require extensive testing however, and evaluating how our other extensions parse data. Essentially I believe this could eliminate "extras", and simplify our responses via API's and make for a cleaner/simpler backend and frontend. It could also be useful in "standardizing" data, such as the fact that we have a "geospatial unique identifier" and a "datajson unique identifier" that are separate. They serve the same function and should/could be combined in CKAN, and it makes it hard for users and us to parse and requires knowing 2 different standards. See datajson example and geospatial example.
The text was updated successfully, but these errors were encountered: