Milestone: Launch Data API service MVP

[birdychang]

eta: 2023-09-30
description:
Mercury’s objectives are twofold:

• to provide a centralized service with a user-friendly and language-agnostic API containing the different datasets (historical and monitoring) that Sentinel offers
• to help analysts and research scientists get their hands on historical Filecoin chain analytics data using tools they’re most familiar with: Python, Pandas, and Jupyter.

More details in the project notion.

Tasks

Preview Give feedback

1. [Sentinel] [Q3 2023] Connect BigQuery as a backing datastore for the REST endpoints #249
   +0
2. [Sentinel] [Q3 2023] POST /query with query body #250
   +0
3. [Sentinel] [Q3 2023] Implement pagination to /query endpoint #248
   +0
4. [Sentinel] [Q3 2023] Add bytes processed view on admin page for all users #247
   +0
5. [Sentinel] [Q3 2023] Add bytes processed in /stats for the user #246
   +0
6. [Sentinel] [Q3 2023] Generate OpenAPI schema with above endpoints #251
   +0
7. [Sentinel] [Q3 2023] Evaluate between Flask, Litestar, and aiohttp #252
   +0
8. [Sentinel] [Q3 2023] Create a web server that can be connected locally #253
   +0
9. [Sentinel] [Q3 2023] Write a Dockerfile and compose file for local development #254
   +0
10. [Sentinel] [Q3 2023] Provision a compute instance and SQL db #255
    +0
11. [Sentinel] [Q3 2023] Create deployment pipeline to deploy to compute instance #256
    +0
12. [Sentinel] [Q3 2023] Write documentation on local setup and deployment #257
    +0