-
Notifications
You must be signed in to change notification settings - Fork 11.2k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[kv store] basic bigtable client (#19890)
## Description Initial implementation of a KV store on top of BigTable. notes: * includes instructions for setting up a local BigTable instance via the emulator and a basic script for data ingestion(later will be added as an option to main ingestion binary) * generated proto files are included in the repo, so users won't have to compile the definitions themselves or install the `protoc` dependency. We can add an optional build step in a follow-up PR --- ## Release notes Check each box that your changes affect. If none of the boxes relate to your changes, release notes aren't required. For each box you select, include information after the relevant heading that describes the impact of your changes that a user might notice and any actions they must take to implement updates. - [ ] Protocol: - [ ] Nodes (Validators and Full nodes): - [ ] Indexer: - [ ] JSON-RPC: - [ ] GraphQL: - [ ] CLI: - [ ] Rust SDK: - [ ] REST API:
- Loading branch information
Showing
15 changed files
with
5,167 additions
and
1 deletion.
There are no files selected for viewing
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,25 @@ | ||
[package] | ||
name = "sui-kvstore" | ||
authors = ["Mysten Labs <[email protected]>"] | ||
license = "Apache-2.0" | ||
publish = false | ||
edition = "2021" | ||
version.workspace = true | ||
|
||
[dependencies] | ||
anyhow.workspace = true | ||
async-trait.workspace = true | ||
base64.workspace = true | ||
bcs.workspace = true | ||
http.workspace = true | ||
gcp_auth.workspace = true | ||
prometheus.workspace = true | ||
prost.workspace = true | ||
prost-types.workspace = true | ||
serde.workspace = true | ||
sui-data-ingestion-core.workspace = true | ||
sui-types.workspace = true | ||
telemetry-subscribers.workspace = true | ||
tokio = { workspace = true, features = ["full"] } | ||
tonic = {version = "0.12.2",features = ["tls", "transport"] } | ||
tracing.workspace = true |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,16 @@ | ||
## Setup | ||
|
||
### Local development | ||
- install the `cbt` CLI tool | ||
```sh | ||
gcloud components install cbt | ||
``` | ||
- start the emulator | ||
```sh | ||
gcloud beta emulators bigtable start | ||
``` | ||
- set `BIGTABLE_EMULATOR_HOST` environment variable | ||
```sh | ||
$(gcloud beta emulators bigtable env-init) | ||
``` | ||
- Run `./src/bigtable/init.sh` to configure the emulator |
Oops, something went wrong.