Release v0.7.2

v0.7.2

Release date: April 08, 2024

Breaking changes

• refactor!: Renames the new memtable to PartitionTreeMemtable by @evenyag in #3547
• fix!: columns table in information_schema misses some columns by @killme2008 in #3639

🚀 Features

• feat: Partition memtables by time if compaction window is provided by @evenyag in #3501
• feat: acquire all locks in procedure by @WenyXu in #3514
• feat: implement the drop database parser by @WenyXu in #3521
• feat(mito): Checks whether a region should flush periodically by @evenyag in #3459
• feat(metasrv): implement maintenance by @tisonkun in #3527
• feat: update dashboard to v0.4.9 by @ZonaHex in #3531
• feat: support per table memtable options by @evenyag in #3524
• feat(flow): shared in-memory state for dataflow operator by @discord9 in #3508
• feat: update pgwire to 0.20 for improved performance by @sunng87 in #3538
• feat: support multi params in promql range function macro by @Taylor-lagrange in #3464
• feat: support append-only mode in time-series memtable by @v0y4g3r in #3540
• feat: Able to pretty print sql query result in http output by @YCCDSZXH in #3539
• feat: return new added columns in region server's extension response by @waynexia in #3533
• feat: update physical table's schema on creating logical table by @waynexia in #3570
• feat: implement the drop database procedure by @WenyXu in #3541
• feat: batch alter logical tables by @fengjiachun in #3569
• feat: support time range in copy table by @v0y4g3r in #3583
• feat: update physical table schema on alter logical tables by @fengjiachun in #3585
• feat(auth): watch file user provider by @tisonkun in #3566
• feat: Support printing postgresql's bytea data type in its "hex" and "escape" format by @J0HN50N133 in #3567
• feat: Implement append mode for a region by @evenyag in #3558
• feat: create regions persist true by @fengjiachun in #3590
• feat: remove support for logical tables in the create table procedure by @fengjiachun in #3592
• feat: adds metric engine to information_schema engines table by @killme2008 in #3599
• feat: support 2+2 and /status/buildinfo by @waynexia in #3604
• feat(tql): add initial support for start,stop,step as sql functions by @etolbakov in #3507
• feat: Implement an unordered scanner for append mode by @evenyag in #3598
• feat: allow cross-schema query in promql by @sunng87 in #3545
• feat: let alter table procedure can only alter physical table by @fengjiachun in #3613
• feat(function): add timestamp epoch integer support for to_timezone by @etolbakov in #3620
• feat: impl show index and show columns by @killme2008 in #3577
• feat: group requests by peer by @fengjiachun in #3619
• feat: Support outputting various date styles for postgresql by @J0HN50N133 in #3602
• feat: reject invalid timestamp ranges in copy statement by @v0y4g3r in #3623
• feat(procedure): auto split large value to multiple values by @WenyXu in #3605
• feat(procedure): enable auto split large value by @WenyXu in #3628
• feat: introduce wal benchmarker by @niebayes in #3446
• feat: adding victoriametrics remote write by @sunng87 in #3641
• feat: Add timers to more mito methods by @evenyag in #3659
• feat: cluster information by @fengjiachun in #3631
• feat: update dashboard to v0.4.10 by @ZonaHex in #3663

🐛 Bug Fixes

• fix: clone data instead of moving it - homemade future is dangerous by @waynexia in #3542
• fix: performance degradation caused by config change by @v0y4g3r in #3556
• fix(flow): Arrange get range with batch unaligned by @discord9 in #3552
• fix: set http response chartset to utf-8 when using table format by @xxxuuu in #3571
• fix: update pk_cache in compat reader by @waynexia in #3576
• fix: incorrect version info in by @waynexia in #3586
• fix: canonicalize catalog and schema names by @killme2008 in #3600
• fix: adjust status code to http error code map by @waynexia in #3601
• fix: run purge jobs in another scheduler by @evenyag in #3621
• fix: mistakely removes compaction inputs on failure by @v0y4g3r in #3635
• fix: move object store read/write timer into inner by @dimbtp in #3627
• fix: construct correct pk list with pre-existing pk by @waynexia in #3614

🚜 Refactor

• refactor: remove removed-prefixed keys by @WenyXu in #3535
• refactor: introduce the DropTableExecutor by @WenyXu in #3534
• refactor: refactor CacheInvalidator by @WenyXu in #3550
• refactor: handle error for http format by @tisonkun in #3548
• refactor: remove redudant PromStoreProtocolHandler::write by @v0y4g3r in #3553
• refactor: reduce one clone by carefully pass ready boundary by @tisonkun in #3543
• re...

Release v0.8.0-nightly-20240401

What's Changed

• feat: acquire all locks in procedure by @WenyXu in #3514
• docs: revise README file by @tisonkun in #3522
• feat: implement the drop database parser by @WenyXu in #3521
• feat(mito): Checks whether a region should flush periodically by @evenyag in #3459
• ci: unassign issues stale 14 days ago by @tisonkun in #3529
• docs: readme style and project status by @tisonkun in #3528
• docs: improve fn comments by @tisonkun in #3526
• feat(metasrv): implement maintenance by @tisonkun in #3527
• refactor: remove removed-prefixed keys by @WenyXu in #3535
• feat: http header with metrics by @shuiyisong in #3536
• chore: avoid unnecessary cloning by @fengjiachun in #3537
• feat: update dashboard to v0.4.9 by @ZonaHex in #3531
• refactor: introduce the DropTableExecutor by @WenyXu in #3534
• feat: support per table memtable options by @evenyag in #3524
• feat(flow): shared in-memory state for dataflow operator by @discord9 in #3508
• feat: update pgwire to 0.20 for improved performance by @sunng87 in #3538
• fix: clone data instead of moving it - homemade future is dangerous by @waynexia in #3542
• feat: support multi params in promql range function macro by @Taylor-lagrange in #3464
• feat: support append-only mode in time-series memtable by @v0y4g3r in #3540
• feat: Able to pretty print sql query result in http output by @YCCDSZXH in #3539
• chore: fix comment in fetch-dashboard-assets.sh by @tisonkun in #3546
• refactor!: Renames the new memtable to PartitionTreeMemtable by @evenyag in #3547
• refactor: refactor CacheInvalidator by @WenyXu in #3550
• refactor: handle error for http format by @tisonkun in #3548
• fix: performance degradation caused by config change by @v0y4g3r in #3556
• refactor: remove redudant PromStoreProtocolHandler::write by @v0y4g3r in #3553
• ci: use a PAT to list all writers by @tisonkun in #3559
• fix(flow): Arrange get range with batch unaligned by @discord9 in #3552
• refactor: reduce one clone by carefully pass ready boundary by @tisonkun in #3543
• chore: avoid confusing TryFrom by @tisonkun in #3565
• test: add a parameter type mismatch test case to sql integration test by @xxxuuu in #3568
• feat: return new added columns in region server's extension response by @waynexia in #3533
• fix: set http response chartset to utf-8 when using table format by @xxxuuu in #3571
• feat: update physical table's schema on creating logical table by @waynexia in #3570
• chore: retain original headers by @tisonkun in #3572
• feat: implement the drop database procedure by @WenyXu in #3541
• ci: use single commit on the deployment branch by @evenyag in #3580
• refactor: try upgrade regex-automata by @tisonkun in #3575
• feat: batch alter logical tables by @fengjiachun in #3569
• chore: limit OpenDAL's feature gates by @waynexia in #3584
• fix: update pk_cache in compat reader by @waynexia in #3576
• fix: incorrect version info in by @waynexia in #3586
• feat: support time range in copy table by @v0y4g3r in #3583
• build(deps): remove some unused dependencies by @dimbtp in #3582
• feat: update physical table schema on alter logical tables by @fengjiachun in #3585
• chore: Delete CODE_OF_CONDUCT.md by @tisonkun in #3578
• feat(auth): watch file user provider by @tisonkun in #3566
• feat: Support printing postgresql's bytea data type in its "hex" and "escape" format by @J0HN50N133 in #3567
• chore: add back core dependency by @shuiyisong in #3588
• feat: Implement append mode for a region by @evenyag in #3558
• feat: create regions persist true by @fengjiachun in #3590
• refactor: refactor drop table executor by @WenyXu in #3589
• test: add tests for drop databases by @WenyXu in #3594
• feat: remove support for logical tables in the create table procedure by @fengjiachun in #3592
• chore: do not reply for broadcast msg by @fengjiachun in #3595
• feat: adds metric engine to information_schema engines table by @killme2008 in #3599
• fix: canonicalize catalog and schema names by @killme2008 in #3600
• test: add more integration test for kafka wal by @niebayes in #3190
• fix: adjust status code to http error code map by @waynexia in #3601
• refactor(table): remove unused table requests by @zhongzc in #3603
• feat: support 2+2 and /status/buildinfo by @waynexia in #3604
• feat(tql): add initial support for start,stop,step as sql functions by @etolbakov in #3507
• feat: Implement an unordered scanner for append mode by @evenyag in #3598
• refactor: cache invalidator by @fengjiachun in #3611
• feat: allow cross-schema query in promql by @sunng87 in #3545
• ci: ignore type in sqlness sql and result files by @waynexia in #3616
• feat: let alter table procedure can only alter physical table by @fengjiachun in #3613
• feat(function): add timestamp epoch integer support for to_timezone by @etolbakov in #3620
• feat: impl show index and show columns by @killme2008 in #3577

New Contributors

• @YCCDSZXH made their first contribution in #3539
• @xxxuuu made their first contribution in #3568

Full Changelog: v0.7.1...v0.8.0-nightly-20240401

Release v0.8.0-nightly-20240325

What's Changed

• feat: acquire all locks in procedure by @WenyXu in #3514
• docs: revise README file by @tisonkun in #3522
• feat: implement the drop database parser by @WenyXu in #3521
• feat(mito): Checks whether a region should flush periodically by @evenyag in #3459
• ci: unassign issues stale 14 days ago by @tisonkun in #3529
• docs: readme style and project status by @tisonkun in #3528
• docs: improve fn comments by @tisonkun in #3526
• feat(metasrv): implement maintenance by @tisonkun in #3527
• refactor: remove removed-prefixed keys by @WenyXu in #3535
• feat: http header with metrics by @shuiyisong in #3536
• chore: avoid unnecessary cloning by @fengjiachun in #3537
• feat: update dashboard to v0.4.9 by @ZonaHex in #3531
• refactor: introduce the DropTableExecutor by @WenyXu in #3534
• feat: support per table memtable options by @evenyag in #3524
• feat(flow): shared in-memory state for dataflow operator by @discord9 in #3508
• feat: update pgwire to 0.20 for improved performance by @sunng87 in #3538
• fix: clone data instead of moving it - homemade future is dangerous by @waynexia in #3542
• feat: support multi params in promql range function macro by @Taylor-lagrange in #3464
• feat: support append-only mode in time-series memtable by @v0y4g3r in #3540
• feat: Able to pretty print sql query result in http output by @YCCDSZXH in #3539
• chore: fix comment in fetch-dashboard-assets.sh by @tisonkun in #3546
• refactor!: Renames the new memtable to PartitionTreeMemtable by @evenyag in #3547
• refactor: refactor CacheInvalidator by @WenyXu in #3550
• refactor: handle error for http format by @tisonkun in #3548
• fix: performance degradation caused by config change by @v0y4g3r in #3556
• refactor: remove redudant PromStoreProtocolHandler::write by @v0y4g3r in #3553
• ci: use a PAT to list all writers by @tisonkun in #3559
• fix(flow): Arrange get range with batch unaligned by @discord9 in #3552
• refactor: reduce one clone by carefully pass ready boundary by @tisonkun in #3543
• chore: avoid confusing TryFrom by @tisonkun in #3565
• test: add a parameter type mismatch test case to sql integration test by @xxxuuu in #3568
• feat: return new added columns in region server's extension response by @waynexia in #3533

New Contributors

• @YCCDSZXH made their first contribution in #3539
• @xxxuuu made their first contribution in #3568

Full Changelog: v0.7.1...v0.8.0-nightly-20240325

Release v0.8.0-nightly-20240318

What's Changed

• feat: acquire all locks in procedure by @WenyXu in #3514
• docs: revise README file by @tisonkun in #3522
• feat: implement the drop database parser by @WenyXu in #3521
• feat(mito): Checks whether a region should flush periodically by @evenyag in #3459

Full Changelog: v0.7.1...v0.8.0-nightly-20240318

Release v0.7.1

What's Changed

This release contains an important bug fix while decoding the Prometheus remote write proto #3505.

It's highly recommended to upgrade to this version if you're using v0.7.

Features

• feat: impl some "set"s to adapt to some client apps by @MichaelScofield in #3443
• feat: update dashboard to v0.4.8 by @ZonaHex in #3450
• feat: max-txn-ops option by @fengjiachun in #3458
• feat(influxdb): add db query param support for v2 write api by @etolbakov in #3445
• feat: support first_value/last_value in range query by @Taylor-lagrange in #3448
• feat: clamp function by @waynexia in #3465
• feat(fuzz): validate columns by @WenyXu in #3485
• feat: to_timezone function by @tisonkun in #3470
• feat(flow): accumlator for aggr func by @discord9 in #3396
• feat(flow): plan def by @discord9 in #3490
• feat: improve prom write requests decode performance by @v0y4g3r in #3478
• feat(fuzz): add insert target by @zhongzc in #3499
• feat(fuzz): add alter table target by @WenyXu in #3503
• feat: support decode gzip if influxdb write specify it by @tisonkun in #3494
• feat: Partition memtables by time if compaction window is provided by @evenyag in #3501

Fixes

• fix: add support for influxdb basic auth by @shuiyisong in #3437
• fix: fix incorrect COM_STMT_PREPARE reply by @WenyXu in #3463
• fix: impl RecordBatchStream method explicitly by @shuiyisong in #3482
• fix: make max-txn-ops limit valid by @fengjiachun in #3481
• fix: fix f64 has no sufficient precision during parsing by @WenyXu in #3483
• fix: freeze data buffer in shard by @evenyag in #3468
• fix: allow passing extra table options by @evenyag in #3484
• fix(common-time): allow building nanos timestamp from parts split from i64::MIN by @zhongzc in #3493
• fix: adjust fill behavior of range query by @Taylor-lagrange in #3489
• fix: decoding prometheus remote write proto doesn't reset the value by @waynexia in #3505
• fix: correctly generate sequences when the value is pre-existed by @MichaelScofield in #3502

Breaking Changes

• fix!: remove error message from http header to avoid panic by @sunng87 in #3506

Others

• build(deps): upgrade opendal to 0.45.1 by @tisonkun in #3432
• chore: add bin opt to build cmd by @WenyXu in #3440
• chore: specify binary name by @WenyXu in #3449
• test: add fuzz test for create table by @WenyXu in #3441
• refactor: separate the quote char and value by @WenyXu in #3455
• perf: Reduce decode overhead during pruning keys in the memtable by @evenyag in #3415
• chore: remove repetitive words by @gcmutator in #3469
• refactor: introduce new Output with OutputMeta by @shuiyisong in #3466
• refactor: make http api returns non-200 status code by @crwen in #3473
• ci: use another mirror for etcd image by @waynexia in #3486
• perf: more benchmarks for memtables by @evenyag in #3491
• refactor: validate constraints eagerly by @tisonkun in #3472
• ci: attempt to setup docker cache for etcd by @sunng87 in #3488
• chore: bump version to v0.7.1 by @evenyag in #3510
• docs: add v0.7 TSBS benchmark result by @evenyag in #3512
• ci: add bin options to reduce build burden by @WenyXu in #3518

New Contributors

• @gcmutator made their first contribution in #3469
• @crwen made their first contribution in #3473

Full Changelog: v0.7.0...v0.7.1

Release v0.7.0

What's Changed

Highlights

• Metric Engine: handles a large number of small tables, making it particularly suitable for cloud-native monitoring.
• Region Migration: enhances the user experience and simplifies region migrations with straightforward SQL commands.
• Inverted Index: dramatically improves the efficiency of locating data segments relevant to user queries, significantly reducing the IO operations needed for scanning data files and thus accelerating the query process.

Features:

• feat: add modulo function by @etolbakov in #3147
• feat: support HTTP&gRPC&pg set timezone by @Taylor-lagrange in #3125
• feat(mito): enable inverted index by @zhongzc in #3158
• feat: upgrade pgwire to 0.19 by @sunng87 in #3157
• feat: let tables API return a stream by @fengjiachun in #3170
• feat: add tests-fuzz crate by @WenyXu in #3173
• feat: tables stream with CatalogManager by @fengjiachun in #3180
• feat: adds date_format function by @killme2008 in #3167
• feat: auto config cache size according to memory size by @QuenKar in #3165
• feat: precise filter for mito parquet reader by @waynexia in #3178
• feat: adds parse options for SQL parser by @killme2008 in #3193
• feat(tests-fuzz): add CreateTableExprGenerator & AlterTableExprGenerator by @WenyXu in #3182
• feat: make procedure able to return output by @WenyXu in #3201
• feat: copy database from by @v0y4g3r in #3164
• feat: introduce information schema provider cache by @WenyXu in #3208
• feat: lazy initialize vector builder on write by @waynexia in #3210
• feat: make query be aware of timezone setting by @killme2008 in #3175
• feat: add create alter table expr translator by @WenyXu in #3203
• feat: read column and region info from state cache by @waynexia in #3222
• feat: enable concurrent write by @WenyXu in #3214
• feat: add Arrow IPC output format for http rest api by @sunng87 in #3177
• feat: change Range Query’s default align behavior aware of timezone by @killme2008 in #3219
• feat: update dashboard to v0.4.7 by @ZonaHex in #3229
• feat: http sql api return schema on empty resultset by @sunng87 in #3237
• feat: add pg create alter table expr translator by @WenyXu in #3206
• feat: read metadata from write cache by @QuenKar in #3224
• feat: batch create ddl by @fengjiachun in #3194
• feat: add insert/select generator & translator by @WenyXu in #3240
• feat: return request outdated error on handling alter by @waynexia in #3239
• feat: don't map semantic type in metric engine by @waynexia in #3243
• feat: create tables in batch on prom write by @fengjiachun in #3246
• feat: Only allow inserts and deletes operations to be executed in parallel by @fengjiachun in #3257
• feat: basic types for Dataflow Framework by @discord9 in #3186
• feat: initial configuration for grafana dashboard by @waynexia in #3263
• feat: support fraction part in timestamp by @discord9 in #3272
• feat: use simple filter to prune memtable by @waynexia in #3269
• feat: Basic Definitions for Expression&Functions for Dataflow by @discord9 in #3267
• feat: support cache for batch_get in CachedMetaKvBackend by @fengys1996 in #3277
• feat: put all filter exprs in a filter plan separately by @waynexia in #3288
• feat: administration functions by @killme2008 in #3236
• feat(mito): adjust seg size of inverted index to finer granularity instead of row group level by @zhongzc in #3289
• feat(mito): add options to ignore building index for specific column ids by @zhongzc in #3295
• feat: organize tracing on query path by @waynexia in #3310
• feat: impl partitions and region_peers information schema by @killme2008 in #3278
• feat: batch get physical table routes by @fengjiachun in #3319
• feat: Defines structs in the merge tree memtable by @evenyag in #3326
• feat(metric-engine): set index options for data region by @zhongzc in #3330
• feat: data buffer and related structs by @v0y4g3r in #3329
• feat: Implement KeyDictBuilder for the merge tree memtable by @evenyag in #3334
• feat: replace pk index with pk_weight during freeze by @v0y4g3r in #3343
• feat: merge tree data parts by @v0y4g3r in #3346
• feat: Defines more structs and methods for a partitioned merge tree by @evenyag in #3348
• feat(flow): impl ScalarExpr&Scalar Function by @discord9 in #3283
• feat: impl migrate_region and procedure_state SQL function by @killme2008 in #3325
• feat: add isnull function by @KKould in #3360
• feat: skip filling NULL for put and delete requests by @waynexia in #3364
• feat: impl merge reader for DataParts by @v0y4g3r in #3361
• feat: Implement write and fork for the new memtable by @evenyag in #3357
• feat: distinguish between different read paths by @v0y4g3r in #3369
• feat: Add freeze and fork method to the memtable by @evenyag in #3374
• feat: merge tree dedup reader by @v0y4g3r in #3375
• feat: Implement iter for the new memtable by @evenyag in #3373
• feat: Implement dedup for the new memtable and expose the config by @evenyag in #3377
• feat: change how region id maps to region worker by @waynexia in #3384
• feat: make tls certificates/keys reloadable (part 1) by @sunng87 in #3335
• feat(grafana): enable shared tooltip, add raft engine throughput by @waynexia in #3387
• feat: Implement partition eviction and only add value size to write buffer size by @evenyag in #3393
• feat: enable zstd compression and encodings in merge tree data part by @v0y4g3r in #3380
• feat(flow): impl for MapFilterProject by @discord9 in #3359
• feat: flush or compact table and region functions by @killme2008 in #3363
• feat: Use a partition level map to look up pk index by @evenyag in #3400
• feat(index): measure memory usage in global instead of single-column and add metrics by @zhongzc in #3383
• feat: enable ArrowFlight compression by @tisonkun in #3403
• feat: zero copy on split rows by @fengjiachun in #3407
• feat: Support automatic DNS lookup for kafka bootstrap servers by @J0HN50N133 in #3379
• feat: add configuration for tls watch option by @sunng87 in #3395
• feat: employ sparse key encoding for shard lookup by @v0y4g3r in #3410
• feat: support Create Table ... Like by @KKould in #3372
• feat: tableref cache by @fengjiachun in #3420
• feat: add verbose support for tql explain/an...

Release v0.7.0-nightly-20240304

What's Changed

• refactor: change the receivers of merge tree components by @v0y4g3r in #3378
• fix: resets dict builder keys counter and avoid unnecessary pruning by @evenyag in #3386
• feat: change how region id maps to region worker by @waynexia in #3384
• chore: skip reorder workspace tables in taplo by @waynexia in #3388
• feat: make tls certificates/keys reloadable (part 1) by @sunng87 in #3335
• feat(grafana): enable shared tooltip, add raft engine throughput by @waynexia in #3387
• test: range fix in modulo function tests by @dimbtp in #3389
• ci: add builder result outputs in release action by @daviderli614 in #3381
• fix: throw errors instead of panic by @WenyXu in #3391
• feat: Implement partition eviction and only add value size to write buffer size by @evenyag in #3393
• feat: enable zstd compression and encodings in merge tree data part by @v0y4g3r in #3380
• feat!: new partition grammar - parser part by @waynexia in #3347
• feat(flow): impl for MapFilterProject by @discord9 in #3359
• feat: flush or compact table and region functions by @killme2008 in #3363
• chore: retry fetch dashboard assets by @tisonkun in #3394
• feat: Use a partition level map to look up pk index by @evenyag in #3400
• chore: add metris for memtable read path by @v0y4g3r in #3397
• build: do not retry for connrefused by @tisonkun in #3402
• refactor: refactor TableRouteManager by @WenyXu in #3392
• feat(index): measure memory usage in global instead of single-column and add metrics by @zhongzc in #3383
• fix: some read metrics by @v0y4g3r in #3404
• feat: enable ArrowFlight compression by @tisonkun in #3403
• refactor: move some costly methods in DataBuffer::read out of read lock by @v0y4g3r in #3406
• feat: zero copy on split rows by @fengjiachun in #3407
• feat: Support automatic DNS lookup for kafka bootstrap servers by @J0HN50N133 in #3379
• fix: partition region id by @fengjiachun in #3414
• fix: show table names not complete from information_schema by @killme2008 in #3417
• feat: add configuration for tls watch option by @sunng87 in #3395
• feat: employ sparse key encoding for shard lookup by @v0y4g3r in #3410
• fix: mitigate memory spike during startup by @niebayes in #3418
• feat: support Create Table ... Like by @KKould in #3372
• feat: tableref cache by @fengjiachun in #3420
• feat: add verbose support for tql explain/analyze by @etolbakov in #3390
• feat: reduce a clone of string by @fengjiachun in #3422
• docs: update pull_request_template.md by @tisonkun in #3421

New Contributors

• @J0HN50N133 made their first contribution in #3379

Full Changelog: v0.7.0-nightly-20240226...v0.7.0-nightly-20240304

Release v0.7.0-nightly-20240226

What's Changed

• refactor: make grpc service able to be added dynamically by @MichaelScofield in #3160
• feat: support HTTP&gRPC&pg set timezone by @Taylor-lagrange in #3125
• feat(mito): enable inverted index by @zhongzc in #3158
• feat: upgrade pgwire to 0.19 by @sunng87 in #3157
• test: engine with write cache by @QuenKar in #3163
• docs: add tracking issue for inverted-index RFC by @tisonkun in #3169
• docs: Update README.md by @tisonkun in #3168
• feat: let tables API return a stream by @fengjiachun in #3170
• feat: add tests-fuzz crate by @WenyXu in #3173
• feat: tables stream with CatalogManager by @fengjiachun in #3180
• chore: expose promql test to distributed instance by @niebayes in #3176
• feat: adds date_format function by @killme2008 in #3167
• refactor: remove TableEngine by @waynexia in #3181
• fix: change back GREPTIME_DB_HEADER_NAME header key name by @shuiyisong in #3184
• chore: carry metrics in flight metadata from datanode to frontend by @shuiyisong in #3113
• refactor: expose region edit in mito engine by @MichaelScofield in #3179
• feat: auto config cache size according to memory size by @QuenKar in #3165
• refactor: introduce common-wal to aggregate wal stuff by @niebayes in #3171
• feat: precise filter for mito parquet reader by @waynexia in #3178
• fix(index): S3 EntityTooSmall error by @zhongzc in #3192
• docs: update SDK links in README.md by @nicecui in #3156
• feat: adds parse options for SQL parser by @killme2008 in #3193
• feat(tests-fuzz): add CreateTableExprGenerator & AlterTableExprGenerator by @WenyXu in #3182
• refactor: reduce number of parquet metadata reads and enable reader buffer by @WenyXu in #3197
• feat: make procedure able to return output by @WenyXu in #3201
• refactor: read parquet metadata by @QuenKar in #3199
• chore: bump opendal to v0.44.2 by @WenyXu in #3209
• feat: copy database from by @v0y4g3r in #3164
• feat: introduce information schema provider cache by @WenyXu in #3208
• feat: lazy initialize vector builder on write by @waynexia in #3210
• fix: remove name matcher from processed matcher list by @waynexia in #3213
• chore: change default factor to compute memory size by @shuiyisong in #3211
• feat: make query be aware of timezone setting by @killme2008 in #3175
• feat!: switch prom remote write to metric engine by @waynexia in #3198
• feat: add create alter table expr translator by @WenyXu in #3203
• fix: fix default value cannot accept negative number by @WenyXu in #3217
• refactor!: rename initialize_region_in_background to init_regions_in_background by @WenyXu in #3216
• feat: read column and region info from state cache by @waynexia in #3222
• feat: enable concurrent write by @WenyXu in #3214
• fix: only register region keeper while creating physical table by @WenyXu in #3223
• refactor: make http server built flexibly by @MichaelScofield in #3225
• feat: add Arrow IPC output format for http rest api by @sunng87 in #3177
• fix: fix MockInstance rebuild issue by @WenyXu in #3218
• feat: change Range Query’s default align behavior aware of timezone by @killme2008 in #3219
• feat: update dashboard to v0.4.7 by @ZonaHex in #3229
• fix: security update for shlex and h2 by @sunng87 in #3227
• feat: http sql api return schema on empty resultset by @sunng87 in #3237
• ci: make git's "safe.directory" accept all by @MichaelScofield in #3234
• feat: add pg create alter table expr translator by @WenyXu in #3206
• ci: adding DOCKER_BUILD_ROOT docker arg for dev build by @MichaelScofield in #3241
• feat: read metadata from write cache by @QuenKar in #3224
• fix: fix create table ddl return incorrect table id by @WenyXu in #3232
• fix: init parquet reader metrics twice by @evenyag in #3242
• feat: batch create ddl by @fengjiachun in #3194
• feat: add insert/select generator & translator by @WenyXu in #3240
• feat: return request outdated error on handling alter by @waynexia in #3239
• feat: don't map semantic type in metric engine by @waynexia in #3243
• docs: RFC of Dataflow Framework by @discord9 in #3185
• test: align chrono and some forked test deps to upstream by @sunng87 in #3245
• fix: IntermediateWriter closes underlying writer twice by @waynexia in #3248
• feat: create tables in batch on prom write by @fengjiachun in #3246
• chore: adjust MySQL connection log by @shuiyisong in #3251
• ci: merge doc label actor and checker tasks by @sunng87 in #3252
• build: make binary name a Dockerfile "ARG" by @MichaelScofield in #3254
• fix: decouple columns in projection and prune by @waynexia in #3253
• chore: switch to free machine by @WenyXu in #3256
• feat: Only allow inserts and deletes operations to be executed in parallel by @fengjiachun in #3257
• chore: adjust storage engine related metrics by @waynexia in #3261
• fix(Copy From): fix incorrect type casts by @WenyXu in #3264
• feat: basic types for Dataflow Framework by @discord9 in #3186
• feat: initial configuration for grafana dashboard by @waynexia in #3263
• fix: SQL insertion and column default constraint aware of timezone by @killme2008 in #3266
• fix: cli export database default value by @tisonkun in #3259
• ci: build GreptimeDB binary for later use by @MichaelScofield in #3244
• refactor: add same SST files by @MichaelScofield in #3270
• feat: support fraction part in timestamp by @discord9 in #3272
• fix: use fe_opts after setup_frontend_plugins in standalone by @shuiyisong in #3275
• ci: fix nightly build by @MichaelScofield in #3276
• feat: use simple filter to prune memtable by @waynexia in #3269
• feat: Basic Definitions for Expression&Functions for Dataflow by @discord9 in #3267
• fix: fix incorrect StatusCode parsing by @WenyXu in #3281
• chore: share cache corss jobs by @WenyXu in #3284
• chore: start plugins during standalone startup & comply with current catalog while changing database by @shuiyisong in #3282
• feat: support cache for batch_get in CachedMetaKvBackend by @fengys1996 in #3277
• feat: put all filter exprs in a filter plan separately by @waynexia in https://github.com/GreptimeTeam/gr...

Release v0.7.0-nightly-20240115

What's Changed

• feat: add modulo function by @etolbakov in #3147

Full Changelog: v0.6.0...v0.7.0-nightly-20240115

Release v0.6.0

What's Changed

Highlights

• Region migration is now available, allowing users to move regions between the datanodes.

Features:

• feat: support PromQL function vector by @waynexia in #3036
• feat(mito): Init the write cache in datanode by @evenyag in #3100
• feat: support grpc for otlp trace and metrics by @fengys1996 in #3105
• feat: add options to enable log recycle and periodical fsync by @v0y4g3r in #3114
• feat: add parquet metadata to cache by @QuenKar in #3097
• feat(python): Print Python interpreter version by @tisonkun in #3118
• feat(inverted_index): introduce SstIndexCreator by @zhongzc in #3107
• feat: update our cross-schema check to cross catalog by @sunng87 in #3123
• feat: expose the region migration replay_timeout argument by @WenyXu in #3129
• feat: adds runtime_metrics by @killme2008 in #3127
• feat: write and upload sst by @QuenKar in #3106
• feat(parquet): introduce inverted index applier to reader by @zhongzc in #3130
• feat: handle drop request for metric table by @waynexia in #3136
• feat: manager kafka cluster in sqlness runner by @waynexia in #3143
• feat: read data from write cache by @QuenKar in #3128
• feat: support PromQL operations over the same metric by @waynexia in #3124
• feat(mito): support write cache for index file by @zhongzc in #3144

Fixes:

• fix: expose unsupported datatype error on MySQL protocol by @waynexia in #3121
• fix: unstable time record test by @zhongzc in #3131
• fix: incorrect parsing broker_endpoints env variable by @WenyXu in #3135
• fix: remove incorrect wal comments in the config file by @niebayes in #3142
• fix: save code in debug_assert! by @WenyXu in #3137
• fix(kafka): overwrite the EntryId with Offset while consuming records by @WenyXu in #3148
• fix: print a detailed error by @WenyXu in #3146
• fix: fix store all wal options by @WenyXu in #3149
• fix: handle non-identical time index and field column in PromQL set operation by @waynexia in #3145
• fix: fix tests failed on Windows by @WenyXu in #3155

Others/Chores:

• chore: add bound check for raft-engine logstore by @v0y4g3r in #3073
• chore(remote_wal): remove topic alias by @niebayes in #3120
• chore: change the default doc checkbox to no need by @waynexia in #3122
• chore: stop exposing num_partitions by @niebayes in #3132
• chore: impl KvBackend for MetaPeerClient by @lyang24 in #3076
• chore: bump version to 0.6.0 by @WenyXu in #3154

Full Changelog: v0.5.1...v0.6.0