Fix: Cache fix distributed #767
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
cache can be enabled from querier UI querier calls the PUT /cache API to all ingesters at ingester, first checks if stream exists, if not found in local map, check in S3 and create stream then checks if caching env vars are set if yes, add cache_enabled flag to STREAM_INFO and update its stream.json in S3 Note: Query still doesn't use the cached data Fixes: 764
nikhilsinhaparseable
added a commit
to nikhilsinhaparseable/parseable
that referenced
this pull request
Apr 20, 2024
caching for distributed mode can be enabled from querier UI. Querier calls the PUT /cache API to all ingestors. An ingestor, first checks if stream exists, if not found in local map, checks in S3 and creates stream. Then checks if caching env vars are set. If yes, add cache_enabled flag to STREAM_INFO and update its stream.json in S3 Fixes: parseablehq#764
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
cache can be enabled from querier UI
querier calls the PUT /cache API to all ingesters
at ingester, first checks if stream exists,
if not found in local map, check in S3 and create stream
then checks if caching env vars are set
if yes, add cache_enabled flag to STREAM_INFO
and update its stream.json in S3
Fixes #764