Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix for Breaking S3 Changes #4129

Open
wants to merge 2 commits into
base: v3.0
Choose a base branch
from

Conversation

kiwikodes
Copy link

Undoing some changes made in #4030 that broke support for S3 (see #4128). These changes will now make sure the appropriate section of the buffer is written to the S3 bucket. Hence resolving #4128.

@kiwikodes kiwikodes closed this Jul 1, 2024
@kiwikodes kiwikodes reopened this Jul 1, 2024
@riipeckx
Copy link

Any update on this?

@stewi1014
Copy link

stewi1014 commented Oct 24, 2024

Unfortunately this is not the end of issues from #4030 for me at least.

The zoom tile generation thread gets stuck in an infinite loop trying to read from s3, and silently failing without any message. This process generates about 2-3MB/s of constant traffic to s3 while not successfully writing zoom tiles.

I wonder if you're having the same issue?

Putting a breakpoint in processZoomFile reveals that the call to S3Client.getObjectAsBytes is failing.
image

@riipeckx
Copy link

@stewi1014 My server have been running for ~6hours for now and still rendering and uploading zoom tiles (not using AWS S3, I'm uploading to Cloudflare R2). As I'm not a Java developer at all I can't ensure I will not be facing an issue soon. Keep us updated :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants