Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

s3store fix incomplete part keys #1042

Closed
wants to merge 1 commit into from
Closed

s3store fix incomplete part keys #1042

wants to merge 1 commit into from

Conversation

butonic
Copy link

@butonic butonic commented Dec 5, 2023

When using a different prefix for metadata files uploads break because the code sometimes uses metadataKeyWithPrefix when it should use keyWithPrefix.

Unless I understood something completely wrong and failed to understand what the debug session was trying to tell me ;-)

When using a different prefix for metadata files uploads break because the code sometimes uses `metadataKeyWithPrefix` when it should use `keyWithPrefix`.

Unless I understood something completely wrong and failed to understand what the debug session was trying to tell me ;-)
@Acconut
Copy link
Member

Acconut commented Dec 5, 2023

Thank you for this PR, but I am not too sure about this change. The documentation clearly states that the metadata prefix will be used for the .part object:

tusd/pkg/s3store/s3store.go

Lines 107 to 113 in c856f72

// ObjectPrefix is prepended to the name of each S3 object that is created
// to store uploaded files. It can be used to create a pseudo-directory
// structure in the bucket, e.g. "path/to/my/uploads".
ObjectPrefix string
// MetadataObjectPrefix is prepended to the name of each .info and .part S3
// object that is created. If it is not set, then ObjectPrefix is used.
MetadataObjectPrefix string

IIRC, the idea is that the object prefix defines the prefix for the completed file uploads. All additional objects (e.g. .info and .part) will be put under the metadata prefix.

@Acconut
Copy link
Member

Acconut commented Jan 24, 2024

Closing this issue due to inactivity. Feel free to leave a comment if you want to continue the discussion :)

@Acconut Acconut closed this Jan 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants