You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Now we use AsyncFileReader::get_metadata() to read the metadata, which requires seek() and downloading the whole file. We'd better implement it using opendal's range reader instead.
We could also store some information in the FileMeta (e.g. file size, footer len, or position of the parquet file meta) to eliminate seek().
The text was updated successfully, but these errors were encountered:
Now we use
AsyncFileReader::get_metadata()
to read the metadata, which requiresseek()
and downloading the whole file. We'd better implement it using opendal's range reader instead.We could also store some information in the
FileMeta
(e.g. file size, footer len, or position of the parquet file meta) to eliminateseek()
.The text was updated successfully, but these errors were encountered: