Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

remove statistics.SpanLengthCollector and document.processing #65

Closed
ArneBinder opened this issue Nov 24, 2023 · 1 comment
Closed

remove statistics.SpanLengthCollector and document.processing #65

ArneBinder opened this issue Nov 24, 2023 · 1 comment
Assignees
@ArneBinder
Labels
breaking Breaking Changes

Comments

@ArneBinder
Copy link
Owner

ArneBinder commented Nov 24, 2023 •
edited
Loading

but import them from https://github.com/ArneBinder/pie-models, because they got moved to pie-models (see ArneBinder/pie-models#60, ArneBinder/pie-models#62, and ArneBinder/pie-models#65).

Note: This requires to

  • add pie-models>=0.7.6,<0.8.0 as dependency, and to
  • update some dataset scripts (thus, also on the HF hub).
@ArneBinder ArneBinder added the breaking Breaking Changes label Nov 24, 2023
@ArneBinder ArneBinder self-assigned this Nov 26, 2023
@ArneBinder ArneBinder changed the title remove statistics.SpanLengthCollector and document.processing.tokenization remove statistics.SpanLengthCollector and document.processing Nov 26, 2023
@ArneBinder ArneBinder mentioned this issue Nov 26, 2023
Merged
@ArneBinder
Copy link
Owner Author

This was fixed in #70.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ArneBinder ArneBinder

Labels
breaking Breaking Changes
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ArneBinder