Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiprocess new_ngram indexer column calculations? #417

Open
alexandermorgan opened this issue Sep 7, 2016 · 0 comments
Open

Multiprocess new_ngram indexer column calculations? #417

alexandermorgan opened this issue Sep 7, 2016 · 0 comments

Comments

@alexandermorgan
Copy link
Contributor

Multiprocessing and the series_indexer were slated for removal in VIS 3 but it may be possible to multiprocess the new_ngram indexer's column calculations (each of which corresponds to an entire dataframe of the old ngram indexer). In theory this should be relatively easy but this is something that can wait until VIS 3.1 as it's not a major change. The new_ngram indexer is already relatively fast but it can never be too efficient because soon we'll start using it as an intermediary tool to help with complex things like dissonance detection.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant