Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible infinite loop syncing records #4

Open
tedottey opened this issue Jul 17, 2020 · 0 comments
Open

Possible infinite loop syncing records #4

tedottey opened this issue Jul 17, 2020 · 0 comments

Comments

@tedottey
Copy link

It seems that there might be a possibility of an infinite loop when syncing records. This was discovered when investigating
a large number of records syncing on the events endpoint:

if offset > 10000:
paginate_datetime = max_modified
offset = 0

Though I'm not an engineer myself, if the max_modified (eventAt) date time remains the same within the set of 10,000 records over a requested page of events; then the offset would be reset on the same page.

The extraction would then repeat up to an offset of 10000; and since the max_modified date-time hadn't changed, the offset would drop to 0 again.

This would continue, infinitely.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant