Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate adding X10 inference unit tests alongside eager-mode ones #515

Open
BradLarson opened this issue May 13, 2020 · 0 comments
Open
Assignees

Comments

@BradLarson
Copy link
Contributor

All of our model inference unit tests use the default eager mode for execution. With X10 now available as an additional backend, we might want to add a parallel set of unit tests with each of these models copied to or initialized on an X10 device, operating against X10 tensors.

This would provide an end-to-end test of at least execution and shape correctness on this new device, but might have adverse impacts on the tests. These include a duplication of test code for this new device, but we might be able to pull these tests out into a function that is called once per device to mitigate this. Of greater concern might be potential slowdowns due to trace compilation for each of the models, because a trace through a ResNet50 model takes about 50 seconds to compile for a GPU target and we have many such model variants.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants