Skip to content
This repository has been archived by the owner on Jun 13, 2018. It is now read-only.

Run all integration tests... somewhere #464

Open
kmcphillips opened this issue Jan 11, 2017 · 0 comments
Open

Run all integration tests... somewhere #464

kmcphillips opened this issue Jan 11, 2017 · 0 comments

Comments

@kmcphillips
Copy link
Member

Problem

On any given CI run we skip over 100 tests:
job__1465_1_-_shopify_active_shipping_-_travis_ci

These are tests that need some kind of credential for a third party carrier that we cannot share.

We need to run these tests, and have a way that's low friction for developers to assure the build is green.

Solutions

As @Shopify employees, we at least need a way to run these tests and share our private credentials. Consider something like:

  • EJSON file with credentials in the project.
  • Shared dev config with shipping credentials in the env.
  • A private CircleCI instance with our credentials.
  • Something else?

Doesn't solve the problem for open source contributions really. Though we can support contributors with broken tests. But we need to in some way run these tests more reliably.

@kmcphillips kmcphillips added this to the Version 2.0 milestone Jan 11, 2017
@garethson garethson removed this from the Version 2.0 milestone May 30, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants