Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GCP Module Inclusion and GCP CI #205

Merged
merged 6 commits into from
Oct 11, 2023
Merged

GCP Module Inclusion and GCP CI #205

merged 6 commits into from
Oct 11, 2023

Conversation

gene-redpanda
Copy link
Contributor

@gene-redpanda gene-redpanda commented Sep 20, 2023

Includes the GCP module and testing around it.

Currently the standard tiered storage testing works with ubuntu -- haven't gotten a clean run with the private proxy in this format -- got an error about focal that is probably related to the ancient image we're using by default in the GCP module since I just copied that bit over from the OG stuff.

A related piece of work that still needs to be done is fixing the buildkite + proxy = error issue.

@gene-redpanda gene-redpanda added ci-ready indicates that a PR is ready for builds to run and removed ci-ready indicates that a PR is ready for builds to run labels Sep 22, 2023
Includes the GCP module and the first pass at testing around it -- still need to actually complete the buildkite bit and make sure that the GCP_CREDS passthru is legit in buildkite.

Currently the standard tiered storage testing works with ubuntu, haven't gotten a clean run with the private proxy in this format -- got an error about focal that is probably related to the ancient image we're using by default in the GCP module since I just copied that bit over from the OG stuff.
CI now works when run locally, still need to validate that it runs on buildkite. Chief issue is the passing in of GCP creds -- not sure what I have will pass muster tbh. Most likely will need to rebuild client image to accept GCP_CREDS as an env var and then use that directly as an ENV var in the script. But want to validate this first 😅

Also did some code stuff

* Loosened some firewall rules
* bumped the basic ubuntu version to be less ancient
* fixed the build script and passed it correctly in buildkite
* allowed passing in the squid_acl so that the proxy correctly handles passthru. This need is created by the difference in subnetting techniques between GCP and AWS
@gene-redpanda gene-redpanda added the ci-ready indicates that a PR is ready for builds to run label Sep 22, 2023
@gene-redpanda gene-redpanda marked this pull request as ready for review September 25, 2023 19:08
@gene-redpanda gene-redpanda changed the title Initial Pass at GCP Module and GCP CI GCP Module Inclusion and GCP CI Sep 25, 2023
@gene-redpanda gene-redpanda requested review from hcoyote, r-vasquez and twmb and removed request for hcoyote September 25, 2023 19:18
.buildkite/scripts/standup-gcp-cluster.sh Outdated Show resolved Hide resolved
.buildkite/scripts/test-proxy-cluster.sh Outdated Show resolved Hide resolved
.buildkite/scripts/test-tiered-storage-cluster.sh Outdated Show resolved Hide resolved
@gene-redpanda gene-redpanda requested review from vuldin, pfcurtis and r-vasquez and removed request for hcoyote and pfcurtis September 28, 2023 21:45
@gene-redpanda gene-redpanda merged commit 451717c into main Oct 11, 2023
2 checks passed
@gene-redpanda gene-redpanda deleted the gcp-module-work branch October 11, 2023 17:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci-ready indicates that a PR is ready for builds to run
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants