Harbor Satellite aims to bring Harbor container registries to edge locations, ensuring consistent, available, and integrity-checked images for edge computing environments. The developed sofware of a stateful, standalone satellite registry that can function as a primary registry for edge locations and act as a fallback option if the central Harbor registry is unavailable.
- Edge Registry fleet management and rollout
- Manage and distribute artifacts to thousands of sites
- Remotely orchestrate the artifacts for edge location
- Predictable behavior in challenging connectivity situations
- Control edge artifact replication and presence
- Optimized resource and bandwidth utilization
- Transparent deployment process
- EDGE/IOT
- Environment without permanent connectivity
- E.g. Remote Locations, Ships, Satellites, Firewalls
- High Availability of container images close to workloads
- Multiple sites
- Highly isolated sites
- Restricted ingress/egress data flow
- Global image distribution
- Container Image CDN
- Immediate application updates across regions
- Satellite acts as Gateway or Proxy for containerized artifacts on site
- Artifacts are managed and orchestrated remotely
- Desired artifacts are securely synced with desired state on remote site
- Satellite can initiate updates or deployments on site (Hooks)
- Runs on edge location as a single process in unattended mode
- Cloud Side
- Ground Control
- Devices management
- Onboarding and grouping of sites
- State management and verification
- Harbor (with satellite extension)
- Ground Control
- EDGE (Satellite Side)
- Satellite
- Artifact store and synchronizer
- Runtime configuration updater
- Downstream event executor
- Satellite
Containers have extended beyond their traditional cloud environments, becoming increasingly prevalent in remote and edge computing contexts. These environments often lack reliable internet connectivity, posing significant challenges in managing and running containerized applications due to difficulties in fetching container images. To address this, the project aims to decentralize container registries, making them more accessible to edge devices. The need for a satellite that can operate independently, store images on disk, and run indefinitely with stored data is crucial for maintaining operations in areas with limited or no internet connectivity.
Harbor Satellite is an extension to the existing Harbor container registry that enables the operation of decentralized registries in edge locations.
Harbor Satellite will synchronize with the central Harbor registry, when Internet connectivity permits it, allowing it to receive and store images. This will ensure that even in environments with limited or unreliable internet connectivity, containerized applications can still fetch their required images from the local Harbor Satellite.
Harbor Satellite will also include a toolset enabling the monitoring and management of local decentralized registries.
Please refer to the latest setup instructions in QUICKSTART.md file for detailed steps on setting up Harbor Satellite locally.
T.B.D.
Deploying a complete Harbor instance on edge devices in poor/no coverage areas could prove problematic since :
- Harbor wasn't designed to run on edge devices.(e.g. Multiple processes, no unattended mode)
- Harbor could behave unexpectedly in poor/no connectivity environments.
- Managing hundreds or thousands of container registries is not operationally feasible with Harbor
- Harbor would be too similar to a simple registry mirror
Harbor Satellite aims to be resilient, lightweight and will be able to keep functioning independently from Harbor instances.
Compatibility with all container registries or edge devices can't be guaranteed.
Harbor Satellite, at its most basic, will run in a single container and will be divided in the following 2 components :
- Satellite : Is responsible for moving artifacts from upstream (using Skopeo/Crane/Other), identifying the source and reading the list of images that needs to be replicated. Satellite will also be able to modify and manage the container runtimes. configuration in sync so that container runtime does not fetch images from remote.
- OCI Registry : Is responsible for storing required OCI artifacts locally (using zotregistry or docker registry).
- Ground Control : Is a component of Harbor and is responsible for serving a Harbor Satellite with the list of images it needs.
Basic Harbor Satellite Diagram
Harbor Satellite may be implemented following 1 or several of 3 different architectures depending on its use cases :
- Replicating from a remote registry to a local registry. In this basic use case, the stateless satellite component will handle pulling images from a remote registry and then pushing them to the local OCI compliant registry. This local registry will then be accessible to other local edge devices who can pull required images directly from it. (A direct access from edge device to the remote registry is still possible when network conditions permit it). The satellite component may also handle updating container runtime configurations and fetching image lists from Ground Control, a part of Harbor. The stateful local regsitry will also need to handle storing and managing data on local volumes. A typical use case would work as follows : In an edge computing environment where IoT devices are deployed to a location with limited or no internet connnectivity, these devices need to run containerised images but cannot pull from a central Harbor registry. A local Harbor Satellite instance can be deployed and take up this role while Internet connectivity is unreliable and distribute all required images. Once a reliable connection is re-established, the Harbor Satellite instance will be able to pull required images from its central Harbor registry and thus store up to date images locally.
Use case #1
- Replicating from a remote regsitry to a local Spegel Registry The stateless satellite component send pull instructions to Spegel instances running with each node of a Kubernetes cluster. The node will then directly pull images from a remote registry and share it with other local nodes, removing the need for each of them to individually pull an image from a remote registry. The network interfaces (boundaries) represented in this use case should and will be the same as those represented in use case #1 A typical use case would work as follows : In a larger scale edge computing environment with a significant amount of IoT devices needing to run containerised applications, a single local registry in might not be able to handle the increased amount of demands from edge devices. The solution is to deploy several registries to several nodes who are able to automatically replicate images across each other thanks to Spegel instances running together with each node. The Satellite component will use the same interface to instruct each node when, where and how to pull new images that need to be replicated across the cluster.
Use case #2
- Proxying from a remote regsitry over the local registry The stateless satellite component will be in charge of configuring the local OCI compliant registry, which will be running in proxy mode only. This local registry will then handle pulling necessary images from the remote registry and serving them up for use by local edge devices. A typical use case would work as follows : When, for a number of possible different reasons, the remote registry side of the diagram would not be able to produce a list of images to push down to the Harbor Satellite, the Satellite would then act as a proxy and forward all requests from edge devices to the remote registry. This ensures the availability of necessary images without the need for a pre-compiled list of images
Use case #3
In each of these use cases, we need to ensure that IoT edge devices needing to run containers will be able to access the registry and pull images from it. To solve this issue, we propose 4 solutions :
- By using containerd or CRI-O and configuring a mirror within them.
- By setting up an HTTP Proxy to manage and optimize pull requests to the registry.
- By directly referencing the registry.
- By directly referencing the registry and using Kubernetes' mutating webhooks to point to the correct registry.
The project is currently in active development. If you are interested in participating or using the product, reach out.
You can reach the Harbor community and developers via the following channels:
- #harbor-satellite on CNCF Slack (Request an invite to join the CNCF Slack via slack.cncf.io)