Enable Manila support in DCN jobs

[lkuchlan]

No description provided.

[github-actions]

Thanks for the PR! ❤️
I'm marking it as a draft, once your happy with it merging and the PR is passing CI, click the "Ready for review" button below.

[gouthampacha]

In DCN, according to https://github.com/openstack-k8s-operators/architecture/tree/main/examples/dt/dcn, there are three Ceph clusters..

You'd need the appropriate Ceph configuration plugged to a specific instance of "manila-share"; and a corresponding extra-mount with the ceph secret.

See how cinder volume is configured beginning line 27 in this file..

We need a change to the "architecture" repo that enables setting "ManilaShares" similar to CinderVolumes so we can do that..

[fmount]

Correct, and also, we might need to change manilaShares here to iterate over the AZs:

manilaShares:
{% for _ceph in _ceph_vars_list %}
    {{ _ceph.cifmw_ceph_client_cluster }}:
      customServiceConfig: |
          [DEFAULT]
          enabled_share_backends = cephfs
          enabled_share_protocols = cephfs
          [cephfs]
          driver_handles_share_servers = False
          share_backend_name = cephfs
          share_driver = manila.share.drivers.cephfs.driver.CephFSDriver
          cephfs_conf_path = /etc/ceph/{{ _ceph.cifmw_ceph_client_cluster }}.conf
          cephfs_cluster_name = {{ _ceph.cifmw_ceph_client_cluster }}
          cephfs_auth_id=openstack
          cephfs_volume_mode = 0755
          cephfs_protocol_helper_type = CEPHFS
{% endfor %}

[fmount]

Correct, and also, we might need to change manilaShares here to iterate over the AZs:

manilaShares:
{% for _ceph in _ceph_vars_list %}
    {{ _ceph.cifmw_ceph_client_cluster }}:
      customServiceConfig: |
          [DEFAULT]
          enabled_share_backends = cephfs
          enabled_share_protocols = cephfs
          [cephfs]
          driver_handles_share_servers = False
          share_backend_name = cephfs
          share_driver = manila.share.drivers.cephfs.driver.CephFSDriver
          cephfs_conf_path = /etc/ceph/{{ _ceph.cifmw_ceph_client_cluster }}.conf
          cephfs_cluster_name = {{ _ceph.cifmw_ceph_client_cluster }}
          cephfs_auth_id=openstack
          cephfs_volume_mode = 0755
          cephfs_protocol_helper_type = CEPHFS
{% endfor %}

[fmount]

As discussed, we also need to patch https://github.com/openstack-k8s-operators/architecture/blob/main/examples/dt/dcn/service-values.yaml#L198 and provide 3 shares (see glance and cinder as an example)

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign viroel for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[fultonj]

Patch to openstack-k8s-operators/architecture#467 looks good to me

[fultonj]

In general I'm +1 to merge but let's confirm by a downstream job. After Liron confirms I say we merge.