Check before delete

[xinyual]

Description

This pr is to check all downstream service before deleting ml model. Two downstream tasks are checking here:

1. Agent
2. Pipelines

For agent, we enforce this tool factory to implement a method to return the key field name of each tool. Then we create a should DSL query like

{
  "query": {
  "should": [
  "terms": {
            "tool.parameters.model_id": ["delete_model_id"]
        },
    "terms": {
            "tool.parameters.embedding_model_id": ["delete_model_id"]
        }
  },
  "terms": {
            "tool.parameters.inference_model_id": ["delete_model_id"]
        }
  }]
}

For pipelines, we fetch all ingestion pipelines and search pipelines and check for each pipeline whether they contain the candidate model id.

Related Issues

#3191
#3087
#3088

Check List

• New functionality includes testing.
• New functionality has been documented.
• API changes companion pull request created.
• Commits are signed per the DCO using --signoff.
• Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[dhrubo-os]

I would like to think the other way. Regardless of having model, any tool developer can extend the Tool interface. So let's not change the Tool interface. Instead we can extend the Tool interface to ToolWithModel which can have this extra method and the tools which aren't using models can implement Tool and the tools which are using models can implement ToolWithModel interface?

[xinyual]

Sure, Please check it. Also with the logic in AgentModelSearcher to construct query.

[xinyual]

But I have concern. For this, we should make sure when a new tool with mlmodel is developed, it needs to implement ToolWithModel but not Tool. It's a requirement for code review and it's more like a soft rule. So I'm afraid in the future it may skip this logic if we code reviewers miss this.