[Feature] Agent microservice support using LlamaIndex

[lvliang-intel]

Priority

P4-Low

OS type

Ubuntu

Hardware type

Gaudi2

Running nodes

Single Node

Description

Feature Name: Agent Microservice Support using LlamaIndex

Description:
This feature aims to extend the current Agent Microservice to support LlamaIndex as an additional implementation alongside LangChain. The integration will allow the Agent Microservice to utilize LlamaIndex’s advanced capabilities for structured reasoning and dynamic task planning, providing greater flexibility and robustness.

Tasks:

Plan integration points where LlamaIndex interacts with the Agent’s core logic, including task orchestration.
Develop and Integrate LlamaIndex Functionality.
Use LlamaIndex to improve the Agent’s ability to reason about tasks and dependencies.
Implement mechanisms for efficient task delegation and response synthesis using LlamaIndex.
Conduct unit and integration tests for the LlamaIndex implementation.