Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting "tools not supported" error when using empower-dev/llama3-empower-functions-small-gguf-v1.1 with Ollama #8

Open
rwankar opened this issue Oct 30, 2024 · 0 comments

Comments

@rwankar
Copy link

rwankar commented Oct 30, 2024

Just tried this by downloading the model from HF. I'm trying to use this with LangChain4j and Ollama. I am able to connect to other models but trying to connect to this I get the error status code: 400; body: {"error":"hf.co/empower-dev/llama3-empower-functions-small-gguf-v1.1 does not support tools"}

Here is the json being posted to Ollama. What could be the issue?

{
  "model" : "hf.co/empower-dev/llama3-empower-functions-small-gguf-v1.1",
  "messages" : [ {
    "role" : "system",
    "content" : "My system prompt...."
  }, {
    "role" : "user",
    "content" : "user prompt..."
  } ],
  "options" : {
    "temperature" : 0.1
  },
  "stream" : false,
  "tools" : [ {
    "type" : "function",
    "function" : {
      "name" : "toolA",
      "description" : "Description for toolA",
      "parameters" : {
        "type" : "object",
        "properties" : {
          "id" : {
            "description" : "Description of parameter",
            "type" : "array",
            "items" : {
              "type" : "integer"
            }
          }
        },
        "required" : [ ]
      }
    }
  }, {
    "type" : "function",
    "function" : {
      "name" : "toolB",
      "description" : "Description of toolB",
      "parameters" : {
        "type" : "object",
        "properties" : {
          "arg0" : {
            "description" : "arg0 description",
            "type" : "string"
          },
          "arg1" : {
            "description" : "arg1 description",
            "type" : "array",
            "items" : {
              "enum" : [ "V1", "V2", "V3", "V4", "V5", "V6" ]
            }
          },
          "propertiesInResult" : {
            "description" : "specify the properties expected in the output",
            "type" : "array",
            "items" : {
              "enum" : [ "P1", "P2", "P3", "P4"]
            }
          }
        },
        "required" : [ "arg1", "propertiesInResult" ]
      }
    }
  } ]
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant