[Bug]: Milvus Lite Times out when trying to insert None Scalar Value

[MrLoh]

Is there an existing issue for this?

• I have searched the existing issues

Describe the bug

When I try to insert a row with nullable values into a collection in milvus lite, no error is returned but somehow the connection times out all of a sudden with StatusCode.UNAVAILABLE, failed to connect to all addresses; last error: UNKNOWN.

Expected Behavior

Milvus lite should support nullable scalar values or at least surface a proper error message

Steps/Code To Reproduce behavior

from pymilvus import DataType, MilvusClient

# setup client
database_uri = "./milvus.db"
client = MilvusClient(database_uri)
assert client is not None

# setup collection with nullable field
assert client.has_collection("test") is False
schema = client.create_schema(auto_id=False, enable_dynamic_field=True)
schema.add_field("id", DataType.INT64, is_primary=True)
schema.add_field("nullable", DataType.VARCHAR, max_length=256, nullable=True)
schema.add_field("vector", DataType.FLOAT_VECTOR, dim=2)
client.create_collection("test", schema=schema)
index_params = MilvusClient.prepare_index_params()
index_params.add_index(field_name="vector", index_name="test_vector", index_type="FLAT", metric_type="L2")
client.create_index("test", index_params=index_params)
client.load_collection("test")
assert client.has_collection("test") is True

# insert a row with no nullable values
client.insert("test", [{"id": 1, "nullable": "test", "vector": [0.0, 0.0]}])
assert client.query("test", output_fields=["count(*)"])[0]["count(*)"] == 1

# insert  a row with nullable values
client.insert("test", [{"id": 2, "nullable": None, "vector": [0.0, 0.0]}])

You will start seeing logs like this:

2024-12-20 16:19:20 [INFO] [describe_collection] retry:4, cost: 0.27s, reason: <_MultiThreadedRendezvous: StatusCode.UNAVAILABLE, failed to connect to all addresses; last error: UNKNOWN: unix:/var/folders/mw/h0vwcj5x08d0d7_8hhs01xlc0000gn/T/tmp54l8z0wy_milvus.db.sock: connect: Connection refused (61)>

Environment details

• Hardware/Softward conditions: macOS, MacBook with M3 Max
• Method of installation pymilvus
• pymilvus v2.5.0 using milvus lite

[XuanYang-cn]

/assign @junjiejiangjjj

[sre-ci-robot]

@XuanYang-cn: GitHub didn't allow me to assign the following users: junjiejiangjjj.

Note that only milvus-io members, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time.
For more information please see the contributor guide

In response to this:

/assign @junjiejiangjjj

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[junjiejiangjjj]

hi @MrLoh, Milvus Lite does not support None scalar value yet.

[MrLoh]

Gotcha, can this issue stay open to track that feature request then?

[junjiejiangjjj]

Gotcha, can this issue stay open to track that feature request then?

You can open an issue here: https://github.com/milvus-io/milvus-lite/issues . Since this is a new feature of milvus 2.5, it may take some time to support it.

[XuanYang-cn]

won't fix in pymilvus, closing the issue.