Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to upgrade qnn to 2.23.1.240531 to support v79 #178

Open
yufeiy opened this issue Nov 6, 2024 · 2 comments
Open

how to upgrade qnn to 2.23.1.240531 to support v79 #178

yufeiy opened this issue Nov 6, 2024 · 2 comments
Assignees

Comments

@yufeiy
Copy link

yufeiy commented Nov 6, 2024

model.layers.0.self_attn.ires_split-00_view_is QNN INT8 op
0.0ms [ ERROR ] Tensor name InceptionV3_InceptionV3_Conv2d_1a_3x3_Conv2D_stride already exists in the graph.

[ ERROR ] QnnModel::addTensor() Creating tensor for node: model.layers.0.self_attn.k_proj.linearint8, tensorName: InceptionV3_InceptionV3_Conv2d_1a_3x3_Conv2D_stride.
[ ERROR ] QnnModel::addNode() addTensor() failed for tensor param InceptionV3_InceptionV3_Conv2d_1a_3x3_Conv2D_stride on node model.layers.0.self_attn.k_proj.linearint8.
[ ERROR ] qnnModels_[qnnModelIndex_].addNode( QNN_OPCONFIG_VERSION_1, name.c_str(), packageName.c_str(), nodeType.c_str(), paramsPtr, params.size(), inputTensorNames, inputTensorNames.size(), outputTensors.data(), outputTensors.size() ) expected MODEL_NO_ERROR, got MODEL_TENSOR_ERROR

when build htp_v79 using qnn 2.23.1.240531 with latest Hexagon SDK(6.1.0.1), there is above tensor name conflict issue. How can we fix it for qnn upgrading?

@liang1232018
Copy link
Collaborator

Hi,

Thank you for your attention on the mllm and for providing this issue. In the earlier version of QNN 2.20, it was possible for LinearINT8 parameter names to have duplicates. However, it seems this is no longer allowed starting with version qnn 2.23.

To resolve this issue, you can reassign a unique name to InceptionV3_InceptionV3_Conv2d_1a_3x3_Conv2D_stride by renaming it according to the linear naming convention. For instance, you could rename it to something like layer.0.q_proj.InceptionV3_InceptionV3_Conv2d_1a_3x3_Conv2D_stride.

Additionally, we are currently working on updates to support htp_v79, which will include the latest versions of QNN and Hexagon SDK (6.1.0.1). Stay tuned for more updates.

Thank you for your patience and understanding. If you have any more questions or need further assistance, feel free to ask!

@yufeiy
Copy link
Author

yufeiy commented Nov 11, 2024

Thanks for your response and comments. But even we rename it with liner naming convention like layer.0.q_proj.InceptionV3_InceptionV3_Conv2d_1a_3x3_Conv2D_stride, the issue was still reproduced as below:

model.layers.0.self_attn.ires_split-00_view_is QNN INT8 op
0.0ms [ ERROR ] Tensor name layer.0.q_proj.InceptionV3_InceptionV3_Conv2d_1a_3x3_Conv2D_stride already exists in the graph.

[ ERROR ] QnnModel::addTensor() Creating tensor for node: model.layers.0.self_attn.k_proj.linearint8, tensorName: layer.0.q_proj.InceptionV3_InceptionV3_Conv2d_1a_3x3_Conv2D_stride.
[ ERROR ] QnnModel::addNode() addTensor() failed for tensor param layer.0.q_proj.InceptionV3_InceptionV3_Conv2d_1a_3x3_Conv2D_stride on node model.layers.0.self_attn.k_proj.linearint8.
[ ERROR ] qnnModels_[qnnModelIndex_].addNode( QNN_OPCONFIG_VERSION_1, name.c_str(), packageName.c_str(), nodeType.c_str(), paramsPtr, params.size(), inputTensorNames, inputTensorNames.size(), outputTensors.data(), outputTensors.size() ) expected MODEL_NO_ERROR, got MODEL_TENSOR_ERROR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants