Grove Vision V2 and SenseCAP indicator

This is a simple demo to show how to use the Grove Vision V2 and SenseCAP indicator. And this repo is contains the code of the SenseCAP indicator(ESP32 and RP2040)

For Grove vision v2, navigate to the wiki page : 🤓Using Grove Vision AI V2 with AT Commands

The SenseCAP indicator get the result data and image from grove vision v2 via UART to draw the point, line and display the image.

_head_vision-indicator.mp4

Let's see the diagram in below:

sequenceDiagram
    indicator->>+grove vision v2: The result of current your see
    grove vision v2->>+indicator: There you go(inference result)
    indicator->>+grove vision v2: Capture a image for me
    grove vision v2->>+indicator: There you go(JPEG{based64})

Loading

To get pose detection modle: yolov8n_pose_256_vela_3_9_0x3BB000, and then flash to the address: 0x400000 on the grove vision v2 via SenseCraft-Web-Toolkit.

Don't forget to set the resolution of Vision v2 to 240x240 by sending AT command: AT+SENSOR=1,1,0.

Prerequisites

• Get and install ESP-IDF toolchain and its dependencies. ESP-IDF Get started

  • Install ESP-IDF on Windows: Description page
  • There's a ESP-related IDE too, made by Espressif, containing ESP-IDF, called Espressif-IDE which is based on Eclipse CDT. Espressif-IDE
    • Get the ESP-IDF offline Windows installer or Espressif-IDE Windows installer
    • Install it on your Windows system accepting all offered options and default settings. This automagically installs Python, git, CMake, etc all at once under C:\Espressif folder.
    • You can start building in command-line from the PowerShell/CMD entries created in the start-menu, but with the help of the included build.bat you can build on a normal commandline too
    • Or you can build the project in the IDE GUI, see 'Usage' section.

More setup details in ESP-IDF - How To Flash The Native Firmware