Skip to content

STMicroelectronics/x-cube-n6-ai-face-landmarks

BranchesTags

Repository files navigation

x-cube-n6-ai-face-landmarks Application

Computer Vision application demonstrating the deployment of several object detection models execution in series on the STM32N6570-DK or NUCLEO-N657X0-Q board. The chosen use case is multiple-faces landmark detection. It consists of two models that execute sequentially:

  1. A face detection (fd) model is executed in the first stage to detect the faces.
  2. A face landmark (fl) detection model is executed in the second stage to identify the landmarks of the faces detected during the first stage. After the execution of the first model, a resize operation takes place to provide the expected input to the second model. On STM32N6570-DK GPU2D is used to also perform a rotation to orient face vertically.

This top README gives an overview of the app. Additional documentation is available in the Doc folder.

Image sample

Doc Folder Content

Features Demonstrated

  • Multi-threaded application flow (FreeRTOS)
  • NPU-accelerated quantized AI model inference
  • GPU2D usage to perform resize and rotation
  • Execute multiple models in series
  • Dual DCMIPP pipelines
  • DCMIPP cropping, decimation, and downscaling
  • DCMIPP ISP usage
  • LTDC dual-layer implementation
  • Development mode
  • Boot from external flash

Hardware Support

Supported development platforms:

  • STM32N6570-DK Discovery Board
    • Connect to the onboard ST-LINK debug adapter (CN6) using a USB-C to USB-C cable for sufficient power.
    • OTP fuses are configured for xSPI IOs to achieve maximum speed (200MHz) on xSPI interfaces.
  • NUCLEO-N657X0-Q Nucleo Board
    • Connect to the onboard ST-LINK debug adapter (CN9) using a USB-C to USB-C cable for sufficient power.
    • OTP fuses are configured for xSPI IOs to achieve maximum speed (200MHz) on xSPI interfaces.

Board STM32N6570-DK board with MB1854B IMX335.

Supported camera modules:

For the Nucleo board, one of the following displays is required:

  • A USB host for data transmission via USB/UVC (using the USB OTG port CN8)

Board NUCLEO-N657X0-Q board with USB/UVC display.

Board NUCLEO-N657X0-Q board with SPI display.

Tools Version

Boot Modes

The STM32N6 series does not have internal flash memory. To retain firmware after a reboot, program it into the external flash. Alternatively, you can load firmware directly into SRAM (development mode), but note that the program will be lost if the board is powered off in this mode.

Development Mode: used for loading firmware into RAM during a debug session or for programming firmware into external flash.

Boot from Flash: used to boot firmware from external flash.

STM32N6570-DK NUCLEO-N657X0-Q
Boot from flash STM32N6570-DK Boot from flash NUCLEO-N657X0-Q Boot from flash
Development mode STM32N6570-DK Development mode NUCLEO-N657X0-Q Development mode

Console parameters

You can see application messages by attaching a console application to the ST-Link console output. Use the following console parameters:

  • Baud rate of 115200 bps.
  • No parity.
  • One stop bit.

Quickstart using Prebuilt Binaries

The prebuilt binaries are an assembly of several binaries:

  • FSBL (First Stage Boot Loader, loading the application from flash to RAM)
  • The application
  • The weights of the neural network models

STM32N6570-DK

To program the board's external flash, follow these steps:

  1. Set the board to development mode.
  2. Program Binary/STM32N6570-DK/x-cube-n6-ai-face-landmarks-dk.hex.
  3. Set the board to boot from flash mode.
  4. Power cycle the board.

NUCLEO-N657X0-Q USB/UVC

To program the board's external flash, follow these steps:

  1. Set the board to development mode.
  2. Program Binary/NUCLEO-N657X0-Q/USB-UVC-Display/x-cube-n6-ai-face-landmarks-nucleo-uvc.hex.
  3. Set the board to boot from flash mode.
  4. Connect a USB cable to the USB OTG port (CN8), next to the RJ45 port. Connect the other end to a USB host (PC, USB hub, etc.) for data transmission via USB/UVC.
  5. Power cycle the board.
  6. Start the camera application on the host. On Windows, search for "camera" in the Start menu.

NUCLEO-N657X0-Q SPI

To program the board's external flash, follow these steps:

  1. Set the board to development mode.
  2. Program Binary/NUCLEO-N657X0-Q/SPI-Display/x-cube-n6-ai-face-landmarks-nucleo-spi.hex.
  3. Set the board to boot from flash mode.
  4. Power cycle the board.

How to Program Hex Files Using STM32CubeProgrammer UI

See How to program hex files STM32CubeProgrammer.

How to Program Hex Files on STM32N6570-DK Using Command Line

Ensure the STM32CubeProgrammer bin folder is in your PATH.

export DKEL="<STM32CubeProgrammer_N6 Install Folder>/bin/ExternalLoader/MX66UW1G45G_STM32N6570-DK.stldr"

# Application Firmware
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $DKEL -hardRst -w Binary/STM32N6570-DK/x-cube-n6-ai-face-landmarks-dk.hex

How to Program Hex Files on NUCLEO-N657X0-Q Using Command Line

Ensure the STM32CubeProgrammer bin folder is in your PATH.

export NUEL="<STM32CubeProgrammer_N6 Install Folder>/bin/ExternalLoader/MX25UM51245G_STM32N6570-NUCLEO.stldr"

# USB/UVC display
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $NUEL -hardRst -w Binary/NUCLEO-N657X0-Q/USB-UVC-Display/x-cube-n6-ai-face-landmarks-nucleo-uvc.hex
# SPI display
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $NUEL -hardRst -w Binary/NUCLEO-N657X0-Q/SPI-Display/x-cube-n6-ai-face-landmarks-nucleo-spi.hex

Quickstart using Source Code

Before building and running the application, you must program Model/face_detector_data.hex and Model/face_landmark_data.hex (models weights and biases). This only needs to be done once unless you change the AI model. See Quickstart using prebuilt binaries for details.

For more information about boot modes, see Boot Overview.

Application Build and Run - Dev Mode

Set your board to development mode.

STM32CubeIDE

Double-click STM32CubeIDE/<board_name>/.project to open the project in STM32CubeIDE. Build and run the project.

IAR EWARM

Double-click EWARM/<board_name>/x-cube-n6-ai-face-landmarks-dk.eww to open the project in IAR. Build and run the project.

Makefile

Run the following commands (ensure required tools are in your PATH):

  1. Build the project: 
    make -j8
  2. Start a GDB server connected to the STM32 target: 
    ST-LINK_gdbserver -p 61234 -l 1 -d -s -cp <path-to-stm32cubeprogramer-bin-dir> -m 1 -g
  3. In a separate terminal, launch a GDB session to load the firmware: 
    $ arm-none-eabi-gdb build/Project.elf
(gdb) target remote :61234
(gdb) monitor reset
(gdb) load
(gdb) continue

Note: To select the board, specify BOARD=STM32N6570-DK or BOARD=NUCLEO-N657X0-Q as a Makefile option.

Note: To select the NUCLEO-N657X0-Q display interface, specify SCR_LIB_SCREEN_ITF=UVCL or SCR_LIB_SCREEN_ITF=SPI as a Makefile option.

Application Build and Run - Boot from Flash

Set your board to development mode.

Build the Application

STM32CubeIDE

Double-click STM32CubeIDE/<board_name>/.project to open the project in STM32CubeIDE. Build the project.

IAR EWARM

Double-click EWARM/<board_name>/x-cube-n6-ai-face-landmarks-dk.eww to open the project in IAR. Build the project.

Makefile

Ensure all required tools are in your PATH, then build the project:

make -j8

Program the Firmware in the External Flash

After building the application, you must add a signature to the binary file:

STM32_SigningTool_CLI -bin build/Project.bin -nk -t ssbl -hv 2.3 -o build/Project_sign.bin

Program the signed binary at address 0x70100000, as well as the FSBL and network parameters.

On STM32N6570-DK:

export DKEL="<STM32CubeProgrammer_N6 Install Folder>/bin/ExternalLoader/MX66UW1G45G_STM32N6570-DK.stldr"

# First Stage Boot Loader
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $DKEL -hardRst -w FSBL/ai_fsbl.hex

# Adjust build path as needed
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $DKEL -hardRst -w build/Project_sign.bin 0x70100000

# Network parameters and biases
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $DKEL -hardRst -w Model/face_detector_data.hex
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $DKEL -hardRst -w Model/face_landmark_data.hex

On NUCLEO-N657X0-Q:

export NUEL="<STM32CubeProgrammer_N6 Install Folder>/bin/ExternalLoader/MX25UM51245G_STM32N6570-NUCLEO.stldr"

# First Stage Boot Loader
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $NUEL -hardRst -w FSBL/ai_fsbl.hex

# Adjust build path as needed
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $NUEL -hardRst -w build/Project_sign.bin 0x70100000

# Network parameters and biases
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $NUEL -hardRst -w Model/face_detector_data.hex
STM32_Programmer_CLI -c port=SWD mode=HOTPLUG -el $NUEL -hardRst -w Model/face_landmark_data.hex

Note: Only the application binary needs to be programmed if fsbl and networks data have already been programmed.

Set your board to boot from flash mode and power cycle to boot from external flash.

How to update my project with a new version of ST Edge AI

The neural network models files (face_detector.c, stai_face_detector.c/h, etc.) included in this project were generated using STEdgeAI version 3.0.0.

Using a different version of STEdgeAI to generate these models files may result in the following compile-time error:
Possible mismatch in ll_aton library used.

If you encounter this error, please follow the STEdgeAI instructions on How to update my project with a new version of ST Edge AI Core to update your project.

About

An AI software expansion package demonstrating face landmarks detection use case on STM32N6 products.

Topics

ai stm32 freertos face-landmarks face-landmark-detection stm32cube-mcu-package computer-vison stm32n6

Resources

Readme

License

View license

Code of conduct

Code of conduct

Security policy

Security policy
Activity
Custom properties

Stars

5 stars

Watchers

0 watching

Forks

2 forks
Report repository

Releases 2

v1.1.0 Latest
Jan 30, 2026
+ 1 release

Packages

 
 
 

Contributors

Languages