Gesture recognition for gaming
Implementation on low-power MCU without a camera.
Approach
We set a detection distance to 20 cm to reduce the influence of the background
The sampling frequency of the sensor is set to its maximum (15 Hz) to capture gesture with a normal velocity
We created a dataset with 1200 records per class, avoiding empty measurement (no motion).
The data logging is very easy to manage with the evaluation board connected to the PC running NEAI Studio.
Finally, we created an 'N-Class classification' model (4 classes) in NanoEdge AI Studio and tested it live on a NUCLEO_F401RE. (with a X-NUCLEO-53L5A1 add-on board)
Sensor
Data
Length data 256, 4 successive matrixes of 8x8
Data rate 15Hz
Results
4 classes classification:
98.12% accuracy, 1.3 KB RAM, 59.1 KB Flash
Green points represent well classified signals. Red points represent misclassified signals. The classes are on the abscissa and the confidence of the prediction is on the ordinate
Resources
Model created with NanoEdge AI Studio
A free AutoML software for adding AI to embedded projects, guiding users step by step to easily find the optimal AI model for their requirements.
The STM32 family of 32-bit microcontrollers based on the Arm Cortex®-M processor is designed to offer new degrees of freedom to MCU users. It offers products combining very high performance, real-time capabilities, digital signal processing, low-power / low-voltage operation, and connectivity, while maintaining full integration and ease of development.