Saving energy is more than ever a priority. Making homes, buildings, and cities smarter is an effective way to save energy. For example, monitoring presence to turn the lights off when possible, optimizing heating systems based on the number of people in a room, or even diming public lighting when the street is empty... However, cameras are not always implemented in streets for various reasons. NanoEdge AI Studio allows you to develop ML libraries decrypting time series data to various sensor such as Radar or Time-of-Flight in order to make these data meaningful data for Humans.

For example purposes, we have taught an AI library how to distinguish human vs animal and to be able to detect when one or several people are entering or leaving a room without any camera. This approach can easily be adapted to many other use cases. 

Approach

We put a Time-of-Flight sensor on a gantry at 2m40 pointed to the ground and changed the detection distance to monitor movements from 1m40 and above (not looking for dogs, suitcases, etc.) 
When a person enters the field of the Time of fight, it triggers the sensor. We concatenate 32 signals of the sensor at a frequency of 15Hz (the maximum) to capture the direction (In or out) 
We binarized the distances captured by the time of flight because we dont need information about the height of the person that passes
We created datasets for 4 classes. 1000 signals for both a single person going in and going out. And 400 signals for both 2 people going in and 2 people going out 
Finally, we created an 'N-Class classification' model (4 classes) in NanoEdge AI Studio and tested it live on a NUCLEO_F411RE (with a X-NUCLEO-53L5A1 add-on board) 

Sensor

Time-of-Flight: VL53L5CX 

Data

4 classes of data 1 person going in, 2 people going in, 1 person going out, 2 people going out 
Signal length 2048 (32 successive 8x8 matrix)
Data rate 15 Hz

Results

3 class classification:
98.14% accuracy, 27.1 KB RAM, 229 KB Flash

RESULTS-propleCounting RESULTS-propleCounting RESULTS-propleCounting

Green points represent well classified signals. Red points represent misclassified signals. The classes are on the abscissa and the confidence of the prediction is on the ordinate 

Model created with
NanoEdge AI Studio
NanoEdge AI Studio
Compatible with
STM32
STM32

Resources

Model created with NanoEdge AI Studio

A free AutoML software for adding AI to embedded projects, guiding users step by step to easily find the optimal AI model for their requirements.

NanoEdge AI Studio NanoEdge AI Studio NanoEdge AI Studio

Compatible with STM32

The STM32 family of 32-bit microcontrollers based on the Arm Cortex®-M processor is designed to offer new degrees of freedom to MCU users. It offers products combining very high performance, real-time capabilities, digital signal processing, low-power / low-voltage operation, and connectivity, while maintaining full integration and ease of development.

STM32 STM32 STM32

You might also be interested by

Predictive maintenance | Accelerometer | NanoEdge AI Studio | Video | Partner | Industrial

Anomaly detection with on-device learning with Rtone

Anomaly detection solution on industrial equipment, running on STM32 MCU.

Object detection | Vision | STM32Cube.AI | Idea | GitHub | Video | Dataset | Smart building

Personal protective equipment detection

Detection of personal protective equipment on workers using an object detection AI model.

Smart city | Smart home | Smart office | Context awareness | Vision | AI for Linux | Idea | Video

People detection and counting solution

Optimized computer vision using an MPU running at 8 FPS.