High-Frequency, Device-Free mmWave Facial Landmark Sensing

A high-resolution, non-contact facial landmark tracking system that uses millimeter wave (mmWave) technology to achieve precise and efficient facial sensing.

Background:

MicroFace introduces a novel mmWave-based system for high-resolution, non-contact facial landmark tracking.  This system addresses the existing challenge of precise and efficient facial sensing without physical contact, a key issue in human-computer interaction and various applications requiring detailed facial expression analysis.

Technology Overview:

MicroFace utilizes millimeter wave (mmWave) technology to sense and track 68 facial landmarks at a high sampling rate of 2667 Hz with minimal delay of 48 ms.  By employing a deep learning model to process high-frequency RF signals, it achieves fine-grained tracking and real-time 3D human mesh construction.  This University at Buffalo technology offers a significant improvement over previous non-contact methods by providing high accuracy, precision, and seamless integration into existing facial expression analytical pipelines.

https://buffalo.technologypublisher.com/files/sites/7569_in-part_image.jpg

Source: sirisakboakaew, https://stock.adobe.com/uk/750353485, stock.adobe.com

Advantages:

MicroFace provides a device-free, non-contact solution with high precision, privacy-preserving capabilities, and a high time resolution of 2667 Hz.  It integrates seamlessly with established analytical pipelines.

Applications:

  • Gaming
  • Virtual reality
  • Security
  • Healthcare

Intellectual Property Summary:

Provisional patent application 63/645,108 filed May 9, 2024.

Stage of Development:

Technology Readiness Level (TRL): 5.

Licensing Status:

Available for licensing or collaboration.

Figure 1.

https://buffalo.technologypublisher.com/files/sites/7569_image.jpg

 

Patent Information: