face-detectiongoogle-mlkit

MLKit face detection 's algorithm


MLKit provides good API documentations and guides for Face detection (https://developers.google.com/ml-kit/vision/face-detection). However, I can not find any informations about the algorihms/baseline model or related research papers behind the scene. Can someone provide any suggestions about it's implementation ?


Solution

  • It likely uses blazeface for face detection used on mediapipe. I could not find a direct answer, but when analyzing an apk with mlkit face detection blazeface.tfl can be found on assets folder.

    enter image description here

    Mediapipe pose detection doc mentions blazepose powers the ML Kit Pose Detection API. So, blazeface is likely to power mlkit on device face detection.

    Links to documentation, paper, poster,

    https://google.github.io/mediapipe/solutions/face_detection.html

    https://arxiv.org/abs/1907.05047

    https://docs.google.com/presentation/d/1YCtASfnYyZtH-41QvnW5iZxELFnf0MF-pPWSLGj8yjQ/present?slide=id.g5bc8aeffdd_1_0

    https://drive.google.com/file/d/1u6aB6wxDY7X2TmeUUKgFydulNtXkb3pu/view