Keypoint detection heatmap

1. What is keypoint detection?
2. What is keypoint regression?
3. How does heatmap regression work?
4. What are image keypoints?

What is keypoint detection?

Keypoint detection involves simultaneously detecting people and localizing their keypoints. Keypoints are the same thing as interest points. They are spatial locations, or points in the image that define what is interesting or what stand out in the image.

What is keypoint regression?

2.1 Keypoint Regression

The semantic keypoints detection aims to find the numerical coordinates of a set of pre-defined facial landmarks (e.g., left eye, right eye, nose, left mouth corner, right mouth corner, etc.).

How does heatmap regression work?

The proposed quantization system induced by the randomized rounding operation 1) encodes the fractional part of numerical coordinates into the ground truth heatmap using a probabilistic approach during training; and 2) decodes the predicted numerical coordinates from a set of activation points during testing.

What are image keypoints?

Image Keypoint: a distinctive image feature that can be detected repeatably despite changes in 1) image scale (resolution), 2) illumination and noise, and 3) image orientation and perspective.