High-speed Multi-person Pose Estimation with Deep Feature Transfer

Ying Huang, Hubert P. H. Shum, Edmond S. L. Ho, Nauman Aslam

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)
7 Downloads (Pure)


Recent advancements in deep learning have significantly improved the accuracy of multi-person pose estimation from RGB images. However, these deep learning methods typically rely on a large number of deep refinement modules to refine the features of body joints and limbs, which hugely reduce the run-time speed and therefore limit the application domain. In this paper, we propose a feature transfer framework to capture the concurrent correlations between body joint and limb features. The concurrent correlations of these features form a complementary structural relationship, which mutually strengthens the network's inferences and reduces the needs of refinement modules. The transfer sub-network is implemented with multiple convolutional layers, and is merged with the body part detection network to form an end-to-end system. The transfer relationship is automatically learned from ground-truth data instead of being manually encoded, resulting in a more general and efficient design. The proposed framework is validated on the multiple popular multi-person pose estimation benchmarks - MPII, COCO 2018 and PoseTrack 2017 and 2018. Experimental results show that our method not only significantly increases the inference speed to 73.8 frame per second (FPS), but also attains comparable state-of-the-art performance.

Original languageEnglish
Article number103010
JournalComputer Vision and Image Understanding
Early online date9 Jun 2020
Publication statusPublished - 1 Aug 2020


Dive into the research topics of 'High-speed Multi-person Pose Estimation with Deep Feature Transfer'. Together they form a unique fingerprint.

Cite this