PLIKS: A Pseudo-Linear Inverse Kinematic Solver for 3D Human Body Estimation

Shetty K, Birkhold A, Jaganathan S, Strobel N, Kowarschik M, Maier A, Egger B (2023)

Publication Type: Conference contribution

Publication year: 2023

Journal

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition IEEE Computer Society; 1999

Publisher: IEEE Computer Society

Book Volume: 2023-June

Pages Range: 574-584

Conference Proceedings Title: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Event location: Vancouver, BC CA

ISBN: 9798350301298

DOI: 10.1109/CVPR52729.2023.00063

Abstract

We introduce PLIKS (Pseudo-Linear Inverse Kinematic Solver) for reconstruction of a 3D mesh of the human body from a single 2D image. Current techniques directly regress the shape, pose, and translation of a parametric model from an input image through a non-linear mapping with minimal flexibility to any external influences. We approach the task as a model-in-the-loop optimization problem. PLIKS is built on a linearized formulation of the parametric SMPL model. Using PLIKS, we can analytically reconstruct the human model via 2D pixel-aligned vertices. This enables us with the flexibility to use accurate camera calibration information when available. PLIKS offers an easy way to introduce additional constraints such as shape and translation. We present quantitative evaluations which confirm that PLIKS achieves more accurate reconstruction with greater than 10% improvement compared to other state-of-the-art methods with respect to the standard 3D human pose and shape benchmarks while also obtaining a reconstruction error improvement of 12.9 mm on the newer AGORA dataset.

Authors with CRIS profile

Karthik Shetty Lehrstuhl für Informatik 5 (Mustererkennung) Srikrishna Jaganathan Lehrstuhl für Informatik 5 (Mustererkennung) Andreas Maier Lehrstuhl für Informatik 5 (Mustererkennung) Bernhard Egger Professur für Cognitive Computer Vision (Stiftungsprofessur)

Involved external institutions

Siemens AG DE Germany (DE)

How to cite

APA:

Shetty, K., Birkhold, A., Jaganathan, S., Strobel, N., Kowarschik, M., Maier, A., & Egger, B. (2023). PLIKS: A Pseudo-Linear Inverse Kinematic Solver for 3D Human Body Estimation. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (pp. 574-584). Vancouver, BC, CA: IEEE Computer Society.

MLA:

Shetty, Karthik, et al. "PLIKS: A Pseudo-Linear Inverse Kinematic Solver for 3D Human Body Estimation." Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC IEEE Computer Society, 2023. 574-584.

BibTeX: Download