TY - GEN
T1 - 3D Body Reconstruction Revisited
T2 - 30th ACM International Conference on Multimedia, MM 2022
AU - Lumentut, Jonathan Samuel
AU - Park, In Kyu
N1 - Publisher Copyright:
© 2022 ACM.
PY - 2022/10/10
Y1 - 2022/10/10
N2 - Recent 3D body reconstruction works are achieving state-of-the-art performances. Each of the prior works applied specific modifications to their respective modules, allowing the ability to show plausible predicted 3D body poses and shapes to human eyes. Unfortunately, those outputs may sometimes be far from the correct position. In contrast to these works, we took a different perspective on how to re-improve this limitation. Without any addition or modification at the module level, we propose a test-time adaptation strategy that fine-tunes the module directly. Our approach is inspired by the science of vaccination that leverages surrogate information, which is helpful and not harmful in improving the human immune system. This notion is translated to our adaptation strategy by fine-tuning the surrogate 3D body module using reliable virtual data. In doing so, the proposed work can revisit the prior state-of-the-art works and improve their performances directly in the test phase. The experimental results demonstrate our strategy's ability to straightforwardly improve the prior works, even with fast adaptation capability.
AB - Recent 3D body reconstruction works are achieving state-of-the-art performances. Each of the prior works applied specific modifications to their respective modules, allowing the ability to show plausible predicted 3D body poses and shapes to human eyes. Unfortunately, those outputs may sometimes be far from the correct position. In contrast to these works, we took a different perspective on how to re-improve this limitation. Without any addition or modification at the module level, we propose a test-time adaptation strategy that fine-tunes the module directly. Our approach is inspired by the science of vaccination that leverages surrogate information, which is helpful and not harmful in improving the human immune system. This notion is translated to our adaptation strategy by fine-tuning the surrogate 3D body module using reliable virtual data. In doing so, the proposed work can revisit the prior state-of-the-art works and improve their performances directly in the test phase. The experimental results demonstrate our strategy's ability to straightforwardly improve the prior works, even with fast adaptation capability.
KW - 3D body reconstruction
KW - self-supervised
KW - test-time adaptation
UR - http://www.scopus.com/inward/record.url?scp=85151048424&partnerID=8YFLogxK
U2 - 10.1145/3503161.3547842
DO - 10.1145/3503161.3547842
M3 - Conference contribution
AN - SCOPUS:85151048424
T3 - MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia
SP - 5923
EP - 5933
BT - MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia
PB - Association for Computing Machinery, Inc
Y2 - 10 October 2022 through 14 October 2022
ER -
