About

I am Hyunsoo Cha, a PhD student at Seoul National University, advised by Prof. Hanbyul Joo. I am currently a Research Scientist Intern at NVIDIA AI-Mediated Reality and Interaction Research Group (AMRI) in Santa Clara, CA.

My long-term research goal is to build virtual worlds in which humans and intelligent agents seamlessly interact, with agents that perceive, represent, and meaningfully assist people in their everyday lives. Toward this vision, I develop generative models that capture the richness of human appearance, motion, and behavior, serving as a foundation for embodied agents that can truly understand and collaborate with people.

News

Experience

Research Scientist Intern
Santa Clara, CA, USA · Jul 2026 - Mar 2027
Manager: Shalini De Mello
Mentors: Seonwook Park, Amrita Mazumdar
Collaborators: Rajarshi Roy, Koki Nagano, Christian Jacobsen
Intern
Hwaseong, Korea · Sep 2021 - Dec 2021

Publications

Robot-Factored World Models via Robot Rendering
CoRL, 2026

Robot-Factored World Models via Robot Rendering

Factors action realization and robot appearance out of the world model by rendering actions as visible robot geometry, yielding a shared visual interface that transfers across viewpoints and unseen robot embodiments.

Robotic Manipulation World Models
SimuScene: Simulation-Ready Compositional 3D Scene Reconstruction from a Single Image
NeurIPS, 2026

SimuScene: Simulation-Ready Compositional 3D Scene Reconstruction from a Single Image

Inhee Lee*, Sangwon Baik*, June Sungjoo Kim, Hyeonwoo Kim, Hyunsoo Cha, Hanbyul Joo * Equal contribution

A compositional 3D reconstruction pipeline that puts physics in the loop of shape and layout estimation, producing a stable, simulation-ready scene from a single image.

3D Scene Reconstruction Physics Simulation Robotic Manipulation
Vanast: Virtual Try-On with Human Image Animation via Synthetic Triplet Supervision
CVPR, 2026 Highlight

Vanast: Virtual Try-On with Human Image Animation via Synthetic Triplet Supervision

Given a human image and one or more garment images, our method generates virtual try-on with human image animation conditioned on a pose video while preserving identity.

Animation Generative Models Virtual Try-On
Durian: Dual Reference Image-Guided Portrait Animation with Attribute Transfer
ICLR, 2026

Durian: Dual Reference Image-Guided Portrait Animation with Attribute Transfer

Hyunsoo Cha, Byungjun Kim, Hanbyul Joo

Given a portrait and one or more reference images specifying target attributes, Durian generates a portrait animation with attribute transfer in a single-stage pipeline.

Animation Appearance Editing Generative Models Virtual Try-On
PERSE: Personalized 3D Generative Avatars from A Single Portrait
CVPR, 2025

PERSE: Personalized 3D Generative Avatars from A Single Portrait

Hyunsoo Cha, Inhee Lee, Hanbyul Joo

A method for building an animatable personalized generative avatar from a reference portrait.

3D Avatar Appearance Editing Generative Models Virtual Try-On
PEGASUS: Personalized Generative 3D Avatars with Composable Attributes
CVPR, 2024

PEGASUS: Personalized Generative 3D Avatars with Composable Attributes

Hyunsoo Cha, Byungjun Kim, Hanbyul Joo

A method for constructing a personalized generative 3D face avatar from monocular videos.

3D Avatar Appearance Editing