About Me

I am a Ph.D. student in the Graduate School of Advanced Imaging Science, Multimedia & Film (GSAIM) at Chung-Ang University, advised by Prof. Hak Gu Kim.

My research integrates vision, language, and audio through multimodal learning, aiming to build systems that understand and interact with humans. I work on speech-driven 3D facial animation, where phonetic and articulatory cues guide audio-visual generation, and on multimodal large language models (MLLMs) that extend language understanding beyond text. I am now extending this line toward socially-aware systems that reason about human interaction across modalities.

Research interests: Multimodal LLM (MLLM) · Cross-modal Learning · Social Artificial Intelligence

News

• May 2026The paper was accepted to Interspeech 2026
• Jun 2025The paper was accepted to ICCV 2025
• May 2025The paper was accepted to Interspeech 2025
• Jun 2024The paper was accepted to ICIP Workshop 2024
• Jun 2024The paper was accepted to ICIP 2024

Publications

Legend: ^* equal contribution  ·  ^† co-corresponding authors

5. ArtBoost: Synthetic Articulatory Data Augmentation for Acoustic-to-Articulatory Inversion
   Hyung Kyu Kim, Byungchan Hwang, Hak Gu Kim
   Interspeech 2026 Oral
   Paper·Project Page
6. MemoryTalker: Personalized Speech-Driven 3D Facial Animation via Audio-Guided Stylization
   Hyung Kyu Kim, Sangmin Lee^†, Hak Gu Kim^†
   International Conference on Computer Vision (ICCV) 2025 Poster
   Paper·Project Page·Code
7. Learning Phonetic Context-Dependent Viseme for Enhancing Speech-Driven 3D Facial Animation
   Hyung Kyu Kim, Hak Gu Kim
   Interspeech 2025 Oral
   Paper·Project Page·Code
8. Analyzing Visible Articulatory Movements in Speech Production for Speech-Driven 3D Facial Animation
   Hyung Kyu Kim, Sangmin Lee, Hak Gu Kim
   IEEE International Conference on Image Processing (ICIP) 2024 Poster
   Paper
9. Unveiling the Potential of Multimodal Large Language Models for Scene Text Segmentation via Semantic-Enhanced Features
   Ho Jun Kim*, Hyung Kyu Kim*, Sangmin Lee, Hak Gu Kim
   IEEE International Conference on Image Processing Workshop (ICIPW) 2024 Presentation
   Paper

Education

• Chung-Ang University (CAU)  Mar. 2025 - Present
  Ph.D. in Graduate School of Advanced Imaging Science, Multimedia & Film (GSAIM)
  Advisor: Prof. Hak Gu Kim
• Chung-Ang University (CAU)  Mar. 2023 - Feb. 2025
  M.S. in Graduate School of Advanced Imaging Science, Multimedia & Film (GSAIM)
  Advisor: Prof. Hak Gu Kim
• Konkuk University  Mar. 2016 - Feb. 2023
  B.S. in Computer Science and Engineering

Honors & Awards

• Doctoral Excellence Scholarship in Science and Engineering (NRF) (2026 - Present)
• Excellence Research Award, 2025 Virtual Convergence Graduate School Symposium (Aug. 2025)
• Best Paper Award, 37th Workshop on Image Processing and Image Understanding (IPIU) (Feb. 2025)