Portrait of Seungheon Doh

Seungheon Doh

Research Scientist
Sony Group Corporation, Creative AI Team

CV Google Scholar GitHub LinkedIn

Seungheon Doh is a Research Scientist at Sony. His research focuses on music and machine learning, including music representation, understanding, recommendation, and generation. Recently, he has been particularly interested in agentic media processing, where language models coordinate tools to understand and transform multimodal media. He received his Ph.D. in Culture Technology from KAIST, where he was advised by Juhan Nam and Keunwoo Choi.

Previously, he held research internships at Sony AI, Adobe Research, Chartmetric, Naver, and ByteDance, and was a visiting scholar at NYU CILVR and MARL. He was also a founding member of talkpl.ai.

Internships at Sony: Feel free to send me a LinkedIn message with a brief note about your research interests, or ask for a coffee chat if we meet at a conference.

Selected Talks

Selected Publications

Full list on Google Scholar

  1. LLM2Fx-Tools: Tool Calling for Music Post-Production

    Seungheon Doh, Junghyun Koo, Marco A. Martínez-Ramírez, Woosung Choi, Wei-Hsiang Liao, Qiyu Wu, Juhan Nam, and Yuki Mitsufuji

    International Conference on Learning Representations (ICLR), 2026

    paperdemo

  2. TalkPlay-Tools: Conversational Music Recommendation with LLM Tool Calling

    Seungheon Doh, Keunwoo Choi, and Juhan Nam

    Workshop on AI for Music, Neural Information Processing Systems (NeurIPS-AI4Music), 2025

    paperdemo

  3. TalkPlay: Multimodal Music Recommendation with Large Language Models

    Seungheon Doh, Keunwoo Choi, and Juhan Nam

    IEEE Transactions on Multimedia (submitted), 2025

    paperdatasetdemo

  4. LP-MusicCaps: LLM-based Pseudo Music Captioning

    Seungheon Doh, Keunwoo Choi, Jongpil Lee, and Juhan Nam

    International Society for Music Information Retrieval Conference (ISMIR), 2023

    papercodedatasetdemo

Professional Experience

Research Scientist Internships View moreHide
  • Research Intern, Sony AIMentors: Junghyun Koo, Marco A. Martínez-Ramírez, Wei-Hsiang Liao
  • Research Intern, Adobe ResearchMentors: Nicholas J. Bryan, Ge Zhu
  • Research Intern, ChartmetricMentor: Keunwoo Choi
  • Research Intern, NaverMentor: Jeong Choi
  • Research Intern, ByteDanceMentors: Keunwoo Choi, Minz Won

Education

Visiting Scholar View moreHide
  • Visiting Scholar, CILVR Lab, New York UniversityAdvisor: Kyunghyun Cho
  • Visiting Scholar, Music and Audio Research Laboratory, New York UniversityAdvisor: Tae Hong Park

Services