Research Scientist
Adobe Research, San Jose, CA, US

mysmilesh@gmail.com
[CV]  [Google Scholar]  [GitHub]  [LinkedIn]  [twitter]


I am a Senior Research Scientist at Adobe Research. My research interests are in the areas of machine learning and natural language processing (NLP). I am particularly interested in understanding long texts for question answering systems and learning language representation for NLP tasks. Further interests lie in applying and integrating NLP research with other disciplines to tackle practical issues; understanding multimodal information (i.e., text, audio, and visual) and NLP for social good.

I received my Ph.D. in Electrical and Computer Engineering from Seoul National University in 2020 with the Distinguished Dissertation Award, where I was fortunate to be advised by Dr. Kyomin Jung. Prior to Seoul National University, I had involved critical initiatives for the engineering and innovation of AI and machine learning while I was a staff software engineer at Samsung Research Artificial Intelligence Center (2006-2017).

News

  • NEW [Apr-26] Three papers (longQA, multihopQA, Video Evaluation) are accepted to ACL 2026.
  • NEW [Mar-26] Our paper (VLM/Image editing) is accepted to WACV 2026.
  • NEW [Jan-26] Our team achieved 1st place in the AVERITEC Shared Task at EACL 2026 Workshop FEVER.
  • NEW [Jan-26] Two papers (LLM-VLM; Conversational User Simulation) are accepted to EACL 2026.
  • [Sep-25] Two papers (RL-QA; Program Synthesis) are accepted to NeurIPS 2025.
  • [Aug-25] Our paper (Unlearning) is accepted to EMNLP 2025.
  • [Jul-25] Our paper (Agent) is accepted to COLM 2025.
  • [May-25] Our team achieved 2nd place in the AVERITEC Shared Task hosted by ACL 2025 Workshop FEVER.
  • [May-25] Four papers (Active Learning; GUI Agent (findings); IR (findings); SlimLM (system)) are accepted to ACL 2025.
  • [May-25] Two papers (Image Captioning; LLM long context) are accepted to ICML 2025.
  • [Jan-25] Three papers (QA Inductive Reasoning; LVLM) are accepted to NAACL 2025.
  • [Jan-25] Two papers (Text to ReLighting (main) and Domain specific QA (workshop)) are accepted to AAAI 2025.
  • [Dec-24] I gave a talk at SNU: Capability of Vision and Language Model for AI for Social Good
  • [Sep-24] I gave a talk at CAU: Vision and Language Representation with LLM for Multimodal Understanding
  • [Sep-24] Three papers (Summarization and Factual Inconsistency Detection; Document QA) are accepted to EMNLP 2024.
  • [Aug-24] Our team achieved 2nd place (1st place among open source) in the AVERITEC Shared Task hosted by EMNLP 2024 Workshop FEVER.
  • [Jul-24] One paper (Video Localization) is accepted to CIKM 2024.
  • [Jun-24] One paper (Speaker Identification) is accepted to INTERSPEECH 2024.
  • [May-24] One paper (Assessing News Thumbnail Representativeness) is accepted to ACL 2024 Findings.
  • [May-24] One paper (Multilingual Representation for Semantic Retrieval) is accepted to SIGIR 2024.
  • [May-24] One paper (Explainable Image Classification) is accepted to NAACL 2024 Findings.
  • [Feb-24] One paper (Video Summary) is accepted to CVPR 2024.
  • [Jan-24] One paper (Textual Representation) is accepted to EACL 2024 Findings.
  • [Nov-23] One paper (Video Topic Segmentation) is accepted to Multimedia Modelling 2024.
  • [Oct-23] One paper (Transcript Understanding) is accepted to IEEE BigData 2023.
  • [Oct-23] One paper (Image Captioning Metric) is accepted to EMNLP 2023 Findings.
  • [May-23] One paper (Transcript Understanding) is accepted to Interspeech 2023.
  • [May-23] Two papers (HighGEN; MeetingQA) are accepted to ACL 2023.
  • [Jan-23] One paper is accepted to EACL 2023.
  • [Oct-22] One paper is accepted to NeurIPS 2022 Workshop on All Things Attention.
  • [Oct-22] One paper (GeNER) is accepted to EMNLP 2022.
  • [Sep-22] I gave a talk at SKKU: Pretrained Language Model and Semantic Textual Understanding
  • [Aug-22] Five papers (KGQA; MedicalQA; Offensive content detection; Keyphrase extraction; Acronym extraction) are accepted to COLING 2022.
  • [Aug-22] Our patent (language model) has issued.
  • [Aug-22] I gave a talk at SNU GoGE Workshop 2022: Semantic Textual Understanding for Information Retrieval
  • [Apr-22] Two papers (image captioning; multimodal intent discovery) are accepted to NAACL 2022 Findings.
  • [Apr-22] Our paper (fake news detection) is accepted to ACL CONSTRAINT 2022.
  • [Dec-21] Our paper (Conversational Image Editing) is accepted to AAAI 2022.
  • [Dec-21] I gave a talk at Korea University: Mutimodal Evaluation Metric and Image Captioning Model
  • [Dec-21] Our patent (mutimodal speech understanding) has issued.
  • [Sep-21] Our patent (QA) has issued.
  • [Aug-21] Two papers (1 main-fewshot intent detection; 1 findings-metric for captioning) are accepted to EMNLP 2021.
  • [May-21] Two papers (unreferenced metric for captioning; medical QU) are accepted to ACL 2021.
  • [May-21] Our paper (QA+summarization) is accepted to NAACL BioNLP 2021.
  • [Mar-21] Our paper (metric for generative QA) is accepted to NAACL 2021.
  • [Jan-21] One paper (fakenews detection) is accepted for publication in IEEE Access 2021.
  • [Dec-20] Our paper (text GAN) is accepted for publication in IEEE Access 2020.
  • [Oct-20] I'm thrilled to join Adobe Research!!!
  • [Sep-20] I gave a talk at Dongguk Univ.: Recent Advancements in NLP for QA; LM; and Evaluation Metric
  • [Aug-20] I am awarded the Distinguished Dissertation Award; Dept. ECE; Seoul National University.
  • [Jul-20] Our paper (multimodal speech emotion) is accepted to INTERSPEECH 2020.
  • [Jul-20] I gave a talk at KAIST/IBS: Understanding Long Texts for Question Answering System Using DNN
  • [Jun-20] I defend my PhD!.
  • [May-20] One paper (signal compression) is accepted for publication in The Journal of Supercomputing 2020.
  • [Apr-20] Our paper (language representation) is accepted to ACL 2020.
  • [Feb-20] I am awarded the Google Conference and Travel Scholarships for the ICASSP-20 paper.
  • [Feb-20] One paper (QA) is accepted to LREC 2020.
  • [Jan-20] Our paper (adverse drug reaction) is accepted to PAKDD 2020 as oral presentation.
  • [Jan-20] One paper (multimodal speech emotion) is accepted to IEEE ICASSP 2020 as oral presentation.
  • [Dec-19] One patent (dialogue) is issued in Korea (10-2059015).
  • [Dec-19] Our paper (multimodal dialogue) is accepted to AAAI 2020 workshop on DSTC8.
  • [Nov-19] Our paper (fakenews detection) is accepted as a book chapter on FNDM; Springer 2020
  • [Aug-19] One paper (QA) is accepted to ACM CIKM 2019.
  • [Jul-19] I gave a talk at NVIDIA AI Conference: Research in Natural Language Processing
  • [Jun-19] Our paper is accepted to ACL 2019 workshop on BioNLP.
  • [May-19] I am awarded the Google Conference and Travel Scholarships for the ICASSP-19 paper.
  • [Feb-19] One paper (multimodal speech emotion) is accepted to IEEE ICASSP 2019 as oral presentation.
  • [Dec-18] One paper is (feature compression) accepted to IEEE BigComp 2019.
  • [Nov-18] One paper is accepted (incongruent news article) to AAAI 2019 as oral presentation.
  • [Sep-18] One paper (multimodal speech emotion) is accepted to IEEE SLT 2018.
  • [Oct-18] One paper (abusive language) is accepted to EMNLP 2018 workshop on ALW2.
  • [Dec-18] I gave a talk at Naver: QA-pair ranking algorithm and its applications
  • [Jul-18] I gave a talk at Paper Day 2018; PyTorch KR
  • [Jul-18] I gave a talk at Fast campus: Advancement of the Neural Dialogue Model
  • [Jun-18] One paper (QA) is accepted to NAACL 2018.
  • [Jan-18] One paper is accepted to IEEE BigComp 2018.

Academic Activities

  • Service:
    Area Chair: COLM 2026
    Area Chair (Industry): ACL 2026
    Area Chair (Industry): EMNLP 2025
    Program Committee Member / Reviewer: ACL, EMNLP, NeurIPS, ICML, ICLR, CVPR, AAAI, NAACL, EMNLP, AACL, EACL, COLING, LREC, ARR, WWW, INTERSPEECH
    Journal Reviewer: IEEE Signal Processing Letters, Information Processing and Management

  • Invited Talks:
    Capability of Vision and Language Model for "AI for Social Good, Seoul National University., Dec. 2024
    Vision and Language Representation with LLM for Multimodal Understanding, Chung-Ang University., Sep. 2024
    Robust Textual Representation for Text and Multimodal Understanding, Dongguk University., Mar. 2024
    Learning Text Representation for NLP Application, Seoul National Univ., Aug. 2023
    Pretrained Language Model and Semantic Textual Understanding, SKKU, Sep. 2022
    Semantic Textual Understanding for Information Retrieval, Seoul National Univ., Aug. 2022
    Mutimodal Evaluation Metric and Image Captioning Model, Korea Univ., Dec. 2021
    Recent Advancements in NLP for QA, LM, and Evaluation Metric, Dongguk Univ., Sep. 2020
    Understanding Long Texts for Question Answering System Using DNN, KAIST/IBS, Jul. 2020
    Question Answering System for Long Text, Adobe Research (San Jose, CA, US), Dec. 2019
    Question Answering System and Multimodal Speech Emotion Recognition, DEEPEST, Aug. 2019
    Research in Natural Language Processing, NVIDIA AI Conference, Jul. 2019
    Question Answering for Short Answer, Adobe Research (San Jose, CA, US), Dec. 2018
    QA-pair ranking algorithm and its applications, NAVER, Aug. 2018
    Learning to Rank Question-Answer Pairs, PyTorch KR, Jun. 2018
    Advancement of the Neural Dialogue Model, Fast campus, Jul. 2018

  • Teaching Assistant:
    Programming Methodology, Seoul National University, Spring 2018
    Machine Learning, Seoul National University, Fall 2015
    Lab. Sentiment Analysis, BigCamp (Big Data Academy), Big Data Institute, 2016-2019

Professional Experiences

  • NLP Research Scientist: Adobe Research (San Jose, CA, US), 2020-present
  • Staff Engineer: Samsung Research (Seoul, KR), 2006-2017
  • Representative of employees: Samsung Electronics (Seoul, KR), 2012-2014
  • Trainer of Global New Employee Course: Samsung Electronics (Seoul, KR), Spring 2011

Publications

    [2026]

  1. Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams [pdf]
    Jiyeon_Kim, Hyunji Lee, Dylan Zhou, Sue Hyun Park, Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Sungmin Cha, Minjoon Seo
    ACL 2026

  2. MARCH: Evaluating the Intersection of Ambiguity Interpretation and Multi-hop Inference [pdf]
    Jeonghyun_Park , Ingeol Baek, Seunghyun Yoon, Haeun Jang, Aparna Garimella, Akriti Jain, Nedim Lipka, Hwanhee Lee
    ACL 2026 findings

  3. FIFA: Unified Faithfulness Evaluation Framework for Text-to-Video and Video-to-Text Generation [pdf]
    Liqiang_Jing , Viet Dac Lai, Seunghyun Yoon, Trung Bui, Xinya Du
    ACL 2026 findings

  4. Vision Language Models Learn to Assess Images with Specialists [pdf]
    Quyet V. Do, Seunghyun Yoon, Ruiyi Zhang, Thiloshon Nagarajah, Trung Bui, Viet Dac Lai
    WACV 2026

  5. Instruction Tuning with and without Context: Behavioral Shifts and Downstream Impact [pdf]
    Hyunji Lee, Seunghyun Yoon, Yunjae Won, Hanseok Oh, Geewook Kim, Trung Bui, Franck Dernoncourt, Elias Stengel-Eskin, Mohit Bansal, Minjoon Seo
    EACL 2026

  6. A Survey on LLM-based Conversational User Simulation [pdf]
    Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K. Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa Siu, Zichao Wang, Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A. Rossi
    EACL 2026

  7. VILLAIN at AVerImaTeC: Verifying Image–Text Claims via Multi-Agent Collaboration [pdf]
    (1st place at the main challenge)
    Jaeyoon_Jung , Yejun Yoon, Seunghyun Yoon, Kunwoo Park
    EACL 2026 Workshop FEVER

    8. [2025]

  8. Program Synthesis via Test-Time Transduction [pdf]
    Kang-il_Lee , Jahyun Koo, Seunghyun Yoon, Minbeom Kim, Hyukhun Koh, Dongryeol Lee, Kyomin Jung
    NeurIPS 2025

  9. Offline RL by Reward-Weighted Fine-Tuning for Conversation Optimization [pdf]
    Subhojyoti Mukherjee, Viet Dac Lai, Raghavendra Addanki, Ryan A. Rossi, Seunghyun Yoon, Trung Bui, Anup Rao, Jayakumar Subramanian, Branislav Kveton
    NeurIPS 2025

  10. FaithUn: Toward Faithful Forgetting in Language Models by Investigating the Interconnectedness of Knowledge [pdf]
    Nakyeong Yang, Minsung Kim, Seunghyun Yoon, Joongbo Shin, Kyomin Jung
    EMNLP 2025

  11. DynaSaur: Large Language Agents Beyond Predefined Actions [pdf]
    Dang Nguyen, Viet Dac Lai, Seunghyun Yoon, Ryan A. Rossi, Handong Zhao, Ruiyi Zhang, Puneet Mathur, Nedim Lipka, Yu Wang, Trung Bui, Franck Dernoncourt, Tianyi Zhou
    COLM 2025

  12. A Survey on Long-Video Storytelling Generation: Architectures, Consistency, and Cinematic Quality [pdf]
    Mohamed Elmoghany, Ryan Rossi, Seunghyun Yoon, Subhojyoti Mukherjee, Eslam Bakr, Puneet Mathur, Gang Wu, Viet Dac Lai, Nedim Lipka, Ruiyi Zhang, Varun Manjunatha, Chien Nguyen, Daksh Dangi, Abel Salinas, Mohammad Taesiri, Hongjie Chen, Xiaolei Huang, Joe Barrow, Nesreen Ahmed, Hoda Eldardiry, Namyong Park, Yu Wang, Jaemin Cho, Anh Totti Nguyen, Zhengzhong Tu, Thien Nguyen, Dinesh Manocha, Mohamed Elhoseiny, Franck Dernoncourt
    ICCV 2025 Workshop LongVid-Foundations

  13. HerO 2 for Efficient Fact Verification [pdf]
    (2nd place at the main challenge)
    Yejun Yoon, Jaeyoon Jung, Seunghyun Yoon, Kunwoo Park
    ACL 2025 Workshop FEVER

  14. SlimLM: An Efficient Small Language Model for On-Device Document Assistance [pdf]
    Thang_M._Pham, Phat T. Nguyen, Seunghyun Yoon, Viet Dac Lai, Franck Dernoncourt, Trung Bui
    ACL 2025 System Demonstrations

  15. From Selection to Generation: A Survey of LLM-based Active Learning [pdf]
    Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie, Junda Wu, Xintong Li, Ryan Aponte, Hanjia Lyu, Joe Barrow, Hongjie Chen, Franck Dernoncourt, Branislav Kveton, Tong Yu, Ruiyi Zhang, Jiuxiang Gu, Nesreen K. Ahmed, Yu Wang, Xiang Chen, Hanieh Deilamsalehy, Sungchul Kim, Zhengmian Hu, Yue Zhao, Nedim Lipka, Seunghyun Yoon, Ting-Hao Kenneth Huang, Zichao Wang, Puneet Mathur, Soumyabrata Pal, Koyel Mukherjee, Zhehao Zhang, Namyong Park, Thien Huu Nguyen, Jiebo Luo, Ryan A. Rossi, Julian McAuley
    ACL 2025

  16. Hypothetical Documents or Knowledge Leakage? Rethinking LLM-based Query Expansion [pdf]
    Yejun Yoon, Jaeyoon Jung, Seunghyun Yoon, Kunwoo Park
    ACL 2025 Findings

  17. GUI Agents: A Survey [pdf]
    Dang Nguyen, Jian Chen, Yu Wang, Gang Wu, Namyong Park, Zhengmian Hu, Hanjia Lyu, Junda Wu, Ryan Aponte, Yu Xia, Xintong Li, Jing Shi, Hongjie Chen, Viet Dac Lai, Zhouhang Xie, Sungchul Kim, Ruiyi Zhang, Tong Yu, Mehrab Tanjim, Nesreen K. Ahmed, Puneet Mathur, Seunghyun Yoon, Lina Yao, Branislav Kveton, Jihyung Kil, Thien Huu Nguyen, Trung Bui, Tianyi Zhou, Ryan A. Rossi, Franck Dernoncourt
    ACL 2025 Findings

  18. Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coverage [pdf] [code] [data]
    Saehyung Lee, Seunghyun Yoon, Trung Bui, Jing Shi, Sungroh Yoon
    ICML 2025

  19. NoLiMa: Long-Context Evaluation Beyond Literal Matching [pdf] [code]
    Ali Modarressi, Hanieh Deilamsalehy, Franck Dernoncourt, Trung Bui, Ryan A. Rossi, Seunghyun Yoon, Hinrich Schuetze
    ICML 2025

  20. Generating Diverse Hypotheses for Inductive Reasoning [pdf]
    (oral presentation)
    Kang-il Lee, Hyukhun Koh, Dongryeol Lee, Seunghyun Yoon, Minsung Kim, Kyomin Jung
    NAACL 2025

  21. CORG: Generating Answers from Complex, Interrelated Contexts [pdf] [code]
    Hyunji Lee, Franck Dernoncourt, Trung Bui, Seunghyun Yoon
    NAACL 2025

  22. VLind-Bench: Measuring Language Priors in Large Vision-Language Models [pdf] [code] [data]
    Kang-il Lee, Minbeom Kim, Seunghyun Yoon, Minsung Kim, Dongryeol Lee, Hyukhun Koh, Kyomin Jung
    NAACL 2025 Findings

  23. Text2Relight: Creative Portrait Relighting with Text Guidance [pdf]
    Junuk Cha, Mengwei Ren, Krishna Kumar Singh, He Zhang, Yannick Hold-Geoffroy, Seunghyun Yoon, HyunJoon Jung, Jae Shin Yoon, Seungryul Baek
    AAAI 2025

  24. Domain-specific Question Answering with Hybrid Search [pdf]
    Dewang Sultania, Zhaoyu Lu, Twisha Naik, Franck Dernoncourt, Seunghyun Yoon, Sanat Sharma, Trung Bui, Ashok Gupta, Tushar Vatsa, Suhas Suresha, Ishita Verma, Vibha Belavadi, Cheng Chen, Michael Friedrich
    AAAI 2025 Workshop Document Understanding and Intelligence

    25. [2024]

  25. HerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World Claims [pdf] [code]
    (2nd place / 1st place among open source)
    Yejun Yoon, Jaeyoon Jung, Seunghyun Yoon, Kunwoo Park
    EMNLP 2024 Workshop FEVER

  26. PDFTriage: Question Answering over Long, Structured Documents [pdf]
    Jon Saad-Falcon, Joe Barrow, Alexa Siu, Ani Nenkova, Seunghyun Yoon, Ryan A. Rossi, Franck Dernoncourt
    EMNLP 2024 Industry

  27. FIZZ: Factual Inconsistency Detection by Zoom-in Summary and Zoom-out Document [pdf]
    Joonho Yang, Seunghyun Yoon, Byeongjeong Kim, Hwanhee Lee
    EMNLP 2024

  28. Towards Enhancing Coherence in Extractive Summarization: Dataset and Experiments with LLMs [pdf]
    Mihir Parmar, Hanieh Deilamsalehy, Franck Dernoncourt, Seunghyun Yoon, Ryan A. Rossi, Trung Bui
    EMNLP 2024

  29. A New Framework for Evaluating Faithfulness of Video Moment Retrieval against Multiple Distractors [pdf] [code]
    Nakyeong Yang, Minsung Kim, Seunghyun Yoon, Joongbo Shin, Kyomin Jung
    CIKM 2024

  30. Identifying Speakers in Dialogue Transcripts: A Text-based Approach Using Pretrained Language Models [pdf]
    Van Minh Nguyen, Franck Dernoncourt, Seunghyun Yoon, Hanieh Deilamsalehy, Hao Tan, Ryan Rossi, Quan Hung Tran, Trung Bui, Thien Nguyen
    INTERSPEECH 2024

  31. Assessing News Thumbnail Representativeness: Counterfactual text can enhance the cross-modal matching ability [pdf] [code]
    Yejun Yoon, Seunghyun Yoon, Kunwoo Park
    ACL 2024 Findings

  32. Multi-hop Database Reasoning with Virtual Knowledge Graph [pdf]
    Juhee Son, Yeon Seonwoo, Alice Oh, James Thorne, Seunghyun Yoon
    ACL 2024 Workshop KaLLM

  33. KaPQA: Knowledge-Augmented Product Question-Answering [pdf]
    Swetha Eppalapally, Daksh Dangi, Chaithra Bhat, Ankita Gupta, Ruiyi Zhang, Karishma Bagga, Seunghyun Yoon, Nedim Lipka, Ryan A. Rossi, Franck Dernoncourt
    ACL 2024 Workshop KnowledgeNLP

  34. Multilingual Sentence-Level Semantic Search using Meta-Distillation Learning [pdf]
    Meryem M'hamdi, Jonathan May, Franck Dernoncourt, Trung Bui, Seunghyun Yoon
    SIGIR 2024

  35. PEEB: Part-based Bird Classifiers with an Explainable and Editable Language Bottleneck [pdf]
    Thang M. Pham, Peijie Chen, Tin Nguyen, Seunghyun Yoon, Trung Bui, Anh Nguyen
    NAACL 2024 Findings

  36. Scaling Up Video Summarization Pretraining with Large Language Models [pdf]
    Dawit Mureja Argaw, Seunghyun Yoon, Fabian Caba Heilbron, Hanieh Deilamsalehy, Trung Bui, Zhaowen Wang, Franck Dernoncourt, Joon Son Chung
    CVPR 2024

  37. Fine-tuning CLIP Text Encoders with Two-step Paraphrasing [pdf]
    Hyunjae Kim, Seunghyun Yoon, Trung Bui, Handong Zhao, Quan Tran, Franck Dernoncourt, Jaewoo Kang
    EACL 2024 Findings

  38. Retrieval Augmented Generation for Domain-specific Question [pdf]
    Sanat Sharma, Seunghyun Yoon, Franck Dernoncourt, Dewang Sultania, Karishma Bagga, Mengjiao Zhang, Trung Bui, Varun Kotte
    AAAI 2024 Workshop SDU

  39. Multi-Modal Video Topic Segmentation with Dual-Contrastive Domain Adaptation [pdf]
    Linzi Xing, Quan Tran, Fabian Caba Heilbron, Franck Dernoncourt, Seunghyun Yoon, Zhaowen Wang, Trung Bui, Giuseppe Carenini
    Multimedia Modelling 2024

    40. [2023]

  40. Aspect-based Meeting Transcript Summarization: A Two-Stage Approach with Weak Supervision on Sentence Classification [pdf]
    Zhongfen Deng, Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Quan Tran, Shuaiqi Liu, Wenting Zhao, Tao Zhang, Yibo Wang, Philip Yu
    IEEE BigData 2023

  41. Perturbation Robust Metric for Multi-Lingual Image Captioning [pdf]
    Yongil Kim, Yerin Hwang, Hyeongu Yun, Seunghyun Yoon, Trung Bui, Kyomin Jung
    EMNLP 2023 Findings

  42. Moment Detection in Long Tutorial Videos [pdf] [code]
    Ioana Croitoru, Simion-Vlad Bogolin, Samuel Albanie, Yang Liu, Zhaowen Wang, Seunghyun Yoon, Franck Dernoncourt, Hailin Jin, Trung Bui
    ICCV 2023

  43. Boosting Punctuation Restoration with Data Generation and Reinforcement Learning [pdf]
    Viet Lai, Abel Salinas, Hao Tan, Trung Bui, Quan Tran, Seunghyun Yoon, Hanieh Deilamsalehy, Franck Dernoncourt, Thien Nguyen
    INTERSPEECH 2023

  44. Automatic Creation of Named Entity Recognition Datasets by Querying Phrase Representations [pdf]
    Hhynjae Kim, Jaehyo Yoo, Seunghyun Yoon, Jaewoo Kang
    ACL 2023

  45. MEETINGQA: Extractive Question-Answering on Meeting Transcripts [pdf]
    Archiki Prasad, Trung Bui, Seunghyun Yoon, Hanieh Deilamsalehy, Franck Dernoncourt, Mohit Bansal
    ACL 2023

  46. PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search [pdf] [page]
    Thang M. Pham, Seunghyun Yoon, Trung Bu, Anh Nguyeng
    EACL 2023

    47. [2022]

  47. Factual Error Correction for Abstractive Summaries Using Entity Retrieval [pdf]
    Hwanhee Lee, Cheoneum Park, Seunghyun Yoon, Trung Bu, Franck Dernoncourt, Juae Kim, Kyomin Jung
    EMNLP 2022 Workshop GEM

  48. Improving cross-modal attention via object detection [pdf]
    Yongil Kim, Yerin Hwang, Seunghyun Yoon, Hyeongu Yun, Kyomin Jung
    NeurIPS 2022 Workshop All Things Attention

  49. Simple Questions Generate Named Entity Recognition Datasets [pdf] [code]
    Hyunjae Kim, Jaehyo Yoo, Seunghyun Yoon, Jinhyuk Lee, Jaewoo Kang
    EMNLP 2022

  50. Virtual Knowledge Graph Construction for Zero-Shot Domain-Specific Document Retrieval [pdf]
    Yeon Seonwoo, Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Alice Oh
    COLING 2022

  51. Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision [pdf]
    Khalil Mrini, Harpreet Singh, Franck Dernoncourt, Seunghyun Yoon, Trung Bui, Walter W. Chang, Emilia Farcas, Ndapa Nakashole
    COLING 2022

  52. Offensive Content Detection Via Synthetic Code-Switched Text [pdf]
    Cesa Salaam, Franck Dernoncourt, Trung Bui, Seunghyun Yoon
    COLING 2022

  53. Keyphrase Prediction from Video Transcripts: New Dataset and Directions [pdf]
    Amir Pouran Ben Veyseh, Quan Tran, Seunghyun Yoon, Varun Manjunatha, Hanieh Deilamsalehy, Rajiv Jain, Trung Bui, Walter W. Chang, Franck Dernoncourt, Thien Huu Nguyen
    COLING 2022

  54. MACRONYM: A Large-Scale Dataset for Multilingual and Multi-Domain Acronym Extraction [pdf]
    Amir Pouran Ben Veyseh, Nicole Meister, Seunghyun Yoon, Rajiv Jain, Franck Dernoncourt, Thien Huu Nguyen
    COLING 2022

  55. Fine-grained Image Captioning with CLIP Reward [pdf] [code] [demo]
    Jaemin Cho, Seunghyun Yoon, Ajinkya Kale, Franck Dernoncourt, Trung Bui, M Bansal
    NAACL 2022 Findings

  56. Multimodal Intent Discovery from Livestream Videos [pdf] [code]
    Adyasha Maharana, Quan Tran, Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Walter Chang, M Bansal
    NAACL Findings 2022

  57. How does fake news use a thumbnail? CLIP-based Multimodal Detection on the Unrepresentative News Image [pdf] [code]
    Hyewon Choi, Yejun Yoon, Seunghyun Yoon, Kunwoo Park
    ACL CONSTRAINT 2022

  58. CAISE: Conversational Agent for Image Search and Editing [pdf] [code]
    Hyounghun Kim, Doo Soon Kim, Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Mohit Bansal
    AAAI 2022

    59. [2021]

  59. Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning [pdf]
    J Zhang, T Bui, S Yoon, X Chen, Z Liu, C Xia, QH Tran, W Chang, P Yue
    EMNLP 2021

  60. QACE: Asking Questions to Evaluate an Image Caption [pdf] [code]
    H Lee, T Scialom, S Yoon, F Dernoncourt, K Jung
    EMNLP 2021 Findings

  61. A Gradually Soft Multi-Task and Data-Augmented Approach to Medical Question Understanding [pdf]
    K Mrini, F Dernoncourt, S Yoon, T Bui, W Chang, E Farcas, N Nakashole
    ACL 2021

  62. UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning [pdf] [code]
    H Lee, S Yoon, F Dernoncourt, T Bui, K Jung
    ACL 2021

  63. UCSD-Adobe at MEDIQA 2021: Transfer Learning and Answer Sentence Selection for Medical Summarization [pdf]
    K Mrini, F Dernoncourt, S Yoon, T Bui, W Chang, E Farcas, N Nakashole
    NAACL 2021 Workshop BioNLP

  64. KPQA: A Metric for Generative Question Answering Using Keyphrase Weights [pdf] [code]
    H Lee, S Yoon, F Dernoncourt, DS Kim, T Bui, J Shin, K Jung
    NAACL 2021

  65. Learning to Detect Incongruence in News Headline and Body Text via a Graph Neural Network [pdf] [code]
    (SCI, IF=3.745)
    S Yoon*, K Park*, M Lee, T Kim, M Cha, K Jung
    IEEE Access 2021

    66. [2020]

  66. Collaborative Training of GANs in Continuous and Discrete Spaces for Text Generation [pdf]
    (SCI, IF=3.745)
    Y Kim, S Won, S Yoon, K Jung
    IEEE Access 2020

  67. ViLBERTScore: Evaluating Image Caption Using Vision-and-Language BERT [pdf] [code]
    H Lee, S Yoon, F Dernoncourt, DS Kim, T Bui, K Jung
    EMNLP 2020 Workshop Eval4NLP

  68. Multimodal Speech Emotion Recognition using Cross Attention with Aligned Audio and Text [pdf]
    Y Lee, S Yoon, K Jung
    INTERSPEECH 2020

  69. Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning [pdf]
    J Shin, Y Lee, S Yoon, K Jung
    ACL 2020

  70. Propagate-Selector: Detecting Supporting Sentences for Question Answering via Graph Neural Networks [pdf] [code]
    S Yoon, F Dernoncourt, DS Kim, T Bui, K Jung
    LREC 2020

  71. Drug-disease Graph: Predicting Adverse Drug Reaction Signals via Graph Neural Network with Clinical Data [pdf] [slide]
    (oral presentation)
    H Kwak, M Lee, S Yoon, J Chang, S Park, K Jung
    PAKDD 2020

  72. DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator [pdf]
    H Lee, S Yoon, F Dernoncourt, DS Kim, T Bui, K Jung
    AAAI 2020 Workshop DSTC8

  73. Comparative Studies on Machine Learning for Paralinguistic Signal Compression and Classification [pdf]
    (SCI, IF=2.157)
    S Byun*, S Yoon*, K Jung
    Journal of Supercomputing 2020

  74. Attentive Modality Hopping Mechanism for Speech Emotion Recognition [pdf] [code] [slide]
    (oral presentation)
    S Yoon, S Dey, H Lee, K Jung
    IEEE ICASSP 2020

  75. BaitWatcher: A lightweight web interface for the detection of incongruent news headlines [pdf] [book]
    K Park, T Kim, S Yoon, M Cha, K Jung
    Disinformation, Misinformation, and Fake News in Social Media-Emerging Research Challenges and Opportunities, Springer 2020

    76. [2019]

  76. A Compare-Aggregate Model with Latent Clustering for Answer Selection [pdf] [slide] [poster]
    (oral presentation)
    S Yoon, F Dernoncourt, DS Kim, T Bui, K Jung
    CIKM 2019

  77. Surf at MEDIQA 2019: Improving Performance of Natural Language Inference in the Clinical Domain by Adopting Pre-trained Language Model [pdf]
    J Nam, S Yoon, K Jung
    ACL 2019 Workshop BioNLP

  78. Speech Emotion Recognition Using Multi-hop Attention Mechanism [pdf] [slide]
    (oral presentation)
    S Yoon, S Byun, S Dey, K Jung
    IEEE ICASSP 2019

  79. Neural Networks for Compressing and Classifying Speaker-Independent Paralinguistic Signals [pdf]
    S Byun, S Yoon, K Jung
    IEEE BigComp 2019

  80. Detecting Incongruity Between News Headline and Body Text via a Deep Hierarchical Encoder [pdf] [code]
    (oral presentation)
    S Yoon*, K Park*, J Shin, H Lim, S Won, M Cha, K Jung
    AAAI 2019

    81. [2018 and earlier]

  81. Multimodal Speech Emotion Recognition using Audio and Text [pdf] [code]
    S Yoon, S Byun, K Jung
    IEEE SLT 2018

  82. Comparative Studies of Detecting Abusive Language on Twitter [pdf] [code]
    Y Lee*, S Yoon*, K Jung
    EMNLP ALW 2018

  83. Learning to Rank Question-Answer Pairs using Hierarchical Recurrent Encoder with Latent Topic Clustering [pdf] [code]
    S Yoon, J Shin, K Jung
    NAACL 2018

  84. Contextual-CNN: A Novel Architecture Capturing Unified Meaning for Sentence Classification [pdf]
    J Shin, Y Kim, S Yoon, K Jung
    IEEE BigComp 2018

  85. Synonym Discovery with Etymology-based Word Embeddings [pdf]
    S Yoon, P Estrada, K Jung
    IEEE SSCI 2017

  86. Efficient Transfer Learning Schemes for Personalized Language Modeling using Recurrent Neural Network [pdf]
    S Yoon, H Yun, Y Kim, G Park, K Jung
    AAAI 2017 (Workshop)

  87. Automatic Question Answering System for Consumer Product [pdf]
    S Yoon, M Sundar, A Gupta, K Jung
    IntelliSys 2016

  88. Mining the Minds of Customers from Online Chat Logs [pdf]
    K Park, J Kim, J Park, M Cha, J Nam, S Yoon, E Rhim
    CIKM 2015

  89. Domain Question Answering System [pdf]
    S Yoon, E Rhim, D Kim
    KIISE Transactions on Computing Practices 2015

  90. Media clips: Implementation of an intuitive media linker [pdf]
    S Yoon, K Lee, H Shin
    IEEE BMSB 2011

Patents

[ International Patents]
  1. ISSUEDSystems and methods for video summarization [link]
    Dawit Mureja Argaw, Seunghyun Yoon, Fabian David Caba Heilbron, Hanieh Deilamsalehy, Trung Huu Bui, Zhaowen Wang, Franck Dernoncourt
    US 12,563,278, 24-Feb-26

  2. ISSUEDMultilingual semantic search utilizing meta-distillation learning [link]
    Meryem M'hamdi, Seunghyun Yoon, Franck Dernoncourt, Trung Bui
    US 12,547,901, 10-Feb-26

  3. ISSUEDVirtual knowledge graph construction for zero-shot domain-specific document retrieval [link]
    Yeon Seonwoo, Seunghyun Yoon, Trung Huu Bui, Franck Dernoncourt, Roger K. Brooks, Mihir Naware
    US 12,332,939, 17-Jun-25

  4. ISSUEDSYSTEMS AND METHODS FOR IMAGE PROCESSING USING NATURAL LANGUAGE [link]
    H Kim, DS Kim, S Yoon, F Dernoncourt, T Bui
    US 12,293,577, 6-May-25

  5. ISSUEDGENERATING SYNTHETIC CODE-SWITCHED DATA FOR TRAINING LANGUAGE MODELS [link]
    S Yoon, T Bui, F Dernoncourt, C Salaam
    US 12,242,820, 4-Mar-25

  6. ISSUEDBI-DIRECTIONAL RECURRENT ENCODERS WITH MULTI-HOP ATTENTION FOR SPEECH EMOTION RECOGNITION [link]
    S Yoon, T Bui, S Dey
    US 12,236,975, 25-Feb-25

  7. ISSUEDIMAGE CAPTIONING [link]
    J Cho, S Yoon, A Kale, F Dernoncourt, T Bui
    US 12,210,825, 28-Jan-25

  8. ISSUEDINTENT DETECTION [link]
    X Chen, W Chang, T Bui, S Yoon, Q Tran, J Zhang
    US 12,182,524, 31-Dec-24

  9. ISSUEDMultimodal intent discovery system [link]
    A Maharana, Q Hung Tran, S Yoon, F Dernoncourt, T Huu Bui, W Chang
    US 12,124,508, 22-Oct-24

  10. ISSUEDUsing neural networks to detect incongruence between headlines and body text of documents [link]
    S Yoon
    US 12,038,960, 16-Jul-24

  11. ISSUEDUtilizing a graph neural network to identify supporting text phrases and generate digital query responses [link]
    S Yoon, F Dernoncourt, DS Kim, T Bui
    US 11,271,876, 8-Mar-22

  12. ISSUEDUtilizing bi-directional recurrent encoders with multi-hop attention for speech emotion recognition [link]
    T Bui, S Dey, S Yoon
    US 11,205,444, 21-Dec-21

  13. ISSUEDAnswer selection using a compare-aggregate model with language model and condensed similarity information from latent clustering [link]
    S Yoon, F Dernoncourt, T Bui, DS Kim, CI Dockhorn, Y Gong
    US 11,113,323, 7-Sep-21

  14. ISSUEDTerminal apparatus, server and method of controlling the same [link]
    Y Kim, O Kwon, S Kim, H Oh, S Yoon, S Cha, J Lee
    US 10,084,850, CN 201410085759, EP20140154718, 25-Sep-18

  15. Method and device for analyzing user's emotion [link]
    E Rhim, J Kim, J Nam, S Yoon, K Park, J Park, M Cha
    WO2016182393, 13-May-16

  16. ISSUEDMethod of recommending application, mobile terminal using the method, and communication system using the method [link]
    J Nam, M Lee, M Koo, S Yoon
    US 9,247,376, 26-Jan-16

  17. ISSUEDMethod and apparatus for displaying photo on screen having any shape [link]
    S Yoon, M Lee
    US 9,049,383, 2-Jun-15

  18. ISSUEDMethod and apparatus for providing information and computer readable storage medium having a program recorded thereon for executing the method [link]
    S Yoon, M Lee, M Koo, J Nam
    US 8,958,824, 17-Feb-15

  19. ISSUEDApparatus and method for clipping and sharing content at a portable terminal [link]
    S Yoon, M Lee, M Koo, J Nam
    US 13/629,394, CN103827913A, EP20120837007, PCT/KR1020110097578, 28-May-14

  20. ISSUEDMethod and apparatus for fast tracking position by using global positioning system [link]
    S Yoon, S Kim
    US 8,094,070, 10-Jan-12

[Korean Patents]
  1. ISSUEDApparatus and method for evaluating sentense by using bidirectional language model
    K Jung, J Shin, S Yoon
    KR 10-2436900, 23-Aug-22

  2. ISSUEDMethod and apparatus for emotion recognition based on cross attentionmodel
    K Jung, Y Lee, S Yoon
    KR 10-2365433, 16-Feb-22

  3. ISSUEDArtificial intelligence based dialog system and response control method thereof
    K Jung, S Yoon, J Shin, H Kwak, S Byun
    KR 10-2059015, 18-Dec-19

  4. ISSUEDTerminal apparatus, server and method of controlling the same
    Y Kim, O Kwon, S Kim, H Oh, S Yoon, S Cha, J Lee
    KR 10-1832394, 20-Feb-18

  5. ISSUEDApparatus and method for collecting information of destination in portable terminal
    S Yoon, J Nam, M Koo, M Lee
    KR 10-1914632, 29-Oct-18

  6. ISSUEDMethod and apparatus for providing information, and computer readable storage medium
    S Yoon, M Lee, M Koo, J Nam
    KR 10-1773167, 24-Aug-17

  7. ISSUEDMethod for recommendation of application, mobile terminal thereof and communication system thereof
    J Nam, M Lee, M Koo, S Yoon
    KR 10-1747303, 8-Jun-17

  8. Device and method for analyzing user emotion
    E Rhim, J Kim, J Nam, S Yoon, K Park, J Park, M Cha
    KR 1020160058782, 13-May-16

  9. ISSUEDMethod and apparatus for fast positioning using global positioning system
    S Yoon, S Kim
    KR 10-1564938, 27-Oct-15