Jeiyoon Park

I'm a master's student in the Department of Computer Science and Engineering at Korea University, advised by the professor Heuiseok Lim.

My research interests are Large language model (LLM), Multimodal deep learning and Reinforcement learning.

Contact: k4ke@korea.ac.kr

Github  /  Google Scholar  /  LinkedIn  /  YouTube  /  Instagram  / 

profile photo
News

[Mar 2024] I will serve as a program committee member at BEA-NAACL 2024.
[June 2022] I came in first place at 2022 Microsoft Azure Virtual Hackathon.
[Mar 2021] I interned as a NLP researcher at Naver Webtoon (Webtoon AI), where I had a wonderful time working with Chaeheon Gwak and Seho Kim, and being mentored by Daesik Kim also.

Research
Preprint (Being under the review)
Jeiyoon Park, Chanjun Park, Heuiseok Lim
Preprint, 2024
[arXiv] [github]





Preprint (Being under the review)
Jeiyoon Park, Chanjun Park, Heuiseok Lim
Preprint, 2024
[arXiv] [github]





Multimodal Frame-Scoring Transformer for Video Summarization
Jeiyoon Park, Kiho Kwoun, Chanhee Lee, Heuiseok Lim
Preprint, 2023
[arXiv]




Analysis of Utterance Embeddings and Clustering Methods Related to Intent Induction for Task-Oriented Dialogue
Jeiyoon Park, Yoonna Jang, Chanhee Lee, Heuiseok Lim
The Eleventh Dialog System Technology Challenge (DSTC11), SIGdial-INLG 2023
[arXiv] [bibtex] [github] [poster]




Variational Reward Estimator Bottleneck: Learning Robust Reward Estimator for Multi-Domain Task-Oriented Dialog
Jeiyoon Park, Chanhee Lee, Chanjun Park, Kuekyeng Kim, Heuiseok Lim
Applied Sciences (SCI), 2021
[journal] [bibtex]





Award
2022 Azure Virtual Hackathon
Yeram Lim, Moongi Lee, Juhui Heo, Jeiyoon Park
Microsoft
First Place, 2022.06.10
[slide] [github] [video1] [video2]

Azure Virtual Hackathon aims to solve various social problems we face, such as climate change and AI for accessibility, by using Azure, Microsoft's AI solution. This work introduces "Hi Azure!: Helping video creators who are visually-impaired edit videos using Azure Cloud AI!", a framework for increasing accessibility to video editing and content creation for visually impaired creators by extracting visual features from video, converting them to voice, and providing them as frame-level descriptions. We came in first place at this Hackathon and additionally I got first place at Microsoft Cloud Skills Challenge (1/63 = 1.58%).

The 3rd AI SPARK Challenge
Kiho Kwoun, Moongi Lee, Juhui Heo, Jeiyoon Park
Innopolis Foundation
Second Place (2/61 = 3.27%), 2022.04.15
[slide] [github] [press]

We postulate that the frames where emotional information appears frequently in a video are correlated with highlights. So our model first extract visual features and audio features from a video simultaneously. And then we employ attention mechanism with these features. Finally our model predicts importance scores from the Emotion-attended features and generates highlights based on the scores.

2020 ETRI Autonomous Growth Artificial Intelligence Contest
Jeiyoon Park, Yewon Park, Jaehoon Cho, Heuiseok Lim
Electronics and Telecommunications Research Institute (ETRI)
Runner-Up Award (14/43 = 32.55%), 2020.10.20
[video] [slide]

In this project, we propose a novel meta-reinforced multi-domain task-oriented dialog agent, which exploits autonomous-growing knowledge base and extends the existing single-domain agent algorithm to multi-domain. Our method is expected to handle not only inferring about information that is not shown in the training process or the relations between domain, slot, and value triples, but also responding to domains other than the existing learning domain.

2019 Korean Information Processing System Competition
Jeiyoon Park, Jihwan Kim, Boemjoo Park, Heuiseok Lim
Korean Institute of Information Scientists and Engineers
Encouragement Award, 2019.10
[url]

The 31st Korean and Korean Information Processing Conference (HCLT 2019) was held at Daejeon Korea Institute of Science and Technology (KAIST). We were awarded the Encouragement Award at the 2019 Korean Information Processing System Competition.

ITRC Global Makerthon 2019
Jeiyoon Park, Jihwan Kim, Boemjoo Park, Woowon Jhang, Heuiseok Lim
Ministry of Science and ICT, Hyundai (Sponsor)
Second Place (2/34 = 5.88%), 2019.08
[video] [vlog] [news] [news2] [press]

The ITRC Global Makerton 2019 was held at Hanyang University. Our team proposed a simple noise canceling software for target noises (e.g. noise from cafe or factory etc.) and won second place.

The 3rd DongBu Global Electronics Competition 2016
Jeiyoon Park, Jeongse Park
DB Foundation
Runner-Up Award (90/1200 = 7.5%), 2016.11
[slide]

We proposed a simple closet that help people to keep their clothes clean and efficient. Also, we invented a novel hanger sensor and actuator for this project. I collaborated with the designer "Jeongse" and we were awarded the runner-up prize.

The 6th K-ICT Creative Idea Contest
Jeiyoon Park, Minji Kim, Yeonkyung Kim, Kihwan Shin
Ministry of Science, ICT and Future Planning
Encouragement Award (19/473 = 4.01%), 2016.10
[pdf] [news]

We proposed "smart hospital scenario using future robot technology". I collaborated with the nurse "Minji", designer "Yeonkyung", and computer scientist "Kihwan" for this project. We won the Encouragement award.

International Robot Contest & R-BIZ Challenge 2016: Self-Driving Car Mission
Jeiyoon Park, Seunghee Woo
Ministry of Trade, Industry and Energy
Bronze Medal, 2016.10
[map]

This challenge consists of four missions: (1) Pattern recognition for the trafic sign. (2) Autonomous parking. (3) Stop drving in front of a pedestrian crossing. (4) Any missions that you want to perform. We won the bronze medal in this challenge.

Texas Instruments Innovation Challenge Korea Final : MCU Design Contest 2015
Joonwoo Ahn, Hoosang Lee, YoonJoo Choi, Jeiyoon Park
Texas Instrument Korea
Second Place (2/70 = 2.85%), 2015.11
[slide]

We proposed a novel racing simulator which is fun and safe to enjoy at a much lower price than previous racing simulators. To this end, we invented new elastic actuator. We won second place.

Granted Patent
Noise Canceling Device for Companion Animal and Method Using Same
Korea Intellectual Property Office
2023.06.01 - 2040.07.27
Patent number: 10-2540549




Teaching
Building Real-Time Video AI Applications
NVIDIA, Hyundai, and Global Acceleration Program for Startups (GAPS)
2023.09, Instructor
2022.08, Instructor
2022.07, Teaching Assistant
[pdf] [url]



Year-Dream School (2nd Generation)
Fast Campus
2022.09 - 2022.10, Mentor
[slide1] [slide2] [review]





SEOULTECH - KSCE AI For Science GPU Bootcamp
NVIDIA, OpenACC, SEOULTECH and Korean Society for Computational Science and Engineering
2021.12, Mentor (with Hyungon Ryu at NVIDIA)
[pdf] [slide] [github]




NVIDIA DLI Workshop: Fundamentals of Deep Learning
NVIDIA Deep Learning Institute, and TAVE
2021.12, Instructor
[pdf] [slide1] [slide2] [slide3] [slide4] [slide5] [slide6]




Building Transformer-Based Natural Language Processing Applications - DLIW1390
NVIDIA GPU TECHNOLOGY CONFERENCE 2021 (GTC21)
2021.11, Teaching Assistant
[pdf]





Introduction to Reinforcement Learning
Korea IT Business Promotion Association
2020.08, Instructor
[slide1] [slide2]

Introduction to Reinforcement Learning and Natural Language Processing
Korea IT Business Promotion Association
2020.08, Instructor
[slide]

Deep Q-Networks (DQN)
SKC
2019.10, Instructor
[slide]


Student Activity
NVIDIA DLI Certificated Instructor Program
NVIDIA Deep Learning Institute
[pdf] [url] (University Ambassador Certificate)
[pdf] (Building Transformer-Based NLP Applications, Spring 2022 - Winter 2022)
[pdf] (Fundamentals of Deep Learning, Summer 2021 - Winter 2021)



Samsung Junior Software Cup
Mentor
A chatbot to close the Digital Divide for the elderly
Summer 2021 - Fall 2021
[pdf] [github] [video]
[slide] (Finals, 2021.10.16)
[slide] (Semifinals, 30/60 = 50%, 2021.09.11)
[slide] (Preliminaries, 60/170 = 35.29%, 2021.08.09)

4th Industrial Revolution Research Club
TAVE, leader of the team "Reinforcement Learning"
Summer 2020 - Winter 2020
[pdf] (Outstanding member award, 5/69 = 7.24%, 2020.11)
[pdf] (First place, 1/8 = 12.5%, 2020.11)
[pdf] (Outstanding member award, 3/69 = 4.34%, 2020.09)
[pdf] (Second place, 2/20 = 10%, 2020.09)

Teaching Assistant Scholarships
Korea University, 1st Semester, 2020
Spring 2020 - Summer 2020

4th Industrial Revolution Academy
Seoul National University
Summer 2017 - Spring 2018

Mentoring to Nurture Next Generation Leaders
Korea Student Aid Foundation, mentored by Lim Cheol-ho
Spring 2017 - Winter 2017
[pdf]


I like this wepsite too 😊