TAESIK GONG
Research Interests: On-Device AI & Human-Centered AI
I am a research scientist at Nokia Bell Labs. I earned my Ph.D. and M.S. from School of Computing at KAIST under the supervision of Prof. Sung-Ju Lee, with close collaboration with Prof. Jinwoo Shin. I am a recipient of Google Ph.D. Fellowship. My Ph.D. dissertation won the Best Ph.D. Dissertation Award from both School of Computing & College of Engineering at KAIST. During my Ph.D., I was a research intern at Google Research/Google AI (2022), Microsoft Research Asia (2019), and Nokia Bell Labs (2018). I received my B.S. in Computer Science from Yonsei University with Summa Cum Laude.
News
- Jun. 2023 | 👔 Start of my journey as a research scientist at Nokia Bell Labs, Cambridge, UK
- May. 2023 | 📝 Paper accepted at INTERSPEECH ‘23
- Apr. 2023 | 📝 Paper accepted at ACM IMWUT (UbiComp) ‘23
- Feb. 2023 | 🏆 Best Ph.D. Dissertation Award from KAIST College of Engineering
- Feb. 2023 | 🏆 Best Ph.D. Dissertation Award from KAIST School of Computing
- Jan. 2023 | 🏆 AI/CS/EE Rising Stars
- Nov. 2022 | 🏆 Qualcomm Innovation Fellowship Finalist
- Oct. 2022 | 🏆 Google Conference Scholarship
- Sep. 2022 | 📝 Paper accepted at NeurIPS ‘22
- Aug. 2022 | 👔 Start of my internship at Google Research/Google AI, NY, USA
- May. 2022 | 👔 Serving as a Shadow Program Committee at ACM SenSys ‘22
- Mar. 2022 | 🏆 Honorable Mention at ACM CHI ‘22
- Nov. 2021 | 📝 Paper accepted at ACM CHI ‘22
- Apr. 2021 | 🤝 Graduate Symposium 2021 by Google Research
- Feb. 2021 | 🏆 Global Leadership Awards from the president of KAIST
- Feb. 2021 | 📝 Paper accepted at IEEE Transactions on Mobile Computing (TMC)
- Dec. 2020 | 💬 Talk at EIRIC (Electronic & Information Research Information Center)
- Oct. 2020 | 🏆 Google Ph.D. Fellowship
Work Experience
- 2023.06.01 - Present: Research Scientist, Nokia Bell Labs, Cambridge, UK
- 2023.03.01 - 2023.05.31: Postdoctoral Researcher, Networking & Mobile Systems Lab, KAIST, Republic of Korea
- 2022.08.22 - 2022.11.25: Research Intern, Google Research/Google AI, NYC, USA
- 2019.04.01 - 2019.06.26: Research Intern, Microsoft Research Asia, Beijing, China
- 2018.07.01 - 2018.09.30: Research Intern, Nokia Bell Labs, Cambridge, UK
Education
- 2017.08 - 2023.02: Ph.D. in Computer Science, KAIST, Republic of Korea (Advisor: Sung-Ju Lee)
- Dissertation Title: “Overcoming Domain Shift in Mobile Sensing via Machine Learning”
(Best Ph.D. Dissertation Award from both School of Computing & College of Engineering)
- Committee: Sung-Ju Lee, Jinwoo Shin, Sung Ju Hwang, Youngki Lee, Nicholas Lane
- 2016.03 - 2017.08: M.S. in Computer Science, KAIST, Republic of Korea (Advisor: Sung-Ju Lee)
- 2012.03 - 2016.02: B.S. in Computer Science, Yonsei University, Republic of Korea (Summa Cum Laude)
PUBLICATIONS
Preprints
“IMG2IMU: Applying Knowledge from Large-Scale Images to IMU Applications via Contrastive Learning”
Hyungjun Yoon, Hyeongheon Cha, Canh Hoang Nguyen, Taesik Gong, and Sung-Ju Lee
arXiv.
PDF
Arxiv
Conferences and Journals
“DAPPER: Label-Free Performance Estimation after Personalization for Heterogeneous Mobile Sensing”
Taesik Gong, Yewon Kim, Adiba Orzikulova, Yunxin Liu, Sung Ju Hwang, Jinwoo Shin, and Sung-Ju Lee
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2023. Will be presented at ACM UbiComp ‘23, Cancún, Mexico. (Accepted with minor revisions)
“LanSER: Language-Model Supported Speech Emotion Recognition”
Taesik Gong, Josh Belanich, Krishna Somandepalli, Arsha Nagrani, Brian Eoff, and Brendan Jou
INTERSPEECH 2023, Dublin, Ireland. (To appear)
“Tailoring Interactions: Exploring the Opportune Moment for Remote Computer-mediated Interactions with Home-alone Dogs”
Yewon Kim, Taesik Gong, and Sung-Ju Lee
Extended Abstracts of ACM CHI Conference on Human Factors in Computing Systems (CHI EA) 2023, Hamburg, Germany. (Acceptance Rate: 34.0%; 330/968)
PDF
Website
“MiCrowd: Vision-Based Deep Crowd Counting on MCU”
Sungwook Son, Ahreum Seo, Gyeongseon Eo, Kwangyeon Gill, Taesik Gong, and Hyung-Sin Kim
Sensors, Volume 23, Issue 7, 2023
PDF
“NOTE: Robust Continual Test-time Adaptation Against Temporal Correlation”
Taesik Gong, Jongheon Jeong, Taewon Kim, Yewon Kim, Jinwoo Shin, and Sung-Ju Lee
Conference on Neural Information Processing Systems (NeurIPS) 2022, New Orleans, LA, USA. (Acceptance Rate: 25.6%; 2672/10411)
PDF
Arxiv
Code
Qualcomm Innovation Fellowship Finalist
“MyDJ: Sensing Food Intakes with an Attachable on Your Eyeglass Frame”
Jaemin Shin, Seungjoo Lee, Taesik Gong, Hyungjun Yoon, Hyunchul Roh, Andrea Bianchi, and Sung-Ju Lee
ACM CHI Conference on Human Factors in Computing Systems (CHI) 2022, New Orleans, LA, USA.
PDF
Website
Video
Honorable Mention
“Adapting to Unknown Conditions in Learning-based Mobile Sensing”
Taesik Gong, Yeonsu Kim, Ryuhaerang Choi, Jinwoo Shin, and Sung-Ju Lee
IEEE Transactions on Mobile Computing (TMC), Volume 21, Issue 10, 2022
PDF
Website
“Messaging Beyond Texts with Real-time Image Suggestions”
Joon-Gyum Kim, Taesik Gong, Kyungsik Han, Juho Kim, Jeonggil Ko, and Sung-Ju Lee
International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) 2020, Virtual Conference.
PDF
Website
“No More One Liners: Bringing Context into Emoji Recommendations”
Joon-Gyum Kim, Taesik Gong, Bogoan Kim, Jaeyeon Park, Woojeong Kim, Evey Huang, Kyungsik Han, Juho Kim, Jeonggil Ko, and Sung-Ju Lee
ACM Transactions on Social Computing (TSC), Volume 3, Issue 2, Article 9, 2020
PDF
Website
“AudiDoS: Real-Time Denial-of-Service Adversarial Attacks on Deep Audio Models”
Taesik Gong, Alberto Gil C. P. Ramos, Akhil Mathur, Sourav Bhattacharya, and Fahim Kawsar
IEEE International Conference on Machine Learning and Applications (ICMLA) 2019, Boca Raton, Florida, USA.
(Acceptance Rate: 28.8%; 108/375)
PDF
“MetaSense: Few-Shot Adaptation to Untrained Conditions in Deep Mobile Sensing”
Taesik Gong, Yeonsu Kim, Jinwoo Shin, and Sung-Ju Lee
ACM Conference on Embedded Networked Sensor Systems (SenSys) 2019, New York, NY, USA.
(Acceptance Rate: 19.4%; 28/144)
PDF
Website
Video
Code
“Knocker: Vibroacoustic-based Object Recognition with Smartphones”
Taesik Gong, Hyunsung Cho, Bowon Lee, and Sung-Ju Lee
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 3, Issue 3, Article 83, September 2019. Presented at ACM UbiComp ‘19, London, UK.
PDF
Website
Video
“Use MU-MIMO at Your Own Risk – Why We Don’t Get Gb/s Wi-Fi”
Hyunwoo Choi, Taesik Gong, Jaehun Kim, Jaemin Shin, and Sung-Ju Lee
Ad Hoc Networks, Vol. 83, 2019.
PDF
Website
“Identifying Everyday Objects with a Smartphone Knock”
Taesik Gong, Hyunsung Cho, Bowon Lee, and Sung-Ju Lee
Extended Abstracts of ACM CHI Conference on Human Factors in Computing Systems (CHI EA) 2018, Montreal, Canada. (Acceptance Rate: 39.7%; 255/641)
PDF
Website
Video
“Enjoy the Silence: Noise Control with Smartphones”
Taesik Gong, Jun Hyuk Chang, Joon-Gyum Kim, Soowon Kang, Donghwi Kim, and Sung-Ju Lee
International Conference on Computer Communications and Networks (ICCCN) 2017, Vancouver, Canada.
PDF
Website
Posters, Demos, and Videos
“Real-Time Object Identification with a Smartphone Knock”
Taesik Gong, Hyunsung Cho, Bowon Lee, and Sung-Ju Lee
ACM International Conference on Mobile Systems, Applications, and Services (MobiSys) 2019, Seoul, Korea.
PDF
Video
Best Video Award
“Towards Condition-Independent Deep Mobile Sensing”
Taesik Gong, Yeonsu Kim, Jinwoo shin, and Sung-Ju Lee
ACM International Conference on Mobile Systems, Applications, and Services (MobiSys) 2019, Seoul, Korea.
PDF
“Dissecting 802.11ac Performance - Why We Should Turn Off MU-MIMO”
Hyeonwoo Choi, Taesik Gong, Jaehun Kim, Jaemin Shin, and Sung-Ju Lee
ACM International Conference on Mobile Systems, Applications, and Services (MobiSys) 2019, Seoul, Korea.
PDF
“Bringing Context into Emoji Recommendations”
JoonGyum Kim, Taesik Gong, Bogoan Kim, JaeYeon Park, Woojeong Kim, Evey Huang, Kyungsik Han, Juho Kim, JeongGil Ko, and Sung-Ju Lee
ACM International Conference on Mobile Systems, Applications, and Services (MobiSys) 2019, Seoul, Korea.
PDF
HONORS
Best Ph.D. Dissertation Award
For top 10 out of 491 (2%) Ph.D. dissertations, College of Engineering, KAIST, 2023
Best Ph.D. Dissertation Award
For top 3 out of 41 (7%) Ph.D. dissertations, School of Computing, KAIST, 2023
AI/CS/EE Rising Stars
For early-career researchers who study AI/CS/EE, supported by Google Explore CS Research, 2023
Qualcomm Innovation Fellowship Finalist
For qualified papers in the division of AI/ML, 2022
Google Conference Scholarship
For the primary author with a paper accepted in selected conferences, 2022
Best TA Award
Introduction to Programming (CS101, 2022 Spring), School of Computing, KAIST, 2022
Best Paper Honorable Mention
For the top 5% of all submissions, ACM CHI, 2022
Global Leadership Award
For the most outstanding grad student in creativity, from the President of KAIST, 2021
Google Ph.D. Fellowship
One of the two recipients from the Republic of Korea (one for Machine Learning), 2020
Best Video Award
ACM MobiSys 2019
NAVER Ph.D. Fellowship
One of the ten Ph.D. students with outstanding research outcomes in KAIST CS Dept., 2018
Outstanding Presentation Award
ACM SIGCHI Korea Local Chapter, 2018
Best Demo/Poster Award
HCI@KAIST Annual Winter Workshop, 2018
Best TA Award
Introduction to Computer Networks (CS341, 2016 Fall), School of Computing, KAIST, 2017
ACADEMIC SERVICES
Program Committee
- ACM SenSys ‘22 (Shadow Program Committee)
Reviewer
- ACM IMWUT ‘20 ‘21 ‘22
- ACM CHI ‘20 ‘21
- IEEE Pervasive Computing ‘21
- IEEE TMC ‘20 ‘22
- ACM CHI ‘20 Case Studies
- ACM TEI ‘20 Work-in-Progress
- ACM CHI PLAY ‘19 Work-in-Progress
PATENTS
“Time-aware Reinforcement-Learning Method for Geographic Ad Hoc Routing with Predefined Mobility and Computer Device for the same”
Jaeha Ahn, Sung-Ju Lee, Taesik Gong, HyungJun Yoon, and Taeckyung Lee
Korea Patent; Filing date: 2022.11.11, No.10-2022-0150662
“Reinforcement Learning for Ad-hoc Routing Using Pre-defined Mobility”
Sung-Ju Lee, Taesik Gong, HyungJun Yoon, Taeckyung Lee, and Jaeha Ahn
Korea Patent; Filing date: 2022.03.21, No.10-2022-0034824
“Meta-Learning Based Federated Learning with Small Set”
Sung-Ju Lee, Jaewon Jung, Jaemin Shin, and Taesik Gong
Korea Patent; Filing date: 2021.12.13, No.10-2021-0177384
“Method and Apparatus for Mobile Sensing for Few-Shot Adapting to Untrained Conditions”
Sung-Ju Lee, Taesik Gong, Yeonsu Kim, and Jinwoo Shin
Korea Patent; Filing date: 2019.12.24, No.10-2019-0173544; Issued date: 2023.02.17, No.10-25024410-0000
“Method and Apparatus for Identifying Object Based on Knock”
Sung-Ju Lee, Taesik Gong, Hyunsung Cho, and Bowon Lee
Korea Patent; Filing date: 2018.07.24, No.10-2018-0086161; Issued date: 2019.11.27, No.10-2051493-0000
“Active Noise Control using Smart-phone”
Sung-Ju Lee, Taesik Gong, Jun Hyuk Chang, Joon-Gyum Kim, Soowon Kang, and Donghwi Kim
Korea Patent; Filing date: 2017.09.25, No.10-2017-0123715; Issued date: 2019.01.30, No.10-1945776-0000
“Recommendation System for Corresponding Message”
Sung-Ju Lee, Joon-Gyum Kim, Taesik Gong, Jun Hyuk Chang, and JeongGil Ko
Korea Patent; Filing date: 2017.08.18, No.10-2017-0104408; Issued date: 2019.05.20, No. 10-1982081-0000
MEDIA
Research Videos
Knocker
ACM IMWUT '19
Media Coverage
ARIRANG TV
Knocker | 2019.11.14
MBC
Knocker | 2019.10.01
KBS
Knocker | 2019.10.01
YTN
Knocker | 2019.10.01
TJB
Knocker | 2019.10.01
News Articles
- KAIST, 스스로 새로운 환경 적응하는 인공지능 기술 개발, Boan News, 2022.10.22
- 카이스트, 스스로 새로운 환경 적응하는 AI 기술 개발, The Tech, 2022.10.21
- 이성주, 신진우 교수팀, 스스로 새로운 환경 적응하는 인공지능 기술 개발, KAIST News, 2022.10.21
- " '노커'와 '메타센스', 모바일 센싱의 영역·성능 확대"…공태식 카이스트 박사과정 연구원, AI Times, 2020.12.23
- Taesik Gong Named Google PhD Fellow, KAIST News, 2020.10.15
- Taesik Gong of KAIST has been awarded Google PhD Fellowship, KAIST SoC News, 2020.10.13
- [이슈] KAIST 박사과정 공태식 연구원... 구글 AI, 'PhD 펠로우십 2020' 머신러닝 부문 선정, AI Times, 2020.10.11
- 적은 양의 데이터로 스스로 적응하는 ‘모바일 센싱 기술’ 개발, CCTV News, 2020.07.03
- 카이스트, 스스로 학습하는 모바일 센서 기술 개발, Tech World, 2020.06.12
- 학습되지 않은 환경에서 스스로 학습하는 모바일 센싱 기술 개발, KAIST News, 2020.06.09
- 카메라나 RFID없이, 접촉만으로도 정확하게! 스마트폰으로 두드려 사물을 인식한다!, Naver MSIT Blog, 2019.10.28
- Sensor fusion lets phone identify objects by simply knocking against them, Electronics Weekly, 2019.10.03
- Object identification and interaction with a smartphone knock, Science Daily, 2019.10.02
- Smartphone tech recognizes objects by being knocked against them, New ATALS, 2019.10.02
- 두드리는 것만으로 사물 인식…카이스트, 스마트폰 '노커'기술 개발, Segye Ilbo, 2019.10.02
- 스마트폰으로 ‘톡’ 어떤 사물인지 ‘쏙’, CCToday, 2019.10.02
- Object Identification ＆ Interaction with a Smartphone Knock, KAIST SoC research highlight, 2019.10.01
- '스마트폰으로 두드려 사물 인식한다'…'노커' 기술 개발, SBS News, 2019.10.01
- 스마트폰으로 사물 두드려 인식하는 ‘노커’ 기술 개발, KBS News, 2019.10.01
- 카메라 없이도 스마트폰 두드리면 정확하게 사물 인식한다, Herald Economy, 2019.10.01
- “스마트폰으로 ‘톡톡’ 치니 생수가 배달되네”, Money S, 2019.10.01
- 스마트폰으로 '두드리면 사물 인식'기술 개발, YTN Science, 2019.10.01
- 스마트폰으로 '두드리면 사물 인식'기술 개발, YTN, 2019.10.01
- 스마트폰으로 노크하듯 두드리면 사물 인식, Seoul Economy, 2019.10.01
- 스마트폰으로 노크하듯 두드리면 사물 인식한다, Energy Economy, 2019.10.01
- 스마트폰으로 노크하듯 두드리면 사물 인식한다, Gukje News, 2019.10.01
- KAIST '스마트폰으로 노크하면 사물 인식' 기술 개발, Joongdo Ilbo, 2019.10.01
- KAIST, “스마트폰으로 노크하면 사물 인식하는 기술 개발”, EDUDONGA, 2019.10.01
- KAIST, 스마트폰 센서만으로 사물 인식 정확도 98% 달성 기술 개발, VERITAS Alpha, 2019.10.01
- 스마트폰으로 두드리면 사물 인식…KAIST연구팀 '노커'기술 개발, News1, 2019.10.01
- 폰으로 '노크'하면 사물 인식…'노커(Knocker)' 기술 개발, NoCut News, 2019.10.01
- 스마트폰으로 노크하듯 두드리면 사물 인식한다, GG Ilbo, 2019.10.01
- 스마트폰으로 두드려 사물을 인식하는 기술 개발, iNews24, 2019.10.01
- 스마트폰으로 두드리면 사물인식…KAIST, ‘노커 기술’ 개발, Digital Daily, 2019.10.01
- 한국과학기술원, 접촉만으로 사물 인식 '노커 기술' 개발, Prime Economy, 2019.10.01
- 이성주 교수, 폰으로 노크만 해도 사물인식하는 기술 개발, Newsis, 2019.10.01
- “빈 물통 스마트폰에 두드리니 자동 주문”...KAIST, '노커 기술’ 개발, Today Korea, 2019.10.01
- 스마트폰으로 두드려 사물 인식한다…KAIST 연구팀 '노커' 기술 개발, Aju News, 2019.10.01
- 국내 연구진, '스마트폰으로 두드려 사물인식' 기술 개발, Kyeonghyang News, 2019.10.01
- 스마트폰으로 '톡톡' 두드리면 사물 인식 신기술 개발, Chosun Biz, 2019.10.01
- 스마트폰으로 두드리기만 해도 사물을 인식한다, Financial News, 2019.10.01
- 스마트폰으로 두드리기만 하면 무엇인지 안다, Asia Economy, 2019.10.01
- “스마트폰으로 생수병 톡톡 치니 바로 온라인 주문 되네”, Money Today, 2019.10.01
- 노크만으로 가능한 세상···"사물 인식하고, 똑똑하게", HelloDD, 2019.10.01
- KAIST, 스마트폰으로 두드려서 물체 식별하는 기술 개발, ENews Today, 2019.10.01
- 스마트폰으로 두드려 사물인식 신기술 개발, Busan Ilbo, 2019.10.01
- 스마트폰으로 두드려 사물 인식 신기술 개발, Media Pen, 2019.10.01
- 스마트폰으로 '똑똑' 두드리면 사물 인식하는 국산 기술 나온다, IT Chosun, 2019.10.01
- 스마트폰으로 두드려 사물을 인식하는 신기술 개발, News Works, 2019.10.01
- KAIST, ‘노커’ 기술 개발...“스마트폰으로 노크만 하면 알람 설정도!”, Good Morning Chungcheong, 2019.10.01
- 스마트폰으로 '똑똑' 빈병 노크했더니…AI가 자동으로 물 주문, Mail Kyeongjae, 2019.10.01
- 두드려서 사물 인식하는 스마트폰 '노커'기술 개발, Daejeon Ilbo, 2019.10.01
- KAIST, 스마트폰 센서만으로 '사물 인식' 기술 개발, Daehak Journal, 2019.10.01
- 스마트폰으로 노크하듯 두드리면 사물 인식한다, Chungnam Ilbo, 2019.10.01
- 스마트 폰 두드리는 동작만으로 사물 인식, Dajeon City Journal, 2019.10.01
- 스마트폰으로 두드리자 사물 인식...마법 같은 '노커 기술', Green Post Korea, 2019.10.01
- 스마트폰으로 두드려 사물 인식하는 기술 개발, MSIT, 2019.10.01
- KAIST, 스마트폰 센서만으로 사물 인식 정확도 98% 달성 기술 개발, MBS, 2019.10.01
- "스마트폰으로 두드리니 생수병 알아맞혀", Bloter.net, 2019.10.01
- '똑똑' 스마트폰으로 두드려 사물인식 기술 개발, TJMBC, 2019.10.01
- 스마트폰 노크 기술 개발/리포트, TJMBC, 2019.10.02
- '침대 두드리면 자동 알람설정'..스마트폰으로 ‘노크’ 사물인식, News Pim, 2019.10.01
- 카이스트, 스마트폰 센서만으로 사물 인식 정확도 98% 달성 기술 개발, News Pim, 2019.10.01
- 스마트폰으로 두드려 사물 인식…'노커' 기술 개발, Yonhap News, 2019.10.01
- 스마트폰으로 두드리면 사물 인식…KAIST, '노커' 기술 개발, ETNews, 2019.10.01
- 노커, 스마트폰으로 두드리면 다 알아요., ETNews, 2019.10.01
- 스마트폰으로 두드리면 사물 인식하는 기술 개발…“정확도 98% 달해”, Kookmin Ilbo, 2019.10.01
- 스마트폰으로 ‘똑똑’…두드리는 것만으로 사물 인식가능한 기술 개발, Kookmin Ilbo, 2019.10.01
- 스마트폰으로 사물을 두드려 인식하는 신기술 개발, KAIST SoC, 2019.10.01
- NAVER Phd Fellowship 선정, KAIST SoC, 2018.12.03
- This algorithm makes smartphones recognize objects just by Knocking them, Nerdiest, 2018.04.23
- New application allows you to identify an object by tapping it with a smartphone, ictnews, 2018.04.23
FUN
Cat Lover
I’m a cat lover. I’m living with five adorable cats (Jero, Cheomji, Kkulbi, Jaban, and Cheetah). I’m truly lucky to meet these cute, warm-hearted cats. Here are some of their photos (auto-navigate):
Please visit my catstagram (in Korean) for more 😺.