Assistant Professor
School of Electronics and Information Engineering
Korea Aerospace University
76, Hanggongdaehak-ro
Deogyang-gu, Goyang-si, Gyeonggi-do, 10540, Korea
Google Scholar
LinkedIn
About Me
Hello, I am an Assistant Professor in the School of Electronics and Information Engineering
at Korea Aerospace University (KAU),
where I direct the Intelligent and Interactive Systems Lab (IIS Lab).
I am interested in computer vision and its application to build intelligent and interactive systems (e.g., robots).
I have extensive research experience in researching and developing diverse intelligent and interactive systems
using many software tools and tecnologies such as
deep learning frameworks (e.g.,Tensorflow) and Robot Operating System (ROS).
My work has been funded by grants and contracts from
the National Research Foundation of Korea (NRF),
the Electronics and Telecommunications Research Institute (ETRI),
the GRRC Program of Gyeonggi Province,
and Korea Aerospace University (KAU).
Before joining KAU,
I spent about two years in the ObjectVideo Labs of Alarm.com.
There I worked mostly on vessel recognition in maritime surveillance videos
with Office of Naval Research (ONR) to support the US Navy’s mission.
Before joining ObjectVideo Labs,
I was a graduate student in the School of Informatics, Computing, and Engineering
at Indiana University.
I worked with Professor David Crandall
on Computer Vision for Activity Learning
and Professor Selma Šabanović
on Human-Robot Interaction.
I completed the Ph.D degree in July 2018.
Before IU, I was a software engineer at Samsung Electronics
and received B.S. in Information and Communication Engineering from Sungkyunkwan University (SKKU)
in 2006 and M.S in Electrical and Computer Engineering from SKKU in 2008.
Education
- Ph.D. in Intelligent and Interactive Systems track of Informatics, Jul 2018
- Indiana Universitiy, Advisor: David Crandall
- Co-Advisor: Selma Šabanović
- Dissertation: Learning Activities From Human Demonstration Videos. PDF
- Graduate Minor: Computer Science
- M.S. in Electrical and Computer Engineering, Feb 2008
- Sungkyunkwan University, Advisor: Sukhan Lee
- Thesis: Automatic Evidence Selection and Collection for Robust Robotic Perception. PDF
- B.S. in Electronic and Electrical Engineering, Feb 2006
Employment
- Assistant Professor, Korea Aerospace University (KAU), Mar 2020 –
- Research Scientist, ObjectVideo Labs at Alarm.com, Sep 2018 - Feb 2020
- Research Assistant/Associate Instructor, Indiana University. Sep 2013 - July 2018
- Research Intern, NASA Jet Propulsion Laboratory, Jun 2016 - Aug 2016
- Software Engineer, Samsung, Feb 2008 - Jul 2013
- Samsung Electronics, Apr 2010 - Jul 2013
- Samsung Digital Imaging, Feb 2009 - Apr 2010
- Samsung Techwin, Feb 2008 - Feb 2009
- Research Assistant, Sungkyunkwan University Mar 2006 - Feb 2008
Research Interest
Computer Vision, Computer Vision for Robotics, Human-Robot Interaction, Human-Robot Collaboration
Recent publications
Peer-reviewed conference papers:
- Jangwon Lee, Bardia Doosti, Yupeng Gu, David Cartledge, David J. Crandall, and Christopher Raphael.
Observing Pianist Accuracy and Form with Computer Vision.
In IEEE Winter Conference on Applications of Computer Vision (WACV),
Jan 2019.
PDF
bibtex
@inproceedings{piano2019wacv,
title = {Observing Pianist Accuracy and Form with Computer Vision},
author = {Jangwon Lee and Bardia Doosti and Yupeng Gu and David Cartledge and David J. Crandall and Christopher Raphael},
booktitle = {IEEE Winter Conference on Applications of Computer Vision (WACV)},
year = {2019}
}
- Jangwon Lee and Michael S. Ryoo.
Learning Robot Activities from First-Person Human Videos
Using Convolutional Future Regression.
In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS),
Sep 2017.
PDF
bibtex
@inproceedings{leejang_iros2017,
title = {Learning Robot Activities from First-Person Human Videos Using Convolutional Future Regression},
author = {Jangwon Lee and Michael S. Ryoo},
booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
year = {2017}
}
- Chenyou Fan, Jangwon Lee, Mingze Xu, Krishna Kumar Singh, Yong Jae Lee, David Crandall, and Michael S. Ryoo.
Identifying First-person Camera Wearers in Third-person Videos.
In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jul 2017.
(Poster, 29.0% acceptance rate).
PDF
bibtex
@inproceedings{firstthird2017cvpr,
title = {Identifying first-person camera wearers in third-person videos},
author = {Chenyou Fan and Jangwon Lee and Mingze Xu and Krishna Kumar Singh and Yong Jae Lee and David J. Crandall and Michael S. Ryoo},
booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
year = {2017}
}
- Jangwon Lee, Jingya Wang, David Crandall, Selma Šabanović, and Geoffrey Fox.
Real-Time, Cloud-Based Object Detection for Unmanned Aerial Vehicles.
In IEEE International Conference on Robotic Computing (IRC), Apr 2017
PDF
bibtex
@inproceedings{lee2017real,
title={Real-Time, Cloud-Based Object Detection for Unmanned Aerial Vehicles},
author={Lee, Jangwon and Wang, Jingya and Crandall, David and {\v{S}}abanovi{\'c}, Selma and Fox, Geoffrey},
booktitle={IEEE International Conference on Robotic Computing (IRC)},
year={2017}
}
Peer-reviewed workshop papers:
- Chenyou Fan, Jangwon Lee, and Michael S. Ryoo.
Forecasting Hand and Object Locations in Future Frames.
In European Conference on Computer Vision (ECCV) Workshop on Anticipating Human Behavior, Sept 2018.
PDF
bibtex
@inproceedings{fan2017forecasting,
title={Forecasting hand and object locations in future frames},
author={Fan, Chenyou and Lee, Jangwon and Ryoo, Michael S},
booktitle={European Conference on Computer Vision (ECCV) Workshop on Anticipating Human Behavior},
year={2018}
}
Extended abstracts and works in progress in conferences and workshops:
- Haodan Tan, Jangwon Lee, and Gege Gao.
Human-Drone Interaction: Drone Delivery & Services for Social Event.
In ACM SIGCHI Conference on Designing Interactive Systems (DIS), June 2018.
PDF
bibtex
@inproceedings{tan2018human,
title={Human-Drone Interaction: Drone Delivery \& Services for Social Events},
author={Tan, Haodan and Lee, Jangwon and Gao, Gege},
booktitle={ACM SIGCHI Conference on Designing Interactive Systems (DIS)},
year={2018}
}
- Jangwon Lee, Haodan Tan, Selma Šabanović, and David Crandall.
Forecasting Hand Gestures for Human-Drone Interaction.
In ACM/IEEE International Conference on Human-Robot Interaction (HRI), Late-Breaking Reports, Mar 2018.
PDF
bibtex
@inproceedings{lee2018forecasting,
title={Forecasting Hand Gestures for Human-Drone Interaction},
author={Lee, Jangwon and Tan, Haodan and Crandall, David and {\v{S}}abanovi{\'c}, Selma},
booktitle={ACM/IEEE International Conference on Human-Robot Interaction (HRI)},
year={2018}
}
- Jangwon Lee and Michael S. Ryoo.
Learning Robot Activities from First-person human Videos Using Convolutional Future Regression.
In IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Workshop on Deep Learning for Robotic Vision (DLRV), Jul 2017.
(Spotlight Presentation). Best paper award!
PDF
bibtex
@InProceedings{Lee_2017_CVPR_Workshops,
author = {Jangwon Lee and Michael S. Ryoo},
title = {Learning Robot Activities From First-Person Human Videos Using Convolutional Future Regression},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
year = {2017}
}
Teaching Experience
Instructor, Korea Aerospace University, Goyang-si, Gyeonggi-do, Korea.
- EI4446/GT608, Deep Learning
- Developer, New course at KAU, Spring 2021 -
- GS1137, Computational Thinking for Problem Solving
- Python Programming, Spring 2021 -
- EI3303, AI based Capstone Design
- EI4318, Control System Design
- RC7164, Computer Programing
- C Programming, Fall 2021 -
- EI4444: Introduction to Deep Learning
- Developer, New Course at KAU, Spring 2020
- EI3302: Electronic Circuits Laboratory
- EI4324: Microprocessor
Associate Instructor, Indiana University, Bloomington, IN, USA.
- INFO I590/CS B659: Vision for Intelligent Robotics
- with Prof. Michael S. Ryoo, Fall 2016
- INFO I427: Search Informatics
- with Prof. David Crandall, Fall 2013, Fall 2014, 2015
- INFO I201: Mathematical Foundations of Informatics
- with John Duncan and Saul Blanco, Spring 2014
Awards and Scholarships
- Best Paper Award, CVPR Workshop on Deep Learning for Robotic Vision, 2017
- Travel Grant, CVPR Workshop Deep Learning for Robotic Vision, 2017
- Fellowship, four years of tuition and stipend, Indiana University, USA, 2013
- Brain Korea 21 Scholarship, Sungkyunkwan University, Korea, 2006
Service
Journal manuscript review
- IEEE Transactions on Multimedia (T-MM)
- IEEE Robotics and Automation Letters (RA-L)
- ACM Transactions on Human-Robot Interaction (THRI)
- IEEE Access
Conference and workshop paper review
- Winter Conference on Applications of Computer Vision (WACV, 2020)
- IEEE International Conference on Intelligent Robots and Systems (IROS 2017, 2019)
- ACM/IEEE International Conference on Human-Robot Interaction (HRI 2018, 2020)