Jin Ryong Kim

Basic Summary

My name is Jin Ryong Kim (First name: "Jin Ryong", Last name: "Kim") and I am a senior research scientist at Alibaba Research, USA. Prior to my current role, I was a senior researcher at Electronics and Telecommunications Research Institute (ETRI), Korea. I am broadly interested in Human-Computer Interaction (HCI), but more focused on creating novel interaction through haptics (sense of touch) in virtual reality, touchscreen interaction, and wearable computing for new user experiences.

I received the Ph.D. degree in Electrical and Computer Engineering (Advisor: Prof. Hong Z. Tan), and M.S. degree in Computer Science, both from Purdue University, IN, USA. I received the B.S. and M.S. degree (Advisor: Prof. Youjip Won) in Electrical and Computer Engineering from Hanyang University, Seoul, Korea. During my academic years, I worked as research interns at Microsoft Research Lab - Asia (Beijing, P. R. China, 2012~2013), NHK Science and Technology Research Laboratories (Tokyo, Japan, 2003), and Samsung Advanced Institute of Technology (Yongin, Korea, 2004). I published several articles in major haptic and HCI conferences such as IEEE World Haptics Conference, IEEE Haptics Symposium, EuroHaptics, and ACM CHI.

Education

Purdue University (West Lafayette, IN)

Ph.D. in Electrical and Computer Engineering (Aug. 2014)

Purdue University (West Lafayette, IN)

M.S. in Computer Science (Dec. 2010)

Hanyang University (Seoul, Korea)

M.S. in Electrical and Computer Engineering (Feb. 2004)

Hanyang University (Seoul, Korea)

B.S. in Electrical and Computer Engineering (Feb. 2001)

Work Experiences

Alibaba Research (Jul. 2018~present)

Senior Research Scientist @ DAMO NHCI Lab, Sunnyvale, CA, USA

ETRI (Mar. 2004~Aug. 2008, Aug. 2014~Jul. 2018)

Senior Researcher @ Software and Digital Contents Research Lab, Daejeon, Korea

Purdue University (Jan. 2011~Aug. 2014)

Research Assistant @ Haptic Interface Research Lab, West Lafayette, IN, USA

Microsoft Research Asia (Sep. 2011~May. 2012)

Research Intern@HCI Lab, Beijing, P. R. China

Samsung Advanced Institute of Technology (Jan. 2004~Feb.2004)

Research Intern@i-Networking Lab, Yongin, Korea

Samsung Electronics (Jun. 2002~Dec.2003)

Software Intern@Software Lab., Seoul, Korea

NHK Science and Technical Research Laboratories (Jan.2003~Feb.2003)

Research Intern@Advanced Audio and Video Coding Lab, Tokyo, Japan

Hanyang University (Mar. 2002~Feb.2004)

Research Assistant@Embedded Software System Lab, Seoul, Korea
Publications

2018

[J3] Seokhee Jeon, Hongchae Lee, Jiyoung Jung, and Jin Ryong Kim, "User Adaptive Key-Click Vibration on Virtual Keyboard," Mobile Information Systems, Vol. 2018, Article ID 6126140, 12 pages, 2018 [ PDF ].

[C19] Hyunjae Gil, Hyungki Son, Jin Ryong Kim, and Ian Oakley, "Whiskers: Exploring the Use of Ultrasonic Haptic Cues on the Face," In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018), Paper No. 658, Montreal, QC, Canada, April 21-26, 2018 [ PDF ].

[D2] Hyungki Son, Hyunjae Gil, Sangkyu Byeon, Sang-Youn Kim, and Jin Ryong Kim, "RealWalk: Feeling Ground Surfaces While Walking in Virtual Reality," Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018 Demo), D400, Montreal, QC, Canada, April 21-26, 2018 [ PDF | Link ].

[W2] Marcello Giordano, Orestis Georgiou, Brygida Dzidek, Loic Corenthy, Jin Ryong Kim, Sriram Subramanian, Stephen A. Brewster, "Mid-Air Haptics for Control Interfaces," Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018 Workshop), W15, Montreal, QC, Canada, April 21-26, 2018 [ PDF | Link ].

​[C18] Reza Haghighi Osgouei, Sunghwan Shin, Jin Ryong Kim, and Seungmoon Choi, "An Inverse Neural Network Model for Data-driven Texture Rendering on Electrovibration Display," In Proceedings of the IEEE Haptics Symposium 2018 (HAPTICS 2018) [ PDF ].

2017

[J2] Reza Haghighi Osgouei, Jin Ryong Kim, and Seungmoon Choi, "Improving 3D Shape Recognition for Electrostatic Friction Display," IEEE Transactions on Haptics, Vol. 10, Iss. 4, pp. 533-544, October-December 2017. [ PDF ]

[P2] Jin Ryong Kim and Seunghyup Shin, "Touch3D: Touchscreen Interaction on Multiscopic 3D with Electrovibration Haptics," ACM SIGGRAPH 2017 Posters, Los Angeles, CA, USA, 30 July - 3 August, 2017. [ PDF | Link ]

[C17] Jin Ryong Kim, Reza Haghighi Osgouei, and Seungmoon Choi, "Effects of Visual and Haptic Latency on Touchscreen Interaction: A Case Study using Painting Task," In Proc. of IEEE World Haptics Conference 2017 (WHC 2017), pp. 159-164, 2017 [ PDF ]

[C16] Inwook Hwang, Hyungki Son, and Jin Ryong Kim, "AirPiano: Enhancing Music Playing Experience in Virtual Reality with Mid-Air Haptic Feedback," In Proc. of IEEE World Haptics Conference 2017 (WHC 2017), pp. 213-218, 2017. [ PDF | Link ]

2016

[J1]​Jin Ryong Kim, Seunghyup Shin, Seungho Choi, and Yeonwoo Yoo, "Multimodal Interaction on Automultiscopic Content with Mobile Surface Haptics," ETRI Journal, Vol. 38, No. 6, pp.1085-1094, December 2016. [ PDF ]

​[C15] Reza Haghighi Osgouei, Jin Ryong Kim, and Seungmoon Choi, "Identification of Primitive Geometrical Shapes Rendered using Electrostatic Friction Display," In Proc. of IEEE Haptics Symposium 2016 (IEEE HAPTICS 2016), Philadelphia, PA, USA, pp.198-204, April 8-11,  2016 (Oral Presentation). [ PDF ]

[D1] Jin Ryong Kim and Seunghyup Shin, "Touchscreen Interaction on Automultiscopic Display with Electrostatic Vibration," demonstrated in AsiaHaptics 2016, Kashiwanoha, Japan, Nov. 29 - Dec. 1, 2016.

2015

[C14] Jin Ryong Kim and Hong Z. Tan, "Effect of Information Content in Sensory Feedback on Typing Performance using a Flat Keyboard," In Proc. of IEEE World Haptics Conference 2015 (IEEE WHC 2015), Evanston, IL, USA, pp. 228-234, June 22-26, 2015 (Oral Presentation). [ PDF ]

2014

[C13] Jin Ryong Kim and Hong Z. Tan, "Haptic Feedback Intensity Affects Touch Typing Performance on a Flat Keyboard", Proceedings of EuroHaptics 2014, Versailles, France, June 24-27, 2014 (Oral presentation). [ PDF ]

[C12] Jin Ryong Kim and Hong Z. Tan, "A Study of Touch Typing Performance with Keyclick Feedback," In Proc. of IEEE Haptics Symposium 2014 (IEEE HAPTICS 2014), Houston, TX, USA, pp. 227-233, Feb. 23-26, 2014 (Long oral presentation; acceptance rate 26%). [ PDF ]

2012

[C11] Jin Ryong Kim, Xiaowei Dai, Xiang Cao, Carl Picciotto, Desney Tan, and Hong Z. Tan, "A Masking Study of Key-Click Feedback Signals on Two Fingers using Simple Clicks," In Proc. of EuroHaptics 2012 (LNCS 7282 Part I), pp. 247-257, 2012 (Oral presentation; acceptance rate 21%). [ PDF ]

[P2] Venkatesh Merwade, Jin Ryong Kim, Lan Zhao, Carol Song, Amjad Assi, Ben Ruddell, and Rabi H. Mohtar, "WaterHUB for Publishing and Sharing of Hydrologic Models," In Proceeding of the American Water Resources Association 2012 Spring Specialty Conference GIS and Water Resources VII, New Orleans, LA, Mar. 2012.

2011

​[C10] Ruben Torres, Alessandro Finamore, Jin Ryong Kim, Marco Mellia, Maurizio M. Munafo, and Sanjay Rao, "Dissecting Video Server Selection Strategies in the YouTube CDN," In Proc. of International Conference on Distributed Computing Systems (ICDCS2011), Minneapolis, MN, USA, June 20-24, 2011 (Oral presentation; acceptance rate 15.4%). [ PDF ]

[W1] ​Lan Zhao, Carol Song, Jaewoo Lee, Jin Ryong Kim, Wei Feng, Venkatesh Merwade, and Nelson Villoria, "Bring Integrated GIS Data and Modeling Capabilities into the HUBzero Platform," Proceedings of the ACM SIGSPATIAL Second International Workshop on High Performance and Distributed Geographic Information Systems (HPDGIS 2011), Chicago, IL, Nov. 3-5, 2011.

[A1] ​Venkatesh Merwade, Ben Ruddell, Carol Song, and Lan Zhao, Jin Ryong Kim, Amjad Assi, "Publishing and Sharing of Hydrologic Models through Water HUB," Abstract IN33B-1467 presented at 2011 Fall Meeting, AGU, San Francisco, CA, Dec. 5-9, 2011.

2003-2010

​[P1] Peter Kristof, Bedrich Benes, Jin Ryong Kim, Lan Zhao, and Carol Song, "Near Real-time 3D Visualization of Rainfall Data," TeraGrid 2009, Arlington, VA, Jun. 22-25, 2009.​

[C9] Jin Ryong Kim, Il Kyu Park, and Kwang Hyun Shim, "The Effects of Network Loads and Latency in Multiplayer Online Games," In Proc. of the 6th International Conference on Entertainment Computing (ICEC2007), LNCS 4740, pp. 427-432, Shanghai, P.R. China, Sep. 15-17, 2007 (Oral presentation). [ PDF ]

[C8] Jin Ryong Kim, Youn-hee Han, and Kwang Hyun Shim, "Seamless Multimedia Transmission during Fast Handover in Mobile IPv6 Environment," In Proc. of IEEE Conference on Multimedia and Expo (ICME2006), Toronto, Canada, July 9-12, 2006. [ PDF ]

[C7] ​Bum Hyun Lim, Jin Ryong Kim, Kwang Hyun Shim, "Hierarchical Load Testing Architecture using Large Scale Virtual Clients," In Proc. of IEEE Conference on Multimedia and Expo (ICME2006), Toronto, Canada, July 9-12, 2006. [ PDF ]

[C6] ​Jung Yul Lim, Jin Ryong Kim, Kwang Hyun Shim, "A Dynamic Load Balancing Model for Networked Virtual Environment Systems using an Efficient Boundary Partition Management," In Proc. of IEEE International Conference on Advanced Communication Technology (ICACT2006), Phoenix Park, Korea, Feb. 20-22, 2006 (Oral presentation). [ PDF ]

[C5] ​Bum Hyun Lim, Jin Ryong Kim, and Kwang Hyun Shim, "A Load Testing Architecture for Networked Virtual Environment," In Proc. of IEEE International Conference on Advanced Communication Technology (ICACT2006), Phoenix Park, Korea, Feb. 20-22, 2006 (Oral presentation). [ PDF ]

​[C4] Jaeyong Chung, Jin Ryong Kim, Kwang Hyun Shim, "Vision based Motion Tracking System for Interactive Entertainment Applications," In Proc. of IEEE Tencon 2005, Melbourne, Australia, Nov. 21-25, 2005 (Oral presentation). [ PDF ]

[C3] Jin Ryong Kim, Youjip Won, Yuichi Iwadate, "Adaptive QoS Framework for Multiview 3D Streaming," In Proc. of 4th International Conference on Computational Science (ICCS2004), Krakow, Poland, LNCS Vol: 3036/2004, pp. 519-522, June 6-9, 2004. [ PDF ]

[C2] Jin Ryong Kim, Yuichi Iwadate, Youjip Won, "Network Aware QoS Management for Immersive Environment," In Proc. of the 13th International Conference on Artificial Reality and Telexistence (ICAT2003), Dec. 3-5, Tokyo, Japan, pp. 222-229, 2003 (Oral presentation). [ PDF ]

​[C1] Jin Ryong Kim, Youjip Won, Beomeun Kim, "Hierarchical QoS Architecture for Networked Virtual Dancing Environment," In Proc. of the 13th International Conference on Artificial Reality and Telexistence (ICAT2003), Dec. 3-5, Tokyo, Japan, pp. 46-53, 2003 (Oral Presentation). [ PDF ]

U.S. Patents Granted

"System and Method for Re-generating Packet Load For Load Test," US Patent Application, Patent Number: 20090156314, Application Number: 12264589, June 18, 2009.

"Method and System for Simulating Network Address Translation," US Patent Application, Patent Number: 20090154464, Application Number: 12336226, June 18, 2009.

"Method and System for Providing Streamed Game Software on Portable Terminal," US Patent Application, Patent Number: 20080288380, Application Number: 12096535, November 20, 2008.

"Intelligent Distributed Server System and Method for Operating The Same," US Patent Application, Patent Number: 20070117631, Application Number: 11437544, May 24, 2007.

Projects



Haptics (the word derives from the Greek, meaning “to touch”) is the science and technology of creating and employing touch sensation. Research in haptics is receiving great attention in industry and academia since it offers an additional dimension to 3D graphics, mobile displays, and virtual reality for richer user experiences. My research interest is haptics interaction. More specifically, my research focuses on designing and creating novel interaction through haptic technology in order to amplify human satisfaction for enriched user experiences in the field of human-computer interaction.

I am interested in interdisciplinary collaboration to solve real-world challenges in human-centered design through haptic interaction. Haptic interaction research fundamentally involves pursuing research across disciplines, which has given me several opportunities to collaborate with experts in other domains ranging from computer graphics, virtual reality, computer vision, and software-to-hardware engineering. Below is a list of projects that I have continuously been pursuing to contribute to a better understanding of touch feedback, and research on how to improve and design haptics interaction in order to simulate real scenarios.

AirPiano

AirPiano

AirPiano is a multi-finger piano playing system to provide touchable experiences in HMD-based VR with mid-air haptic feedback. Read More

Touch3D

Touch3D

Touch3D is an interactive mobile platform that provides realistic viewing and touching experiences through glasses-free 3D visualization with electrovibration. Read More

Eyes-Free Typing in VR

Eyes-Free Typing in VR

This work contributes to the in-air typing literature by investigating the effects of keystroke level haptic feedback on performance. Read More

RealWalk

RealWalk

RealWalk is pair of haptic shoes for HMD-based virtual reality and it is designed to create realistic sensations of ground surface deformation through MR flid actuators. Read More

CONTACT

Jin Ryong Kim
Alibaba NHCI Laboratory
  525 Almanor Ave. Sunnyvale, CA, 94085, USA
  jinryongkim AT gmail DOT com
  www.jessekim.com