Parinya Punpongsanon, Ph.D.

Projects

FlyingHand: Extending the Range of Haptic Feedback on Virtual Hand using Drone-based Object Recognition
(ACM SIGGRAPH Asia 2018 Technical Briefs)

We present an HMD integrated system that uses a drone and a virtual hand to help the users explore and access space of the remote environment regardless of body limitations. The system allows the users to use hand gestures to control the drone and identify the Objects of Interest (OOI) through tactile feedback. The system uses a Convolutional Neural Network to perform object classification with the drone captured image and provides a virtual hand to realize interaction with the object. Accordingly, tactile feedback is also provided to users' hands to enhance the virtual hand body ownership. ...

FleXeen: Visually Manipulating Perceived Fabric Bending Stiffness in Spatial Augmented Reality
(IEEE TVCG 2018)

The appearance of fabric motion is suggested to affect the human perception of bending stiffness. This study presents a novel spatial augmented reality, or projection mapping, approach that can visually manipulate the perceived bending stiffness of a fabric. Particularly, we proposed a flow enhancement method that can change the apparent fabric motion by using a simple optical flow analysis technique rather than complex physical simulations for interactive applications ...

Efficient Information Sharing Techniques between Workers of Heterogeneous Tasks in 3D CVE
(ACM CSCW 2018)

We compare different information sharing techniques and determine and efficient technique for the collaboration between workers. In our user experiment, particinants performed a floor plan design task in a designer and engineer pairing on a desktop VR environment. The results showed that the proposed information sharing technique, in which objects are updated based on local users' actions, is more suitable than real-time updates ...

ColorMod: Recoloring 3D Printed Objects using Photochromic Inks
(ACM CHI 2018 Papers, and ACM CHI 2018 Extended Abstracts)

We present ColorMod, a method for changing the color of a 3D-printed object even after fabrication. ColorMod works based on photochromic inks that can switch their appearance from transparent to colored when exposed to light of a certain wavelength. The color remains even when the object is removed from the light source. The process is fully reversible allowing users to recolor the object as many times as they want ...

Personal Fabrication Research in HCI and Graphics: An Overview of Related Work
(This project hosted by Prof. Stefanie Mueller at MIT CSAIL)

This website provides all papers publushed in personal fabrication in the HCI and Graphics communities. Each paper comes with an image, a short description, and links to the pdf, video, and a webpage if available. In addition, all papers can be sorted by conference and year. We hope this will help newcomers in personal fabrication to quickly get an overview of the field and for everyone else to quickly scan for related work.

SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality
(IEEE ISMAR 2014/2015, IEEE TVCG 2015, ACM SIGGRAPH 2016 [Invited Talks], and MIRU 2016 [Invited Talks])

We present SoftAR, a novel spatial augmented reality (AR) technique based on a pseudo-haptics mechanism that visually manipulates the sense of softness perceived by a user pushing a soft physical object. Considering the limitations of projection-based approaches that change only the surface appearance of a physical object, we propose two projection visual effects on the basis of the observations of humans pushing physical objects.

LazyNav: 3D Ground Navigation with Non-Critical Body Parts
(ICAT-EGVE 2014, IEEE 3DUI 2015 [Best Paper Award], and IEEE TVCG 2016)

While classical input devices have their own ground navigation standards, natural input techniques still lack acknowledged mechanisms for travelling in a 3D scene. In particular, navigation is not the primary interaction. Thus, the user should navigate in the scene while still being able to perform other interactions with her hands, and observe the displayed content by moving her eyes and locally rotating her head.

DeforMe: Visualization of Tangential Surface Deformation using Invisible Textures
(KJMR2013 [Best Presentation Award], ACM SIGGRAPH Asia 2013: Emerging Technologies, and Springer-Verlag Virtual Reality 2015)

We propose a projection-based mixed reality system that visualizes the tangential deformation of a nonrigid surface by superimposing graphics directly onto the surface by projected imagery. The superimposed graphics is deformed according to the surface deformation. We develop a computer vision technique that estimates the tangential deformation by measuring the frame-by-frame movement of an infrared (IR) texture on the surface.

Publications

Journal Articles

Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato. FleXeen: Visually Manipulating Perceived Fabric Bending Stiffness in Spatial Augmented Reality. IEEE Transactions on Visualization and Computer Graphics, 2018. (Early Access)

Santawat Thanyadit, Parinya Punpongsanon, and Ting-Chuen Pong. Efficient Information Sharing Techniques between Workers of Heterogeneous Tasks in 3D CVE. Proceedings of the ACM on Human-Computer Interaction (Proceedings of the 21th ACM Conference on Computer-Supported Cooperative Work & Social Computing), Vol. 2, No. CSCW, Article No. 172. November 2018.

Parinya Punpongsanon, Emilie Guy, Daisuke Iwai, Kosuke Sato, and Tamy Boubekeur. Extended LazyNav: Virtual 3D Ground Navigation for Large Displays and Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics, Vol. 23, No. 8, pp. 1952-1963. August 2017.

Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato. SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality. IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE International Symposium on Mixed and Augmented Reality 2015), Vol. 21, No. 11, pp. 1279-1288. November 2015.

Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato. Projection-based Visualization of Tangential Deformation of Nonrigid Surface by Deformation Estimation Using Infrared Texture. Virtual Reality, Springer London, Vol. 19(1), pp. 45-56. March 2015.

Conference Proceedings

Tinglin Duan, Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato. FlyingHand: Extending the Range of Haptic Feedback on Virtual Hand using Drone-based Object Recognition. In Proceedings of ACM SIGGRAPH Asia 2018: Technical Briefs, Article 28. Tokyo, Japan, December 2018.

Parinya Punpongsanon, Xin Wen, David Kim, Stefanie Mueller. ColorMod: Recoloring 3D Printed Objects using Photochromic Inks. In Proceedings of ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) 2018, pp. 213:1-213:12. Montréal, Canada, April 2018.

Emilie Guy, Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato, Tamy Boubekeur. LazyNav: 3D Ground Navigation with Non-Critical Body Parts. In Proceedings of IEEE Symposium on 3D User Interfaces (3DUI) 2015, pp. 43-50. Arles, France, March 2015. (Best Paper Award)

Parinya Punpongsanon, Emilie Guy, Tamy Boubekeur, Daisuke Iwai, Kosuke Sato. Ground Navigation in 3D Scenes using Simple Body Motions. International Conference on Artificial Reality and Telexistence with Eurographics Symposium on Virtual Environments (ICAT-EGVE) 2014, pp. 19-20. Bremen, Germany, December 2014.

Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato. A Preliminary Study on Altering Surface Softness Perception using Augmented Color and Deformation. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2014, pp. 301-302. Munich, Germany, September 2014.

Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato, and Shinsaku Hiura. Altering Surface Softness Perception in Spatial Augmented Reality by Visually Superimposing Projection Appearance. Presented in the International Symposium on Future of SHITSUKAN research, Tokyo, Japan, July 2014.

Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. DeforMe: projection-based visualization of deformable surfaces using invisible textures. In Proceedings of ACM SIGGRAPH Asia 2013: Emerging Technologies. Article 8, Hongkong, China, November 2013.

Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. Projection-based Visualization of Viscoelastic Surfaces Deformation using Infrared Vision Technique. In Proceedings of 6th Thailand-Japan International Academic Conference (TJIA), Osaka, Japan, November 2013.

Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. Projection-based Mixed Reality for Deformable Surfaces. Talked in the 6th Korea-Japan Workshop on Mixed Reality (KJMR2013), Okinawa, Japan, February 2013. (Best Presentation Award)

Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. 表面変形のビジュアルトラッキングによる粘弾性曲面上での射影に基づく複合現実感. 第88回パターン計測シンポジウム資料, SICE, pp.35-40, Yamanashi, Japan, December 2012.

Suriyong Lertkulvanich, Parinya Punpongsanon. English Composition game on the computer using a Natural Language Processing through online learning, In Proceedings of the 4th TCU International e-Learning Conference (IEC2012), Bangkok, Thailand, June 2012.

Mentoring & Teaching

Teaching

知能システム学セミナー (Intelligent System Seminar)
2018 Osaka University
理工系の英文に慣れるとともに，プレゼンテーションの方法や，文献の読み進め方など，卒業研究を進めていく上で必要となる基礎的な技術の習得もめざす．各人がいずれかの研究室において，セミナー形式により英文の専門書，論文などを輪読し討論する．４年次の卒業研究を質的に高めるための導入部分である．

知能システムPBL (Intelligent System Problem-based Learning)
2018 Osaka University
「基礎工学PBL（知能システム学）」は，独創的な学術研究を推進し，国際社会で活躍できる豊かな創造性をもった学生を養成することを目的として，従来の学部教授法の慣習にとらわれることなく，新鮮で自由な教育研究の推進を図ることを目指します（PBL：Problem-Based Learning)．近年，我が国の社会体制は急激に成熟化し，若年層における学問への動機が失われつつあります．

学生実験C 倒立振子 (Stabilization Control Experiment)
2018 Osaka University
The aims of this laboratory are as follows: 1) Confirming the knowledge studied in classroom lecture, 2) Mastering the technique to operate instruments and to summarize results, 3) Cultivating the ability to plan experiments by their own. This is the class designed for a forth year undergraduate course.

6.813: User Interface Design and Implementation
2017 MIT CSAIL
Develop the class materials (e.g., assignments). The class covers design priciples, prototyping techniques, evaluation techniques, and the implementation of graphical user interfaces. Deliverables include short programming assignments and a semester-long group project.

IAP: Build your own Multi-Touch Pad
2017 MIT CSAIL
Support the students in the class for hardware and software implementation. The class cover the learn laser cutting, electronics breadboard prototyping, soldering, and computer vision.

6.S063: Engineering Interactive Technologies
2017 MIT CSAIL
Teaches how to build cutting edge interactive technologies and provides an overview of each field. Topics covered include multitouch, augmented reality, haptics, wearables, brain computer interfaces, tangibles, fabrication, and more.

MENTORING

Project Cyber-Manufacturing (Undergraduate Student)
Jiamin He 2017 MIT CSAIL
This project introduces a new method for personal fabrication through the cross-manufacturing. The goal of this project is to provide a 3D prototyping tool that assist the user in 'online-to-offline' manufacturing warehouse.

FrontierLab@OsakaU (Undergraduate Student)
Tlinglin (Francis) Duan 2018 Osaka University
The project introduces the integration of a Head-Mounted Display (HMD) with drone and a virtual hand to help the users explore remote environment. The system allows the users to use hand gesture to control the drone and identify the Object of Interest (OOI) through tactile feedback.

Professional Activities

Grants

Multidisciplinary Research Laboratory (10/2018 - 09/2019)
色の変化できる素材を使って日常物の持続性を高める研究, by 未来研究ラボシステム (Multidisciplinary Research Laboratory, MRL).

JSPS Specially Promoted Research (DC2/PD) (04/2016 - 03/2018)
身体および接触対象への映像重畳投影が触質感知覚に及ぼす影響の解明, Project No. 16J00049 by Japan Society for the Promotion of Science (JSPS).

Student Dispatch Program (Specific Funding for Short-term Visiting Researcher)
Provided by Graduate School of Engineering Science, Osaka University.

MEXT Scholarship (10/2012 - 03/2016)
Provided by the Ministry of Education, Culture, Sports, Science and Technology of Japan.

JASSO Scholarship (10/2008 - 09/2009)
Provided by the Japan Student Services Organization, Ministry of Education, Culture, Sports, Science and Technology of Japan.

Awards

IEEE Kansai Section Best Student Research Award
Student Research award at IEEE Kansai Section (JP: IEEE 関西支部　学生研究奨励賞) 2016.

ACM UIST 2016 Best Student Volunteer Award
Student Volunteers award at the 29th ACM User Interface Software and Technology Symposium 2016.

IEEE 3DUI 2015 Best Paper Award
Emilie Guy, Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato, Tamy Boubekeur, "LazyNav: 3D Ground Navigation with Non-Critical Body Parts", IEEE Symposium on 3D User Interfaces (3DUI), 2015.

Highest Commendation for Volunteer Services
Student Volunteers award of the 7th ACM SIGGRAPH Asia 2014.

KJMR 2013 Best Presentation Award
Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato, "Projection-based Mixed Reality for Deformable Surfaces," Korea-Japan Workshop on Mixed Reality, 2013.

JASSO Scholarship (10/2008 - 09/2009)
Provided by the Japan Student Services Organization, Ministry of Education, Culture, Sports, Science and Technology of Japan.

Invited Talks/Lectures

ACM SIGCHI Asian Symposium 2018 , Sendai, Japan.
Topic: Providing Target Haptics Sensation to Everyday Objects: From Digital to Physical Reality.

MIRU 2016 (第19回画像の認識・理解シンポジウム): Talks , Shizuoka, Japan.
Topic: SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality.

ACM SIGGRAPH 2016: IEEE TVCG Special Session on VR/AR , Anaheim, USA.
Topic: SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality.

VRSJ 2015: 世界を目指せ！ ― トップコンファレンス採択論文紹介 (3DUI Top Conference presentation) , Tokyo, Japan.
Topic: LazyNav: 3D Ground Navigation with Non-Critical Body Parts.

Academic contribution

Workshop Co-Organizer , ACM ISS'18 Workshop on Computational Augmented Reality Displays 2018, Tokyo, Japan.

Doctoral Consortium Co-Chair , ACM International Conference on Interactive Surfaces and Spaces (ISS) 2018, Tokyo, Japan.

Local Arrangements Chair , Symposium on Computational Fabrication (SCF) 2017, Cambridge, USA.

Local Arrangements Chair , SIGCHI Summer School on Computational Fabrication and Smart Matter 2017, Cambridge, USA.

Session Chair (Experiences with Virtual Reality) , ACM Conference on Human Factors in Computing Systems (CHI) 2017, Denver, USA.

Documentations Chair , ACM User Interface Software and Technology Symposium (UIST) 2017, Quebec City, Canada.

AV Chair , ACM Symposium on Spatial User Interaction (SUI) 2016, Tokyo, Japan.

Visual Design and Web Chair , The 20th Anniversary of The Virtual Reality Society of Japan.

Chief Graphics Designer , of The 25th International Conference on Artificial Reality and Telexistence and the 20th Eurographics Symposium on Virtual Environments (ICAT-EGVE) 2015, Kyoto, Japan.

Program Committee member
ACM SIGGRAPH Asia 2018 , 2017 (Emerging Technologies Track) , ICAT-EGVE 2018 (IPC), 2017 (IPC).

Conference/Journal paper reviewer
ACM TEI (2018), ACM CSCW (2018), ACM CHI (2018, 2017), ACM HRI (2017), ACM ISS (2018), ACM SIGGRAPH Asia (2018, 2017, 2016), ACM SUI (2018, 2016), ACM UIST (2018, 2017, 2016), ACM VRST (2018, 2017, 2016), IEEE VR (2018, 2017), IEEE ISMAR (2018, 2017, 2016), ICAT-EGVE (2018, 2017).

Conference Student Volunteer
ACM UIST (2016), IEEE ISMAR (2015), ACM UbiComp/ISWC (2015), ACM SIGGRAPH Asia (2014), and ACM Multimedia (2012).

Education

Ph.D in Engineering (10/2013 - 09/2016) , Sato Laboratory, Graduate School of Engineering Science, Osaka University.
Under the supervision of Prof. Daisuke Iwai and Prof. Kosuke Sato .
Dissertation: Spatial Augmented Reality for Deformable Objects

Visiting Researcher (12/2013 - 02/2014) , Computer Graphics Group, TSI, Telecom ParisTech (ENST), University Paris-Saclay.
Under the supervision of Prof. Tamy Boubekeur.
Project: Natural Interaction Interfaces and Systems

Master of Engineering (10/2011 - 09/2013) , Sato Laboratory, Graduate School of Engineering Science, Osaka University.
Under the supervision of Prof. Daisuke Iwai and Prof. Kosuke Sato .
Thesis: Projection-based Mixed Reality for Deformable Surfaces using Infrared Textures

Exchange Student (10/2008 - 09/2009) , Electrical Engineering, School of Engineering, University of Fukui.
Theme: Natural Language Processing and Artificial Intelligence

Bachelor of Science [First Class Honor] (04/2006 - 03/2010) , Applied Computer Science in Multimedia, Information Technology, Faculty of Education and Industrial Engineering, King Mongkut's University of Technology Thonburi.
Under the supervision of Prof. Suriyong Lertkulvanich.
Thesis: English Composition game on the computer using a Natural Language Processing

Employment

Assistant Professor (04/2018 - Present) , Graduate School of Engineering Science, Osaka University, Japan
Research Fields: Spatial Augmented Reality, Digital Fabrication, Human Perception.

Postdoctoral Associate (01/2017 - 03/2018) , HCI Engineering Group, MIT CSAIL, USA.
Research Fields: Personal Fabrication, Dynamic 3D Printing.

Postdoctoral Fellow (10/2016 - 03/2018) , SENS Laboratory, Osaka University, Japan.
Research Fields: Spatial Augmented Reality, Visual and Haptic Perception.

Programmer Analysis (06/2010 - 09/2011) , Kiatnakin Bank Public Limited Company, Bangkok.
Role: Core Banking Systems (Data Management), Information System Department..

Misc.

Editor
MIT CSAIL - HCI Engineering group and HCI Research group website

Graphic designer
The 13th Thai Festival 2015 in Osaka, Osaka, JAPAN (by Royal Thai Consulate-General at Osaka).

Parinya Punpongsanon , Ph.D. (in Engineering)