Parinya Punpongsanon, Ph.D.

Projects

ColorMod: Recoloring 3D Printed Objects using Photochromic Inks
(ACM CHI 2018)

We present ColorMod, a method for changing the color of a 3D-printed object even after fabrication. ColorMod works based on photochromic inks that can switch their appearance from transparent to colored when exposed to light of a certain wavelength. The color remains even when the object is removed from the light source. The process is fully reversible allowing users to recolor the object as many times as they want ...

Personal Fabrication Research in HCI and Graphics: An Overview of Related Work
(This project hosted by Prof. Stefanie Mueller at MIT CSAIL)

This website provides all papers publushed in personal fabrication in the HCI and Graphics communities. Each paper comes with an image, a short description, and links to the pdf, video, and a webpage if available. In addition, all papers can be sorted by conference and year. We hope this will help newcomers in personal fabrication to quickly get an overview of the field and for everyone else to quickly scan for related work.

SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality
(IEEE ISMAR 2014/2015, IEEE TVCG 2015, ACM SIGGRAPH 2016 [Invited Talks], and MIRU 2016 [Invited Talks])

We present SoftAR, a novel spatial augmented reality (AR) technique based on a pseudo-haptics mechanism that visually manipulates the sense of softness perceived by a user pushing a soft physical object. Considering the limitations of projection-based approaches that change only the surface appearance of a physical object, we propose two projection visual effects on the basis of the observations of humans pushing physical objects.

LazyNav: 3D Ground Navigation with Non-Critical Body Parts
(ICAT-EGVE 2014, IEEE 3DUI 2015 [Best Paper Award], and IEEE TVCG 2016)

While classical input devices have their own ground navigation standards, natural input techniques still lack acknowledged mechanisms for travelling in a 3D scene. In particular, navigation is not the primary interaction. Thus, the user should navigate in the scene while still being able to perform other interactions with her hands, and observe the displayed content by moving her eyes and locally rotating her head.

DeforMe: Visualization of Tangential Surface Deformation using Invisible Textures
(KJMR2013 [Best Presentation Award], ACM SIGGRAPH Asia 2013: Emerging Technologies, and Springer-Verlag Virtual Reality 2015)

We propose a projection-based mixed reality system that visualizes the tangential deformation of a nonrigid surface by superimposing graphics directly onto the surface by projected imagery. The superimposed graphics is deformed according to the surface deformation. We develop a computer vision technique that estimates the tangential deformation by measuring the frame-by-frame movement of an infrared (IR) texture on the surface.

Publications

JOURNALS

Parinya Punpongsanon, Emilie Guy, Daisuke Iwai, Kosuke Sato, and Tamy Boubekeur. Extended LazyNav: Virtual 3D Ground Navigation for Large Displays and Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics, Vol. 23, No. 8, PP. 1952-1963. August 2017.

Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato. SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality. IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE International Symposium on Mixed and Augmented Reality 2015), Vol. 21, No. 11, PP. 1279-1288. November 2015.

Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato. Projection-based Visualization of Tangential Deformation of Nonrigid Surface by Deformation Estimation Using Infrared Texture. Virtual Reality, Springer London, Vol. 19(1), PP. 45-56. March 2015.

CONFERENCE ARTICLES/PRESENTATION

Parinya Punpongsanon, Xin Wen, David Kim, Stefanie Mueller. ColorMod: Recoloring 3D Printed Objects using Photochromic Inks. In Proceedings of ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) 2018, PP. 213:1-213:12. Montréal, Canada, April 2018.

Emilie Guy, Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato, Tamy Boubekeur. LazyNav: 3D Ground Navigation with Non-Critical Body Parts. In Proceedings of IEEE Symposium on 3D User Interfaces (3DUI) 2015, PP. 43-50. Arles, France, March 2015. (Best Paper Award)

Parinya Punpongsanon, Emilie Guy, Tamy Boubekeur, Daisuke Iwai, Kosuke Sato. Ground Navigation in 3D Scenes using Simple Body Motions. International Conference on Artificial Reality and Telexistence with Eurographics Symposium on Virtual Environments (ICAT-EGVE) 2014, PP. 19-20. Bremen, Germany, December 2014.

Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato. A Preliminary Study on Altering Surface Softness Perception using Augmented Color and Deformation. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2014, PP. 301-302. Munich, Germany, September 2014.

Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato, and Shinsaku Hiura. Altering Surface Softness Perception in Spatial Augmented Reality by Visually Superimposing Projection Appearance. Presented in the International Symposium on Future of SHITSUKAN research, Tokyo, Japan, July 2014.

Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. DeforMe: projection-based visualization of deformable surfaces using invisible textures. In Proceedings of ACM SIGGRAPH Asia 2013: Emerging Technologies. Article 8, Hongkong, China, November 2013.

Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. Projection-based Visualization of Viscoelastic Surfaces Deformation using Infrared Vision Technique. In Proceedings of 6th Thailand-Japan International Academic Conference (TJIA), Osaka, Japan, November 2013.

Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. Projection-based Mixed Reality for Deformable Surfaces. Talked in the 6th Korea-Japan Workshop on Mixed Reality (KJMR2013), Okinawa, Japan, February 2013. (Best Presentation Award)

Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. 表面変形のビジュアルトラッキングによる粘弾性曲面上での射影に基づく複合現実感. 第88回パターン計測シンポジウム資料, SICE, pp.35-40, Yamanashi, Japan, December 2012.

Suriyong Lertkulvanich, Parinya Punpongsanon. English Composition game on the computer using a Natural Language Processing through online learning, In Proceedings of the 4th TCU International e-Learning Conference (IEC2012), Bangkok, Thailand, June 2012.

Mentoring & Teaching

TEACHING

システム制御 PBL (Multi-TouchPad)
2018 Osaka University
The problem-based learning class. This class covers the self-learning on fabricate a prototyping of multi-touchpad, develop a software based on computer vision technique, and implement a useful application over the prototyping of multi-touchpad.

学生実験C: 倒立振子 (Stabilization Control)
2018 Osaka University
The aims of this laboratory are as follows: 1) Confirming the knowledge studied in classroom lecture, 2) Mastering the technique to operate instruments and to summarize results, 3) Cultivating the ability to plan experiments by their own. This is the class designed for a forth year undergraduate course.

6.813: User Interface Design and Implementation
2017 MIT CSAIL
Develop the class materials (e.g., assignments). The class covers design priciples, prototyping techniques, evaluation techniques, and the implementation of graphical user interfaces. Deliverables include short programming assignments and a semester-long group project.

IAP: Build your own Multi-Touch Pad
2017 MIT CSAIL
Support the students in the class for hardware and software implementation. The class cover the learn laser cutting, electronics breadboard prototyping, soldering, and computer vision.

6.S063: Engineering Interactive Technologies
2017 MIT CSAIL
Teaches how to build cutting edge interactive technologies and provides an overview of each field. Topics covered include multitouch, augmented reality, haptics, wearables, brain computer interfaces, tangibles, fabrication, and more.

MENTORING

Project Cyber-Manufacturing (Undergraduate Student)
Jiamin He 2017 MIT CSAIL
This project introduces a new method for personal fabrication through the cross-manufacturing. The goal of this project is to provide a 3D prototyping tool that assist the user in 'online-to-offline' manufacturing warehouse.

FrontierLab@OsakaU (Undergraduate Student)
Tlinglin (Francis) Duan 2018 Osaka University
TBA

Professional Activities

AWARDS/GRANTS

IEEE Kansai Section Best Student Research Award
Student Research award at IEEE Kansai Section (JP: IEEE 関西支部　学生研究奨励賞) 2016.

JSPS Research Fellows - DC2/PD (04/2016 - 03/2018)
Project ID: 16J00049, Provided by Japan Society for the Promotion of Science.

ACM UIST 2016 Best Student Volunteer Award
Student Volunteers award at the 29th ACM User Interface Software and Technology Symposium 2016.

IEEE 3DUI 2015 Best Paper Award
Emilie Guy, Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato, Tamy Boubekeur, "LazyNav: 3D Ground Navigation with Non-Critical Body Parts", IEEE Symposium on 3D User Interfaces (3DUI), 2015.

Highest Commendation for Volunteer Services
Student Volunteers award of the 7th ACM SIGGRAPH Asia 2014.

Student Dispatch Program (Specific Funding for Short-term Visiting Researcher)
Provided by Graduate School of Engineering Science, Osaka University.

KJMR 2013 Best Presentation Award
Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato, "Projection-based Mixed Reality for Deformable Surfaces," Korea-Japan Workshop on Mixed Reality, 2013.

MEXT Scholarship (10/2012 - 03/2016)
Provided by the Ministry of Education, Culture, Sports, Science and Technology of Japan.

JASSO Scholarship (10/2008 - 09/2009)
Provided by the Japan Student Services Organization, Ministry of Education, Culture, Sports, Science and Technology of Japan.

INVITED TALKS

MIRU 2016 (第19回画像の認識・理解シンポジウム): Talks , Shizuoka, Japan.
Topic: SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality.

ACM SIGGRAPH 2016: IEEE TVCG Special Session on VR/AR , Anaheim, USA.
Topic: SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality.

VRSJ 2015: 世界を目指せ！ ― トップコンファレンス採択論文紹介 (3DUI Top Conference presentation) , Tokyo, Japan.
Topic: LazyNav: 3D Ground Navigation with Non-Critical Body Parts.

Volunteer services

Doctoral Consortium Co-Chair , ACM International Conference on Interactive Surfaces and Spaces (ISS) 2018, Tokyo, Japan.

Documentations Co-Chair , ACM User Interface Software and Technology Symposium (UIST) 2018, Berlin, Germany.

Local Arrangements Chair , Symposium on Computational Fabrication (SCF) 2017, Cambridge, USA.

Local Arrangements Chair , SIGCHI Summer School on Computational Fabrication and Smart Matter 2017, Cambridge, USA.

Session Chair (Experiences with Virtual Reality) , ACM Conference on Human Factors in Computing Systems (CHI) 2017, Denver, USA.

Documentations Chair , ACM User Interface Software and Technology Symposium (UIST) 2017, Quebec City, Canada.

AV Chair , ACM Symposium on Spatial User Interaction (SUI) 2016, Tokyo, Japan.

Visual Design and Web Chair , The 20th Anniversary of The Virtual Reality Society of Japan. [HP]

Chief Graphics Designer , of The 25th International Conference on Artificial Reality and Telexistence and the 20th Eurographics Symposium on Virtual Environments (ICAT-EGVE) 2015, Kyoto, Japan. [HP]

Program Committee member
ACM SIGGRAPH Asia 2018 , 2017 (Emerging Technologies Track) , ICAT-EGVE 2018 (IPC), 2017 (IPC).

Conference/Journal paper reviewer
ACM CSCW (2018), ACM CHI (2018, 2017), ACM HRI (2017), ACM ISS (2018), ACM SIGGRAPH Asia (2018, 2017, 2016), ACM SUI (2018, 2016), ACM UIST (2018, 2017, 2016), ACM VRST (2017, 2016), IEEE VR (2018, 2017), IEEE ISMAR (2018, 2017, 2016), ICAT-EGVE (2018, 2017).

Conference Student Volunteer
ACM UIST (2016), IEEE ISMAR (2015), ACM UbiComp/ISWC (2015), ACM SIGGRAPH Asia (2014), and ACM Multimedia (2012).

Education

Ph.D in Engineering (10/2013 - 09/2016) , Sato Laboratory, Graduate School of Engineering Science, Osaka University.
Under the supervision of Prof. Daisuke Iwai and Prof. Kosuke Sato .
Dissertation: Spatial Augmented Reality for Deformable Objects

Visiting Researcher (12/2013 - 02/2014) , Computer Graphics Group, TSI, Telecom ParisTech (ENST), University Paris-Saclay.
Under the supervision of Prof. Tamy Boubekeur.
Project: Natural Interaction Interfaces and Systems

Master of Engineering (10/2011 - 09/2013) , Sato Laboratory, Graduate School of Engineering Science, Osaka University.
Under the supervision of Prof. Daisuke Iwai and Prof. Kosuke Sato .
Thesis: Projection-based Mixed Reality for Deformable Surfaces using Infrared Textures

Exchange Student (10/2008 - 09/2009) , Electrical Engineering, School of Engineering, University of Fukui.
Theme: Natural Language Processing and Artificial Intelligence

Bachelor of Science [First Class Honor] (04/2006 - 03/2010) , Applied Computer Science in Multimedia, Information Technology, Faculty of Education and Industrial Engineering, King Mongkut's University of Technology Thonburi.
Under the supervision of Prof. Suriyong Lertkulvanich.
Thesis: English Composition game on the computer using a Natural Language Processing

Employment

Assistant Professor (04/2018 - Present) , Graduate School of Engineering Science, Osaka University, Japan
Research Fields: Spatial Augmented Reality, Digital Fabrication, Human Perception.

Postdoctoral Associate (01/2017 - 03/2018) , HCI Engineering Group, MIT CSAIL, USA.
Research Fields: Personal Fabrication, 3D Printing Technologies.

Postdoctoral Fellow (10/2016 - 03/2018) , SENS Laboratory, Osaka University, Japan.
Research Fields: Spatial Augmented Reality, Visual and Haptic Perception.

Programmer Analysis (06/2010 - 09/2011) , Kiatnakin Bank Public Limited Company, Bangkok.
Role: Core Banking Systems (Data Management), Information System Department..

Misc.

Editor
MIT CSAIL - HCI Engineering group and HCI Research group website

Graphic designer
The 13th Thai Festival 2015 in Osaka, Osaka, JAPAN (by Royal Thai Consulate-General at Osaka).

Parinya Punpongsanon , Ph.D. (in Engineering)