Parinya Punpongsanon
, Ph.D. (in Engineering)
Assistant Professor at
Graduate School of Engineering Science,
Osaka University
(SENS Laboratory)
in collaboration with MIT CSAIL (HCI Engineering Group) .
[ Curriculum Vitae (PDF) ]
Graduate School of Engineering Science, Osaka University
Building D, room D558 (5F).
1-3 Machikaneyama-cho, Toyonaka, Osaka 560-8531, Japan
Email: parinya /at/ sys.es.osaka-u.ac.jp
Research Focus:
Spatial Augmented Reality, Human Perception, Human-Computer Interaction (with regards digital fabrication)
Projects
Efficient Information Sharing Techniques between Workers of Heterogeneous Tasks in 3D CVE
(ACM CSCW 2018)
We compare different information sharing techniques and determine and efficient technique for the collaboration between workers. In our user experiment, particinants performed a floor plan design task in a designer and engineer pairing on a desktop VR environment. The results showed that the proposed information sharing technique, in which objects are updated based on local users' actions, is more suitable than real-time updates ...
(ACM CSCW 2018)
We compare different information sharing techniques and determine and efficient technique for the collaboration between workers. In our user experiment, particinants performed a floor plan design task in a designer and engineer pairing on a desktop VR environment. The results showed that the proposed information sharing technique, in which objects are updated based on local users' actions, is more suitable than real-time updates ...
ColorMod: Recoloring 3D Printed Objects using Photochromic Inks
(ACM CHI 2018 Papers, and ACM CHI 2018 Extended Abstracts)
We present ColorMod, a method for changing the color of a 3D-printed object even after fabrication. ColorMod works based on photochromic inks that can switch their appearance from transparent to colored when exposed to light of a certain wavelength. The color remains even when the object is removed from the light source. The process is fully reversible allowing users to recolor the object as many times as they want ...
(ACM CHI 2018 Papers, and ACM CHI 2018 Extended Abstracts)
We present ColorMod, a method for changing the color of a 3D-printed object even after fabrication. ColorMod works based on photochromic inks that can switch their appearance from transparent to colored when exposed to light of a certain wavelength. The color remains even when the object is removed from the light source. The process is fully reversible allowing users to recolor the object as many times as they want ...
Personal Fabrication Research in HCI and Graphics: An Overview of Related Work
(This project hosted by Prof. Stefanie Mueller at MIT CSAIL)
This website provides all papers publushed in personal fabrication in the HCI and Graphics communities. Each paper comes with an image, a short description, and links to the pdf, video, and a webpage if available. In addition, all papers can be sorted by conference and year. We hope this will help newcomers in personal fabrication to quickly get an overview of the field and for everyone else to quickly scan for related work.
(This project hosted by Prof. Stefanie Mueller at MIT CSAIL)
This website provides all papers publushed in personal fabrication in the HCI and Graphics communities. Each paper comes with an image, a short description, and links to the pdf, video, and a webpage if available. In addition, all papers can be sorted by conference and year. We hope this will help newcomers in personal fabrication to quickly get an overview of the field and for everyone else to quickly scan for related work.
SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality
(IEEE ISMAR 2014/2015, IEEE TVCG 2015, ACM SIGGRAPH 2016 [Invited Talks], and MIRU 2016 [Invited Talks])
We present SoftAR, a novel spatial augmented reality (AR) technique based on a pseudo-haptics mechanism that visually manipulates the sense of softness perceived by a user pushing a soft physical object. Considering the limitations of projection-based approaches that change only the surface appearance of a physical object, we propose two projection visual effects on the basis of the observations of humans pushing physical objects.
(IEEE ISMAR 2014/2015, IEEE TVCG 2015, ACM SIGGRAPH 2016 [Invited Talks], and MIRU 2016 [Invited Talks])
We present SoftAR, a novel spatial augmented reality (AR) technique based on a pseudo-haptics mechanism that visually manipulates the sense of softness perceived by a user pushing a soft physical object. Considering the limitations of projection-based approaches that change only the surface appearance of a physical object, we propose two projection visual effects on the basis of the observations of humans pushing physical objects.
LazyNav: 3D Ground Navigation with Non-Critical Body Parts
(ICAT-EGVE 2014, IEEE 3DUI 2015 [Best Paper Award], and IEEE TVCG 2016)
While classical input devices have their own ground navigation standards, natural input techniques still lack acknowledged mechanisms for travelling in a 3D scene. In particular, navigation is not the primary interaction. Thus, the user should navigate in the scene while still being able to perform other interactions with her hands, and observe the displayed content by moving her eyes and locally rotating her head.
(ICAT-EGVE 2014, IEEE 3DUI 2015 [Best Paper Award], and IEEE TVCG 2016)
While classical input devices have their own ground navigation standards, natural input techniques still lack acknowledged mechanisms for travelling in a 3D scene. In particular, navigation is not the primary interaction. Thus, the user should navigate in the scene while still being able to perform other interactions with her hands, and observe the displayed content by moving her eyes and locally rotating her head.
DeforMe: Visualization of Tangential Surface Deformation using Invisible Textures
(KJMR2013 [Best Presentation Award], ACM SIGGRAPH Asia 2013: Emerging Technologies, and Springer-Verlag Virtual Reality 2015)
We propose a projection-based mixed reality system that visualizes the tangential deformation of a nonrigid surface by superimposing graphics directly onto the surface by projected imagery. The superimposed graphics is deformed according to the surface deformation. We develop a computer vision technique that estimates the tangential deformation by measuring the frame-by-frame movement of an infrared (IR) texture on the surface.
(KJMR2013 [Best Presentation Award], ACM SIGGRAPH Asia 2013: Emerging Technologies, and Springer-Verlag Virtual Reality 2015)
We propose a projection-based mixed reality system that visualizes the tangential deformation of a nonrigid surface by superimposing graphics directly onto the surface by projected imagery. The superimposed graphics is deformed according to the surface deformation. We develop a computer vision technique that estimates the tangential deformation by measuring the frame-by-frame movement of an infrared (IR) texture on the surface.
Publications
JOURNALS
Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato.
FleXeen: Visually Manipulating Perceived Fabric Bending Stiffness in Spatial Augmented Reality.
IEEE Transactions on Visualization and Computer Graphics,
(accepted)
Santawat Thanyadit, Parinya Punpongsanon, and Ting-Chuen Pong.
Efficient Information Sharing Techniques between Workers of Heterogeneous Tasks in 3D CVE.
Proceedings of the ACM on Human-Computer Interaction
(Proceedings of the 21th ACM Conference on Computer-Supported Cooperative Work & Social Computing),
Vol. 2, No. CSCW, Article No. 172. November 2018. (In press)
Parinya Punpongsanon, Emilie Guy, Daisuke Iwai, Kosuke Sato, and Tamy Boubekeur.
Extended LazyNav: Virtual 3D Ground Navigation for Large Displays and Head-Mounted Displays.
IEEE Transactions on Visualization and Computer Graphics,
Vol. 23, No. 8, PP. 1952-1963. August 2017.
Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato.
SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality.
IEEE Transactions on Visualization and Computer Graphics
(Proceedings of IEEE International Symposium on Mixed and Augmented Reality 2015),
Vol. 21, No. 11, PP. 1279-1288. November 2015.
Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato.
Projection-based Visualization of Tangential Deformation of Nonrigid Surface by Deformation Estimation Using Infrared Texture.
Virtual Reality, Springer London, Vol. 19(1), PP. 45-56. March 2015.
CONFERENCE ARTICLES/PRESENTATION
Parinya Punpongsanon, Xin Wen, David Kim, Stefanie Mueller.
ColorMod: Recoloring 3D Printed Objects using Photochromic Inks.
In Proceedings of ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) 2018, PP. 213:1-213:12. Montréal, Canada, April 2018.
Emilie Guy, Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato, Tamy Boubekeur.
LazyNav: 3D Ground Navigation with Non-Critical Body Parts.
In Proceedings of IEEE Symposium on 3D User Interfaces (3DUI) 2015, PP. 43-50. Arles, France, March 2015.
(Best Paper Award)
Parinya Punpongsanon, Emilie Guy, Tamy Boubekeur, Daisuke Iwai, Kosuke Sato.
Ground Navigation in 3D Scenes using Simple Body Motions.
International Conference on Artificial Reality and Telexistence with Eurographics Symposium on Virtual Environments (ICAT-EGVE) 2014,
PP. 19-20. Bremen, Germany, December 2014.
Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato.
A Preliminary Study on Altering Surface Softness Perception using Augmented Color and Deformation.
In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2014,
PP. 301-302. Munich, Germany, September 2014.
Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato, and Shinsaku Hiura.
Altering Surface Softness Perception in Spatial Augmented Reality by Visually Superimposing Projection Appearance.
Presented in the International Symposium on Future of SHITSUKAN research, Tokyo, Japan, July 2014.
Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato.
DeforMe: projection-based visualization of deformable surfaces using invisible textures.
In Proceedings of ACM SIGGRAPH Asia 2013: Emerging Technologies. Article 8, Hongkong, China, November 2013.
Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato.
Projection-based Visualization of Viscoelastic Surfaces Deformation using Infrared Vision Technique.
In Proceedings of 6th Thailand-Japan International Academic Conference (TJIA), Osaka, Japan, November 2013.
Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato.
Projection-based Mixed Reality for Deformable Surfaces. Talked in the 6th Korea-Japan Workshop on Mixed Reality (KJMR2013),
Okinawa, Japan, February 2013. (Best Presentation Award)
Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato.
表面変形のビジュアルトラッキングによる粘弾性曲面上での射影に基づく複合現実感. 第88回パターン計測シンポジウム資料,
SICE, pp.35-40, Yamanashi, Japan, December 2012.
Suriyong Lertkulvanich, Parinya Punpongsanon.
English Composition game on the computer using a Natural Language Processing through online learning,
In Proceedings of the 4th TCU International e-Learning Conference (IEC2012), Bangkok, Thailand, June 2012.
Mentoring & Teaching
TEACHING
システム制御 PBL (Multi-TouchPad)
2018 Osaka University
The problem-based learning class. This class covers the self-learning on fabricate a prototyping of multi-touchpad, develop a software based on computer vision technique, and implement a useful application over the prototyping of multi-touchpad.
2018 Osaka University
The problem-based learning class. This class covers the self-learning on fabricate a prototyping of multi-touchpad, develop a software based on computer vision technique, and implement a useful application over the prototyping of multi-touchpad.
学生実験C: 倒立振子 (Stabilization Control)
2018 Osaka University
The aims of this laboratory are as follows: 1) Confirming the knowledge studied in classroom lecture, 2) Mastering the technique to operate instruments and to summarize results, 3) Cultivating the ability to plan experiments by their own. This is the class designed for a forth year undergraduate course.
2018 Osaka University
The aims of this laboratory are as follows: 1) Confirming the knowledge studied in classroom lecture, 2) Mastering the technique to operate instruments and to summarize results, 3) Cultivating the ability to plan experiments by their own. This is the class designed for a forth year undergraduate course.
6.813: User Interface Design and Implementation
2017 MIT CSAIL
Develop the class materials (e.g., assignments). The class covers design priciples, prototyping techniques, evaluation techniques, and the implementation of graphical user interfaces. Deliverables include short programming assignments and a semester-long group project.
2017 MIT CSAIL
Develop the class materials (e.g., assignments). The class covers design priciples, prototyping techniques, evaluation techniques, and the implementation of graphical user interfaces. Deliverables include short programming assignments and a semester-long group project.
IAP: Build your own Multi-Touch Pad
2017 MIT CSAIL
Support the students in the class for hardware and software implementation. The class cover the learn laser cutting, electronics breadboard prototyping, soldering, and computer vision.
2017 MIT CSAIL
Support the students in the class for hardware and software implementation. The class cover the learn laser cutting, electronics breadboard prototyping, soldering, and computer vision.
6.S063: Engineering Interactive Technologies
2017 MIT CSAIL
Teaches how to build cutting edge interactive technologies and provides an overview of each field. Topics covered include multitouch, augmented reality, haptics, wearables, brain computer interfaces, tangibles, fabrication, and more.
2017 MIT CSAIL
Teaches how to build cutting edge interactive technologies and provides an overview of each field. Topics covered include multitouch, augmented reality, haptics, wearables, brain computer interfaces, tangibles, fabrication, and more.
MENTORING
Project Cyber-Manufacturing (Undergraduate Student)
Jiamin He 2017 MIT CSAIL
This project introduces a new method for personal fabrication through the cross-manufacturing. The goal of this project is to provide a 3D prototyping tool that assist the user in 'online-to-offline' manufacturing warehouse.
Jiamin He 2017 MIT CSAIL
This project introduces a new method for personal fabrication through the cross-manufacturing. The goal of this project is to provide a 3D prototyping tool that assist the user in 'online-to-offline' manufacturing warehouse.
FrontierLab@OsakaU (Undergraduate Student)
Tlinglin (Francis) Duan 2018 Osaka University
The project introduces the integration of a Head-Mounted Display (HMD) with drone and a virtual hand to help the users explore remote environment. The system allows the users to use hand gesture to control the drone and identify the Object of Interest (OOI) through tactile feedback.
Tlinglin (Francis) Duan 2018 Osaka University
The project introduces the integration of a Head-Mounted Display (HMD) with drone and a virtual hand to help the users explore remote environment. The system allows the users to use hand gesture to control the drone and identify the Object of Interest (OOI) through tactile feedback.
Professional Activities
AWARDS/GRANTS
IEEE Kansai Section Best Student Research Award
Student Research award at IEEE Kansai Section (JP: IEEE 関西支部 学生研究奨励賞) 2016.
Student Research award at IEEE Kansai Section (JP: IEEE 関西支部 学生研究奨励賞) 2016.
JSPS Research Fellows - DC2/PD (04/2016 - 03/2018)
Project ID: 16J00049, Provided by Japan Society for the Promotion of Science.
Project ID: 16J00049, Provided by Japan Society for the Promotion of Science.
ACM UIST 2016 Best Student Volunteer Award
Student Volunteers award at the 29th ACM User Interface Software and Technology Symposium 2016.
Student Volunteers award at the 29th ACM User Interface Software and Technology Symposium 2016.
IEEE 3DUI 2015 Best Paper Award
Emilie Guy, Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato, Tamy Boubekeur, "LazyNav: 3D Ground Navigation with Non-Critical Body Parts", IEEE Symposium on 3D User Interfaces (3DUI), 2015.
Emilie Guy, Parinya Punpongsanon, Daisuke Iwai, Kosuke Sato, Tamy Boubekeur, "LazyNav: 3D Ground Navigation with Non-Critical Body Parts", IEEE Symposium on 3D User Interfaces (3DUI), 2015.
Highest Commendation for Volunteer Services
Student Volunteers award of the 7th ACM SIGGRAPH Asia 2014.
Student Volunteers award of the 7th ACM SIGGRAPH Asia 2014.
Student Dispatch Program (Specific Funding for Short-term Visiting Researcher)
Provided by Graduate School of Engineering Science, Osaka University.
Provided by Graduate School of Engineering Science, Osaka University.
KJMR 2013 Best Presentation Award
Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato, "Projection-based Mixed Reality for Deformable Surfaces," Korea-Japan Workshop on Mixed Reality, 2013.
Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato, "Projection-based Mixed Reality for Deformable Surfaces," Korea-Japan Workshop on Mixed Reality, 2013.
MEXT Scholarship (10/2012 - 03/2016)
Provided by the Ministry of Education, Culture, Sports, Science and Technology of Japan.
Provided by the Ministry of Education, Culture, Sports, Science and Technology of Japan.
JASSO Scholarship (10/2008 - 09/2009)
Provided by the Japan Student Services Organization, Ministry of Education, Culture, Sports, Science and Technology of Japan.
Provided by the Japan Student Services Organization, Ministry of Education, Culture, Sports, Science and Technology of Japan.
INVITED TALKS
MIRU 2016 (第19回画像の認識・理解シンポジウム): Talks
, Shizuoka, Japan.
Topic: SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality.
Topic: SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality.
ACM SIGGRAPH 2016: IEEE TVCG Special Session on VR/AR
, Anaheim, USA.
Topic: SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality.
Topic: SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality.
VRSJ 2015: 世界を目指せ！ ― トップコンファレンス採択論文 紹介 (3DUI Top Conference presentation)
, Tokyo, Japan.
Topic: LazyNav: 3D Ground Navigation with Non-Critical Body Parts.
Topic: LazyNav: 3D Ground Navigation with Non-Critical Body Parts.
Academic contribution
Workshop Organizer
, ACM ISS'18 Workshop on Computational Augmented Reality Displays 2018, Tokyo, Japan.
Doctoral Consortium Co-Chair
, ACM International Conference on Interactive Surfaces and Spaces (ISS) 2018, Tokyo, Japan.
Documentations Co-Chair
, ACM User Interface Software and Technology Symposium (UIST) 2018, Berlin, Germany.
Local Arrangements Chair
, Symposium on Computational Fabrication (SCF) 2017, Cambridge, USA.
Local Arrangements Chair
, SIGCHI Summer School on Computational Fabrication and Smart Matter 2017, Cambridge, USA.
Session Chair (Experiences with Virtual Reality)
, ACM Conference on Human Factors in Computing Systems (CHI) 2017, Denver, USA.
Documentations Chair
, ACM User Interface Software and Technology Symposium (UIST) 2017, Quebec City, Canada.
AV Chair
, ACM Symposium on Spatial User Interaction (SUI) 2016, Tokyo, Japan.
Visual Design and Web Chair
, The 20th Anniversary of The Virtual Reality Society of Japan.
Chief Graphics Designer
, of The 25th International Conference on Artificial Reality and Telexistence and the 20th Eurographics Symposium on Virtual Environments (ICAT-EGVE) 2015, Kyoto, Japan.
Conference/Journal paper reviewer
ACM TEI (2018), ACM CSCW (2018), ACM CHI (2018, 2017), ACM HRI (2017), ACM ISS (2018), ACM SIGGRAPH Asia (2018, 2017, 2016), ACM SUI (2018, 2016), ACM UIST (2018, 2017, 2016), ACM VRST (2018, 2017, 2016), IEEE VR (2018, 2017), IEEE ISMAR (2018, 2017, 2016), ICAT-EGVE (2018, 2017).
ACM TEI (2018), ACM CSCW (2018), ACM CHI (2018, 2017), ACM HRI (2017), ACM ISS (2018), ACM SIGGRAPH Asia (2018, 2017, 2016), ACM SUI (2018, 2016), ACM UIST (2018, 2017, 2016), ACM VRST (2018, 2017, 2016), IEEE VR (2018, 2017), IEEE ISMAR (2018, 2017, 2016), ICAT-EGVE (2018, 2017).
Conference Student Volunteer
ACM UIST (2016), IEEE ISMAR (2015), ACM UbiComp/ISWC (2015), ACM SIGGRAPH Asia (2014), and ACM Multimedia (2012).
ACM UIST (2016), IEEE ISMAR (2015), ACM UbiComp/ISWC (2015), ACM SIGGRAPH Asia (2014), and ACM Multimedia (2012).
Education
Ph.D in Engineering (10/2013 - 09/2016)
, Sato Laboratory, Graduate School of Engineering Science, Osaka University.
Under the supervision of Prof. Daisuke Iwai and Prof. Kosuke Sato .
Dissertation: Spatial Augmented Reality for Deformable Objects
Under the supervision of Prof. Daisuke Iwai and Prof. Kosuke Sato .
Dissertation: Spatial Augmented Reality for Deformable Objects
Visiting Researcher (12/2013 - 02/2014)
, Computer Graphics Group, TSI, Telecom ParisTech (ENST), University Paris-Saclay.
Under the supervision of Prof. Tamy Boubekeur.
Project: Natural Interaction Interfaces and Systems
Under the supervision of Prof. Tamy Boubekeur.
Project: Natural Interaction Interfaces and Systems
Master of Engineering (10/2011 - 09/2013)
, Sato Laboratory, Graduate School of Engineering Science, Osaka University.
Under the supervision of Prof. Daisuke Iwai and Prof. Kosuke Sato .
Thesis: Projection-based Mixed Reality for Deformable Surfaces using Infrared Textures
Under the supervision of Prof. Daisuke Iwai and Prof. Kosuke Sato .
Thesis: Projection-based Mixed Reality for Deformable Surfaces using Infrared Textures
Exchange Student (10/2008 - 09/2009)
, Electrical Engineering, School of Engineering, University of Fukui.
Theme: Natural Language Processing and Artificial Intelligence
Theme: Natural Language Processing and Artificial Intelligence
Bachelor of Science [First Class Honor] (04/2006 - 03/2010)
, Applied Computer Science in Multimedia, Information Technology, Faculty of Education and Industrial Engineering, King Mongkut's University of Technology Thonburi.
Under the supervision of Prof. Suriyong Lertkulvanich.
Thesis: English Composition game on the computer using a Natural Language Processing
Under the supervision of Prof. Suriyong Lertkulvanich.
Thesis: English Composition game on the computer using a Natural Language Processing
Employment
Assistant Professor (04/2018 - Present)
, Graduate School of Engineering Science, Osaka University, Japan
Research Fields: Spatial Augmented Reality, Digital Fabrication, Human Perception.
Research Fields: Spatial Augmented Reality, Digital Fabrication, Human Perception.
Postdoctoral Associate (01/2017 - 03/2018)
, HCI Engineering Group, MIT CSAIL, USA.
Research Fields: Personal Fabrication, Dynamic 3D Printing.
Research Fields: Personal Fabrication, Dynamic 3D Printing.
Postdoctoral Fellow (10/2016 - 03/2018)
, SENS Laboratory, Osaka University, Japan.
Research Fields: Spatial Augmented Reality, Visual and Haptic Perception.
Research Fields: Spatial Augmented Reality, Visual and Haptic Perception.
Programmer Analysis (06/2010 - 09/2011)
, Kiatnakin Bank Public Limited Company, Bangkok.
Role: Core Banking Systems (Data Management), Information System Department..
Role: Core Banking Systems (Data Management), Information System Department..
Misc.
Graphic designer
The 13th Thai Festival 2015 in Osaka, Osaka, JAPAN (by Royal Thai Consulate-General at Osaka).
The 13th Thai Festival 2015 in Osaka, Osaka, JAPAN (by Royal Thai Consulate-General at Osaka).