Visual Computing and Machine Learning


I am a Senior Research Scientist at Adobe Research. Prior to joining Adobe I was Researcher and Software Engineer in the Google AI (Robotics at Google) team and a Visiting Assistant Professor in the Geometry Lab of the Computer Science Department at Stanford University, supported by the MPC-VCC and the SAIL-Toyota Center for AI Research. I received my PhD from the University of Konstanz (Visual Computing Lab), Germany. My research interests are in Machine Learning and Visual Computing with a focus on time-variant phenomena and multi-modal data streams. Specifically, I am interested in developing efficient geometric representations to enable solving complex tasks like interactively simulating natural phenomena, encoding interactions and behavior, or for 4D computer vision. In the past I have worked on topics such as understanding physical interactions, robotic manipulation and social navigation, learning from demonstration, style transfer, and video prediction.

I was recently invited by the ACM to chat about research on environmental modeling. The interview is available here: link.


Publications

A. Z. Zhu, V. Casser, R. Mahjourian, H. Kretzschmar, S. Pirk, Instance Segmentation with Cross-Modal Consistency, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022
[Preprint], [Bibtex]
W. Pałubicki, M. Makowski, W. Gajda, T. Hädrich, D. L. Michels, S. Pirk, Ecoclimates: Climate-Response Modeling of Vegetation, ACM Transactions on Graphics (Proceedings of SIGGRAPH), 2022
[Website], [Preprint], [Video], [Bibtex]
T. Niese, S. Pirk, M. Albrecht, B. Benes, O. Deussen, Procedural Urban Forestry, ACM Transactions on Graphics (TOG) and SIGGRAPH, 2022
[Website], [Preprint], [Video], [Bibtex]
S. Pirk, E. Lee, X. Xiao, L. Takayama, A. Francis, A. Toshev, A Protocol for Validating Social Navigation Policies, IEEE International Conference on Robotics and Automation, Workshop: Social Robot Navigation: Advances and Evaluation, 2022
[Preprint], [Poster], [ArXiv], [Bibtex]
H. Karnan, A. Nair, X. Xiao, G. Warnell, S. Pirk, A. Toshev, J. Hart, J. Biswas, P. Stone, Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigation, IEEE Robotics and Automation Letters (RA-L) and IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022
[Website], [Preprint], [Video], [Dataset], [Bibtex]
W. Raateland, T. Hädrich, J. A. Herrera, D. Banuti, W. Pałubicki, S. Pirk, K. Hildebrandt, D. L. Michels DCGrid: An Adaptive Grid Structure for Memory-Constrained Fluid Simulation on the GPU, ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, 2022
[Website], [Preprint], [DOI], [Supplementary Material], [Video], [Bibtex]
R. Jean, S. Brodeur, S. Pirk, P.-L. St-Charles, Self-Supervised Learning of Pose-Informed Latents, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshop: Learning with Limited Labelled Data for Image and Video Understanding, 2022
[Preprint], [Poster], [Supplementary Material], [Bibtex]
H. Shao, T. Kugelstadt, T. Hädrich, W. Pałubicki, J. Bender, S. Pirk, D. L. Michels, Accurately Solving Rod Dynamics with Graph Learning, Conference on Neural Information Processing Systems (NeurIPS), 2021
[Website], [Preprint], [ArXiv], [Supplementary Material], [Video], [Bibtex]
J. A. Amador Herrera, T. Hädrich, W. Pałubicki, D. T. Banuti, S. Pirk, D. L. Michels, Weatherscapes: Nowcasting Heat Transfer and Water Continuity, ACM Transactions on Graphics (SIGGRAPH Asia), 2021
[Website], [Preprint], [Video], [Technical Papers Trailer], [Bibtex]
B. Li, J. Kałużny, J. Klein, D.L. Michels, W. Pałubicki, B. Benes, S. Pirk, Learning to Reconstruct Botanical Trees from Single Images, ACM Transactions on Graphics (SIGGRAPH Asia), 2021
[Website], [Preprint], [Video], [Technical Papers Trailer], [Bibtex]
T. Hädrich, D. T. Banuti, W. Pałubicki, S. Pirk, D. L. Michels, Fire in Paradise: Mesoscale Simulation of Wildfires, ACM Transactions on Graphics (SIGGRAPH), 2021
[Website], [Preprint], [Video], [Talk], [Two Minute Papers], [Gallery of Fluid Motion], [Bibtex]
Y. Lu, S. Pirk, J. Dlabal, A. Brohan, A. Pasad, Z. Chen, V. Casser, A. Angelova, A. Gordon, Taskology: Utilizing Task Relations at Scale, IEEE Conference on Computer Vision and Pattern Recognition
(CVPR), Oral, 2021
[Preprint], [ArXiv], [Supplementary Material], [Poster], [Talk], [Bibtex]
J. Klein, S. Pirk, D. L. Michels, Domain Adaptation with Morphologic Segmentation, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshop: Autonomous Driving: Perception, Prediction and Planning, 2021
[Website], [Preprint], [ArXiv], [Video], [Bibtex]
T. Hädrich, M. Makowski, W. Pałubicki, D. T. Banuti, S. Pirk, D. L. Michels, Stormscapes: Simulating Cloud Dynamics in the Now, ACM Transactions on Graphics (SIGGRAPH Asia), 2020
[Website], [Preprint], [Video], [Talk], [Technical Papers Trailer], [Bibtex]
S. Pirk, K. Hausman, A. Toshev, M. Khansari, Modeling Long-horizon Tasks as Sequential Interaction Landscapes, Conference on Robotic Learning (CoRL), 2020
[Website], [Preprint], [ArXiv], [Video], [Talk], [Bibtex]
T. Hädrich, J. Scheffczyk, W. Pałubicki, S. Pirk, D. L. Michels, Interactive Wood Fracture,
Eurographics / ACM SIGGRAPH Symposium on Computer Animation - Posters, 2020
[Website], [Preprint], [Video], [Bibtex]
V. Krs, T. Hädrich, D. L. Michels, O.Deussen, S.Pirk, B. Benes, Wind Erosion: Shape Modifications by Interactive Particle-based Erosion and Deposition, Eurographics / ACM SIGGRAPH Symposium on Computer Animation - Posters, 2020
[Website], [Preprint], [Video], [Bibtex]
S. Pirk, M. Khansari, Y. Bai, C. Lynch, P. Sermanet, Online Learning of Object Representations by Appearance Space Feature Alignment, IEEE International Conference on Robotics and Automation, 2020
[Preprint], [Video], [Talk], [Bibtex]
S. Pirk, M. Khansari, Y. Bai, C. Lynch, P. Sermanet, Online Object Representations with Contrastive Learning, CVPR Workshop: Learning from Unlabeled Videos, 2019
[Website], [Poster], [ArXiv], [Bibtex]
X. Yan, M. Khansari, J. Hsu, Y. Gong, Y. Bai, S. Pirk, H. Lee, Data-Efficient Learning for Sim-to-Real Robotic Grasping using Deep Point Cloud Prediction Networks, 2019
[ArXiv], [Website], [Bibtex]
M. Makowski, T. Hädrich, J. Scheffczyk, D. L. Michels, S. Pirk, W. Pałubicki, Synthetic Silviculture: Multi-scale Modeling of Plant Ecosystems, ACM Transactions on Graphics (Proceedings of SIGGRAPH), 2019
[Website], [Preprint], [Video], [Technical Papers Trailer], [Two Minute Papers], [Bibtex]
H. Wang, S. Pirk, E. Yumer, V. G. Kim, O. Senner, S. Sridhar, L. J. Guibas, Learning a Generative Model for Multi-Step Human-Object Interactions from Videos, Computer Graphics Forum (Proceedings of Eurographics), 2019, Best Paper Honorable Mention
[Website], [Preprint], [Video], [Code + Data], [Stanford AI Blog], [Bibtex]
V. Casser, S. Pirk, R. Mahjourian, A. Angelova, Unsupervised Monocular Depth and Ego-motion Learning with Structure and Semantics, CVPR Workshop on Visual Odometry & Computer Vision Applications Based on Location Clues (VOCVALC), 2019
[Website], [ArXiv], [Code], [Bibtex]
V. Casser, S. Pirk, R. Mahjourian, A. Angelova, Depth Prediction without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videos, Thirty-Third AAAI Conference on Artificial Intelligence (AAAI'19), 2019
[Website], [ArXiv], [Code], [Bibtex]
R. Ma, A. Gadi Patil, M. Fisher, M. Li, S. Pirk, B.-S. Hua, S.-K. Yeung, X. Tong, L. Guibas, H. Zhang, Language-Driven Synthesis of 3D Scenes from Scene Databases, ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 2018
[Website], [Preprint], [Video], [Bibtex]
S. Vora, R. Mahjourian, S. Pirk, A. Angelova, Future Semantic Segmentation Using 3D Structure, ECCV 3D Reconstruction meets Semantics Workshop, 2018
[ArXiv], [Bibtex]
V. Ganapathi-Subramanian, O. Diamanti, S. Pirk, C. Tang, M. Niessner, L. J. Guibas, Parsing Geometry Using Structure-Aware Shape Templates, International Conference on 3D Vision, 2018
[Preprint], [ArXiv], [Video], [Bibtex]
J. Kratt, T. Niese, R. Hu, H. Huang, S. Pirk, A. Sharf, D. Cohen-Or, O. Deussen, Sketching In Gestalt Space: Interactive Shape Abstraction Through Perceptual Reasoning, Computer Graphics Forum, 2018
[Website], [Preprint], [Video], [Bibtex]
S. Pirk, M. Jarząbek, T. Hädrich, D. L. Michels, W. Palubicki, Interactive Wood Combustion for Botanical Tree Models, ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 2017
[Website], [Preprint], [Video], [Technical Papers Trailer], [Two Minute Papers], [Bibtex]
S. Pirk, O. Diamanti, B. Thibert, D. Xu, L. J. Guibas, Shape-aware Spatio-temporal Descriptors for Interaction Classification, IEEE International Conference on Image Processing (ICIP), 2017
[Preprint], [Video], [Bibtex]
Y. Yoshiyasu, E. Yoshida, S. Pirk, L. J. Guibas, 3D Convolutional Neural Networks by Modal Fusion, IEEE International Conference on Image Processing (ICIP), 2017
[Preprint], [Bibtex]
S. Pirk, V. Krs, K. Hu, S. D. Rajasekaran, H. Kang, B. Benes, Y. Yoshiyasu, L. J. Guibas, Understanding and Exploiting Object Interaction Landscapes, ACM Transactions on Graphics (TOG), 2017
[Website], [Preprint], [DOI], [ArXiv], [Video], [Bibtex]
T. Hädrich, B. Benes, O. Deussen, S. Pirk, Interactive Modeling and Authoring of Climbing Plants, Computer Graphics Forum (Proceedings of Eurographics), 2017, Best Paper Honorable Mention
[Website], [Preprint], [Video], [Two Minute Papers], [Bibtex]
Y. Li, S. Pirk, H. Su, C. R. Qi, L. J. Guibas, FPNN: Field Probing Neural Networks for 3D Data, Conference on Neural Information Processing Systems (NIPS), 2016
[Website], [Preprint], [ArXiv], [Code], [Bibtex]
S. Pirk, B. Benes, T. Ijiri, Y. Li, O. Deussen, B. Chen, R. Mech, Modeling Plant Life in Computer Graphics, SIGGRAPH 2016 Courses
[Website], [DOI], [Bibtex]
J. Kratt, M. Spicker, A. Guayaquil, M. Fiser, S. Pirk, O. Deussen, J. C. Hart, B. Benes, Woodification: User-Controlled Cambial Growth Modeling, Computer Graphics Forum (Proceedings of Eurographics), 2015
[Website], [Preprint], [DOI], [Video], [Bibtex]
S. Pirk, T. Niese, T. Härich, B. Benes, O. Deussen, Windy Trees: Computing Stress Response for Developmental Tree Models, ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 2014
[Website], [Preprint], [DOI], [Video], [Bibtex]
J. Kratt, F. Eisenkeil, S. Pirk, A. Sharf, O. Deussen, Non-Realistic 3D Object Stylization, International Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging, 2014
[Website], [Preprint], [DOI], [Video], [Bibtex]
O. Stava, S. Pirk, J. Kratt, B. Chen, R. Mech, O. Deussen, B. Benes, Inverse Procedural Modeling of Trees, Computer Graphics Forum, 2014 and Eurographics, 2015
[Website], [Preprint], [DOI], [Video], [Bibtex]
T. Lindemeier, S. Pirk, O. Deussen, Image Stylization with a Painting Machine Using Semantic Hints, Computers and Graphics, 2013
[Preprint], [DOI], [Bibtex]
S. Pirk, M. F. Cohen, O. Deussen, M. Uyttendaele, J. Kopf, Video Enhanced Gigapixel Panoramas Siggraph Asia 2012, Technical Brief
[Website], [Preprint], [DOI], [Video], [Bibtex]
S. Pirk, T. Niese, O. Deussen, B. Neubert, Capturing and Animating the Morphogenesis of Polygonal Tree Models, ACM Transactions on Graphics (Proceedings of Siggraph Asia), 2012
[Website], [Preprint], [DOI], [Video], [Bibtex]
O. Deussen, T. Lindemeier, S. Pirk, M. Tautzenberger, Feedback-guided Stroke Placement for a Painting Machine, Computational Aesthetics in Graphics, 2012
[Website], [Preprint], [DOI], [Video], [Bibtex]
S. Pirk, O. Stava, J. Kratt, M. Abdul-Massih, B. Neubert, R. Mech, B. Benes, O. Deussen, Plastic Trees: Interactive Self-Adapting Botanical Tree Models, ACM Transactions on Graphics (Proceedings of SIGGRAPH), 2012
[Website], [Preprint], [DOI], [Video], [Bibtex]
Y. Livny, S. Pirk, F. Yan, Z. Cheng, O. Deussen, D. Cohen-Or, B. Chen, Texture-Lobes for Tree Modeling, ACM Transactions on Graphics (Proceedings of SIGGRAPH), 2011
[Website], [Preprint], [DOI], [Video], [Bibtex]
B. Neubert, S. Pirk, O. Deussen, C. Dachsbacher, Improved Model- and View-Dependent Pruning of Large Botanical Scenes, Computer Graphics Forum, 2011 and EGSR 2011
[Website], [Preprint], [DOI], [Bibtex]


Professional Service

Technical Program Chair ACM SIGGRAPH / Eurographics Symposium on Computer Animation: 2022, link
Associate Editor Computer Graphics Forum (2019-2022), link
IEEE Computer Graphics and Applications (2020-2022), link
Committee Member International Conference on Autonomous Agents and Multiagent Systems (AAMAS): 2019
Computational Visual Media Conference (CVM): 2020, 2019, 2018
Eurographics: 2020 (Short Papers), 2019 (Short Papers), 2017
Web3D Conference: 2014, 2013, 2012, 2011, 2010
Reviewer International Conference on Machine Learning (ICML): 2021, 2020
IEEE Conference on Computer Vision and Pattern Recognition (CVPR): 2022, 2021, 2020
International Conference on Representation Learning (ICLR): 2022, 2021, 2020
International Conference on 3D Vision (3DV): 2022, 2021, 2020, 2019
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS): 2020, 2019
Conference on Neural Information Processing Systems (NeurIPS): 2022, 2021, 2020, 2019
ACM SIGGRAPH: 2022, 2021, 2018, 2017, 2015, 2013, 2012, 2011
ACM SIGGRAPH Asia: 2022, 2021, 2020, 2017, 2016, 2015, 2012
Transactions on Graphics (TOG): 2022, 2021, 2020, 2017, 2016, 2013
Eurographics (EG): 2021, 2020, 2018, 2017, 2015, 2014, 2013, 2011
Computer Graphics Forum (CGF): 2019, 2018, 2017, 2016, 2015, 2014
Pacific Graphics (PG): 2020, 2016, 2015, 2014, 2013
IEEE Transactions on Visualization & Computer Graphics (TVCG): 2018, 2017, 2014, 2013
Computers & Graphics: 2021, 2020, 2019, 2018, 2017, 2016, 2015, 2014, 2013, 2012


Personal

2022 Senior Research Scientist, Adobe Research, USA
Research on Visual Computing and Machine Learning.
2017 AI Researcher and Software Engineer, Google AI (Robotics at Google), USA
Research on Machine Learning, Robotics, and Computer Vision.
2015 Visiting Assistant Professor at Stanford University, School of Engineering, USA
Head of the Geometric Modeling Group at the Max Planck Center for Visual Computing and Communication.
2014 Researcher and Software Engineer, Esri R&D Center Zurich, Switzerland
Research and development for large-scale geo information systems.
2013 Postdoctoral Fellowship, Visual Computing, University of Konstanz, Germany
Postdoctoral Fellow in the Lab for Visual Computing.
2013 Ph.D. of the Faculty of Computer and Information Science, University of Konstanz, Germany
Dr.rer.nat. of the Faculty of Computer and Information Science, University of Konstanz.
2012 Research visits at Shenzhen Institute of Advanced Technology (SIAT), China
Academic projects and studies toward procedural modeling and geometric representations.
2007 Research visit at the University of Canterbury, New Zeland
Academic studies toward real-time rendering and augmented reality in the Human Interface Technology Laboratory (HitLab).
2007 Dipl.-Ing. (FH), Computer Science, Germany
University of Applied Sciences Emden.