Machine Learning, Visual Computing & Robotics


I am a Researcher and Software Engineer in the Google AI (Robotics at Google) team. Prior to joining Google, I was a Visiting Assistant Professor in the Geometry Lab of the Computer Science Department at Stanford University, supported by the MPC-VCC and the SAIL-Toyota Center for AI Research. I received my PhD from the University of Konstanz, Germany. My research interests are in Machine Learning, Visual Computing, and Robotics. Specifically, I am working on techniques for learning representations of objects, scenes, and tasks, where the focus is on enabling more advanced behavior of autonomous systems. Also, I am interested in developing efficient geometric representations that allow us to simulate and model natural phenomena and scenes. In the past I have worked on topics such as understanding physical interactions, cognitive planning, robotic manipulation, learning from demonstration, Sim2Real, video prediction, and simulating natural phenomena.


Publications

S. Pirk, M. Khansari, Y. Bai, C. Lynch, P. Sermanet, Online Learning of Object Representations by Appearance Space Feature Alignment, IEEE International Conference on Robotics and Automation, 2020
[Paper], [Video]
S. Pirk, M. Khansari, Y. Bai, C. Lynch, P. Sermanet, Online Object Representations with Contrastive Learning, CVPR Workshop: Learning from Unlabeled Videos, 2019
[Website], [Poster], [ArXiv]
X. Yan, M. Khansari, J. Hsu, Y. Gong, Y. Bai, S. Pirk, H. Lee, Data-Efficient Learning for Sim-to-Real Robotic Grasping using Deep Point Cloud Prediction Networks, 2019
[ArXiv] [Website]
M. Makowski, T. Hädrich, J. Scheffczyk, D. L. Michels, S. Pirk, W. Pałubicki, Synthetic Silviculture: Multi-scale Modeling of Plant Ecosystems, ACM Transactions on Graphics (Proceedings of SIGGRAPH), 2019
[Website], [Preprint], [Video], [Technical Papers Trailer]
H. Wang, S. Pirk, E. Yumer, V. G. Kim, O. Senner, S. Sridhar, L. J. Guibas, Learning a Generative Model for Multi-Step Human-Object Interactions from Videos, Computer Graphics Forum (Proceedings of Eurographics), 2019, Best Paper Honorable Mention
[Website], [Preprint], [Video], [Stanford AI Blog]
V. Casser, S. Pirk, R. Mahjourian, A. Angelova, Depth Prediction without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videos, Thirty-Third AAAI Conference on Artificial Intelligence (AAAI'19), 2019
[Website], [ArXiv]
R. Ma, A. Gadi Patil, M. Fisher, M. Li, S. Pirk, B.-S. Hua, S.-K. Yeung, X. Tong, L. Guibas, H. Zhang, Language-Driven Synthesis of 3D Scenes from Scene Databases, ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 2018
[Website], [Preprint], [Video]
S. Vora, R. Mahjourian, S. Pirk, A. Angelova, Future Semantic Segmentation Using 3D Structure, ECCV 3D Reconstruction meets Semantics Workshop, 2018
[ArXiv]
V. Ganapathi-Subramanian, O. Diamanti, S. Pirk, C. Tang, M. Niessner, L. J. Guibas, Parsing Geometry Using Structure-Aware Shape Templates, International Conference on 3D Vision, 2018
[Preprint], [ArXiv], [Video]
J. Kratt, T. Niese, R. Hu, H. Huang, S. Pirk, A. Sharf, D. Cohen-Or, O. Deussen, Sketching In Gestalt Space: Interactive Shape Abstraction Through Perceptual Reasoning, Computer Graphics Forum, 2018
[Website], [Preprint], [Video], [Bibtex]
S. Pirk, M. Jarząbek, T. Hädrich, D. L. Michels, W. Palubicki, Interactive Wood Combustion for Botanical Tree Models, ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 2017
[Website], [Preprint], [Video], [Technical Papers Trailer], [Bibtex]
S. Pirk, O. Diamanti, B. Thibert, D. Xu, L. J. Guibas, Shape-aware Spatio-temporal Descriptors for Interaction Classification, IEEE International Conference on Image Processing (ICIP), 2017
[Preprint], [Bibtex]
Y. Yoshiyasu, E. Yoshida, S. Pirk, L. J. Guibas, 3D Convolutional Neural Networks by Modal Fusion, IEEE International Conference on Image Processing (ICIP), 2017
[Preprint], [Bibtex]
S. Pirk, V. Krs, K. Hu, S. D. Rajasekaran, H. Kang, B. Benes, Y. Yoshiyasu, L. J. Guibas, Understanding and Exploiting Object Interaction Landscapes, Transactions on Graphics (TOG), 2017
[Website], [Preprint], [DOI], [ArXiv], [Video], [Bibtex]
T. Hädrich, B. Benes, O. Deussen, S. Pirk, Interactive Modeling and Authoring of Climbing Plants, Computer Graphics Forum (Proceedings of Eurographics), 2017, Best Paper Honorable Mention
[Website], [Preprint], [Video], [Media], [Bibtex]
Y. Li, S. Pirk, H. Su, C. R. Qi, L. J. Guibas, FPNN: Field Probing Neural Networks for 3D Data, Neural Information Processing Systems (NIPS), 2016
[Website], [Preprint], [ArXiv], [Bibtex]
S. Pirk, B. Benes, T. Ijiri, Y. Li, O. Deussen, B. Chen, R. Mech, Modeling Plant Life in Computer Graphics, SIGGRAPH 2016 Courses
[Website], [DOI], [Bibtex]
J. Kratt, M. Spicker, A. Guayaquil, M. Fiser, S. Pirk, O. Deussen, J. C. Hart, B. Benes, Woodification: User-Controlled Cambial Growth Modeling, Computer Graphics Forum (Proceedings of Eurographics), 2015
[Website], [Preprint], [DOI], [Video], [Bibtex]
S. Pirk, T. Niese, T. Härich, B. Benes, O. Deussen, Windy Trees: Computing Stress Response for Developmental Tree Models, ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 2014
[Website], [Preprint], [DOI], [Video], [Bibtex]
J. Kratt, F. Eisenkeil, S. Pirk, A. Sharf, O. Deussen, Non-Realistic 3D Object Stylization, International Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging, 2014
[Website], [Preprint], [DOI], [Video], [Bibtex]
O. Stava, S. Pirk, J. Kratt, B. Chen, R. Mech, O. Deussen, B. Benes, Inverse Procedural Modeling of Trees, Computer Graphics Forum, 2014 and Eurographics, 2015
[Website], [Preprint], [DOI], [Video], [Bibtex]
T. Lindemeier, S. Pirk, O. Deussen, Image Stylization with a Painting Machine Using Semantic Hints, Computers and Graphics, 2013
[Preprint], [DOI], [Bibtex]
S. Pirk, M. F. Cohen, O. Deussen, M. Uyttendaele, J. Kopf, Video Enhanced Gigapixel Panoramas Siggraph Asia 2012, Technical Brief
[Website], [Preprint], [DOI], [Video], [Bibtex]
S. Pirk, T. Niese, O. Deussen, B. Neubert, Capturing and Animating the Morphogenesis of Polygonal Tree Models, ACM Transactions on Graphics (Proceedings of Siggraph Asia), 2012
[Website], [Preprint], [DOI], [Video], [Bibtex]
O. Deussen, T. Lindemeier, S. Pirk, M. Tautzenberger, Feedback-guided Stroke Placement for a Painting Machine, Computational Aesthetics in Graphics, 2012
[Website], [Preprint], [DOI], [Video], [Bibtex]
S. Pirk, O. Stava, J. Kratt, M. Abdul-Massih, B. Neubert, R. Mech, B. Benes, O. Deussen, Plastic Trees: Interactive Self-Adapting Botanical Tree Models, ACM Transactions on Graphics (Proceedings of SIGGRAPH), 2012
[Website], [Preprint], [DOI], [Video], [Bibtex]
Y. Livny, S. Pirk, F. Yan, Z. Cheng, O. Deussen, D. Cohen-Or, B. Chen, Texture-Lobes for Tree Modeling, ACM Transactions on Graphics (Proceedings of SIGGRAPH), 2011
[Website], [Preprint], [DOI], [Video], [Bibtex]
B. Neubert, S. Pirk, O. Deussen, C. Dachsbacher, Improved Model- and View-Dependent Pruning of Large Botanical Scenes, Computer Graphics Forum, 2011 and EGSR 2011
[Website], [Preprint], [DOI], [Bibtex]


Professional Service

Associate Editor Computer Graphics Forum (2019-2022)
Committee Member AAMAS 2019; CVM 2020, 2019; Eurographics 2020 (Short Papers), 2018 (Short Papers), 2017; Web3D 2010-2014
Reviewer SIGGRAPH 2018, 2017, 2015, 2013, 2012, 2011; SIGGRAPH Asia 2016, 2015, 2012; TOG 2017, 2016, 2013; EG 2020, 2018, 2017, 2015, 2014, 2013, 2011, 2009; CGF 2019, 2018, 2017, 2016, 2015, 2014; PG 2016, 2015, 2014, 2013; TVCG 2018, 2017, 2014, 2013; 3DV 2018, 2019; NeurIPS 2019; IROS 2019; ICLR 2020; CVPR 2020; ICML 2020


Personal

2017 AI Researcher and Software Engineer, Google AI (Robotics at Google)
Research on Machine Learning, Robotics, and Computer Vision.
2015 Visiting Assistant Professor at Stanford University, School of Engineering
Head of the Geometric Modeling Group at the Max Planck Center for Visual Computing and Communication.
2014 Researcher and Software Engineer, Esri R&D Center Zurich
Research and development for large-scale geo information systems.
2013 Postdoctoral Fellowship, Visual Computing
Postdoctoral Fellow in the Lab for Visual Computing, University of Konstanz.
2013 Ph.D. of the Faculty of Computer and Information Science, University of Konstanz
Dr.rer.nat. of the Faculty of Computer and Information Science, University of Konstanz.
2007 Dipl.-Ing. (FH), Computer Science
University of Applied Sciences Emden.