{"id":11137,"date":"2018-11-16T13:45:47","date_gmt":"2018-11-16T21:45:47","guid":{"rendered":"https:\/\/mediax.stanford.edu\/?page_id=11137"},"modified":"2018-11-28T09:27:28","modified_gmt":"2018-11-28T17:27:28","slug":"sc-levoy","status":"publish","type":"page","link":"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/","title":{"rendered":"High Speed 3D Shape Digitization Using Projected Light Patterns"},"content":{"rendered":"<p><em>From The Theme<\/em><br \/>\n<a href=\"https:\/\/mediax.stanford.edu\/research\/sensing-and-computing\/\"><strong>SENSING AND COMPUTING<\/strong><\/a><\/p>\n<p><strong>WHAT IF<\/strong><br \/>\nWhat if we could quickly determine and track the 3D shape of a moving or deforming object?<\/p>\n<p><a href=\"https:\/\/mediax.stanford.edu\/research-projects\/high-speed-3d-shape-digitization-using-projected-light-patterns\/attachment\/high_speed_3d_main\/\" rel=\"attachment wp-att-11192\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-full wp-image-11192\" src=\"https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main.jpg\" alt=\"High Speed 3D Main Image\" width=\"995\" height=\"421\" srcset=\"https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main.jpg 995w, https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main-350x148.jpg 350w, https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main-768x325.jpg 768w, https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main-400x169.jpg 400w, https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main-800x338.jpg 800w\" sizes=\"auto, (max-width: 995px) 100vw, 995px\" \/><\/a><\/p>\n<p><strong>WHAT WE SET OUT TO DO<\/strong><br \/>\nWe set out to address one of the central problems in computer vision \u2013 the ability digitize an object at high speed. Rapid digitization has applications in film and digital video, with advantages such as: faster scanning, acquiring moving scenes, and interweaving the shape acquisition with regular motion recording. Our proposed prototype system would perform stripe tracking and triangulation in real-time, and would store the resulting stream of range images and analyze it of\ufb02ine.<\/p>\n<p><strong>WHAT WE FOUND<\/strong><br \/>\nIn order to acquire the shape, we built a high-speed projector to project time-coded stripe patterns into a scene, and then read them with a synchronized high-speed camera. An algorithm enabled us to align the range points and merge the scans at high speed, creating a full 3D model. Our tools have the capability to acquire the shape of an object at a rate of 240Hz, getting up to 6000 points per frame. This high speed enables users to scan moving objects or to incorporate the real-time range data in other systems such as trackers or light-field viewers.<\/p>\n<p><strong>LEARN MORE<\/strong><br \/>\n<a href=\"http:\/\/graphics.stanford.edu\/papers\/rt_model\">Real-Time 3D Model Acquisition<\/a> (2002) Rusinkiewicz, S., Hall-Holt, O., Levoy, M. Proc. SIGGRAPH 2002, ACM Transactions on Graphics 21(3),<\/p>\n<p><strong>PEOPLE BEHIND THE PROJECT<\/strong><br \/>\n<strong><a href=\"https:\/\/mediax.stanford.edu\/research-projects\/high-speed-3d-shape-digitization-using-projected-light-patterns\/attachment\/marc_levoy_small\/\" rel=\"attachment wp-att-11141\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-full wp-image-11141\" src=\"https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/Marc_Levoy_Small.jpg\" alt=\"Marc Levoy\" width=\"82\" height=\"100\" \/><\/a><a href=\"https:\/\/ai.google\/research\/people\/MarcLevoy\">Marc Levoy<\/a><\/strong> is the VMware Founders Professor of Computer Science and Electrical Engineering, Emeritus. He received a Bachelor&#8217;s and Master&#8217;s in Architecture from Cornell University in 1976 and 1978, and a PhD in Computer Science from the University of North Carolina at Chapel Hill in 1989. At Stanford he taught computer graphics and the science of art, and digital photography. Outside of academia, Levoy co-designed the Google book scanner, launched Google&#8217;s Street View project, and currently leads a team in Google Research that has worked on Project Glass, the Nexus HDR+ mode, and the Jump light field camera for Google Cardboard.<\/p>\n<p><strong><a href=\"https:\/\/mediax.stanford.edu\/research-projects\/force-input-device-for-graphical-environment-tweaking-fidget\/attachment\/mark_bolas_small\/\" rel=\"attachment wp-att-11129\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-full wp-image-11129\" src=\"https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/Mark_Bolas_Small.jpg\" alt=\"Mark Bolas\" width=\"82\" height=\"100\" \/><\/a><a href=\"http:\/\/ict.usc.edu\/profile\/mark-bolas\/\" target=\"_blank\" rel=\"noopener\">Mark Bolas<\/a><\/strong> is a researcher exploring perception, agency and intelligence. His work focuses on creating virtual environments and transducers that fully engage one\u2019s perception and cognition and create a visceral memory of the experience. At the time of this proposal, he was a Lecturer in Stanford\u2019s Product Design program, and co-founder of Fakespace Labs in Mountain View, California, building instrumentation for research labs to explore virtual reality. In 2017, he is the Associate Director for mixed reality research and development at the Institute for Creative Technologies at USC, and an Associate Professor of Interactive Media in the Interactive Media Division of the USC School of Cinematic Arts.<\/p>\n<p><strong><a href=\"https:\/\/mediax.stanford.edu\/research-projects\/force-input-device-for-graphical-environment-tweaking-fidget\/attachment\/ian_mcdowall_small\/\" rel=\"attachment wp-att-11131\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-full wp-image-11131\" src=\"https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/Ian_McDowall_Small.jpg\" alt=\"Ian McDowall\" width=\"82\" height=\"100\" \/><\/a><a href=\"https:\/\/www.linkedin.com\/in\/ian-mcdowall-0239\/\" target=\"_blank\" rel=\"noopener\">Ian McDowall<\/a><\/strong> is CEO and co-founder of Fakespace Labs in Mountain View, California, building instrumentation for research labs to explore virtual reality. He is also a Fellow at Intuitive Surgical, working on intelligent robotic technologies.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>From The Theme SENSING AND COMPUTING WHAT IF What if we could quickly determine and track the 3D shape of a moving or deforming object? WHAT WE SET OUT TO DO We set out to address one of the central problems in computer vision \u2013 the ability digitize an object at high speed. Rapid digitization [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":363,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":"","_links_to":"","_links_to_target":""},"tags":[7,26,24,20,33,53],"class_list":["post-11137","page","type-page","status-publish","hentry","tag-design","tag-design-thinking","tag-interaction","tag-sensors","tag-technology","tag-tools"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>High Speed 3D Shape Digitization Using Projected Light Patterns - mediaX at Stanford University<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"High Speed 3D Shape Digitization Using Projected Light Patterns - mediaX at Stanford University\" \/>\n<meta property=\"og:description\" content=\"From The Theme SENSING AND COMPUTING WHAT IF What if we could quickly determine and track the 3D shape of a moving or deforming object? WHAT WE SET OUT TO DO We set out to address one of the central problems in computer vision \u2013 the ability digitize an object at high speed. Rapid digitization [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/\" \/>\n<meta property=\"og:site_name\" content=\"mediaX at Stanford University\" \/>\n<meta property=\"article:modified_time\" content=\"2018-11-28T17:27:28+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"995\" \/>\n\t<meta property=\"og:image:height\" content=\"421\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mediax.stanford.edu\\\/research-projects\\\/sc-levoy\\\/\",\"url\":\"https:\\\/\\\/mediax.stanford.edu\\\/research-projects\\\/sc-levoy\\\/\",\"name\":\"High Speed 3D Shape Digitization Using Projected Light Patterns - mediaX at Stanford University\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mediax.stanford.edu\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mediax.stanford.edu\\\/research-projects\\\/sc-levoy\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mediax.stanford.edu\\\/research-projects\\\/sc-levoy\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mediax.stanford.edu\\\/wp-content\\\/uploads\\\/2018\\\/11\\\/High_Speed_3D_Main.jpg\",\"datePublished\":\"2018-11-16T21:45:47+00:00\",\"dateModified\":\"2018-11-28T17:27:28+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mediax.stanford.edu\\\/research-projects\\\/sc-levoy\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mediax.stanford.edu\\\/research-projects\\\/sc-levoy\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mediax.stanford.edu\\\/research-projects\\\/sc-levoy\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mediax.stanford.edu\\\/wp-content\\\/uploads\\\/2018\\\/11\\\/High_Speed_3D_Main.jpg\",\"contentUrl\":\"https:\\\/\\\/mediax.stanford.edu\\\/wp-content\\\/uploads\\\/2018\\\/11\\\/High_Speed_3D_Main.jpg\",\"width\":995,\"height\":421,\"caption\":\"High Speed 3D Main Image\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mediax.stanford.edu\\\/research-projects\\\/sc-levoy\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mediax.stanford.edu\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Research Projects\",\"item\":\"https:\\\/\\\/mediax.stanford.edu\\\/research-projects\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"High Speed 3D Shape Digitization Using Projected Light Patterns\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mediax.stanford.edu\\\/#website\",\"url\":\"https:\\\/\\\/mediax.stanford.edu\\\/\",\"name\":\"mediaX at Stanford University\",\"description\":\"Industry Affiliate Program of Stanford\u2019s H-STAR Institute\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mediax.stanford.edu\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"High Speed 3D Shape Digitization Using Projected Light Patterns - mediaX at Stanford University","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/","og_locale":"en_US","og_type":"article","og_title":"High Speed 3D Shape Digitization Using Projected Light Patterns - mediaX at Stanford University","og_description":"From The Theme SENSING AND COMPUTING WHAT IF What if we could quickly determine and track the 3D shape of a moving or deforming object? WHAT WE SET OUT TO DO We set out to address one of the central problems in computer vision \u2013 the ability digitize an object at high speed. Rapid digitization [&hellip;]","og_url":"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/","og_site_name":"mediaX at Stanford University","article_modified_time":"2018-11-28T17:27:28+00:00","og_image":[{"width":995,"height":421,"url":"https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/","url":"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/","name":"High Speed 3D Shape Digitization Using Projected Light Patterns - mediaX at Stanford University","isPartOf":{"@id":"https:\/\/mediax.stanford.edu\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/#primaryimage"},"image":{"@id":"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/#primaryimage"},"thumbnailUrl":"https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main.jpg","datePublished":"2018-11-16T21:45:47+00:00","dateModified":"2018-11-28T17:27:28+00:00","breadcrumb":{"@id":"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/#primaryimage","url":"https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main.jpg","contentUrl":"https:\/\/mediax.stanford.edu\/wp-content\/uploads\/2018\/11\/High_Speed_3D_Main.jpg","width":995,"height":421,"caption":"High Speed 3D Main Image"},{"@type":"BreadcrumbList","@id":"https:\/\/mediax.stanford.edu\/research-projects\/sc-levoy\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mediax.stanford.edu\/"},{"@type":"ListItem","position":2,"name":"Research Projects","item":"https:\/\/mediax.stanford.edu\/research-projects\/"},{"@type":"ListItem","position":3,"name":"High Speed 3D Shape Digitization Using Projected Light Patterns"}]},{"@type":"WebSite","@id":"https:\/\/mediax.stanford.edu\/#website","url":"https:\/\/mediax.stanford.edu\/","name":"mediaX at Stanford University","description":"Industry Affiliate Program of Stanford\u2019s H-STAR Institute","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mediax.stanford.edu\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mediax.stanford.edu\/wp-json\/wp\/v2\/pages\/11137","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mediax.stanford.edu\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mediax.stanford.edu\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mediax.stanford.edu\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mediax.stanford.edu\/wp-json\/wp\/v2\/comments?post=11137"}],"version-history":[{"count":3,"href":"https:\/\/mediax.stanford.edu\/wp-json\/wp\/v2\/pages\/11137\/revisions"}],"predecessor-version":[{"id":11193,"href":"https:\/\/mediax.stanford.edu\/wp-json\/wp\/v2\/pages\/11137\/revisions\/11193"}],"up":[{"embeddable":true,"href":"https:\/\/mediax.stanford.edu\/wp-json\/wp\/v2\/pages\/363"}],"wp:attachment":[{"href":"https:\/\/mediax.stanford.edu\/wp-json\/wp\/v2\/media?parent=11137"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mediax.stanford.edu\/wp-json\/wp\/v2\/tags?post=11137"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}