{"id":98,"date":"2021-04-13T00:21:34","date_gmt":"2021-04-12T15:21:34","guid":{"rendered":"http:\/\/shitsukan.jp\/deep\/en\/?page_id=98"},"modified":"2021-06-04T15:16:52","modified_gmt":"2021-06-04T06:16:52","slug":"c01-1-augmenting-material-perception-by-human-machine-integrated-vision","status":"publish","type":"page","link":"http:\/\/shitsukan.jp\/deep\/en\/?page_id=98","title":{"rendered":"C01-1 Augmenting Material Perception by Human-Machine Integrated Vision"},"content":{"rendered":"<div id=\"block-profile\">\n  <figure id=\"profile-fig\">\n    <img class=\"profile-img\" src=\"http:\/\/shitsukan.jp\/deep\/en\/wordpress\/wp-content\/uploads\/2021\/04\/c01-1-1.png\" \/>\n  <\/figure>\n  <div id=\"profile-text\">\n    <span id=\"profile-name\">Daisuke Iwai<\/span>\n    <span id=\"profile-affiliation\">Osaka University<\/span>\n  <\/div>\n<\/div>\n\n\n\n<p>The goal of this project is to dramatically improve human material (Shitsukan) recognition ability by integrating machine vision with human vision. Human vision predicts and recognizes rich material information from limited sensory stimuli based on the world model. On the other hand, machine vision captures the propagation of light with much higher spatio-temporal and wavelength resolution than human vision, and can precisely decompose the light field emitted from real objects into information presenting materials. On the other hand, machine vision can capture light propagation with much higher spatio-temporal and wavelength resolution than human vision, and can accurately decompose the light field emitted from real objects into information that represents its material. In this research project, we approach the generation of &#8220;deep Shitsukan perception&#8221; by converting the material information captured by machine vision into a form that can be perceived by humans and giving it to their field of vision to update their world model. Specifically, we have developed a wearable device (light modulation glasses) that directly manipulates the light field emitted from a real object just before it reaches the human eye, and selectively emphasizes or suppresses the material information. The device is constructed as near-eye optics capable of spatio-temporal and wavelength filtering of a group of light rays, and combined with synchronized computational illumination. In addition, we will investigate whether light-modulated glasses can improve people&#8217;s ability to recognize materials.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" width=\"1200\" height=\"680\" src=\"http:\/\/shitsukan.jp\/deep\/en\/wordpress\/wp-content\/uploads\/2021\/04\/iwai_en-Daisuke-Iwai-1200x680.jpeg\" alt=\"\" class=\"wp-image-123\" srcset=\"http:\/\/shitsukan.jp\/deep\/en\/wordpress\/wp-content\/uploads\/2021\/04\/iwai_en-Daisuke-Iwai-1200x680.jpeg 1200w, http:\/\/shitsukan.jp\/deep\/en\/wordpress\/wp-content\/uploads\/2021\/04\/iwai_en-Daisuke-Iwai-600x340.jpeg 600w, http:\/\/shitsukan.jp\/deep\/en\/wordpress\/wp-content\/uploads\/2021\/04\/iwai_en-Daisuke-Iwai-768x435.jpeg 768w, http:\/\/shitsukan.jp\/deep\/en\/wordpress\/wp-content\/uploads\/2021\/04\/iwai_en-Daisuke-Iwai-1536x870.jpeg 1536w, http:\/\/shitsukan.jp\/deep\/en\/wordpress\/wp-content\/uploads\/2021\/04\/iwai_en-Daisuke-Iwai-2048x1160.jpeg 2048w, http:\/\/shitsukan.jp\/deep\/en\/wordpress\/wp-content\/uploads\/2021\/04\/iwai_en-Daisuke-Iwai-1112x630.jpeg 1112w\" sizes=\"(max-width: 1200px) 100vw, 1200px\" \/><\/figure>\n\n\n\n<h4>Co-Investigator<\/h4>\n\n\n<div id=\"block-profile\">\n  <figure id=\"profile-fig\">\n    <img class=\"profile-img\" src=\"http:\/\/shitsukan.jp\/deep\/en\/wordpress\/wp-content\/uploads\/2021\/06\/yuta-itoh-1024x1024-Yuta-Itoh-1.jpg\" \/>\n  <\/figure>\n  <div id=\"profile-text\">\n    <span id=\"profile-name\">Yuta Itoh<\/span>\n    <span id=\"profile-affiliation\">The University of Tokyo<\/span>\n  <\/div>\n<\/div>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The goal of this project is to dramatically improve human material (Shitsukan) recognition ability by integrating machine vision with human vision. Human vision predicts and recognizes rich material information from limited sensory stimuli based on the world model. On the other hand, machine vision captures the propagation of light with much higher spatio-temporal and wavelength [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":23,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"http:\/\/shitsukan.jp\/deep\/en\/index.php?rest_route=\/wp\/v2\/pages\/98"}],"collection":[{"href":"http:\/\/shitsukan.jp\/deep\/en\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/shitsukan.jp\/deep\/en\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/shitsukan.jp\/deep\/en\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/shitsukan.jp\/deep\/en\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=98"}],"version-history":[{"count":5,"href":"http:\/\/shitsukan.jp\/deep\/en\/index.php?rest_route=\/wp\/v2\/pages\/98\/revisions"}],"predecessor-version":[{"id":204,"href":"http:\/\/shitsukan.jp\/deep\/en\/index.php?rest_route=\/wp\/v2\/pages\/98\/revisions\/204"}],"up":[{"embeddable":true,"href":"http:\/\/shitsukan.jp\/deep\/en\/index.php?rest_route=\/wp\/v2\/pages\/23"}],"wp:attachment":[{"href":"http:\/\/shitsukan.jp\/deep\/en\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=98"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}