Click on title to see details.

D01 Scientific investigation of Shitsukan recognition

D01-1 Effects of lower luminance component and cycles-per-item of textures on SHITSUKAN perception.

Principal Investigator : Ichiro KURIKI(Tohoku University)

Ichiro KURIKI

Principal Investigator

Tohoku University

Ichiro KURIKI


Co-Investigator

Yamagata University    National Institute of Technology,     Tohoku University;
                  Ichinoseki College        University of California, San Diego.
Takehiro NAGAI          Tomoharu SATO              Sae KANEKO

 永井氏           佐藤氏             金子氏

Outline

The highlights in object images give clues to the smoothness/roughness of the object surfaces and illuminant perception. It is usually included in the brighter component of the luminance histogram. However, for the perception of rough surfaces, such as fabrics, wood barks, and skins of objects (fruit, body, and etc.), the darker component becomes rather informative. This may originate from the physical nature of multiple reflections at junctions of weave/pulp or interface of materials. Our project is aimed to elucidate the contribution of the darker component of luminance histogram on the SHITSUKAN perception, by using high dynamic-range (HDR) images as stimuli in psychophysical experiments. The perception of fabric and wood barks could be mistaken when images are presented with a wrong scale. Therefore, we will also pay attention to the spatial scale of "cycles per item," through this project.

図1.png
Figure 1. Equal luminance contrast, but different lowest luminance. The darker image gives the better SHITSUKAN.

図2_20160526.jpgのサムネイル画像
Figure 2. Pine tree bark can be misperceived as a rock wall, if size information is insufficient.

D01-2 Identifying Shitsukan processes using flash lag effect

Principal Investigator : Shioiri, Satoshi(Research Institute of Electrical Communication, Tohoku University)

Shioiri, Satoshi

Principal Investigator

Research Institute of Electrical Communication, Tohoku University

Shioiri, Satoshi


Co-Investigator

Research Institute of Electrical Communication, Tohoku University
Matsumiya,Kazynuchi  

Research Institute of Electrical Communication, Tohoku University
Tseng, Chia huei

Outline

The visual system obtains variety of object information through Shitsukan such as gloss, viscosity and so on. However, it is difficult to define what Shitsukan is. Although, for example, gloss is different from brightness subjectively, there is no objective method to isolate the process for gloss perception from other low level processes. We will develop a technique to isolate processes for different kinds of Shitsukan perception from basic low-level visual processes, using flash lag effect.

D01-2_overview_e.png

D01-3 Why is tactile texture diverse? ~Non-linear tactile texture arousal model~

Principal Investigator : Yoshimune Nonomura(Yamagata Universtiy)

Yoshimune Nonomura

Principal Investigator

Yamagata Universtiy

Yoshimune Nonomura


Co-Investigator

Asahikawa Medical University
Hiroyuki Mayama

Outline

When humans touch materials, they feel tactile textures, such as smooth and soft feels. We propose a hypothetical "Non-linear tactile texture arousal model": A delicate tactile texture is caused by a variety of friction patterns, which are arisen by non-linear frictional phenomena on skin surfaces.
In the present study, we examine the relationship between tactile texture and friction phenomena to verify the hypothesis. We develop a tactile texture evaluation system in which a sample is rubbed by a viscoelastic contact probe with a rough hierarchical surface under sine movement. The obtained friction phenomena are modeled based on nonlinear theory. The physical model for the tactile texture will be useful for understanding the shitsukan science and applying tactile engineering in the industrial area.

D01-3_overview_e.png

D01-4 Establishment of skin colour space and mapping of skin-Shitsukan recognition

Principal Investigator : Yoko Mizokami(Department of Imaging Sciences,Graduate School of Engineering, Chiba University)

Yoko Mizokami

Principal Investigator

Department of Imaging Sciences,Graduate School of Engineering, Chiba University

Yoko Mizokami


Co-Investigator

Life Science Research Center, Shiseido Co., Ltd
Kumiko Kikuchi

Graduate School of Advanced Integration Science, Chiba University
Hirohisa Yaguchi

Graduate School of Advanced Integration Science, Chiba University
Fang, Yu

Graduate School of Advanced Integration Science, Chiba University
Yuki Nakajima

College of Liberal Arts and Sciences, Chiba University
Rumi Tokunaga

Outline

Skin-Sitsukan (or skin appearance, skin quality) including skin color and texture is important for estimating age, health condition, the impression of face, and so on. It is known that the appearance of skin color does not always agree with its colorimetric values or chromaticities on conventional color spaces. It suggests that human would have developed a color perception specific to the color distribution of skin. An appropriate color space for skin color considering melanin and hemoglobin components would be needed to evaluate skin color and its appearance accurately. The recognition of skin-Shitsukan is also largely influenced by those components, and thus we would be able to map skin-Shitsukan to the skin color space.
We examine the influence of skin color and texture to skin-Shitsukan as well as the appearance of skin color to establish "Skin color space". We further investigate if it is possible to analyze skin-Shitsukan by mapping skin images to the new skin color space. The new skin colour space should enable us to evaluate relationship between skin perception and chromatic value that was not clear on conventional color spaces, and it would contribute to understand the recognition of skin-Shitsukan.

D01-4_overview_en.jpg

D01-5 Cultural dependency of SHITSUKAN recognitions

Principal Investigator : Kohske Takahashi(Department of Psychology, Chukyo University)

Kohske Takahashi

Principal Investigator

Department of Psychology, Chukyo University

Kohske Takahashi


Co-Investigator

World Language and Society Education Center, Tokyo University of Foreign Studies
Takanori Oishi

TEIKYO University of Science
Masaki Shimada 

Kyushu University 
QIAN KUN

Outline

"SHITSUKAN information of an object is embedded in the complex modulation patterns of sensory signals produced by interactions among object, environment and observer (Nishida)." --- The environment depends on cultures and hence the interaction also depends on cultures. Accordingly, culture may serve as a base for SHITSUKAN recognitions. To reveal the cultural dependency and universality of SHITSUKAN recognitions, we will collect numerous images and movies from across the world and extract the image statistics. Then, the characteristics of humans SHITSUKAN recognitions from across the world will be associated with the culture-specific image statistics. Thus, we will reveal how visual environment of the culture where one is born and raised contributes to one's SHITSUKAN recognitions.

D01-4_overview_e.jpg

D01-6 ASMR-inducing sounds as sensual, emotional media

Principal Investigator : Masashi Nakatani(Faculty of Environment and Information Studies, Keio University)

Masashi Nakatani

Principal Investigator

Faculty of Environment and Information Studies, Keio University

Masashi Nakatani


Outline

This study utilizes ASMR-inducing sounds for SHITUKAN study. ASMR stands for Autonomous Sensory Meridian Response, which produces sensual feeling when it is heard. ASMR-inducing sounds are known to produce chilling and relaxing feelings. This phenomenon may be associated with profound feelings when hearing moving music; however neural mechanism of producing ASMR is still unknown. By examining ASMR-inducing sounds, this research aims at uncovering SHITUKAN of sounds. For this objective, first, this study plans to collect ASMR-inducing sounds by recoding human voice, material-inducing, or natural sounds to establish ASMR sound library. Second, audio signal analysis is conducted for collected ASMR-inducing sounds to recapitulate acoustic characteristics in these audio sources. This study also plans to conduct human experiments in order to obtain both subjective ratings and physiological measures while hearing ASMR-inducing sounds.

D01-6_overview.jpg

D01-7 Understanding SHITSUKAN recognition mechanisms in auditory perception based on concept of amplitude modulation

Principal Investigator : Masashi Unoki(Japan Advanced Institute of Science and Technology)

Masashi Unoki

Principal Investigator

Japan Advanced Institute of Science and Technology

Masashi Unoki


Outline

Human beings should be perceived auditory SHITSUKAN of an object from its corresponded acoustical features without predicting room acoustic information when they perceived the objective sound in our daily environments. In the room acoustics, speech transmission index is used to assess quality and intelligibility of the objective sound in terms of modulation characteristics. It can be regarded that physical information of amplitude modulation plays an important role of accounting for perceptual aspect of SHITSUKAN by incorporating concept of modulation perception with the room acoustics. This study aims to understand SHITSUKAN recognition mechanisms in auditory perception of the objective sound in room acoustics. In particular, the following three points will be investigated: (1) what are the physical features related to roughness in auditory SHITSUKAN recognition, (2) whether perceptual aspect related to the room acoustics affects to auditory SHITSUKAN recognition of the objective sound, and (3) whether human beings recognize auditory SHITSUKAN of the objective sound by separating out the room acoustic information.

D01-7_overview_e.jpg

D01-8 Identification of Neural Substrates Representing Deliciousness

Principal Investigator : Koshi Murata(Department of Brain Structures and Functions, Faculty of Medical Sciences, University of Fukui)

Koshi Murata

Principal Investigator

Department of Brain Structures and Functions, Faculty of Medical Sciences, University of Fukui

Koshi Murata


Outline

Delicious food is essential for enriching our lives. However, it is still unclear whether and how the brain creates subjective feeling of deliciousness. In this study, we define the deliciousness as the hedonic quality of food that reinforces eating the food. By mouse genetic engineering, we reveal the neural substrates representing deliciousness.

D01-8_overview_e.jpg

D01-9 High-precision shitsukan memory: Psychological and neural mechanisms

Principal Investigator : Jun Saiki(Graduate School of Human and Environmental Studies, Kyoto University )

Jun Saiki

Principal Investigator

Graduate School of Human and Environmental Studies, Kyoto University

Jun Saiki


Co-Investigator

Graduate School of Human and Environmental Studies, Kyoto University
Hiroki Yamamoto

Graduate School of Human and Environmental Studies, Kyoto University
Hiroyuki Tsuda

Graduate School of Human and Environmental Studies, Kyoto University
Munendo Fujimichi

Outline

Memory for shitsukan is crucial to understand the discrepancy between our precise and vivid shitsukan perception and difficulty in its expression. Based on our previous work indicating that precision of visual short-term memory for glossiness of object surfaces is extremely high, we aim at elucidating its psychological and neural mechanisms. Through comparisons of (1) memory and perception, (2) surface properties and illumination information, and (3) glossiness and elementary visual features, we will figure out unique properties of glossiness memory. Also, we try to identify brain regions containing glossiness memory by fMRI and MVPA. Unique properties of shitsukan memory may raise a problem of restructuring the notions of perception and memory. Our project also tries to provide some clues for creating techniques of visualing subjective shitsukan information such as retrieval and expression of shitsukan memories.

D01-9_overview_e.png

D01-10 Encoding, decoding, and representation of textures by a population of cortical neurons

Principal Investigator : Ichiro Fujita(Osaka University Graduate School of Frontier Biosciences and Center for Information and Neural Networks)

Ichiro Fujita

Principal Investigator

Osaka University Graduate School of Frontier Biosciences and Center for Information and Neural Networks

Ichiro Fujita


Co-Investigator

Osaka University Graduate School of Frontier Biosciences
Mikio Inagaki

University of Yamanashi Graduate School of Interdisciplinary Research
Koji Ikezoe

National Institute of Information and Communications Technology,
Center for Information and Neural Networks
Shinji Nishimoto 

Outline

Objects have their specific visual properties on their surfaces (textures and material properties). Humans and non-human primates exploit this information for recognition and manipulation of objects. We explore the role of a mid-tier cortical area, V4, in processing texture information. Specifically, we address if V4 neurons as a population carry information sufficient for supporting texture perception, how this information is represented in V4 and interacts with other visual information, and how the representation in V4 differs from that in earlier areas such as V1 and V2. Through these efforts we aim to advance our understanding of the neural basis for texture perception.

D01-11_overvuew_e.jpg

D01-11 Single shot BRDF estimation and SHITSUKAN analysis

Principal Investigator : Hajime NAGAHARA(OSAKA UNIVERSITY)

Hajime NAGAHARA

Principal Investigator

OSAKA UNIVERSITY

Hajime NAGAHARA


Outline

We proposes to capture BRDF by using a light field camera and analyze it for understanding SHISUKAN of an object. We models reflections of rays on the object surface and observation of the rays by a light field camera. The proposed method simultaneously estimate the object shape and its BRDF by comparing with the captured image from the light field camera and generated image of the model. The proposed method can capture BRDF from single light field image without knowledge of the object shape. We also proposes the analyzing method of the BRDF for parameterizing and evaluating its SHITSUKAN. We are expecting to apply to various applications, since the proposed method realizes easer methodology to capture BRDF from single light field camera while regular BRDF capturing is time consuming and requires to laboratory environment.

D01-11_overview.png

D01-12 The Development of Multisensory Processing in Shitsukan Information

Principal Investigator : Masami K. Yamaguchi(Department of Psychology, Chuo University)

Masami K. Yamaguchi

Principal Investigator

Department of Psychology, Chuo University

Masami K. Yamaguchi


Co-Investigator

Department of Psychology, Japan Women's University
So Kanazawa

Department of Life Sciences, The University of Tokyo
The Japan Society for the Promotion of Science
Jiale Yang

Department of Information Science and Biomedical Engineering, Kagoshima University
Wakayo Yamashita

Research and Development Initiative, Chuo University
Yuta Ujiie

Department of Psychology, Chuo University
The Japan Society for the Promotion of Science
Kazuki Sato

Outline

Our goal is to understand the mechanism of SHITSUKAN perception by exploring the developmental process of multisensory integration. We will test the infants how to integrate the information from different modalities and investigate whether they can use these integrated information to discriminate materials by behavioral experiments and brain measurement. Additionally, we will investigate how the ability of multisensory integration affects the prelinguistic infants' acquisition of sound symbolism and language, which implies how we categorize the material perception in the cognitive system.

D01-12_overview.png

D01-13 SHITSUKAN perception and recognition in chimpanzee from the perspectives of comparative and cognitive science.

Principal Investigator : Tomoko Imura(Niigata University of International and Information Studies)

Tomoko Imura

Principal Investigator

Niigata University of International and Information Studies

Tomoko Imura


Co-Investigator

Primate Research Institute, Kyoto University
Masaki Tomonaga

Outline

Why is it that humans can apprehend different material and surface qualities through SHITSUKAN perception? To answer such a question, it is necessary to explore the uniqueness and ecological validity of human SHITSUKAN perception as well as its functional and computational mechanisms. In this study, we will explore whether chimpanzees can distinguish differences through SHITSUKAN, which is vital for survival, and we will compare this ability with that of humans. We will focus on the perception of food quality and various kinds of materials, and on skin texture and facial color, which can provide essential indicators for sex, age, and health conditions in humans. Based on our findings, we will be able to demonstrate the evolutionary origin and special characteristics of human SHITSUKAN perception from the perspectives of comparative and cognitive science.

D01-13_overview_e.png

D01-14 Neural correlates of onomatopoeia that expresses Shitsukan of touch

Principal Investigator : Ryo Kitada(National Institutes for Physiological Sciences)

Ryo Kitada

Principal Investigator

National Institutes for Physiological Sciences

Ryo Kitada


Outline

The direct contact with an object provides a wealth of physical information on the object. Previous psychophysical researches suggest that tactually perceived object properties can be explained by a few of perceptual dimensions such as softness and roughness. However, tactile experience in our daily life is complex and not simply explained by these dimensions. Instead of simple perceptual dimensions, we often use onomatopoeia like "fukafuka". Thus, in order to understand mechanisms of tactile material perception, we need to understand the mechanisms that translates extracted material properties into language expressions such as onomatopoeia. Given this background, the main goal of this research is to understand the neural basis wherein physical softness is extracted and then translated into relevant onomatopoeia.

D01-14_overview_e.png

D01-15 Neural mechanism of liquid motion perception

Principal Investigator : Takahisa Sanada(KANSAI MEDICAL UNIVERSITY)

Takahisa Sanada

Principal Investigator

KANSAI MEDICAL UNIVERSITY

Takahisa Sanada


Outline

Goal of this study is to reveal neural representation of liquid motion. Computing feature of complex motion might be necessary to identify non-solid materials such as liquid. We will measure neural characteristics of complex motion using visual stimulus developed based on image statistics that relate to spatial smoothness of local motion vectors. Electrophysiological recording will be conducted in higher visual areas such as MT/FST, which receive local motion signals. By comparing neural properties for complex motion across areas, functional role of these areas for liquid motion perception will be studied.

D01-15_overview.jpgのサムネイル画像

D01-16 Subjective valuation on edible insects as novel foods

Principal Investigator : Yuji Wada(Ritsumeikan University )

Yuji Wada

Principal Investigator

Ritsumeikan University

Yuji Wada


Co-Investigator

Food Research Institute, National Agriculture and Food Research Organization
Akihiro Miyanoshita

Food Research Institute, National Agriculture and Food Research Organization
Fumiyo Hayakawa

College of Risk Management, Nihon University
Atsushi Kimura

Faculty of Arts and Science, Kyushu University
Yuki Yamada

Faculty of Human Science Department of Psychology, Bunkyo University
Tomohiro Masuda

Department of Educational Psychology, Shujitsu University
Kazunori Iwasa

Outline

Recently, most Japanese do not consume insects as food, and some consumers find insects disgusting even to look at. However, even today, some insects are marketed as food in some local areas. People who consume edible insects might recognize them as food without disgust. Here, we assumed that one of the determining factors of consumers' emotional valuation of edible insects is eating habits. The present study elucidated whether daily eating habits are related to implicit and explicit attitudes toward visual images of edible insects. Furthermore, we examined whether the experience of eating insects can trigger a consumer's acceptance of edible insects as food.

D01-16_overview_e.png

D01-17 Neural processing of gloss-related information in marmoset visual cortex

Principal Investigator : Naohisa Miyakawa(National Institute of Radiological Sciences,National Institute for Quantum and Radiological Science and Technology)

Naohisa Miyakawa

Principal Investigator

National Institute of Radiological Sciences,National Institute for Quantum and Radiological Science and Technology

Naohisa Miyakawa


Co-Investigator

Department of Ultrastructural Research, National Institute of Neuroscience, National Center of Neurology and Psychiatry
Lab for Molecular Analysis of Higher Brain Functions, Ichinohe group
Noritaka Ichinohe

Department of Ultrastructural Research, National Institute of Neuroscience, National Center of Neurology and Psychiatry
Wataru Suzuki

Outline

We previously found a cluster of neurons in area FSTv of common marmoset visual cortex that respond selectively to gloss images. Neurons in area MTc subregion that projects strongly to FSTv gloss area also responded to gloss images. However, response of MTc neurons could be explained by low-level image statistics more robustly than those of FSTv neurons. To evaluate the role of this gloss-selective neural circuit, we will investigate 1) dependency of FSTv gloss-selectivity on input from MTc, 2) dependency of gloss perception on FSTv activity, and 3) dependency of gloss perception on input from MTc to FSTv, using optogenetical and/or pharmacological approaches.

D01-17_overview_e.png

D01-18 Effect of Shitsukan on temporal processing stages of facial information

Principal Investigator : Yasuko Sugase-Miyamoto(National Institute of Advanced Industrial Science and Technology (AIST))

Yasuko Sugase-Miyamoto

Principal Investigator

National Institute of Advanced Industrial Science and Technology (AIST)

Yasuko Sugase-Miyamoto


Co-Investigator

National Institute of Advanced Industrial Science and Technology (AIST)
Narihisa Matsumoto

Kyoto University
Kenji Kawano

Outline

In our social life, we can easily recognize a face and its individual identity, age and physical conditions from the configuration of facial parts and Shitsukan information. This ability is assumed to be based on neural processing in areas participating in the analysis of visual characteristics of faces in the temporal lobe of both humans and monkeys. To understand neural processing of Shitsukan information of faces, especially about the effect of Shitsukan on temporal processing stages of facial information, we examine neural activity in the macaque temporal lobe.

D01-18_overview_e.png

D01-19 Investigating the mechanisms of SHITSUKAN perception of food by using pseudo-mastication feedback sounds generated from EMG signals

Principal Investigator : Waka Fujisaki(National Institute of Advanced Industrial Science and Technology (AIST))

Waka Fujisaki

Principal Investigator

National Institute of Advanced Industrial Science and Technology (AIST)

Waka Fujisaki


Co-Investigator

National Institute of Advanced Industrial Science and Technology (AIST) 
Hiroshi Endo

National Institute of Advanced Industrial Science and Technology (AIST)
Shuichi Ino

Outline

SHITSUKAN perception is not merely the processing of information input from a variety of sensory modalities; it results from multimodal, adaptive, and active processes including prediction, decision-making, body motor control, and sensory-motor feedback. Perception of food textures is the optimal subject matter to investigate such processes because sensory feedback information arising from active eating behavior contributes greatly to food texture perception. Several studies have used auditory feedback of mastication sounds to influence participants' perception of food textures. However, these studies were limited either by only allowing the examination of brittle foods, or by not providing perfectly synchronized sounds. We recently solved these problems: we converted the masseter muscle's EMG waveforms during mastication to an acoustic signal and provided this sound to participants as real-time feedback. This method enables feedback of perfectly synchronized mastication sounds for foods with different physical properties. In this study, we aimed to reveal the mechanisms of human perception of a wide range of food textures via a series of experiments using an updated version of our method.

D01-19_overview_e.JPG

D02 Development of innovative Shitsukan technologies

D02-1 Haptic-illusion-based touchscreen display with multi-degree-of-freedom output

Principal Investigator : Satoshi Saga(University of Tsukuba)

Satoshi Saga

Principal Investigator

University of Tsukuba

Satoshi Saga


Co-Investigator

University of Tsukuba
Hiroaki Yano
D02-1_矢野氏(嵯峨班).jpgのサムネイル画像

Outline

In recent years, with the popularity of smartphones expectations for haptic technology are increasing. However, touch interaction with a displayed virtual object is still not an intuitive one. This is because that, the haptic sensation itself is interactive sensation with inputs and outputs, though, the touch screen is widely used only as an input device. Here, we aim at realizing intuitive and interactive haptic operation with virtual objects.
The purpose of this study is as follows; first, we will develop a multi-degree-of-freedom haptic display by employing multiple electrodes. Our haptic display enables bump and texture feeling using lateral force. We extend the feelings to multi-degree-of-freedom using electrostatic force. Second, we will develop soft expression or dynamic representation of it by contact area control. These two directions will realize intuitive feeling of contact moment and soft feeling on the touch screen.

D02-1_overview_e.png

D02-2 Rewritable texture by energy projection and chromic ink

Principal Investigator : KOIZUMI Naoya(The University of Electro-Communications)

KOIZUMI Naoya

Principal Investigator

The University of Electro-Communications

KOIZUMI Naoya


Outline

For digital fabrication of SHITSUKAN, we aim to realize a texture mapping method based on light control type energy projection. In the computer graphics, we can easily control the texture of the 3D model. If we can do the same action in the real world, it is the merging of real and virtual worlds. The basic idea of this research is a combination of the chromic paint and the energy-projector. Energy-projector emits UV light or heat to a target that covered with chromatic ink, which color is changed by the energy absorbing. In this study, I combine these two key components to edit surface property of real object.

D02-2_overview.jpg

D02-3 Dynamic appearance reproduction based on high-speed vision and high-speed display

Principal Investigator : Yoshihiro Watanabe(The University of Tokyo)

Yoshihiro Watanabe

Principal Investigator

The University of Tokyo

Yoshihiro Watanabe


Outline

The visual information perceived by actively changing the positions of viewpoints, objects and lights has a crucial role for the deep understanding of the materials. However, it is difficult to reproduce this type of visual perception virtually on the real world. The bottleneck is in the temporal and spatial inconsistency between the real world, somatic sensation and virtual reproduction. In this research, we aim to overcome this bottleneck using high-speed sensing and display technologies. In particular, we develop a system fusing the dynamically-changing real world and virtual appearance perfectly at the level of human perception based on the 1,000fps/ms-order-latency high-speed image sensing and projector. The performance of the elemental technologies exceeds the limitation of human perception and the non-restraint and non-contact configuration for user interaction is provided. This dynamic appearance reproduction technology is expected to take the conventional approaches limited in static or quasi-static environment to the next level.

D02-3_concept_e.png

D02-4 Technology for Evoking Pseudo-haptics with a Touch Screen Interface and Its Application for Designing Haptic Feeling

Principal Investigator : Takuji Narumi(The University of Tokyo)

Takuji Narumi

Principal Investigator

The University of Tokyo

Takuji Narumi


Co-Investigator

The University of Electro-Communications
Koichi Hirota

Outline

This research proposes new approach for evoking illusory haptic perception (pseudo-haptics) with touch screen interface. Conventionally, modifying the pointer or the user's body has been the key to inducing pseudo-haptic perception in the desktop environment. It is difficult to apply this approach to the interactions on touch interfaces, where the finger and pointer are co-located. However, we observed that while scrolling down the background image, the users recognize the image as an object, which is a target of interaction, and not as an object that is the extension of users themselves. The purposes of this research project are modeling this novel pseudo-haptic effect, and realizing technologies for designing haptic feeling based on pseudo-haptic feedback with a touch screen interface. This project also aims to seek design approach of the effect of haptic feelings such as attentional guidance and evoking emotions.

D02-4_overview.jpg

D02-5 A study on the innovative perceptual material editing by apparent BRDF manipulation regarding Nishijin textiles made with brocade

Principal Investigator : Toshiyuki Amano(Wakayama University)

Toshiyuki Amano

Principal Investigator

Wakayama University

Toshiyuki Amano


Co-Investigator

Osaka Institute of Technology
Shun Ushida

Kyoto University
Goshiro Yamamoto

Outline

The object's color which we perceive can be affected not only by the object's reflectance property, but also by illuminations that project onto it. Additionally, perceptual color and material properties of the object that has anisotropic reflection property can be affected by the incoming illumination direction. Therefore, precisely controlled luminance, illumination color and its direction can manipulate object's color and material perception in our perception.
In this research, we attempt to develop a novel projection display technique which employed the light field projection and measurement of its reflection in the closed feedback loop regarding "Hikibaku" that is a Nishijin textile made with brocade. For this purpose, we attempt to establish an analytical method of BRDF (Bidirectional Reflectance Distribution Function) using compressed sensing techniques with the light field projection. Then, we develop an apparent BRDF manipulation method in the closed feedback loop. Finally, we grope innovative material appearance representation methods based on the apparent BRDF manipulation technique.

D02-5_overview.png

D02-6 Image-Based Modeling and Rendering of Fluorescent Materials Using Multispectral and Multidirectional Light Sources for SHITSUKAN Analysis

Principal Investigator : Takahiro Okabe(Kyushu Institute of Technology)

Takahiro Okabe

Principal Investigator

Kyushu Institute of Technology

Takahiro Okabe


Outline

We aim to develop a technique for editing SHITSUKAN of fluorescent materials. Fluorescent materials have unique SHITSUKAN because their photometric properties depend not only on the direction but also on the color of a light source. Accordingly, we make use of a set of images of a fluorescent material taken under multispectral and multidirectional light sources, and then acquire its geometric and photometric properties via Image-Based Modeling (IBM) and synthesize its photorealistic images under arbitrary illumination conditions via Image-Based Rendering (IBR). In addition, based on the acquired model via IBM and the images themselves for IBR, we develop a method for editing SHITSUKAN of fluorescent materials.

D02-6_overview_e.png