It is important to know the mental states of learners during the learning process to improve the effectiveness of teaching and learning. In this study, we first extracted the relationships between learners' mental states and teachers' speech acts, as well as learners' physiological information, by constructing a deep learning system. The physiological indexes were near infrared spectroscopy (NIRS), electroencephalography (EEG), respiration intensity, skin conductance, and pulse volume. Learners' mental states were divided into nine categories in accordance with the Achievement Emotions Questionnaire. In our experiment, the system achieved a high accuracy in predicting the learner's mental states from the teacher's speech acts and the learner's physiological information. A mock-up experiment was then conducted, which revealed that the system's interface was able to support teaching and learning in real time.

Typically, it is difficult to transmit visual images in words. The transmission of the visual image includes various information. Therefore, efficient communication is necessary. In this research, we focused on the relationship between onomatopoeia and modalism, and conducted a survey to measure the distance. We asked for general group and design skill holding group. Transmission of visual image in communication, we collected 200 words of onomatopoeia that are frequently used. Then we carried out relevance research on sensory modality, using the MD (Modal Differential) method. Then, we conducted a hierarchical cluster analysis and the semantic structure analysis which is called as SS analysis. As a result, we drew the SS graph for each cluster, which shows the relevance and order-related structure. The results were compared between the general group and the design skill preservation group, and discussions were made on the differences depending on the attributes of the subjects.

The purpose of the present study was to examine sequential relations between items of the Value-Intention Scale (VIS), which measures 6 types of personal values based on Spranger's (1950) theory. An analysis method, Sequential Relation Analysis (SRA), was developed to enable judgments of sequential relations between items. In Sequential Relation Analysis, each pair of items is examined to determine whether the relation between them is sequential or equal. If there is a higher correlation and a larger mean difference between them than the defined criteria, the relation between them is judged to be sequential. If there is a higher correlation and a smaller mean difference than the defined criteria, the relation between them is judged to be equal. Treegrams were drawn to enable visualization of the sequential and equal relations. Participants (320 university students: 156 men, 164 women
average age, 20.0 years) completed the Value-Intention Scale. Sequential Relation Analysis was applied to the resulting data. Six treegrams for the 6 subscales (theoretical, economic, aesthetic, religious, social, and political) of the Value- Intention Scale were drawn. Some characteristic sequential relations were found, which accords with Spranger's theory.

Decision making acts as the basis of our behaviors. This study aims to experimentally clarify how environments influence the risk evaluation stages in humans' decision-making processes. Because color is an environmental attribute which can affect human temperament, we conducted a psychological experiment to investigate if environmental colors can influence humans' risk evaluation. Given that the Iowa Gambling Task (IGT) is a widely-used measure of risk-taking propensity, we analyzed the subjects' IGT net scores and the subjects' choice behaviors that they took after their big losses. These behaviors were considered ordinary in both daily-life environments and specially colored environments. The results showed that the subjects in the blue room tended to be conservative. Conversely, the subjects in the red room tended to take risks. It suggests that red environments may inhibit positive affect.

The focus of this paper is the reading process of sound translation. Reading process of sound translation is a process of replacing information of a symbolic language written on a visual copyrighted work with information of a speech language. And, it is considered that the pause of time interval inserted in the speech sound performs an important function of replacing formal information of the symbolic language expressed depending on the sense of sight with information of the speech language. To clarify the function of this interval, experiments was conducted using synthetic speech; which controlled paralinguistic information. The subjects were the interval of punctuation marks and bracket signs, which replace the formal sign of the symbolic language with the interval. As a result of experiments, synthetic speech in which the interval used by transliteration persons was reflected in punctuation marks and bracket signs was evaluated as appropriate as a talking book.

With the ongoing development of information and communications technology, it is apparent that computers will be indispensable partners in future human life. In terms of computer information processing, techniques for coordinating human sensitivity and emotional levels are attracting attention and stand in contrast to conventional knowledge information processing. In this chapter, we present an overview of content-oriented research considering knowledge itself and describe an approach to handling knowledge of human sensitivity and emotions using computers. First, we provide an overview of existing content-oriented studies in the field of artificial intelligence (AI). Second, we discuss problems regarding the handling of knowledge of human sensibilities and emotions. Then, we introduce an ontology pertaining to the concept of color emotion as an approach to understanding human sensibilities and emotions. Finally, we describe the applicability of such an ontology to human-computer interactions and for the understanding of human nature through the concept of analysis-by-synthesis.

In this research, a computational model that simulates the mental function of multicolor aesthetic evaluation through backpropagation neural networks was constructed. Helmut Leder's psychological model served as the theoretical framework. We determined the macro-architecture of the computational model through two psychological experiments using the semantic differential (SD) method. The aesthetic score of a multicolor stimulus is defined as the inverse of its factor score on the factor "Pleasure" extracted in the first experiment, and each of the three factors extracted in the second experiment-i.e., "Stability," "Heaviness," and "Presence"-is regarded as a simple perceptual feature. The genetic algorithm was then employed to optimize the hidden layer node number, the learning rate, and the momentum constant of each neural network. In two simulation tests, this computational model exhibited some predictive power, implying that the model can be regarded as a relatively successful approximation of the psychological mechanism of multicolor aesthetic evaluation. In addition, the results of the second simulation also show that the perceptual feature "Heaviness" possesses the principal impact on the aesthetic evaluation of multicolor objects, whereas the other two perceptual features "Stability" and "Presence" have a minor influence. The heavier and/ or more stable a multicolor object is perceived to be, the less aesthetically pleasing it is. Conversely, the stronger the sense of matter presence a multicolor object elicits, the more aesthetically appealing it is. (C) 2016 Wiley Periodicals, Inc.

Many people have experienced that even long after their graduation, their school songs can still evoke nostalgia of their old school days. In this study, we proposed a psychological model of the generation mechanism underlying the school-song-evoked nostalgic feelings. Firstly, we extracted the terms characteristic of school songs from the lyrics of 156 Japanese school songs. Then, we investigated how the number of years that had elapsed since graduation influenced the degrees of school-song-evoked nostalgic feelings through questionnaires. Finally, we conducted an experiment in which the participants were asked to rate the “school-songness” of the lyrics of four existing school songs as well as an “average school song” which we made using the terms extracted at the first stage of the study. The results show that the “average school song” ranks highest, which implies the properness of our model.

Recently, the viewpoint of service has become widespread. In learning domains, service providers have been required to adopt the viewpoint and to provide values co-created by teachers and learners. However, production by a service provider means the generation of potential value, whereas usage by a service receiver implies the generation of real value. That is, a receiver creates value independent of the value generated by a provider. Indeed, value co-creation takes place in a joint sphere where providers and customers interact with each other. Thus, service providers must attempt to generate the potential value through service design and play a role of co-producer of the real value in the interactions between the providers and the receivers. In the current study, we developed an ontology to share the knowledge on value co-creation and the information related to the interactions between the providers and the receivers. In concrete terms, we proposed ontological descriptions of receiver states for sharing knowledge in learning service design, and conceptualized elements of consensus building and value co-creation, according to the conceptual model of value co-creation proposed in a previous study. In addition, concepts pertaining to academic emotions are also described to represent contents of consensus building. Then, we demonstrated instances of a consensus building, which is extracted from conversations during counseling by a teacher (mentor) and a learner. As a result, we obtained a metamodel for co-design processes in the learning service design, and a conceptual framework of the knowledge sharing on learning states including academic emotions by the ontological descriptions.

<p>Recently, value creation from view point of service has been widespread. A service process is regarded as a kind of interaction between service providers and receivers. Sharing and managing such the knowledge on human Kansei are of growing significance to providing product's values focused on customers. However, any sufficiently-advanced technologies that realize such knowledge sharing and management have been established. One typical approach is to clarify and systematize concepts as an ontology which is a basis to describe knowledge. In the current study, we discuss a method to develop an ontology describing knowledge on human Kansei and introduce several existing ontologies. The ontology will serve as a useful reference to develop value recognition map and be of assistance to designers.</p>

The uncanny valley is a major phenomenon that occurs during the implementation of facial expressions in a humanlike agent. Recent studies have explained that the negative impression of the agent's expressions is a "prediction error." We hypothesized that the prediction error stemmed from the differential output of dual processing, - that is, emotional and rational processing, - and it negatively affected a person's impression of the facial expression of the agent, which was similar to that when perceiving an eerie sensation. A qualitative computational model was proposed to clarify this mechanism according to cortico-cerebellar function to compute the prediction of the humanlike agent's facial movement. Thus, rapid emotional processing was indispensable with the thalamus playing an essential role in the processing.

In order to improve the efficiency of teaching and learning, it is very important to grasp learners' mental states during their learning processes. In this study, we attempt to extract and formalize the relationships between learners' mental states and learners' physiological information complemented with teachers' speech acts using the association rule mining technique through an experiment. As a result, four sets of association rules with high degrees of generality are obtained.

In order to improve the efficiency of teaching and learning, it is very important to grasp learners' mental states during their learning processes. In this study, we attempt to extract and formalize the relationships between learners' mental states and learners' physiological information complemented with teachers' speech acts using the association rule mining technique through an experiment. As a result, four sets of association rules with high degrees of generality are obtained.

Improving added value and productivity of services entails improving both value-in-exchange and value-in-use. Value-in-use is realized by value co-creation, where providers and receivers create value together. In higher education services, value-in-use comes from learners achieving learning outcomes (e.g., knowledge and skills) that are consistent with their learning goals. To enhance the learning outcomes of a learner, it is necessary to enhance and utilize the abilities of the teacher along with the abilities of the learner. To do this, however, the learner and the teacher need to build a consensus about their respective roles. Teachers need to provide effective learning content; learners need to choose the appropriate learning strategies by using the learning content through consensus building. This makes consensus building an important factor in value co-creation. However, methods to build a consensus about their respective roles may not be clearly established, making such consensus difficult. In this paper, we propose some strategies for consensus building between a teacher and a learner in value co-creation. We focus on a teacher and learner co-design and propose an analysis method to clarify a collaborative design process to realize value co-creation. We then analyze some counseling data obtained from a university class. This counseling aimed to build a consensus for value-in-use, learning outcomes, and learning strategies between the teacher and the learner.

Recently, view point of service has been widespread. In learning domains, service providers have been required to adopt it and to provide values co-created by teachers and learners. The value co-creation takes place in joint sphere where providers and customers make interaction, and the value is subjectively perceived by receivers (learners in learning service). That is, a mental state of leaner is one of possible value in the co-creation. The current study aims to develop a conceptual framework which describes mental states of learners for specifying values in the co-creation. As a result, we proposed ontological descriptions of learning event which consists of a teacher, a learner, learning materials, and a learning action by the learner. In concrete terms, we proposed ontological descriptions for receiver states in a learning activity, on the basis of a conceptual model of value co-creation. The ontological descriptions are useful for sharing knowledge on values perceived by learners to design learning services.

In the research field of Human-agent interaction, the uncanny valley is the crucial issue to realize co-existence of human and artificial agents. It is referred to as the phenomenon that human can feel repulsive against the agents whose appearance is considerably humanlike. There has been just theoretical based but not verifiable model providing an explanation for how it occurs. We hypothesized that when human observes that humanlike agent, s/he perceives it as both human and non-human, and the contradiction between the perceptions causes him or her to elicit negative response against it. We conducted the experiment where the participants were asked to judge whether face of agents or a person was depicted as that of a real person, with their eye tracked and their gaze direction estimated. The results indicated that observers had two-step information processing to the agent. Above all, we proposed a model generating the human negative response against humanlike agents, taking into consideration of the function of the brain regions such as amygdala, prefrontal cortex, hippocampus, and striatum. To verify the model, the transition of the emotional value (namely, positive or negative) was simulated on the basis of a qualitative description for the model. It is suggested that the model be proposed which is verifiable with many findings in the field of neuroscience.

Estimation of learners' mental states during the interaction between teacher and learners is very important issues from quality of learning environment design point of view. In this experimental study, relationship between teacher's utterances, behaviors, learner's physiological indexes and mental states were tried to be detected by the association rule detection method. After that some additional trials to formalize relations between mental states and some physiological information of learner were carried out. As a result, some meaningful generalized rules have been detected.

<p>近年日常的にエージェントが利用されるようになり、今後はエージェントとしてのロボットの普及が加速すると推測される。当該状況下では、人ーエージェント間のインタラクション時の人への負担を軽減することが、普及を促進する上で非常に重要になる。本研究では、人ーエージェント間のインタラクションを負担が軽いと推測される人間のインタラクションに近づける目的で、人が表出する特徴的キューを特定する心理実験を行った。</p>

<p>本研究では、多色配色に対する審美的評価ルールをシミュレートする計算モデルをBPニューラルネットワークで構築した。SD法の心理学実験を通して理論的枠組みであるHelmut Lederの心理学モデルを定量化し、それに基づき計算モデルの構造を決定し、学習率などのシステムパラメータを遺伝的アルゴリズムによって最適化した。性能テストの結果、本計算モデルは多色配色の審美的評価値に対して高い予測能力を有した。</p>

<p>高等教育においては，教育サービスの提供者と受給者が目標とする学習成果についての合意形成を行うことで，高い利用価値を共創的に実現することが期待される．本研究では，合意形成の過程を可視化するために，合意された話題の意味内容の概念化を試みる．具体的には，メンターと学習者のカウンセリング事例を取り上げ，サービス提供者，受給者，コンテンツ・チャネルとして発話内容を位置づける．</p>

<p>本研究では，テーマパークにおいて携帯情報端末を用いて混雑情報を取得することができる来場者の満足度を，マルチエージェントシミュレーションを用いてモデル化した．具体的には，期待不一致モデルをもとに，アトラクションに対する効用とアトラクションに並ぶ行列人数とのトレードオフの関係を考慮するようなモデルを構築した．その上で，来場者の満足度向上の観点からテーマパークにおける混雑情報の提供方法を検討する．</p>

The purpose of this study is to show the characteristic of "pause of time interval" that is put into the speech when Transliteration-Person reads books out to visually impaired people. Transliteration-Person needs to express also what kind of structure it is as well as to read symbolic language on books out. It may be presumed that "pause of time interval" plays an important role such that auditory sentence structure makes similar to visual sentence structure. So, we focused on punctuation marks and made an experiment comparing 5 skilled Transliteration-Persons with 4 beginner Transliteration-Persons. The result of our experiment shows that "pause of time interval" for punctuation marks is paralinguistic information putting in their speech to construct auditory sentence structure, because the skilled Transliteration-Persons put in their speech different "pause of time interval" to play 2 different type of sentence structure.

When a company or an individual disseminate their information on advertising and sales promotion. Between several people who is a client and a designer or a designer and an illustrator and a photographer have a scene to share the visual image. In the transmission communication of visual image, onomatopoeia is able to convey information with a sense of reality. Onomatopoeia because the words that are interpreted by the sense modality. (the sense modality : Visual, Auditory, Olfactory, Gustatory, Tactual) Therefore, in this study, it was intended from association with sensory modality of onomatopoeia in the transfer communication of visual image, and to clarify the relational structure of onomatopoeia. Elucidation of the semantic structure was included ambiguity of onomatopoeia. It will enable the discussion about how to use and understandable meaning of onomatopoeia. The onomatopoeia of 200 words were investigated by the MD method and analyzed using the SS analysis and cluster analysis. And we assume that the semantic interpretation is determined by the strength of the association of the Modal. I discussed the rank structure. As a result, it is considered onomatopoeia of the group that there is a direction of understanding meaning is effective communication to convey the impression with vague. In addition, differences were observed in the technique of description and usage, selection onomatopoeia between expert and novice. It depends on skills and knowledge.

Sharing and managing knowledge on human Kansei obtained in several study fields are of growing significance to providing product's values focused on customers. However, few sufficiently-advanced technologies that realize such knowledge sharing and management have been established. One typical approach is to clarify and systematize concepts as an ontology. In the current study, we developed an ontology to describe correspondence of affective meaning spaces analyzed by semantic differential method. First, we collect literatures reveal the affective meaning evaluated through the five senses and their inter-modality. Second, we described the concepts on the basis of an ontology of color emotions. Then, we demonstrated and evaluated the usefulness of the ontology in a design situation. As a result, we confirmed that the ontology will serve as a useful reference and be of assistance to designers.

This is research on "Pause" in the speech language producing from a printed book by Transliteration Person: Transliteration Person produces a talking book for visually-impaired people from a printed book. "Pause" on the speech language is required faithful to original printed book, because Transliteration Person has to reproduce the author's intention. So we experimented in how to use "Pause" on the speech language with Transliteration Person. As a result, it was shown that "Short Pause" inserted by Transliteration Person is important to produce faithful talking book from original printed book: "Short Pause" is 0.5 second or less. In the future work, we would like to show clearly that "Short Pause" is concerned with comfortable rhythm and tempo for faithful speech language from original printed book.

The color research has much interest in exploring emotional responses to color stimuli, which are referred to as color emotions. In general, color emotions are measured through psychological methods and represented as values on rating scales. For further understanding of color emotions and development of their effective application, conceptual structure of color emotions and rating scales need to be shared among various disciplinary fields. One typical approach in sharing such knowledge is to clarify concepts as an ontology. In this paper, we specified color emotions based on psychological attributes and built an ontology with an ontology development environment Hozo and a top-level ontology YAMATO. As a result, our ontology describes 16 psychological attributes which are measured by rating scales on the basis of a concept of human awareness. Approximately 74.7 percent of instances of the psychological attributes, which are frequently used in articles on measurement of color emotions, are accounted by the 16 psychological attributes. By adding descriptions of psychological attributes which are infrequently used and have not been fully elucidate in the color research, our ontology would increase utility for knowledge sharing and be feasible in prompting scientific and engineered approaches to understand human mind.

Why does human can identify a facial caricature with its model’s face? We hypothesize that a facial caricature has an effect on a person’s memory representation of the model’s face to get closer into the facial caricature itself, which causes a person to evoke the feeling of similarity between the model’s face and its facial caricature. In this point, we conducted the experiment to verify whether the continuous exposure of a facial caricature changes participants’ memory representation and whether the exposure also evokes participants’ feeling of similarity between them.

The color research has much interest in exploring emotional responses to color stimuli, which are referred to as color emotions. In general, color emotions are measured through psychological methods and represented as values on rating scales. For further understanding of color emotions and development of their effective application, conceptual structure of color emotions and rating scales need to be shared among various disciplinary fields. One typical approach in sharing such knowledge is to clarify concepts as an ontology. In this paper, we specified color emotions based on psychological attributes and built an ontology with an ontology development environment Hozo and a top-level ontology YAMATO. As a result, our ontology describes 16 psychological attributes which are measured by rating scales on the basis of a concept of human awareness. Approximately 74.7 percent of instances of the psychological attributes, which are frequently used in articles on measurement of color emotions, are accounted by the 16 psychological attributes. By adding descriptions of psychological attributes which are infrequently used and have not been fully elucidate in the color research, our ontology would increase utility for knowledge sharing and be feasible in prompting scientific and engineered approaches to understand human mind.

When a company or an individual disseminate their information on advertising and sales promotion. Between several people who is a client and a designer or a designer and an illustrator and a photographer have a scene to share the visual image. In the transmission communication of visual image, onomatopoeia is able to convey information with a sense of reality. Onomatopoeia because the words that are interpreted by the sense modality. (the sense modality : Visual, Auditory, Olfactory, Gustatory, Tactual) Therefore, in this study, it was intended from association with sensory modality of onomatopoeia in the transfer communication of visual image, and to clarify the relational structure of onomatopoeia. Elucidation of the semantic structure was included ambiguity of onomatopoeia. It will enable the discussion about how to use and understandable meaning of onomatopoeia. The onomatopoeia of 200 words were investigated by the MD method and analyzed using the SS analysis and cluster analysis. And we assume that the semantic interpretation is determined by the strength of the association of the Modal. I discussed the rank structure. As a result, it is considered onomatopoeia of the group that there is a direction of understanding meaning is effective communication to convey the impression with vague. In addition, differences were observed in the technique of description and usage, selection onomatopoeia between expert and novice. It depends on skills and knowledge.

Sharing and managing knowledge on human Kansei obtained in several study fields are of growing significance to providing product's values focused on customers. However, few sufficiently-advanced technologies that realize such knowledge sharing and management have been established. One typical approach is to clarify and systematize concepts as an ontology. In the current study, we developed an ontology to describe correspondence of affective meaning spaces analyzed by semantic differential method. First, we collect literatures reveal the affective meaning evaluated through the five senses and their inter-modality. Second, we described the concepts on the basis of an ontology of color emotions. Then, we demonstrated and evaluated the usefulness of the ontology in a design situation. As a result, we confirmed that the ontology will serve as a useful reference and be of assistance to designers.

<p>ヒューマンエージェントインタラクションにおいて不気味の谷は重要な課題である．不気味の谷は，人型エージェントに対して人間／非人間の二つの知覚情報処理を行う過程における情報間の齟齬により発生すると考えられるが，この齟齬が不気味さを誘発するメカニズムに関しては統一的な説明がなされていない．本研究では，知覚対象の情動評価に関わる脳部位の機能を定性表現によりモデル化することで，このメカニズムの説明を試みた．</p>

<p>学習者の知識・理解状態に加えて心的状態を考慮した学習支援システムの実現のためには，心的状態に関する知識記述・管理が必要である．心理学の分野では，質問紙の評定データと統計モデルに基づいて，学習行為に関わる感情の構造を明らかにする試みがいくつかある．本研究ではそれらの知見を統一的に捉え共有することを目指し，因子分析などの統計モデルを用いて表される感情の次元に関するオントロジー記述を試みる．</p>

Some pauses are found in natural reading a book aloud, which work to support smooth communication. They are supposed to be working in transliterating service for visually impaired people. In this study, we propose types and functions of the pauses in that situation. We conducted an experiment to record speeches of 3 transliterators. As a result, 2 types of pauses were extracted; pause as visual information, and pause as easy-to-understand. In the both type usage, an expert made better use of the short pauses which put 0.5 second or less in the speeches than other transliterators. This suggests that the short pauses have an important function to support the smooth communication. In the future work, we analyze pitches and other parameters to specify the characteristics of expression with the short pauses.

From the view point of value co-creation in education and learning environment, it is important to cultivate competency and literacy for learning for both learners and teachers. For realizing value co-creative education and learning environment, detection of learners' mental states during their learning activities plays very important role at this environment. In this context, it is an important task to implement an e-learning system that can automatically detect changes of learners' mental states by observing their behaviors in learning activities. In this study, we conducted an experiment to explore relationships between mental states and behaviors of a learner on our experimental tools designed along with an assumption of a learning environment with an e-learning system. We focused on mouse and face movement as the behaviors. The results of the experiment revealed some features about the behaviors and the mental states.

For designing the rounded communication between human and agent, humanlike appearance of agent can contribute to human understandability towards their intension. However, the excessive humanlike-ness can cause human to feel repulsive against the agent, which is well known as the uncanny valley. In this study, we propose a model providing an explanation for how the human negative response is fomred, based on the brain regions and its function, including the amygdala, hippocampus, cortex and striatum. This model is described with quantitative reasoning and simulated. The results indicate that as human observes a humanlike agent, the emotion goes negative and the brain regions were more activated in comparison with the case human observes a person.

Many studies have been conducted during the last two decades examining learner reactions within e-learning environments. In an effort to assist learners in their scholastic activities, these studies have attempted to understand learner mental states by analyzing participants' facial images, eye movements, and other physiological indices and data. To add to this growing body of research, we have been developing IMS (Intelligent Mentoring System) which performs automatic mentoring by using an ITS (Intelligent Tutoring System) to scaffold learning activities and an ontology to provide a specification of learner's models. To identify learner mental states, the ontology operates based on theoretical and data-driven knowledge of emotions. In this study, we use statistical models to examine constructs of emotions evaluated in previous psychological studies, and then produce a construct of academic boredom.

Some pauses are found in natural reading a book aloud, which work to support smooth communication. They are supposed to be working in transliterating service for visually impaired people. In this study, we propose types and functions of the pauses in that situation. We conducted an experiment to record speeches of 3 transliterators. As a result, 2 types of pauses were extracted; pause as visual information, and pause as easy-to-understand. In the both type usage, an expert made better use of the short pauses which put 0.5 second or less in the speeches than other transliterators. This suggests that the short pauses have an important function to support the smooth communication. In the future work, we analyze pitches and other parameters to specify the characteristics of expression with the short pauses.

In Human Computer Interaction, the uncanny valley is crucial to design the appropriate appearance of an agent for human beings. Previous studies have implied that human perceives a humanlike agent in two processes. We conducted the experiment to clarify how human observes a humanlike agent and the results showed that participants perceive it as human at first and then as non-human. These two information-processes can be explained by the dual-pathway of emotion. In current study, we propose a model for the occurrence of uncanny valley based on the function of hippocampus, which can provide the explanation for human evocation of the feeling of the eeriness toward a humanlike agent.

視線計測を用いた先行研究では，四択問題の回答に対して確信がある時の問題読解プロセスは，問題と4つの選択肢を順に走査する規範的なものとなること，確信がない時は走査が乱れることが示唆されている．本研究ではこの知見に基づき，計算機の汎用デバイスからのリソースを用いて多肢選択問題の読解プロセスが規範的か乱れたかを分析することで，回答への確信を推定する手法を考案する．

<p>学習者の知識・理解状態に加えて心的状態を考慮した支援を行う知的メンタリングシステムの実現のためには，心的状態に関する知識記述・管理が必要である．学業に関する文脈で学習者が経験する感情は包括的にAcademic Emotionと呼ばれており，学習者の特性や一時的な心的状態との概念的な関係は明確でない．そこで，知的メンタリングシステムにおける学習者モデルに記述されるべき感情の概念を整理する．</p>

Besides skills in musical expression, exact timing among music players is required in excellent performances. In order to synchronize each respective sound of music among players, they must use a variety of information. In case of four-hand performances on the piano or performances by a band, for example, information such as musical sounds, body movements and gazes is considered to play critical roles. In this study, we empirically investigated roles of the information as communication channels between music players. We conducted an experiment where pairs of players performed music with a constant tempo, one varying its tempo and one including a long rest on the piano. They played the three sets of music both in a face-to-face setting where they could watch each other and a back-to-back setting where they could not. According to the results of the experiment, we then proposed communication models of players in music performances.

In the research field of human-agent interaction, it is a crucial issue to clarify the effect of agent appearances on human impressions. The uncanny valley is one crucial topic. We hypothesize that people can perceive a humanlike agent as human at an earlier stage in interaction even if they finally notice it as non-human and such contradictory perceptions are related to the uncanny valley. We conducted an experiment where participants were asked to judge whether faces presented on a PC monitor were human or not. The faces were a doll, a CG-modeled human image fairly similar to real human, an android robot, another image highly similar and a person. Eyes of the participants were recorded during watching the faces and changes in observing the faces were studied. The results indicate that eye data did not initially differ between the person and CG fairly similar, whereas differences emerged after several seconds. We then proposed a model of the uncanny valley based on dual pathway of emotion. © 2013 Springer-Verlag.

Recently, the research in intelligent educational systems has much interest in exploring data from academic settings to understand learners behavior and mental states. We have been developing IMS (Intelligent Mentoring System) which performs automatic mentoring by using an ITS (Intelligent Tutoring System) to scaffold learning activities and an ontology to provide a specification of learner's models. To provide learner's models in mentoring, the ontology describes qualities and quality values on awareness which are conceptualization of subjective evaluation. To specify relationships among qualities on awareness in academic settings, this study organized academic emotions in the psychological research and proposed their ontological descriptions.

Besides skills in musical expression, exact timing among music players is required in excellent performances. In order to synchronize each respective sound of music among players, they must use a variety of information. In case of four-hand performances on the piano or performances by a band, for example, information such as musical sounds, body movements and gazes is considered to play critical roles. In this study, we empirically investigated roles of the information as communication channels between music players. We conducted an experiment where pairs of players performed music with a constant tempo, one varying its tempo and one including a long rest on the piano. They played the three sets of music both in a face-to-face setting where they could watch each other and a back-to-back setting where they could not. According to the results of the experiment, we then proposed communication models of players in music performances.

Problem posing, by which learners create new problems by themselves, is an important activity in mathematics education. However, novice learners have difficulty in posing problems, particularly when formulating appropriate solution structures of problems. Although they are provided with example problems that can serve as hints for composing novel problems, they do not necessarily understand the key ideas used to generate the examples. To improve problem posing for novices, this study discusses an approach that supports learning from examples as a production task. We propose a method of learning from examples through imitation, where a learner reproduces problems identical to given examples. We implement a system that presents examples of problem posing and supports learners in understanding the examples by having the learners reproduce them. We conducted an experimental evaluation in which learners learned from an example that embeds useful ideas to alter solution structures in the system. The results demonstrated that the learners successfully adapted the example when posing their own problems if they learned the example by the reproduction method. Thus, learning from examples through reproduction appears to be effective in the domain of problem posing as a production task. © 2013 - IOS Press and the authors. All rights reserved.

Recently, the research area of intelligent educational systems has increasingly approached Educational Data Mining, which addressed a variety of learner aspects such as mental states. Although data of eye movements is promising in realizing mental states of learners, we have to empirically understand features of eye movements in advance due to difficulty in handling them. Toward the final goal of automatic estimation of learner mental states based on eyes, this study experimentally described changes of eye movements by confidence of correct answers. In our experiment, participants were asked to answer multiple-choice problems and respond to questionnaires about the problems, with the results indicating that transitions of eyes in initial processes where all choices were scanned differed depending on the levels of confidence.

Recently, the research in intelligent educational systems has much interest in exploring data from educational settings to understand learners behavior and mental states. To further un- derstand learners based on such the data and sophisticate supportive interventions by educational systems, knowledge of relationships between learners' behavior and mental states must be shared. To propose an framework to share the knowledge, this study attempted ontological descriptions for learners eye-movement and mental states in solving computer-based multiple-choice problems. The current study forms a technical basis for development of an IMS(Intelligent Mentoring System) in which an automatic mentoring function is implemented with ITS(Intelligent Tutoring System).

<p>視線は，計算機による学習者の心的状態の理解において有益な指標となることが期待されているが，視線データの分析手法は必ずしも確立していない．本研究では，計算機を用いて学習者が多肢選択問題に回答する場面を想定し，学習者の視線データを取得する実験を実施した．そして，学習者の視線から問題回答プロセスを質的に記述し，問題回答に対する確信度を推定するための分析手法を考案を行う．</p>

<p>近年は，自信や興味などの認知，困惑などの情動といった学習者自身の心理的な側面に焦点を当てた学習者の理解が試みられている．それらに基づいた学習支援を行う場合には，あらかじめ学習者の行動と心理状態に関する概念を明示することが，具体的な支援方略の決定に役立つと考えられる．本研究では，多肢選択問題を回答する学習者の視線と心理状態を例にとり，その知識を記述するためのオントロジーの構築を試みた．</p>

In calligraphy, calligraphers express their emotions in calligraphic characters and that impress people who view the characters. Calligraphers generally acquire tacit techniques for expressing emotions by themselves and, therefore, the knowledge on the technique is difficult to be shared. We experimentally studied features of calligraphic characters expressing five different emotions, using writings created by an expert calligrapher. We classified fundamental strokes comprising the characters based on stroking methods defined in 'Eijihappo' and then extracted knowledge on emotion expression techniques in drawing strokes.

Recently, the research in intelligent educational systems has much interest in exploring data from educational settings to understand learners behavior and mental states. To further understand learners based on such the data and sophisticate supportive interventions by educational systems, knowledge of relationships between learners' behavior and mental states must be shared. To propose a framework to share the knowledge, this study attempted ontological descriptions for learners' eye-movement and mental states in solving computer-based multiple-choice problems. The current study forms a technical basis for development of an IMS (Intelligent Mentoring System) in which an automatic mentoring function is implemented with ITS (Intelligent Tutoring System).

Recently, the research area of intelligent educational systems has increasingly approached Educational Data Mining, which addressed a variety of learner aspects such as mental states. Although data of eye movements is promising in realizing mental states of learners, we have to empirically understand features of eye movements in advance due to difficulty in handling them. Toward the final goal of automatic estimation of learner mental states based on eyes, this study experimentally described changes of eye movements by confidence of correct answers. In our experiment, participants were asked to answer multiple-choice problems and respond to questionnaires about the problems, with the results indicating that transitions of eyes in initial processes where all choices were scanned differed depending on the levels of confidence.

In calligraphy, calligraphers express their emotions in calligraphic characters and that impress people who view the characters. Calligraphers generally acquire tacit techniques for expressing emotions by themselves and, therefore, the knowledge on the technique is difficult to be shared. We experimentally studied features of calligraphic characters expressing five different emotions, using writings created by an expert calligrapher. We classified fundamental strokes comprising the characters based on stroking methods defined in 'Eijihappo' and then extracted knowledge on emotion expression techniques in drawing strokes.

The color research has much interest in exploring an emotional response to a color stimulus, which is referred to as color emotions. In general, knowledge on color emotions is represented as statistical models, and be implemented in computer-based systems such as a communication agent. In this paper, we ontologically specifed basic concepts of perceptual quantities, color space and statistical models. We then discuss how our ontology can improve interaction between human and computer based on communication strategy which is proposed in Human-Robot Interaction.

Now that the commodity value for customers has been changing from function oriented products to kansei-oriented products, what we extract designs appropriate for kansei of individuals from a great deal of candidates is our problem in today's information oriented society. On the other hand, the development of computer technology that can handle these kinds of information with speed and precision has been also achieved. Therefore, we try the simulation that reflect human kansei by using computer, and evaluate the extraction accuracy. In this study, kansei evaluations on the computer are conducted by using neural networks which are modeled on human brain functions. As a result, when affective dimensions present in human brain activity are applied, the learning accuracy is effective enough, but the evaluation accuracy does not go far enough to put this research into practical use in the future.

From a viewpoint of knowledge engineering, it is an important task to clarify concepts of color emotions. One of methods to achieve the task is to construct an ontology. For the aspect of applications of color research, the ontological descriptions will promote implementation of knowledge on color emotion in computer-based systems. In this paper, we ontologically specified basic concepts relating to rating scales which are used to measure emotional reactions to color stimuli, and demonstrated instances of common factors shared by rating scales.

<p>色刺激に対する印象はSD法および因子分析によってその因子構造が明らかになっている．また，色刺激に対する感情については，感情価，覚醒，支配という三つの次元から解釈されている．印象と感情は互いに深く関連していると考えられるため，それらに関する知見を統一的な視点から理解する必要がある．そこで本研究ではオントロジー工学の方法論を用いて，色刺激に対する印象と感情の関係構造を表現することを試みる．</p>

Human kansei is one of the important factors in recent product development. Thus, management of knowledge about consumers&#039; feelings is an essential task in current industrial design. For the purpose of such the knowledge management, development of a descriptive method to identify feelings is needed. In this paper, we measured implicit attitudes to color combinations using affect misattribution procedure, and we analyzed proportions of positive responses to each stimulus. The results showed that chroma contrast was explained by a concept of perceptual fluency. According to the finding, we discuss significance of the perceptual fluency which links physical features and impressions from the viewpoint of ontological description. The discussion indicated a need for development of a descriptive method for correspondence between physical features and impressions explained by perceptual fluency (e.g. symmetry, contrast, prototypicality).

Although humanlike robots and computer agents are fundamentally recognized as familiar, considerable similar external representation occasionally reduces their familiarities. We experimentally investigated relationships between the similarities and the familiarities of multi-modal agents which had face and voice representation, with the results indicating that similarities of the agents didn't simply increase their familiarities. The results in our experiments implied that external representation of computer agents for communicative interactions should not be very similar to human but appropriately similar in order to gain familiarities.

Recently, impressions of web pages formed by visitors have become an important tool to increase the number of repeat visitors to the web page. Therefore, the management of knowledge on consumers' impressions obtained in several study fields is an essential task in current industrial design. However, no methods that realize such knowledge management have been established. Thus, our study proposes and implements a knowledge management method that can effectively provide knowledge of impressions to web designers to help them in building attractive websites. We introduce a framework for the description of impressions that depend on perceptual fluency, which can serve as an useful indicator of pleasure. We can extract the features of objects that affect impressions on the basis of perceptual fluency. We specify the relationship between objects and impressions by modeling the concepts of awareness, perception, and self-report on the basis of an ontology development environment Hozo and a top-level ontology YAMATO. We then instantiate a case where a person has a good impression of a Web page, and we describe the relationship between a perception and a stimulus in such a case. Our approach demonstrates that ontological modeling of impressions helps us to understand the correspondences between affections and physical irritations.

Recently, human kansei is one of the important factors in product design. Several\nmehods to extract knowledge about impressions have been developed in the field of architectonics\nand kansei engineering. However, few studies have addressed management of such the knowledge,\nand no methods to be commonly used in the management have been established. Thus, our study\nproposes and implements a knowledge management method that can effectively provide knowledge\nof impressions. We introduce a framework for descriptions of impressions explained by perceptual\nfluency which can serve as an useful indicator of a pleasure. Since perceptions are closely related\nto awareness, we model a perception as well as awareness and a self-report for the framework\nbased on an ontology development environment Hozo and a top-level ontology YAMATO. We then\ninstantiate a case where a person has a good impression of a web page, and we describe relations\nbetween a perception and stimulus in such the case. Our approach demonstrates that ontological\nmodeling of impressions helps us to understand correspondences between affections and physical\nirritations.

<p>プロダクトやサービスに対して人間が持つ印象は，品質向上に役立てるための重要な知識である．本研究では面接調査によって抽出した印象に関する知識に対して，オントロジー工学の方法論を適用することでその記述を試みる．また，特定の対象世界において印象が言語表現によって観察されることから，印象の記述方法を提案すると共にそれらの区別について考察する．</p>

The know-how information to perceive care needs based on assessment results is crucial to improve the quality of care service. We developed a know-how information sharing system for care planning processes. We propose a method that externalizes and shares know-how information by visualizing and observing care plans drawn by experts in various forms that allow beginners to notice the differences between the plans of novices and experts. Sharing know-how information is possible by recording, accumulating, and referring to what has been observed when comparing documents. This system two-dimensionally maps and visualizes each document based on the differences among documents perceived by the assessment results. Externalizing and sharing know-how information are supported by visualization. Trial results in a care facility confirmed that our system effectively externalized and shared know-how information. Improvement in individual capabilities, organization growth, and the possibility of rejuvenation were confirmed by using our system.

Sharing know-how information for appropriately grasping care needs is an important factor to improve the quality of care service. Our know-how information sharing method highlights the differences between beginners and more skillful persons and brings them to the attention of the former. When a skillful person is given assessment data, first she roughly observes them based on a certain pattern that reflects her experience and then gradually notices the details. In this paper, we promote awareness by showing beginners this process. We classified assessment data using cluster analysis. With our results, which were verified by skillful persons, we verified that they basically agreed with the skillful person&apos;s classification pattern. Therefore, a skillful person&apos;s data observation process can be presented to beginners.

This study is to constitute a framework for understanding aesthetic sensibility by introducing a mental model called the content space which is defined as a set of all possible contents of consciousness. An aesthetic sensation is a conscious process, thus it belongs to the content space. On the other hand, all mental process must be realized by neural activities which were initially evolved in human ancestors. Because aesthetic sensation is a content of consciousness appeared only in human, it is highly probable that its origin can be explained by a correlating process of biological evolution and cultural development. As the bridge between mental and physiological processes, the emotion and mood relating aesthetic sensation are also considered in the proposed model.

We have developed the know-how information sharing system As the method to extract the know-how information, we consider that visualizing and showing care plans drawn up by experts in various forms allows a beginner to see the differences between a novice plan and an expert plan. This system can visualize the similarities among documents that experts interpreted the results of an assessment and can flexibly change viewpoints. Additionally, it can map a user's and several beginners' new document into a two-dimensional document space.
Through the result of the evaluation used by a nurse, care workers and care takers, we confirmed that this system was effective in educational supports.

Problem posing is identified as an important activity in mathematics education. In problem posing, it is important but difficult for learners to generate diverse problems. In this study, we examine a method and implement a system for facilitating learners’ diverse thinking in the task of posing mathematical word problems. Since we focus on an aspect of problem posing as a creative generation task, we utilize the presentation of problems as cases in supporting problem posing. We experimentally investigate the diversifying effect of presenting cases while controlling similarities and then implement a support system for problem posing that can present various cases. We also conduct experimental evaluations to verify the effectiveness of our system. © 2008 - IOS Press and the authors.

The purpose of this study is the establishment of a method and the development of a support system for educating personnel involved in care management by computer. We propose a system in which know-how information can be shared. We consider that visualizing and showing care plans drawn zip by experts in various forms allows a beginner to see the differences between a novice plan and an expert plan. Sharing know-how information is possible by recording, accumulating, and giving titles to what has been noticed v comparing documents. This system can visualize the similarities among documents that interpreted the results of an assessment and can flexibly change viewpoints. Additionally, it can map a user's and another beginner's new document into a two-dimensional document space. Through evaluations by experts in nursing and caring, we confirmed that this system could be educational.

The purpose of this study is to develop a computer support system for educating personnel who are involved in care management. We wish to develop a system in which know-how information can be shared. We consider that visualizing and showing care plans drawn up by experts in various forms allows a beginner to see the differences between their plans and an expert plan. Sharing know-how information is possible by recording, accumulating, and giving titles to what has been noticed in comparing documents. This function can visualize the similarities among documents that interpreted the results of an assessment, and can flexibly change different viewpoints. In order to promote user awareness, we mapped a user's new document into a two-dimensional document space, and confirmed that the results of this mapping were appropriate.

In this study, an e-learning system is developed to handle the e-learning environment based on the learning ecological model. In the learning ecological model, which represents the comprehensive e-learning environment, not only the contents of learning, but also the learning environment are managed and provided, based on the content, the goal, and the configuration of the learning. The major purpose of this study is to realize the function that can manage the diversified learning objects with various information granularities and representation formats, using the learning object metadata, so that each learner can utilize the learning object based on the learning scenario, which is matched to the individual learner. The learning scenario is constructed by sequencing the learning objects based on the learning necessity, the learning history information, and the curriculum information of the object of learning, according to the characteristics of the learning object. As the sequencing procedure, the sequencing of the learning objects is considered, by applying the optimization technique of the multi-objective optimization problem, so that multiple evaluation viewpoints are simultaneously satisfied. The genetic algorithm is used as the optimization procedure. The learning object metadata and the sequencing of the learning objects are discussed in detail in this paper. The evaluation of the developed e-learning system is also described. © 2004 Wiley Periodicals, Inc.

We have developed a software that supports care management by the KOMI Chart System, aimed at improving the visibility of the KOMI Chart System with functions for drawing, revising and observing the time-series charts. The purpose of this study is to evaluate the effectiveness of computer support for care management. The experiment results showed: (1) the time required for care planning was reduced, and (2) grasping client's daily life was affected by the speed of drawing the KOMI Chart.

We built an educational Qualitative Diagnosis simulator (QUAD) to model SCS (Space Collaboration System) conferences. Our research aim is supporting SCS beginner users in forming correct SCS mental models and in understanding SCS essentials. Therefore, we use a logical circuit, to model the possible computations. The system diagnoses the student's conceptual understanding mistakes about the SCS system and explains their cause.

The research presented here belongs to a framework research on distance educational training for teachers, presented in a different panel session. Our goal with this research is to accumulate information for teachers, about established teaching methodologies and techniques, as lesson example videos. We are currently developing an environment for facilitating the usage of these example movies, via a VOD retrieval server. The domain of our classroom examples is "Information Education", a new subject introduced in the Japanese curriculum.

The purpose of our study is to develop an intelligent adaptive instruction system that manages intelligently the learner's estimated knowledge structure and optimizes the selection of problems according to his/her knowledge structures. The system adopts the dynamic problems of high school physics as a material of study, and is intended to operate on a UNIX Work Station. For these purposes, the system is composed of three parts, 1) interface part, 2) problem solving expert part, and 3) optimization expert system part for problem selection. The main feature of our system is that both knowledge structures of learner and teacher are represented by structural graph, and the problem selection process is controlled by the relationship between the learner's knowledge structure and the teacher's knowledge structure. In our system the relationship between these two knowledge structures is handled in the optimization expert system part for problem selection. In this paper the theory of the optimization expert system part for problem selection is described, and the effectiveness of this part is clarified through a simulation experiment of the originally defined matching coefficient.

The questionnaire test using the rating scale data is applied effectively, since it features relatively high reliability and the simple processing. The semantic structure analysis (SS analysis) is proposed as the method of structural analysis for the rating scale data. In the SS analysis, the order of the items is considered, and the human behavior or the psychological aspects are interpreted from the ordering structure of the items. In the conventional questionnaire test using the rating scale data, the evaluation is possible in many cases even if the data are composed of a discrete single point. Depending on the questionnaire items, however, it may happen that the evaluator is not convinced of a discrete single point.
From such a viewpoint, this paper proposes a structural analysis considering the ordering among items which is not a discrete point evaluation to evaluate by a single discrete point, but is an interval evaluation to evaluate by an interval on the rating scale. For this purpose, the difference between the ratings of two items is quantified anew based on the interval rating data. The inversely ordered rating ratio and the ordering coefficient are defined as the indices for the ordering.
It is shown that the method proposed in this paper is an extension of the SS analysis. Furthermore, as the structural analysis, the ordering structure graph is constructed for the set of items. A method of constructing the ordering structure graph is presented, and the application process is shown through an actual example.

In analyzing human psychological behavior or action, multiple-choice question methods are quite effective means. Especially the questionnaire method in accordance with the rating scale method is frequently used because of its simplicity and reliability. The structural analysis method is a mean for analyzing the consciousness structure of evaluators from ordering structure of questionnaire items, and interval rating method is considered to reflect ambiguity of evaluators' consciousness better than fixed-point rating method. In this structural analysis method, a hierarchical structure graph (hereafter just called the structure graph) of the item group is constructed in order to visualize the related structure of the item group. Then in this paper, the structural analysis method for interval rating scale data to investigate consciousness concerning the environment education/environmental problems. On the other hand by providing the evaluators with some stimulus, by performing the same consciousness survey before and after the conduct, and by computing the similarity (difference) of these structure graphs, metamorphosis of the consciousness structure of the evaluators' group have been analyzed. As a result, problematic points of the environment education or effects of video teaching aids have been verified.

A questionnaire containing multiple‐choice questions is a representative method to investigate human behavior. Previously, Takeya proposed the semantic structure analysis (SS analysis) as an analytical means for data obtained by the forementioned method. A structural graph of the SS analysis is called an SS graph, and it is conceived that the SS graph is of the hierarchical structure when items are laid out taking the ordinate for the measurement as the statistic such as mean evaluation values. However, no argument has been made with the layout of the abscissa. With this in mind, an observation concerning the unsolved problem, i.e., a method for two‐dimensional layout of the semantic structure graph, is given in this paper. To solve this problem, a concept of a zone is introduced from a relationship between the ordering coefficient and the factor load by means of the centroid method. Then a measure to compose the abscissa by means of the zone determination values is proposed. It is shown that not only can the relationship among the individual items be comprehended but also the meanings grasped as item groups together with the meanings among the item groups. Furthermore, by observing the linkage of the amount of information possessed by the individual items, especially of the effective category numbers and mean evaluation values, by means of a model and examples, the size of scattering of the evaluation values is explained explicitly by composing the abscissa by means of this effective category number. Thus, the relationship of items including the response pattern can be grasped. Copyright © 1993 Wiley Periodicals, Inc., A Wiley Company

Progress in our highly information-oriented society is accelerating every day as we approach the new century. Socially, great importance is attached to education, particularly mathematical education, to meet future needs. In this paper, we describes Japanese social background first, and try to forecast the situation in the near future around the next five years. A plan to make an efficient use of computer is introduced. It is based on the consideration about the entire curriculum and the integration of the existing uncoordinated attempts. Furthermore, we discuss about more abvauced use which includes the integrated learning environment and idea to apply the computer communication to mathematical education.