Harmonic and percussive sound separation (HPSS) is a widely applied pre-processing tool that extracts distinct (harmonic and percussive) components of a signal. In the previous methods, HPSS has been performed based on the structural properties of magnitude (or power) spectrograms. However, such approach does not take advantage of phase that contains useful information of the waveform. In this paper, we propose a novel HPSS method named MipDroP that relies only on phase and does not use information of magnitude spectrograms. The proposed MipDroP algorithm effectively examines phase through its mixed partial derivative and constructs a pair of masks for the separation. Our experiments showed that MipDroP can extract percussive components better than the other methods.

Phase recovery is a methodology of estimating a phase spectrogram that is reasonable for a given amplitude spectrogram. For enhancing the signals obtained from the processed amplitude spectrograms, it has been applied to several audio applications such as harmonic/percussive source separation (HPSS). Because HPSS is often utilized as preprocessing of other processes, its phase recovery should be simple. Therefore, practically effective methods without requiring much computational cost, such as phase unwrapping (PU), have been considered in HPSS. However, PU often results in a phase that is completely different from the true phase because (1) it does not consider the observed phase and (2) estimation error is accumulated with time. To circumvent this problem, we propose a phase-recovery method for HPSS using the observed phase information. Instead of accumulating the phase as in PU, we formulate a local optimization model based on the observed phase so that the estimated phase remains similar to the observed phase. The analytic solution to the proposed optimization model is provided to keep the computational cost cheap. In addition, iterative refinement of phase in the existing methods is applied for further improving the result. From the experiments, it was confirmed that the proposed method outperformed PU.

Audio declipping aims to reconstruct the original signal from a clipped observed signal. Clipping has a negative effect on subsequent multichannel processing such as beamforming. This is because the channel-wise nonlinear distortion deteriorates the spatial covariance matrix in the time-frequency domain. Hence, it is important to consider multichannel audio declipping that explicitly takes into account the subsequent audio signal processing. However, most of the existing methods have been developed for the single-channel case. In this paper, we propose a joint optimization method for declipping and beamforming. The multichannel declipped signal and the spatial filter are jointly optimized to sparsify the output of beamforming. Our experimental results show the effectiveness of the proposed method compared to the beamforming with prior declipping.

In this paper, we propose a phase-aware audio inpainting method and its variations. The aim of audio inpainting is to restore some gaps of audio signals. Among various methods, sparsity-based methods have been studied, especially for restoring gaps up to 50 ms. However, they usually focus only on the magnitude information even though the phase information is also available. In the proposed method, we utilize a phase-aware prior to induce smoothness of phase. The variations of the basic algorithm are also obtained by applying some updating schemes. The numerical results show effectiveness of the proposed methods, especially for longer gaps.

Nonstationary signals are commonly analyzed and processed in the time-frequency (T-F) domain that is obtained by the discrete Gabor transform (DGT). The T-F representation obtained by DGT is spread due to windowing, which may degrade the performance of T-F domain analysis and processing. To obtain a well-localized T-F representation, sparsity-aware methods using '1-norm have been studied. However, they need to discretize a continuous parameter onto a grid, which causes a model mismatch. In this paper, we propose a method of estimating a sparse T-F representation using atomic norm. The atomic norm enables sparse optimization without discretization of continuous parameters. Numerical experiments show that the T-F representation obtained by the proposed method is sparser than the conventional methods.

© 2020 Elsevier Ltd Accurate determination of microphone sensitivity is important to build reliable acoustical instruments. The sensitivity is usually determined by calibration. However, because available microphone calibration methods determine the sensitivity from a mathematical model derived from the geometry of a conventional condenser microphone, they cannot be applied to the calibration of microelectromechanical systems (MEMS) microphone straightforwardly. To compromise this geometry difference with the available calibration methods, some authors have proposed the development of adapters that fits the conventional calibration apparatus and modified the calibration procedure. In this paper, we propose a different approach to calibrate the MEMS microphone. The sensitivity is calculated directly from the measurement of the sound field applied to the MEMS microphone and its output voltage. The projection of the sound field is measured by parallel phase-shifting interferometry (PPSI), and sound pressure on the MEMS microphone is obtained by tomographic reconstruction. Experimental calibration of a MEMS microphone was performed and validated using a microphone substitution method to evaluate the discrepancies of the sensitivity result. It is shown that the proposed method can be used to determine the frequency response of the MEMS microphone in the frequency range of 1000 Hz to 12000 Hz.

Optical interferometric measurement methods for sound fields have garnered considerable attention owing to their contactless nature. The capabilities of non-invasive measurement and reconstruction of three-dimensional sound fields are significant for characterizing acoustic transducers. However, three-dimensional reconstructions are typically time consuming because of the two-dimensional scanning and rotation of the measurement system. This paper presents a scan and rotation-free reconstruction of an axisymmetric sound field in the human hearing range. A physical-model-based algorithm is proposed to reconstruct an axisymmetric sound field from optical interferograms recorded using parallel phase-shifting interferometry and a high-speed polarization camera. We demonstrate that audible sound fields can be reconstructed from data measured in 10 ms. The proposed method is effective for the rapid evaluation of axially symmetric acoustic transducers.

Sound fields radiated from the castanet, a Spanish percussive instrument comprising two shells, were optically visualized. A measurement system, which used parallel phase-shifting interferometry and a high-speed polarization camera, enabled the capture of instantaneous sound fields around the castanets, while the castanets were played, with the spatial resolution of 1.1 mm and frame rate of 100 000 fps. By carefully aligning the tilt of the castanets, the sound fields within the 1-mm gaps between both the shells were captured. From the visualization results, two acoustic resonances between the shells were identified. The first mode appeared between 1000 and 2000 Hz and exhibited a frequency chirp of several hundred hertz for several milliseconds after the impact. This can be explained by the Helmholtz resonance with a time-varying resonator shape, which is caused by the movement of the shells after impact. The second mode showed a resonance pattern with a single nodal diameter at the center of the shells, i.e., the standing wave mode caused by the interior volume. These physical phenomena involved in the sound radiation were identified owing to the unique features of the optical imaging method, such as contactless nature and millimeter-resolution imaging of instantaneous pressure fields.

Detecting sound source objects within visual observation is important for autonomous robots to comprehend surrounding environments. Since sounding objects have a large variety with different appearances in our living environments, labeling all sounding objects is impossible in practice. This calls for self-supervised learning which does not require manual labeling. Most of conventional self-supervised learning uses monaural audio signals and images and cannot distinguish sound source objects having similar appearances due to poor spatial information in audio signals. To solve this problem, this paper presents a self-supervised training method using 360 images and multichannel audio signals. By incorporating with the spatial information in multichannel audio signals, our method trains deep neural networks (DNNs) to distinguish multiple sound source objects. Our system for localizing sound source objects in the image is composed of audio and visual DNNs. The visual DNN is trained to localize sound source candidates within an input image. The audio DNN verifies whether each candidate actually produces sound or not. These DNNs are jointly trained in a self-supervised manner based on a probabilistic spatial audio model. Experimental results with simulated data showed that the DNNs trained by our method localized multiple speakers. We also demonstrate that the visual DNN detected objects including talking visitors and specific exhibits from real data recorded in a science museum.

<sec>
<title>Abstract</title>
Aerodynamic sound is one of the causes of noise in high-speed trains, automobiles, and wind turbines. To investigate the characteristics of aerodynamic sound generation, measurements around the sound sources are required. Aerodynamic sound is typically measured using microphones. However, microphones cannot capture the near-field of aerodynamic sound because they become new noise sources inside the air flow. To observe the aerodynamic sound near-field, we performed two-dimensional visualization of aerodynamic sound using an optical method. The optical method used in this research, parallel phase-shifting interferometry (PPSI), can detect the pressure within the measurement area as variations of the phase of light. PPSI can therefore visualize the pressure fields. We visualized both the sound pressure and flow components of the sound generated by flow around a square cylinder and flat plates. The visualized pressure fields are provided as animations in the online resources. Analysis of the sound and flow component time variations confirmed the correlations between them.


</sec>
<sec>
<title>Graphic abstract</title>

</sec>

In recent single-channel speech enhancement, deep neural network (DNN) has played a quite important role for achieving high performance. One standard use of DNN is to construct a maskgenerating function for time-frequency (T-F) masking. For applying a mask in T-F domain, the shorttime Fourier transform (STFT) is usually utilized because of its well-understood and invertible nature. While the mask-generating regression function has been studied for a long time, there is less research on T-F transform from the viewpoint of speech enhancement. Since the performance of speech enhancement depends on both the T-F mask estimator and T-F transform, investigating T-F transform should be beneficial for designing a better enhancement system. In this paper, as a step toward optimal T-F transform in terms of speech enhancement, we experimentally investigated the effect of parameter settings of STFT on a DNN-based mask estimator. We conducted the experiments using three types of DNN architectures with three types of loss functions, and the results suggested that U-Net is robust to the parameter setting while that is not the case for fully connected and BLSTM networks.

Visualizing sound field is important to fully understand the acoustic behavior and phenomena. Recently, sound field visualization by using parallel phase-shifting interferometer (PPSI) has been proposed. PPSI can observe sound field quantitively and instantaneously without placing any object inside the field. However, the system has introduced some unwanted noise to the output fringe image. There is continuous development in signal processing method to reduce the noise in PPSI system. In this paper, different type of spatio-temporal filter has been tested to improve noise reduction in PPSI system upon establishing.

© 2020 IEEE. We propose an end-to-end speech enhancement method with trainable time-frequency (T-F) transform based on invertible deep neural network (DNN). The resent development of speech enhancement is brought by using DNN. The ordinary DNN-based speech enhancement employs T-F transform, typically the short-time Fourier transform (STFT), and estimates a T-F mask using DNN. On the other hand, some methods have considered end-to-end networks which directly estimate the enhanced signals without T-F transform. While end-to-end methods have shown promising results, they are black boxes and hard to understand. Therefore, some end-to-end methods used a DNN to learn the linear T-F transform which is much easier to understand. However, the learned transform may not have a property important for ordinary signal processing. In this paper, as the important property of the T-F transform, perfect reconstruction is considered. An invertible nonlinear T-F transform is constructed by DNNs and learned from data so that the obtained transform is perfectly reconstructing filterbank.

© 2020 IEEE. The short-time Fourier transform (STFT) is widely employed in non-stationary signal analysis, whose property depends on window functions. Instantaneous frequency in STFT, the time-derivative of phase, is recently applied to many applications including spectrogram reassignment. The computation of instantaneous frequency requires STFT with the window and STFT with the (time-)differential window, i.e., the computation of instantaneous frequency depends on both the window function and its time derivative. To obtain the instantaneous frequency accurately, the sidelobe of frequency response of differential window should be reduced because the side-lobe causes mixing of multiple components. In this paper, we propose window functions suitable for computing the instantaneous frequency which are designed based on minimizing the sidelobe energy of the frequency response of the differential window.

© 2020 IEEE We propose a speech enhancement method using a causal deep neural network (DNN) for real-time applications. DNN has been widely used for estimating a time-frequency (T-F) mask which enhances a speech signal. One popular DNN structure for that is a recurrent neural network (RNN) owing to its capability of effectively modelling time-sequential data like speech. In particular, the long short-term memory (LSTM) is often used to alleviate the vanishing/exploding gradient problem which makes the training of an RNN difficult. However, the number of parameters of LSTM is increased as the price of mitigating the difficulty of training, which requires more computational resources. For real-time speech enhancement, it is preferable to use a smaller network without losing the performance. In this paper, we propose to use the equilibriated recurrent neural network (ERNN) for avoiding the vanishing/exploding gradient problem without increasing the number of parameters. The proposed structure is causal, which requires only the information from the past, in order to apply it in real-time. Compared to the uni- and bi-directional LSTM networks, the proposed method achieved the similar performance with much fewer parameters.

© 2020 IEEE. Phase reconstruction, which estimates phase from a given amplitude spectrogram, is an active research field in acoustical signal processing with many applications including audio synthesis. To take advantage of rich knowledge from data, several studies presented deep neural network (DNN)-based phase reconstruction methods. However, the training of a DNN for phase reconstruction is not an easy task because phase is sensitive to the shift of a waveform. To overcome this problem, we propose a DNN-based two-stage phase reconstruction method. In the proposed method, DNNs estimate phase derivatives instead of phase itself, which allows us to avoid the sensitivity problem. Then, phase is recursively estimated based on the estimated derivatives, which is named recurrent phase unwrapping (RPU). The experimental results confirm that the proposed method outperformed the direct phase estimation by a DNN.

In this paper, we propose a phase reconstruction framework, named Deep Griffin-Lim Iteration (DeGLI). Phase reconstruction is a fundamental technique for improving the quality of sound obtained through some process in the time-frequency domain. It has been shown that the recent methods using deep neural networks (DNN) outperformed the conventional iterative phase reconstruction methods such as the Griffin-Lim algorithm (GLA). However, the computational cost of DNN-based methods is not adjustable at the time of inference, which may limit the range of applications. To address this problem, we combine the iterative structure of GLA with a DNN so that the computational cost becomes adjustable by changing the number of iterations of the proposed DNN-based component. A training method that is independent of the number of iterations for inference is also proposed to minimize the computational cost of the training. This training method, named sub-block training by denoising (SBTD), avoids recursive use of the DNN and enables training of DeGLI with a single sub-block (corresponding to one GLA iteration). Furthermore, we propose a complex DNN based on complex convolution layers with gated mechanisms and investigated its performance in terms of the proposed framework. Through several experiments, we found that DeGLI significantly improved both objective and subjective measures from GLA by incorporating the DNN, and its sound quality was comparable to those of neural vocoders.

© 2019 IEEE. Decomposition of an audio mixture into harmonic and percussive components, namely harmonic/percussive source separation (HPSS), is a useful pre-processing tool for many audio applications. Popular approaches to HPSS exploit the distinctive source-specific structures of power spectrograms. However, such approaches consider only power spectrograms, and the phase remains intact for resynthesizing the separated signals. In this paper, we propose a phase-aware HPSS method based on the structure of the phase of harmonic components. It is formulated as a convex optimization problem in the time domain, which enables the simultaneous treatment of both amplitude and phase. The numerical experiment validates the effectiveness of the proposed method.

© 2019 IEEE. Recent development of optical interferometry enables us to measure sound without placing any device inside the sound field. In particular, parallel phase-shifting interferometry (PPSI) has realized advanced measurement of refractive index of air. Its novel application investigated very recently is simultaneous visualization of flow and sound, which had been difficult until PPSI enabled high-speed and accurate measurement several years ago. However, for understanding aerodynamic sound, separation of air flow and sound is necessary since they are mixed up in the observed video. In this paper, guided-spatio-temporal filtering is proposed to separate sound from the optically measured images. Guided filtering is combined with a physical-model-based spatio-temporal filterbank for extracting sound-related information without the undesired effect caused by the image boundary or occluding objects. Such image boundary and occluding objects are typical difficulty arose in signal processing of an optically measured sound filed.

© 2019 IEEE. Low-rankness of amplitude spectrograms has been effectively utilized in audio signal processing methods including non-negative matrix factorization. However, such methods have a fundamental limitation owing to their amplitude-only treatment where the phase of the observed signal is utilized for resynthesizing the estimated signal. In order to address this limitation, we directly treat a complex-valued spectrogram and show a complex-valued spectrogram of a sum of sinusoids can be approximately low-rank by modifying its phase. For evaluating the applicability of the proposed low-rank representation, we further propose a convex prior emphasizing harmonic signals, and it is applied to audio denoising.

© 2019 IEEE. We propose a data-driven design method of perfect-reconstruction filterbank (PRFB) for sound-source enhancement (SSE) based on deep neural network (DNN). DNNs have been used to estimate a time-frequency (T-F) mask in the short-time Fourier transform (STFT) domain. Their training is more stable when a simple cost function as mean-squared error (MSE) is utilized comparing to some advanced cost such as objective sound quality assessments. However, such a simple cost function inherits strong assumptions on the statistics of the target and/or noise which is often not satisfied, and the mismatch of assumption results in degraded performance. In this paper, we propose to design the frequency scale of PRFB from training data so that the assumption on MSE is satisfied. For designing the frequency scale, the warped filterbank frame (WFBF) is considered as PRFB. The frequency characteristic of learned WFBF was in between STFT and the wavelet transform, and its effectiveness was confirmed by comparison with a standard STFT-based DNN whose input feature is compressed into the mel scale.

© 2019 IEEE. This paper presents a novel phase reconstruction method (only from a given amplitude spectrogram) by combining a signal-processing-based approach and a deep neural network (DNN). To retrieve a time-domain signal from its amplitude spectrogram, the corresponding phase is required. One of the popular phase reconstruction methods is the Griffin-Lim algorithm (GLA), which is based on the redundancy of the short-time Fourier transform. However, GLA often involves many iterations and produces low-quality signals owing to the lack of prior knowledge of the target signal. In order to address these issues, in this study, we propose an architecture which stacks a sub-block including two GLA-inspired fixed layers and a DNN. The number of stacked sub-blocks is adjustable, and we can trade the performance and computational load based on requirements of applications. The effectiveness of the proposed method is investigated by reconstructing phases from amplitude spectrograms of speeches.

© 2019 Author(s). In order to incorporate a directive sound source into acoustic simulation using the finite-difference time-domain method (FDTD), this paper proposes an optimization-based method to estimate the initial value which approximates a desired directional pattern after propagation. The proposed method explicitly considers a discretized FDTD scheme and optimizes the initial value directly in the time domain so that every effect of the discretization error of FDTD, including numerical dispersion, is taken into account. It is also able to consider a frequency-wise directivity by integrating the Fourier transform into the optimization procedure, even though the estimated result is defined in the time domain. After the optimization, the obtained result can be utilized in any acoustic simulation based on the same FDTD scheme without modification because the result is represented as the initial value to be propagated and no additional procedure is required.

© 1994-2012 IEEE. Recovering a signal from its amplitude spectrogram, or phase recovery, exhibits many applications in acoustic signal processing. When only an amplitude spectrogram is available and no explicit information is given for the phases, the Griffin-Lim algorithm (GLA) is one of the most utilized methods for phase recovery. However, GLA often requires many iterations and results in low perceptual quality in some cases. In this letter, we propose two novel algorithms based on GLA and the alternating direction method of multipliers (ADMM) for better recovery with fewer iteration. Some interpretation of the existing methods and their relation to the proposed method are also provided. Evaluations are performed with both objective measure and subjective test.

© 2019 SPIE. We have proposed a method of simultaneously measuring aerodynamic sound and fluid ow using parallel phase- shifting interferometry (PPSI). PPSI can observe phase of light instantaneously and quantitatively. This method is useful for understanding the aerodynamic sound because PPSI can measure near the source of the aerodynamic sound. However, the components of sound and ow should be separated in order to observe detail near the source of sound inside a region of ow. Therefore, we consider a separation of the component of sound from simultaneously visualized images of sound and ow. In previous research, a spatio-temporal filter was used to extract a component satisfying the wave equation. The ow and the sound are different physical phenomena, and the ow cannot be expressed by the wave equation. Hence, we think that the spatio-temporal filter enables us to separate the component of sound from the simultaneously visualized images. In this paper, we propose a method for separation of ow and sound using spatio-temporal filter in order to visualize the component of the aerodynamic sound near its source. We conducted an experiment of the separation of data measured by PPSI. The results show that the spatio-temporal filter can extract the sound from air-ow except for the sound near objects and boundaries.

©2019 The Acoustical Society of Japan. As importance of the phase of complex spectrogram has been recognized widely, many techniques have been proposed for handling it. However, several definitions and terminologies for the same concept can be found in the literature, which has confused beginners. In this paper, two major definitions of the short-time Fourier transform and their phase conventions are summarized to alleviate such complication. A phase-aware signal-processing scheme based on phase conversion is also introduced with a set of executable MATLAB functions (https://doi.org/10/c3qb).

© 2019 Acoustical Society of Japan. All rights reserved. For musical instrument sounds containing partials, which are referred to as modes, the decaying processes of the modes significantly affect the timbre of musical instruments and characterize the sounds. However, their accurate decomposition around the onset is not an easy task, especially when the sounds have sharp onsets and contain the non-modal percussive components such as the attack. This is because the sharp onsets of modes comprise peaky but broad spectra, which makes it difficult to get rid of the attack component. In this paper, an optimization-based method of modal decomposition is proposed to overcome it. The proposed method is formulated as a constrained optimization problem to enforce the perfect reconstruction property which is important for accurate decomposition and causality of modes. Three numerical simulations and application to the real piano sounds confirm the performance of the proposed method.

© INTER-NOISE 2019 MADRID - 48th International Congress and Exhibition on Noise Control Engineering. All Rights Reserved. Optical measurement of sound play an important role to understand the physical natures and spatial distributions of sound. The optical measurement of sound is especially useful under the conditions where microphones cannot be installed such as inside high-temperature fields, narrow spaces, and flow fields. Flow-induced sound generated by parallel plates is one of such situations. The measurement of the sound by microphones is difficult because the spaces between plates are narrow and the objective sound is inside flow fields. While previous research investigates the pressure field including sound fields between flat plates by computer simulations, experimental measurement have not been well investigated. In this paper, we performed the measurement of the aerodynamic sound generated by flat plates inside a flow field by parallel phase-shifting interferometry in order to experimentally capture the sound field including spaces between flat plates. The result shows that the phases of sound between plates were opposite, which is consistent with the simulation in prior research.

© 2018 Elsevier Ltd In this paper, a sound source localization method for simultaneously estimating both direction-of-arrival (DOA) and distance from the microphone array is proposed. For estimating distance, the off-grid problem must be overcome because the range of distance to be considered is quite broad and even not bounded. The proposed method estimates the positions based on a modified version of the convex clustering method combined with the sparse coefficients estimation. A method for constructing a suitable monopole dictionary based on the coherence is also proposed so that the convex clustering based method can appropriately estimate distance of the sound sources. Numerical and measurement experiments were performed to investigate the performance of the proposed method.

© 2018 IEEE. The piano is one of the most popular and attractive musical instruments that leads to a lot of research on it. To synthesize the piano sound in a computer, many modeling methods have been proposed from full physical models to approximated models. The focus of this paper is on the latter, approximating piano sound by an IIR filter. For stably estimating parameters, the Kautz model is chosen as the filter structure. Then, the selection of poles and excitation signal rises as the questions which are typical to the Kautz model that must be solved. In this paper, sparsity based construction of the Kautz model is proposed for approximating piano sound.

© 2018 IEEE. In optimization-based signal processing, the so-called prior term models the desired signal, and therefore its design is the key factor to achieve a good performance. For audio signals, the time-directional total variation applied to a spectrogram in combination with phase correction has been proposed recently to model sinusoidal components of the signal. Although it is a promising prior, its applicability might be restricted to some extent because of the mismatch of the assumption to the signal. In this paper, based upon the previously proposed one, an improved prior for audio signals named instantaneous phase corrected total variation (iPCTV) is proposed. It can handle wider range of audio signals owing to the instantaneous phase correction term calculated from the observed signal.

© 2018 IEEE. Estimating envelope of a signal has various applications including empirical mode decomposition (EMD) in which the cubic C^2 -spline based envelope estimation is generally used. While such functional approach can easily control smoothness of an estimated envelope, the so-called undershoot problem often occurs that violates the basic requirement of envelope. In this paper, a tangentially constrained spline with tangential points optimization is proposed for avoiding the undershoot problem while maintaining smoothness. It is defined as a quartic C^2 -spline function constrained with first derivatives at tangential points that effectively avoids undershoot. The tangential points optimization method is proposed in combination with this spline to attain optimal smoothness of the estimated envelope.

© 2018 IEEE. For a musical instrument sound containing partials, or modes, the behavior of modes around the attack time is particularly important. However, accurately decomposing it around the attack time is not an easy task, especially when the onset is sharp. This is because spectra of the modes are peaky while the sharp onsets need a broad one. In this paper, an optimization-based method of modal decomposition is proposed to achieve accurate decomposition around the attack time. The proposed method is formulated as a constrained optimization problem to enforce the perfect reconstruction property which is important for accurate decomposition. For optimization, the alternating direction method of multipliers (ADMM) is utilized, where the update of variables is calculated in closed form. The proposed method realizes accurate modal decomposition in the simulation and real piano sounds.

© 2018 IEEE. Wave-based acoustic simulation methods are studied actively for predicting acoustical phenomena. Finite-difference time-domain (FDTD) method is one of the most popular methods owing to its straightforwardness of calculating an impulse response. In an FDTD simulation, an omnidirectional sound source is usually adopted, which is not realistic because the real sound sources often have specific directivities. However, there is very little research on imposing a directional sound source into FDTD methods. In this paper, a method of realizing a directional sound source in FDTD methods is proposed. It is formulated as an estimation problem of the initial value so that the estimated result corresponds to the desired directivity. The effectiveness of the proposed method is illustrated through some numerical experiments.

© 2018 Optical Society of America. In this Letter, a visualization method of a fluid flow through temperature control is proposed. The proposed method enables us to visualize an invisible fluid flow by controlling the temperature so that its visibility can be easily adjusted. Such ability of adjusting appearance is effective for visualizing the phenomena consisting of multiple physical processes. In order to verify the validity of the proposed method, the measurement experiment of visualization of both flow and sound in air using parallel phase-shifting interferometry, which is a similar condition to the previous research [Opt. Lett. 43, 991 (2018)], was conducted.

© 2018 Optical Society of America. Recent development of parallel phase-shifting interferometry (PPSI) enables accurate measurement of time-varying phase maps. By combining a high-speed camera with PPSI, it became possible to observe not only time-varying but also fast phenomena including fluid flow and sound in air. In such observation, one has to remove static phase (time-invariant or slowly-varying phase unrelated to the phenomena of interest) from the observed phase maps. Ordinarily, a signal processing method for eliminating the static phase is utilized after phase unwrapping to avoid the 2π discontinuity which can be a source of error. In this paper, it is shown that such phase unwrapping is not necessary for the high-speed observation, and a time-directional filtering method is proposed for removing the static phase directly from the wrapped phase without performing phase unwrapping. In addition, experimental results of simultaneously visualizing flow and sound with 42 000 fps are shown to illustrate how the time-directional filtering changes the appearance. A MATLAB code is included within the paper (also in https://goo.gl/N4wzdp) for aiding the understanding of the proposed method.

© 2018 Optical Society of America. In this Letter, simultaneous imaging of flow and sound by using parallel phase-shifting interferometry and a high-speed polarization camera is proposed. The proposed method enables the visualization of flow and sound simultaneously by using the following two factors: (i) injection of the gas, whose density is different from the surrounding air, makes the flow visible to interferometry, and (ii) time-directional processing is applied for extracting the small-amplitude sound wave from the high-speed flow video. An experiment with a frame rate of 42,000 frames per second for visualizing the flow and sound emitted from a whistle was conducted. By applying time-directional processing to the obtained video, both flow emitted from the slit of the whistle and a spherical sound wave of 8.7 kHz were successively captured.

Parametric speakers generate narrow directive sound field using modulated ultrasonic. Small size parametric speakers have a problem in sound quality. Demodulated audible sounds by parametric speakers have poor sound pressure in low and middle frequency bands due to the theory of the finite amplitude sound. The sound pressure of a demodulated sound monotonically increases as the frequency of the demodulated sound increases. To solve these problems, an ultrasonic transducer having a wide single peak or more than two peaks must be fabricated. Our previous paper proposed to use two resonant peaks which are close each other. Two close resonant peaks were obtained by two same sized diaphragms linked each other by a specially designed rod. In this paper, a transducer was developed to better structure which has durability against strong mechanical forces and two electrical inputs to control resonant modes of vibration. Durability was improved by optimization of the junction structure. The resonant mode control was enabled by a phase difference between two electrical signals applied to piezoelectric elements on two diaphragms. We succeeded in boosting mid-range sounds, by the newly developed transducer.

For speech communication, it is useful to emphasise the sound coming from a target direction. A large-scale microphone array enables a flexible design of the directivity pattern. However, it is difficult to implement a large-sale microphone array onto an ear-type hearing aid system. In this paper, we propose a hat-type hearing aid system composed of 48 MEMS microphones that can increase the flexibility of the sound directivity pattern. We found that it is possible to reduce the number of microphones to be used by considering the hat effect, without affecting the system performance. By compensating the time delays and reducing the number of microphones based on impulse response measurements, the directivity range of the sound directivity pattern was improved by 5 dB. In addition, we conducted a qualitative evaluation that resulted in an intelligibility improvement when using our hearing aid system.

Nowadays, many acoustical applications utilize microphone arrays whose configurations have a lot of varieties including linear, planar, spherical and random arrays. Arguably, some configurations are better than the others in terms of acquiring the spatial information of a sound field (for example, a spherical array can distinguish any direction of arrival, while a linear array cannot distinguish the direction perpendicular to its aperture direction due to the rotational symmetry). However, it is not easy to compare arrays of different configurations because each array has been treated by a specific theory depending on the configuration of the array. Although several criteria have been proposed for evaluating and/or designing the arrays, most of them are application-oriented criteria, and the best configuration for some criterion may not be a better one for the other criterion. Therefore, an analysis method for microphone arrays which does not depend on the array configuration or application is necessary. In this paper, the infinite-dimensional SVD is proposed for analyzing and comparing the properties of arrays. The singular values, functions and vectors obtained by the proposed method provide the fundamental properties of an array. (C) 2017 The Authors. Published by Elsevier Ltd.

© 2018 SPIE. Optical methods have been applied to visualize sound waves, and these have received a considerable amount of attention in both optical and acoustical communities. We have researched optical methods for sound imaging including laser Doppler vibrometry and Schlieren method. More recently, parallel phase-shifting interferometry with a high-speed polarization camera has been used, and it can take a slow-motion video of sound waves in the audible range. This presentation briefly reviews the recent progress in optical imaging of sound in air and introduces the applications including acoustic transducer testing and investigation of acoustic phenomena.

© 2018 The Acoustical Society of Japan. In marine seismic surveys to explore seafloor resources, the structure below the seafloor is estimated from the obtained sound waves, which are emitted by a marine seismic sound source and reflected or refracted between the layers below the seafloor. In order to estimate the structure below the seafloor from returned waves, information of the sound source position and the sound speed are needed. Marine seismic vibrators, which are one of the marine seismic sound sources, have some advantages such as high controllability of the frequency and phase of the sound, and oscillation at a high depth. However, when the sound source position is far from the sea surface, it becomes difficult to specify the exact position. In this paper, we propose a method to estimate the position of a marine seismic vibrator and the sound speed from obtained seismic data by formulating an optimization problem via hyperbolic Radon transform. Numerical simulations confirmed that the proposed method almost achieves theoretical lower bounds for the variances of the estimations.

© INTER-NOISE 2018 - 47th International Congress and Exposition on Noise Control Engineering: Impact of Noise Control Engineering. All rights reserved. In order to reduce aerodynamic noise, understanding the nature of aerodynamic sound sources is important. Generally, aerodynamic sound is measured by using microphones. However, microphones should be installed far from aerodynamic sound sources, which makes difficult to understand the nature of aerodynamic sound sources. As non-contact measurement methods, optical measurement methods of sound have been proposed. Among those, parallel phase-shifting interferometry (PPSI) can capture time-varying phenomena. Recently, simultaneous visualization of flow and sound using PPSI has been proposed. This method enables to capture the propagation of sound inside a flow. In this paper, as an application of aerodynamic sound visualization using PPSI, results of visualization of sound sources of edge tones are shown. The nozzle-edge distance and the flow rate, which are parameters of changing frequency of an edge tone, were adjusted from 5 mm to 13 mm at intervals of 1 mm and from 15 L/min to 45 L/min at intervals of 5 L/min, respectively. The frame rate of the high-speed camera in PPSI was set to 20,000 frames per second and the size of the visualization area was 77 mm by 56 mm. From the visualized images, the characteristics of spatial spread of edge tones were observed.

© INTER-NOISE 2018 - 47th International Congress and Exposition on Noise Control Engineering: Impact of Noise Control Engineering. All rights reserved. Measurement of sound pressure inside a tube is important for duct acoustics and microphone calibration. Inserting microphone directly into sound field will disturb the field and produce inaccurate measurement result. Recently, non-intrusive sound pressure measurement using optical techniques have been proposed. A laser Doppler vibrometer is used to measure line integrals of sound pressure yield projections and a reconstruction technique is then applied to recover the original sound field from projections. In this paper, measurement of sound pressure distribution using optical method is proposed to realize direct pressure measurement for microphone calibration. A simulation of sound field reconstruction from projections using filtered back-projection technique was developed and the performance was evaluated. The reconstruction performance was evaluated for the projection of plane wave and point source wave of frequency from 1000 Hz to 16000 Hz. The implementation of the proposed method for reconstruction of sound field inside an acrylic tube diameter 61.75 mm, length 22 mm, and thickness 3.5 mm for 1000 Hz sound source from projection using laser Doppler vibrometer was performed. The result shows that the proposed method was able to reconstruct the sound field inside tube and measure pressure distribution.

© INTER-NOISE 2018 - 47th International Congress and Exposition on Noise Control Engineering: Impact of Noise Control Engineering. All rights reserved. Visualization of a sound field is a powerful tool for understanding acoustic phenomena. Methods using a microphone array such as beamforming and near-field acoustic holography have widely been studied, and these have been applied to industrial problems. As alternative choices for the visualization of the sound field, optical methods have gained a considerable amount of attention due to their capability of non-intrusive measurement. These include laser Doppler vibrometry, Shadowgraphy, Schlieren method, optical digital holography, and parallel phase-shifting interferometry (PPSI). These methods are well developed for the visualization of propagating sound wave in a free field. Also, as these methods can observe the sound field without installing any instruments into the field to be measured, they have the potential to achieve visualization of sound inside a cavity, which is quite important for duct acoustics. This paper presents the single-shot visualization of the sound field inside a transparent cavity using PPSI with a high-speed camera, as well as the brief review of the development of the optical measurement of sound. For the experiments, the sound field inside of a ported speaker box made by acrylic plates was measured. Acoustics resonances and mode patterns inside the box were successively captured.

This paper presents a method of significantly improving the previously proposed simple, flexible, and accurate phase retrieval algorithm for the random phase-shifting interferometry named HEFS [K. Yatabe, J. Opt. Soc. Am. A 34, 87 (2017)]. Although its effectiveness and performance were confirmed by numerical experiments in the original paper, it is found that the algorithm may not work properly if observed fringe images contains untrusted (extremely noisy) pixels. In this paper, a method of avoiding such untrusted pixels within the estimation processes of HEFS is proposed for the practical use of the algorithm. In addition to the proposal, an experiment of measuring a sound field in air was conducted to show the performance for real data, where the proposed improvement is critical for that situation. MATLAB codes (which can be downloaded from http://goo.gl/upcsFe) are provided within the paper to aid understanding the main concept of the proposed methods. (C) 2017 Optical Society of America

© 2017 Copyright held by the owner/author(s). We propose a visualization system of three-dimensional (3D) sound information using video and optical see-through head mounted displays (ST-HMDs). The Mixed Reality (MR) displays enable intuitive understanding of 3D information of a sound field which is quite difficult to project onto an ordinary two-dimensional (2D) display in an easily understandable way. As examples of the visualization, the sound intensity (a stationary vector field representing the energy flow of sound) around a speaker and a motor engine is shown.

As an alternative to microphones, optical techniques have been studied for measuring a sound field. They enable contactless and non-invasive acoustical observation by detecting density variation of medium caused by sound. Although they have important advantages comparing to microphones, they also have some disadvantages. Since sound affects light at every points on the optical path, the optical methods observe an acoustical quantity as spatial integration. Therefore, point -wise information of a sound field cannot be obtained directly. Ordinarily, the computed tomography (CT) method has been applied for reconstructing a sound field from optically measured data. However, the observation process of the optical methods have not been considered explicitly, which limits the accuracy of the reconstruction. In this paper, a physical -model -based sound field reconstruction method is proposed. It explicitly formulates the physical observation process so that a model mismatch of the conventional methods is eliminated. (C) 2017 Elsevier Ltd. All rights reserved.

This paper presents a non-iterative phase retrieval method from randomly phase-shifted fringe images. By combining the hyperaccurate least squares ellipse fitting method with the subspace method (usually called the principal component analysis), a fast and accurate phase retrieval algorithm is realized. The proposed method is simple, flexible, and accurate. It can be easily coded without iteration, initial guess, or tuning parameter. Its flexibility comes from the fact that totally random phase-shifting steps and any number of fringe images greater than two are acceptable without any specific treatment. Finally, it is accurate because the hyperaccurate least squares method and the modified subspace method enable phase retrieval with a small error as shown by the simulations. A MATLAB code, which is used in the experimental section, is provided within the paper to demonstrate its simplicity and easiness. (C) 2016 Optical Society of America.

Visualization of sound field using optical techniques is a powerful tool for understanding acoustical behaviors. It uses light waves to examine the acoustical quantities without disturbing the sound information of the field under investigation. Schlieren imaging is an optical method that uses a camera to visualize the density of transparent media. As it uses a single shot to capture the information without scanning, it can observe both reproducible and non-reproducible sound field. Conventionally, the Schlieren system is applied to high-pressure ultrasound and shock waves. However, since the density variation of air caused by the audible sound field is very small, this method was not applicable for visualizing these fields. In this paper, a spatio-temporal filter bank is proposed to overcome this problem. As the sound is a very specific signal, the spatio-temporal spectrum (in two-dimensional space and time) of the audible sound is concentrated in a specific region. The spatio-temporal filter bank is designed for extracting the sound field information in the specific region and removing noise. The results indicate that the visibility of the sound fields is enhanced by using the proposed method. (C) 2016 Elsevier Ltd. All rights reserved.

Imaging of sound aids the understanding of the acoustical phenomena such as propagation, reflection, and diffraction, which is strongly required for various acoustical applications. The imaging of sound is commonly done by using a microphone array, whereas optical methods have recently been interested due to its contactless nature. The optical measurement of sound utilizes the phase modulation of light caused by sound. Since light propagated through a sound field changes its phase as proportional to the sound pressure, optical phase measurement technique can be used for the sound measurement. Several methods including laser Doppler vibrometry and Schlieren method have been proposed for that purpose. However, the sensitivities of the methods become lower as a frequency of sound decreases. In contrast, since the sensitivities of the phase-shifting technique do not depend on the frequencies of sounds, that technique is suitable for the imaging of sounds in the low-frequency range. The principle of imaging of sound using parallel phase-shifting interferometry was reported by the authors (K. Ishikawa et al., Optics Express, 2016). The measurement system consists of a high-speed polarization camera made by Photron Ltd., and a polarization interferometer. This paper reviews the principle briefly and demonstrates the high-speed imaging of acoustical phenomena. The results suggest that the proposed system can be applied to various industrial problems in acoustical engineering.

In this paper, 3D sound source localization method for simultaneously estimating both direction-of-arrival (DOA) and distance from the microphone array is proposed. For estimating distance, the off-grid problem must be overcome because the range of distance to be considered is quite broad and even not bounded. The proposed method estimates positions based on an extension of the convex clustering method combined with sparse coefficients estimation. A method for constructing a suitable monopole dictionary based on coherence is also proposed so that the convex clustering based method appropriately estimate distance of sound sources. Numerical experiments of distance estimation and 3D localization show possibility of the proposed method.

Nowadays, various types of microphone array are used in many applications. However, it is not easy to compare arrays of different types because each array has been treated by a specific theory depending on the type of an array. Although several criteria have been proposed for microphone arrays for evaluating and/or designing an array, most of them are application-oriented criteria and the best configuration for some criterion may not be a better one in the other criterion. Therefore, an analysis and comparing method for microphone arrays which does not depend on an array configuration and application are necessary. In this paper, infinite-dimensional SVD is proposed for analyzing and comparing properties of arrays. The singular values and functions obtained by proposed method show sampling property of an array and can be unified criterion.

© 2017 The Acoustical Society of Japan. Many acoustical simulation methods have been studied to investigate acoustical phenomena. Modeling of the directivity pattern of a sound source is also important for obtaining realistic simulation results. However, there has been little research on this. Although there has been research on sound source identification, the results might not be in a suitable form for numerical simulation. In this paper, a method for modeling a sound source from measured data is proposed. It utilizes the sum of monopoles as the physical model, and the modeling is achieved by estimating the model parameters. The estimation method is formulated as a convex optimization problem by assuming the smoothness of a solution and the sparseness of parameters. Moreover, an algorithm based on the alternating direction method of multipliers (ADMM) for solving the problem is derived. The validity of the method is evaluated using simulated data, and the modeling result for an actual loudspeaker is shown.

© 2017 Acoustical Society of America. Sound source localization techniques using microphones have been the subject of much interest for many years. Many of them assume far-field sources, and plane waves are used as a dictionary for estimating the direction-of-arrival (DOA) of sound sources. On the other hand, there has been less research on 3D source localization which estimates both direction and distance. In case of estimating distances, monopoles must be used as a dictionary. By setting monopoles in far-field, their waves can be regarded as plane waves, and their distance can be estimated. However, monopoles set at many positions can be impossible due to high computational cost. Moreover, the grid discretization can cause estimation error because there are a lot of the number of grid points in 3D space. Such discretization issue is called off-grid problem. Therefore, a source localization with monopole-only dictionary needs some methods to solve the off-grid problem. The proposed method uses sparse estimation and modified convex clustering with a monopole-only dictionary. Sparse estimation selects the monopoles which are candidates of the source positions. Then, modified convex clustering solves the off-grid problem, and estimates source positions. In this paper, simulation and comparison with another method show effectiveness of the proposed method.

© 2017 Acoustical Society of America. Accurately measuring sound pressure is not an easy task because every microphone has its own mechanical and electrical characteristics. Moreover, the existence of a measuring instrument inside the field causes reflection and diffraction which deform the wavefront of sound to be measured. Ideally, a sensing device should not have any characteristic nor exist inside a measuring region. Although it may sound unrealistic, optical measurement methods are able to realize such ideal situation. Optical devices can be placed outside the sound field, and some of the sensing techniques, which decode information of sound from the phase of light, are able to cancel optical and electrical characteristics. Thus, optical sound measurement methods have possibility of achieving higher accuracy than ordinary sound measurement in principle. However, they have two main drawbacks that have prevented their applications in acoustics: (1) point-wise information cannot be obtained directly because observed signal is spatially integrated along the optical path; and (2) increasing signal-to-noise ratio is difficult because optical measurement of less than a nanometer order is typically required. To overcome the above difficulties, we have proposed several signal processing methods. In this paper, those methods are introduced with the physical principle of optical sound measurement.

© 2017 Acoustical Society of America. Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using a conventional two-dimensional screen, it is necessary to move a camera and measure repeatedly. On the other hand, the augmented reality (AR) techniques such as an video see-through head mounted display (VST-HMD) have been rapidly developed. In this study, we propose a sound field visualization system using an VST-HMD and a hand held four-point microphone. This system calculates sound intensity from the four sound signals in real time. Then, the sound intensity distribution is depicted as arrows in the 3D display. The position and angle of the microphones and users head are acquired via AR markers and head tracking sensors of the VST-HMD. The system realizes simple and effective visualization of 3D sound field information from the various directions and positions of view. For the experiments, the sound fields generated by loudspeakers and motorcycles were visualized. The results suggested that the proposed system can present information of the field in easily recognizable manner.

This paper presents a prototype system of a three-dimensional noise mapping system with an aerial blimp robot. The system's length is 1.5 m, its width is approximately 1.2 m, and its weight is approximately 850 g. The system is divided into two parts
one part is a balloon filled with helium gas, and the other part is a multirotor unit. Since the balloon helps to hover in the air without rotating propellers, the propeller rotation noise can be reduced. The buoyancy of helium gas is lighter than the system weight and therefore the system could return to the ground automatically, even when it is out of control caused by low battery or other problems. The multirotor unit has six propellers, which make enable omnidirectional motion. The multirotor unit also has a system control board with a field programmable gate array system on chip, which integrates central processing unit for controlling of propeller rotation, sound recording, and communicating with the host personal computer. The microphone for recording the sound is mounted at the middle of the balloon, to reduce the effect of propeller rotation noise. We evaluated the system two ways: a comparison of the propeller rotation noises between the system and a general multirotor, and an analysis of acoustical effect of the balloon. The result showed that the propeller rotation noise was reduced by 42 dB as compared with a general multirotor, and the balloon had large effects of the sound field when the balloon was placed between the sound source and the microphone. Finally, we measured the sound pressure level using the proposed system. The result showed that the proposed system can continuously measure sound pressure distribution in noise map space.

© 2017 Acoustical Society of America. Imaging of a sound field aids understanding of the actual behavior of the field. That is useful for obtaining acoustical spatial characteristics of transducers, materials and noise sources. For high spatial resolution imaging, optical measurement methods have been used thanks to its contactless nature. This paper presents sound field imaging method based on parallel phase-shifting interferometry, which enables to acquire an instantaneous two-dimensional phase distribution of light. Information of sound field is calculated from the phase of light based on the acousto-optic theory. The system consists of a polarization interferometer and high-speed polarization camera. The number of the measurement points in a single image are 512 × 512 and the interval between adjacent pixels is 0.22 mm. Therefore, the system can image a sound field with much higher spatial resolution compared with conventional imaging methods such as microphone arrays. The maximum frame rate, which is corresponding to the sampling frequency, is 1.55 M frames per second. This paper contains the principle of optical measurement of sound, the description of the system, and several experimental results including imaging of sound fields generated by transducers and reflection of the sound waves.

Phase extraction methods based on the principal component analysis (PCA) can extract objective phase from phase-shifted fringes without any prior knowledge about their shift steps. Although it is fast and easy to implement, many fringe images are needed for extracting the phase accurately from noisy fringes. In this paper, a simple extension of the PCA method for reducing extraction error is proposed. It can effectively reduce influence from random noise, while most of the advantages of the PCA method is inherited because it only modifies the construction process of the data matrix from fringes. Although it takes more time because size of the data matrix to be decomposed is larger, computational time of the proposed method is shown to be reasonably fast by using the iterative singular value decomposition algorithm. Numerical experiments confirmed that the proposed method can reduce extraction error even when the number of interferograms is small. (C) 2016 Optical Society of America

© 2016, German Acoustical Society (DEGA). All rights reserved. Optical sound measurement, which acquires acoustical quantities by means of optical techniques, is of growing interest as an alternative method for the sound field imaging. There are two remarkable aspects of the optical sound measurement. The first is non-intrusiveness. Since the measurement is achieved by observing the light passed through the sound field, the instruments can be arranged outside the measurement field; non-contact and non-destructive measurement can be achieved. The second one is spatial resolution. Instead of building an array, expanding or scanning of light are often used for the optical imaging. Therefore, the optical imaging does not have the limitation of interval of measurement points due to the size of the instruments as microphone arrays. These two aspects make the optical method possible to image sound field with high spatial resolution and without any disturbance to the original field. In this paper, we show several methods for the optical sound imaging. Laser Doppler vibrometer can be developed as the imaging methods by scanning a narrow light beam. The two dimensional of transient field measurement can be achieved by using a high-speed camera because of single-shot. In addition some signal processing techniques introduced to optical measurement are also described.

For three-dimensional shape measurement, phase-shifting techniques are widely used to recover the objective phase containing height information from images of projected fringes. Although such techniques can provide an accurate result in theory, there might be considerable error in practice. One main cause of such an error is distortion of fringes due to nonlinear responses of a measurement system. In this paper, a postprocessing method for compensating distortion is proposed. Compared to other compensation methods, the proposed method is flexible in two senses: (1) no specific model of nonlinearity (such as the gamma model) is needed, and (2) no special calibration data are needed (only the observed image of the fringe is required). Experiments using simulated and real data confirmed that the proposed method can compensate multiple types of nonlinearity without being concerned about the model. (C) 2016 Optical Society of America

Sound-field imaging, the visualization of spatial and temporal distribution of acoustical properties such as sound pressure, is useful for understanding acoustical phenomena. This study investigated the use of parallel phase-shifting interferometry (PPSI) with a high-speed polarization camera for imaging a sound field, particularly high-speed imaging of propagating sound waves. The experimental results showed that the instantaneous sound field, which was generated by ultrasonic transducers driven by a pure tone of 40 kHz, was quantitatively imaged. Hence, PPSI can be used in acoustical applications requiring spatial information of sound pressure. (C) 2016 Optical Society of America

The windowed Fourier filtering (WFF), defined as a thresholding operation in the windowed Fourier transform (WFT) domain, is a successful method for denoising a phase map and analyzing a fringe pattern. However, it has some shortcomings, such as extremely high redundancy, which results in high computational cost, and difficulty in selecting an appropriate window size. In this paper, an extension of WFF for denoising a wrapped-phase map is proposed. It is formulated as a convex optimization problem using Gabor frames instead of WFT. Two Gabor frames with differently sized windows are used simultaneously so that the above-mentioned issues are resolved. In addition, a differential operator is combined with a Gabor frame in order to preserve discontinuity of the underlying phase map better. Some numerical experiments demonstrate that the proposed method is able to reconstruct a wrapped-phase map, even for a severely contaminated situation. (C) 2016 Optical Society of America

Recent development of microphone arrays which consist of more than several tens or hundreds microphones enables acquisition of rich spatial information of sound. Although such information possibly improve performance of any array signal processing technique, the amount of data will increase as the number of microphones increases; for instance, a 1024 ch MEMS microphone array, as in Fig. 1, generates data more than 10 GB per minute. In this paper, a method constructing an orthogonal basis for efficient representation of sound data obtained by the microphone array is proposed. The proposed method can obtain a basis for arrays with any configuration including rectangle, spherical, and random microphone array. It can also be utilized for designing a microphone array because it offers a quantitative measure for comparing several array configurations.

In this study, we observe traveling sound waves with a laser and computed tomography. In our previous research, we observed steady-state sound fields using a sine wave signal. However, transient sound fields observation is necessary in order to observe more complicated sound fields that need to be separated into direct and reflected sounds. Therefore, in this study, we use a traveling sound wave (pulse sound wave). For fundamental experiments, we observed projections of a traveling pulse sound wave generated by a 2-way loudspeaker and a flat-panel loudspeaker with a laser. For transit sound fields, we used the sound field projections obtained with a laser to observe that a flat sound wave generated by a flat-panel loudspeaker is reflected by a sound-reflecting board. Then, we reconstructed the sound field information on the transition of a pulse sound wave generated by a 2-way loudspeaker, by computed tomography.

Visualization of sound field using Schlieren technique provides many advantages. It enables us to investigate the change of the sound field in real-time from every point of the observing region. However, since the density gradient of air caused by the disturbance of acoustic field is very small, it is difficult to observe the audible sound field from the raw Schlieren video. In this paper, to enhance visibility of the audible sound fields from the Schlieren videos, we propose to use spatio-temporal filters for extracting sound information and for noise removal. We have utilized different filtering techniques such as the FIR bandpass filter, the Gaussian filter, the Wiener filter and the 3D Gabor filter, to do this. The results indicate that the data observed after using these signal processing methods are clearer than the raw Schlieren videos.

Visualization is an effective way to understand the behavior of a sound field. There are several methods for such observation including optical measurement technique which enables a non-destructive acoustical observation by detecting density variation of the medium. For audible sound propagating through the air, however, smallness of the variation requires high sensitivity of the measuring system that causes problematic noise contamination. In this paper, a method for reconstructing two-dimensional audible sound fields from noisy optical observation is proposed.

A study is conducted to propose a sparse representation method for acoustic signals by the use of curvelets, and confirm its efficacy through an example of speech denoising. The curvelet denoising method was applied using the hard thresholding to speech, to demonstrate the effectiveness of the proposed representation. The method was applied to a female speech with additive pink noise for conducting the investigations. The level of the noise was chosen so that signal-to-noise ratio (SNR) became 10 dB. The thresholding process was iterated 10 times. The same input signal was processed by two denoising Methods for comparison.

Light propagating through a sound field is affected by variations in the density of the medium caused by sound. Therefore, acoustical measurements using light have been studied. The popular measurement methods use the phase shift of the transmitted light. Because they detect integrated acoustical quantities along the optical path of the detected light, time and effort are required to measure the quantities at a single point. On the other hand, single-point acoustical particle velocity measurement by light scattering has been proposed. Using light scattering enables the measurement of non-integrated quantities because the scattered light includes only the acoustical information at a scattering point. However, a method of non-invasive sound pressure measurement at a single point in a free field has not been established. This paper proposes sound pressure measurement at a scattering point, in which the light scattered by particles in the sound field is observed. The intensity of light scattered in the sound field indicates the sound pressure because the intensity of the scattered light is proportional to the density of scatterers. The theory of light scattering by sounds is formalized, and sound measurement experiments with light scattering are also conducted using water drops and air particles as scatterers.

Small highly efficient ultrasonic transducers are in high demand to fabricate compact parametric speakers. We focus on small piezoelectric transducers that can be used for ultrasonic emitters of parametric speakers. Typical small piezoelectric transducers have piezoelectric boards and radial cones. We propose a transducer consisting of a unimorph diaphragm and a flat metal plate. This structure gives two resonant peaks, which are determined by the physical parameters and dimensions of the diaphragms, the flat plate, and their junction structure. Controlling these resonant peaks is one approach to fabricating transducers having the ideal frequency response of the sound pressure for parametric speakers. We devised a design to control these two resonant peaks by adjusting the junction structure of the diaphragm and the flat plate. Using the results of a theoretical analysis, we designed an improved transducer that satisfies the ideal frequency response for parametric speakers.

We investigated a new communication-aid system focused on bone-conduction through a tooth, for listening to and recording voices. In this paper, we developed a tooth-conduction microphone (TCM) and evaluate the articulation of tooth-conducted voice (TCV). Because the TCM has the shape of one's dental mold, it is wearable like a mouthpiece. Moreover, it can extract tooth vibration during phonation as TCV. To evaluate articulation of TCV, we adopted monosyllable articulation for subjective assessment and linear predictive coding cepstral distance for objective assessment. The results of articulation show that TCV is not sufficiently clear compared to airconducted. However, it is confirmed that TCV is robust to environmental noise because the accuracy rate is not decreased when the TCV is recorded under high ambient noise.

音場の測定にはマイクロホンが広く用いられるが,音場内における測定機器の存在自体が音場を乱してしまう.そこで我々は,レーザドプラ振動計(LDV)を用いて音場に影響を与えない遠方からの観測により音場の測定及び可視化を行ってきた.しかし,これまでは離散的に測定した点を多項式を用いて補間しており,測定点以外は必ずしも妥当な値にならない問題があった.本論文では,LDVによって観測された音圧データにKirchhoff-Helmholtz積分方程式に基づく境界要素法の逆解析を導入することで,離数的に測定した情報から原音場の連続的な分布を推定する手法を提案する.また,計算機シミュレーションと実測データに提案手法を適用することでその妥当性を確認した.

One possible solution for generating point sound sources in mid air is the photoacoustic effect: energy transduction from light energy to sound energy. The photoacoustic effect generates sounds from the alternate current components of air expansion due to the heat generated by light absorption of a material when light modulated with acoustic signal is radiated to a material. In order to confirm sound reproduction using the photoacoustic effect, the experiments to reproduce a pure tone and a musical sound is performed. In order to generate louder sound, the light from the halogen lamp is focused on a charcoal, which has high absorptive power since a charcoal is black and spongy. It is shown that a halogen lamp can be modulated with acoustic signal although the amplitude of higher frequency components is reduced because of the response speed of halogen lamp. Next, the experiments of sound reproduction using a halogen lamp and a charcoal were performed.

An effective way to understand the behavior of a sound field is to visualize it. An optical measurement method is a suitable option for this as it enables contactless non-destructive measurement. After measuring a sound field, interpolation of the data is necessary for a smooth visualization. However, conventional interpolation methods cannot provide a physically meaningful result especially when the condition of the measurement causes moire effect. In this paper, a special interpolation method for an optically visualized sound field based on the Kirchhoff-Helmholtz integral equation is proposed.

A Yagi-Uda antenna gets high directivity by applying current phase shift between elements due to resonance phenomena. It has some directors and reflectors, which are elements without electric supply. The length of directors is shorter than half-wave and that of reflectors is longer than half-wave. We proposed an acoustic Yagi-Uda antenna which elements are resonance tubes and a loudspeaker. The aim of this research is to im- prove directivity in a specific frequency. This can be applied to Radio Acoustic Sounding System (RASS), which is a kind of radar for weather observation, or to a parametric loudspeaker. The phase shift of sound waves was observed in the condition with a resonance tube and without the tube at the same position. That shift changes suddenly around the resonance frequency of the tube. Our acoustic antenna has resonance tubes that have different length as directors and reflectors to apply this phenomenon. Moreover, the distances be- Tween a loudspeaker and tubes were concerned by some experiments and by numerical analysis. The acoustic antenna showed directivity in an appropriate condition of the distances and the frequency of the sound source. It will be also added the consideration about the effective frequency band of this acoustic antenna.

高齢者は放送番組の背景音(音楽・効果音)をうるさく感じたり,アナウンサーや役者の音声が不明瞭で聞きづらく感じたりすることがある.これに対し,家庭側(受信機側)で高齢者に適した番組音声に調整する装置の開発を進めている.音声区間(ナレーション・セリフと背景音が混在する区間)では,ステレオ背景音の無相関な成分を抑圧し,相関成分では音声の母音や子音の音響的な特徴をフィルタ処理により強調し,非音声(背景音だけの)区間は,ゲイン制御のみによる劣化のない抑圧を行なうことで,番組全体での音質劣化を抑制する手法を提案した.提案手法により6dB相当番組背景音を抑圧できることを主観評価で確認し,高齢者視聴実験により番組音が聞きとりやすくなることを確認した.

Piezoelectric actuators are used in a wide range of electrical devices, including piezoelectric speakers, buzzers, haptics and ultrasonic transducers. For piezoelectric actuator systems used in mobile devices, the most important issue is improving the electromechanical conversion efficiency. The power consumed by the actuators must be minimized due to the small size of the batteries used. The frequency response around the mechanical resonance must be carefully designed to enable low power driving. The resonant frequencies of piezoelectric actuators that consist of integrated components, such as the metal cones in ultrasonic speakers, are determined by the energy dispersion of the total system. Therefore, factors such as the size and physical properties of each component must be designed to optimize the resonant frequencies for practical applications. The total energy of the piezoelectric system is described by Lagrange-Maxwell equations. Even though it is not easy to solve the differential equations written in a Lagrangian coordinate system by using exact calculations, useful information for designing systems can be derived from approximate calculations. In this paper, we will introduce design guidelines that can be used to optimize the resonant frequencies of piezoelectric actuators with integrated components, based on analysis using the Lagrangian coordinate system. © 2013 Acoustical Society of America.

It is highly important to generate a point sound source in mid air for several applications such as virtual realty and precise acoustic measurement since most of acoustic theories are based on a point sound source. One possible solution for generating a point sound source in mid air is the photoacoustic effect that generates sounds from the alternate-current components of air expansion due to the heat generated by light absorption of a material when light modulated with acoustic signal is radiated to a material. To apply this method to molecule of gases in mid air, it is possible to generate a point sound source in mid air. Thus, for the first step to realize this possibility, this paper attempt to confirm that it is possible to generate audible sounds using the photoacoustic effect. In particular, this paper describes the sound generation using a charcoal that has high absorptive power and a halogen lamp that can produce high intensity infrared light, which is easier, absorbed by gas molecules than visible light. © 2013 Acoustical Society of America.

One common problem of outdoor recordings is a contamination of wind noise which has highly non-stationary characteristics. Although there are a lot of noise reduction methods which work well for general kinds of noises, most methods perform worse for wind noise due to its non-stationary nature. Therefore, wind noise reduction need specific technique to overcome this non-stationary. Empirical mode decomposition (EMD) is a relatively new method to decompose a signal into several data-driven bases which are modeled as amplitude and frequency modulated sinusoids that represent wind noise better than quasi-stationary analysis methods such as short-time Fourier transform since it assumes an analyzing signal as non-stationary. Thus, EMD has a potential to reduce wind noise from recorded sounds in an entirely different way from ordinary methods. In this paper, the method to apply EMD as a wind noise suppressor is presented. The experiment is performed on a female speech superimposed with wind noise, and the results showed its possibility. © 2013 Acoustical Society of America.

Conversation is one of the most important channels for human beings. To help communications, speech recognition technologies have been developed. Above all, in a conversation, not only contents of utterances but also intonations and tones include important information regarding a speaker's intention. To study the sphere of human speech, microphones are typically used to record voices. However, since microphones have to be set around a space, their existences affect a physical behavior of the sound field. To challenge this problem, we have suggested a recording method using a high-speed camera. By using a high-speed camera for recording sound vibrations, it can record two or more points within the range of the camera at the same time and can record from a distance, without interfering with the sound fields. In this study, we extract voice information using high-speed videos which capture both a face and a cervical part of the subject. This method allows recording skin vibrations which contain voices with individuality and extrapolating sound waves by using an image processing method. The result of the experiment shows that a high-speed camera is capable of recording voice information. © 2013 Acoustical Society of America.

Since bone-conducted sound is conveyed to cochlea directly, without passing through eardrum, it is audible even for hard-of-hearing people whose inner ears are still normal. In this study, we utilize bone-conducted sound via teeth so as to support sound communication. We implemented a bone-conducted actuator on teeth, while actuators of prevalent hearing aids are attached to mastoid, forehead or jaw in general. Teeth convey sound excitation more easily, because they are bare bones, not covered with skin. Our communication aid is made in the form of mouthpiece with a dental material, and it can be readily put on and taken off from a tooth. Using this actuator, we attempted to record vibrations of teeth when a subject produces a sound. In addition, we carried out experiments regarding sound lateralization of bone-conducted sound via teeth with this actuator. The result shows that examinees can perceive right and left using bone-conducted sound via teeth. The aim of this study is to suggest a new communication aid system not only for hard-of-hearing people but also for the robust. © 2013 Acoustical Society of America.

骨伝導を用いた技術は高騒音下等における新しい音声伝達方法として期待されている.近年では,音楽再生,音声受聴用としてヘッドホンや携帯電話のヘッドセットに骨伝導技術を用いたものが普及しつつある.また,聴覚障害者のための補聴システムとして骨伝導アクチュエータを搭載している補聴器もある.通常,骨伝導アクチュエータは乳様突起,耳珠などの箇所に取り付けられることが多い.これに対し,歯はむき出しの骨であり,皮膚を介すことなく効率良く音響信号を伝達することができると考えられる.本研究では,歯を介した骨導音に着目したコミュニケーションエイトの提案を行う.超磁歪素子を用いて歯骨伝導アクチュエータを作製し,このアクチュエータを用いて検知限測定及び音像定位測定を行った.その結果,コミュニケーションエイドとして有効なデバイスとなり得る可能性を確認することができた.

This study is a report of the result of investigating the sound environment at setting childcare scene in nursery institutions focused on children's learning activity aiming to make the acoustic environment as their learning field. By the behavioral observation and the sound field analysis at activity scene, we observed the characteristic of sound field at each study scene and the change of the acoustic environment when the teacher was setting the learning environment.The result shows that the sound by the children's behavior was a keynote source at dynamic activity scene like singing and dancing. Especially, the level of 1-2kHz band by children's voice and low frequency sound was characteristic. And for making settled space that was attached weight in young children's educational field, teachers often used the sound factor by the setting environment scene and a moderate silence was a very important environmental factor. For acoustic design according to the educational purpose, many-sided investigation of the sound space was essential to understand the teacher's setting behavior and children's behavioral pattern.

In this paper, we propose a measuring method of the sound field from high-speed movie of dust. The movements of dust in the sound field are affected by the sound vibration. We observe the dust using high-speed cameras. The movie is recorded by one high-speed camera in order to get the information of 2-D sound field and two high-speed cameras for 3-D. The influence of air current is reduced from the movement of dust so that the sound field information is extracted. The experimental results indicate that this method is effective to observe the sound field especially composed of low frequency components.

With the aim of making speech easier to listen to on a TV receiver, a noble method for back-ground-sound suppression processing was proposed, and the results of evaluation tests using broadcast-program sound showed that a prototype device was able to adjust a suitable level of background sound for elderly people. Our proposed method was able to suppress the magnitude of sound components with low correlation by using 2ch stereo signals and perform gain-control only on the speechless intervals. The preparatory evaluation tests confirm that it is possible to suitably reduce program background volume by the proposed method. On the basis of this result, a device for suppressing background sound by decoding the transport stream (TS) of a broadcast program was prototyped. The results of evaluation tests using this device demonstrate that the magnitude of background sound can be adjusted to a suitable level for elderly people.

A measuring method of the sound field using a high-speed movie of dust was proposed. A sound field generated using two speakers was measured from high-speed movies of dust. Two high-speed cameras and the powered monitor speakers were located. Speaker-L was driven by the sound of Japanese drums and Speaker-R was driven by 80 Hz sinusoidal sound. To analyze the frequency component, generalized harmonic analysis (GHA) was used. From the result of the waveforms and the frequency components, it is confirmed that the sound field information can be obtained from the movement of dust.

A study was conducted to demonstrate the design guidelines to use the multiband compressor as the suppressor of the electrical power for piezoelectric speakers. The design guidelines stated that the driving system needed to be designed according to signals whose energy concentrated in high frequency band, as electrical admittance of the piezoelectric speakers increased along with power consumption in high frequency band. The performance of the proposed system was investigated and the cutoff frequency of high pass and low pass filters and parameter of compressor were optimized to satisfy two requirements, such as high frequency components of standard signal, which needed to go through without any suppression and energy of high frequency band needed to be suppressed without exceeding the maximum rating of the driving system when it was excess. The response in time domain needed to be calculated as the solution of ordinary differential equations for the equivalent circuit for accurate estimation.

設置された位置で瞬時音圧を光強度に変換するデバイスをアレー状で空間に配置し音場の可視化を試みている.このセンサ(本システムではマイクロホン)とディスプレイ(本システムではLED)を一体化したものをセンサ・ディスプレイ複合(SDC:Sensor-Display Composite)と呼ぶことにする.SDCは観測する物理量をその位置から光によって伝送するデバイスであり,観測した物理量とその位置情報を同時に伝送できる利点がある.マイクロホンと発光体のSDCデバイスを用いた音場の可視化は古くから試みられている.一つのデバイスで空間をスキャンする方式では一定時間音場の維持が必要であり,定在波の観察や再現可能な音場の観察は可能であるが一度しか生成することのできない音場に対してはその観察が困難であり,任意の音場に対しては時変動を十分に把握できない.本研究ではSDCの二次元アレーに波形が認識できる程度の表示能力をもたせ,音波の可視化を可能にした.SDCデバイスの大きさは約1cm^2程度であり,現時点で利用可能な小型のMEMSマイクロホンとフルカラーLEDに加えてマイクロプロセッサを搭載し,ディジタル信号処理と時系列メモリ機能を備えた.時系列メモリを用いた音波の記録や再生を外部からコントロールできるので,任意の時刻近傍における音波の伝搬を時間を引き伸ばして観察することが可能であり,現場において非常に有効なものとなる.

本論文ではレーザと計算断層撮影法を用い,過渡的な音場の観測を試みる。前報までの実験では正弦波信号を用いて定常的な音場の観測を行った。しかし,より複雑な音場の観測には直接音と反射音の区別など,過渡的な音場の観測が必要不可欠である。そこで,測定信号に進行波(パルス音波)を用いる。基礎的な実験として,2ウェイスピーカと平板スピーカの2種類のスピーカを用いて駆動されたパルス音波の伝搬をレーザ音場投影により観測した。過渡的な音場の観測実験として平面スピーカにより駆動された平面波が音響反射板に反射する様子をレーザ音場投影によって観測した。また,計算断層撮影法を用いた音場情報の再構成によって,2ウェイスピーカで駆動したパルス音波の伝搬の観測実験を試みた。

The use of the bread slicing method to reduce the amount of communication among nodes of a computer cluster on parallel computing of the distributed memory system, was investigated. The computer cluster consisted of 128 calculating nodes were used for the study. The sound wave in a three dimensional sound field was used to determine nodes distance. Boundary conditions was used to calculate sound pressure at grid points. The 256 GB memory space of the cluster was used for dividing the calculating field. The calculation of the sound field was performed using a spatial grid that is effective to calculate field with less memory space. The field was divided by the bread slicing method that requires a shorter communicating time among the processes. The method has the ability to increase the speed and scale of a distributed memory system.

本論文では筆者らが提案するレーザドプラ振動計と剛壁を用いた音圧分布の再構成法の測定精度を検討し,誤差の要因を予測する目的で,レーザの反射面の振動による測定精度への影響の分析と屈折率と音圧の変換の誤差について論じる。基礎的な実験として,スピーカの再生する音場に対して,レーザを用いた音圧レベルと騒音計を用いた結果の比較対照を行った。結果として,屈折率と音圧の変換の誤差と壁面の振動による誤差が十分に無視できることを確認した。

The method for estimating the direction of arrival (DOA) using a matching pursuit algorithm under reverberant conditions is discussed. The method starts with the obtaining of an array output of the delay-and-sum method and calculating the average array output in the fixed frequency range. The DOA is estimated by iteration at each step and a re-optimization of all DOA found at the earlier steps. It is suggested that the method can be improved by considering the spatial information from this method.

In this paper, we describe some new sound field measurement methods by using laser Doppler vibrometer (LDV). By Irradiating the reflection wall with a laser, we can observe the light velocity change that is caused by the refractive index change from the change in air density. It means that it is possible to observe the change of the sound pressure.
We measured a sound field projection on a 2-D plane using a scanning laser Doppler vibrometer (SVM) which can visualize a sound field. And we made a 3-D sound field reconstruction from some 2-D laser projections based on the computed tomography (CT) techniques. We made the reconstruction image for the sound field near the loudspeaker or in the room.

In this paper, we describe a new source separation method in which uses spatial information derived from the direction of arrival (DOA) estimates of each direct and reflected sound issued. The method we propose has the following steps: (1) each DOA is estimated using matching pursuit and reoptimized after each new DOA is estimated, (2) using these DOA estimates, the mixing matrix is also estimated and the inverse of the mixing matrix is used to separate the mixture signals. In our experiments, we obtained a better signal separation with the new method than with the conventional frequency-domain independent component analysis (ICA)-based source separation method.

The sound field reproduction has been studied by many people. Dr. Itow suggested the stereophonies and an analyze the two channels system. We extend this theory and suggest the sound field control and reproduction method by wave front synthesis considering human hearing sense. We explain the stereophonies system and multi speakerphones system. Then we simulate this system and make sure of its effect. We are able to construct the virtual reality system, which has a realizable number of speakerphones.

Reverberation time, distribution of sound pressure, intelligibility, and/or other parameters are used in sound room evaluation. But characteristics of room acoustics are complex, and often quite different impressions are received from rooms that have nearly the same parameters. These differences might come from the difference of spatial information, especially in early reflection periods. Thus a four‐microphone method is proposed to measure spatial information of the room. Here, the sound field reproduction using the wavefront synthesis [A. J. Berkhout, J. Acoust. Soc. Am. 93(5) (1993) and Y. Yamasaki, J. Acoust. Soc. Jpn. 10(2) (1989)] based on the four‐point measurement is discussed. © 1996, Acoustical Society of America. All rights reserved.

本研究では、歯を介した骨伝導に着目し、新たなコミュニケーションエイドを提案した。骨の一部である歯を直接駆動することは特性の点からも、効率の点からも、その性能を向上させる上で非常に有効な手段となりうる。小型で様々な歯型に適合可能なマウスピース型歯骨伝導デバイスを開発し、明瞭性、聴き取りやすさを中心とした受聴特性を明らかにし、新たな音情報伝達経路として十分利用可能であることを示した。また、マウスピース型歯骨伝導デバイスを用いた音声情報取得に関する検討を行い、騒音下でも明瞭な音声の取得が可能であることを示した。さらに、デバイスの無線化等の改良を加え、装着、持ち運びが容易なシステムとした

これまで断熱系として論じられてきた音の伝搬であるが非常に細い管の中などでは熱の移動を無視できない状態となる。本研究では、分子動力学法を導入した音波伝搬の計算、音場の解析を行い、さらに音場に影響を及ぼさない音場測定手法を実現し、計算と実験の両面から熱の移動を無視できない状態の音場を解明することを目的とする。分子動力学法を用いることにより熱の移動を考慮した音場計算を可能とした。また、非線形音場の解析手法を提案し、種々の非線形現象の計算を可能とした。さらに、レーザや高速度カメラを用いた音場に影響を及ぼさない音場測定技術を確立、計算と実験の両面から現象を解析し、細い管の中の音場の挙動を確認した

系譜研究では、イスラム陶器の発展史を把握するために、初期イスラム時代の水壺と白地藍彩双鳥文の来歴に焦点を当てた考察が中心的に行われた。また薬（ヘイサラバサラ）をめぐる東西交渉史に関する論考報告もなされた。地域比較研究においては、インドネシアの国立イスラム大学におけるワークショップと、早稲田大学におけるシンポジウムの２つを中心に議論が進められた。前者では主に、医療分野での情報技術の利用に焦点が当てられ、ヘルスケアと高齢者ケアにおける先端技術のあり方と今後の展望に関しての討議が行われた。特に、インドネシア社会の特長ともなる、①ムスリム社会福祉・教育活動のためのIT推進の手法、②島嶼国家におけるIT推進に伴う困難の克服、の２点が重要な討議事項となった。後者では主に、「アラブの春」後の経済動向に焦点を当て、特にサラフィー主義（厳格なイスラム回帰主義）の拡大が経済問題の政策に与える影響に関する点が討議された。特にこの動向が影響を持つ地域には、エジプトおよび湾岸諸国があり、今後の動向の予測が行われた。これらワークショップとシンポジウムの討議内容は、イスタンブルおよびカイロで開催された研究集会においても、重要な報告事項となった。これらの他には、アジア地域におけるイスラム問題が手がけられ、中国における部分的イスラム化に対する考察や、マレーシアにおける若者の価値意識に関する考察が行われた。

1)系譜研究:農業分野では精糖技術の復元、窯業分野ではイスラム陶器の分析研究、薬学分野では医薬技術と社会意識との接点の研究を通して、前イスラムの時代から近代直前期まで幅広い時代のイスラム技術の系譜が紐解かれた。2)広域研究:中東イスラム、東南アジア、中央アジアの動向分析を通して、地域に育まれた豊かな経済が新たな資源の登場によって消滅していく過程や、イスラム圏の各地でITがさまざまな形で積極的に利用されている動向も明らかになった。

本研究では先人達が限られた技術環境で実現した蝋管・SPレコードやテープレコーダなどの記録システムにより記録された情報を現在の技術を駆使して傷つけることなく,非接触・非破壊で内容を細大漏らさず読み取り保存・再生する技術を確立するとともに博物館,図書館,学校等で手軽に使用する事のできる精密な複製や専用の再生装置を構築しようというものである。
痛みの激しい貴重な文化財であるレコードやテープに記録された映像や音を再生し,CD,DVD等のディジタルメディアに記録保存するいわゆるディジタルアーカイブ作業が盛んに行われている。これらは多くの場合いずれもアナログのレコードプレーヤやテープレコーダを使って再生した信号をディジタル収録したうえ,信号処理技術により雑音や歪の軽減処理を施しディジタルメディアに記録しているのが現状である。
本研究ではレコードプレーヤやテープレコーダで再生するのではなく,レコードやテープを超音波,レーザ,走査顕微鏡,3次元写真技術等によりレコード,蝋管は非接触でその溝の3次元形状を把握し記録・保存しようというものである。また必要に応じて研究や観賞を目的とした原本と同じ正確な複製を作成する。
初年度の研究により古いレコードやテープに驚くほど質の高い音声や映像が記録されていることを確認した。次年度の研究によりレコード,蝋管をレーザ走査顕微鏡を用いて音溝全体を読み取り平均化することにより音溝全体に含まれる情報を読み取る手法を確立した。また一般化調和解析を用いることにより破壊された蝋管やレコードからの音を復元する手法を確立した。さらに肉眼では判断することの困難なくらい傷んだ蝋管からクラスタ分析を用いて音溝を特定する手法を確立した。最終年度では蝋管やレコードの読み取り,復元,保存処理を一貫して行うソフトウェアを確立した。

本研究は,申請者が日本学術振興会特別研究員時の3年間にわたって行ってきた三次元音空間の記述に関する研究に基づき,理論的に確立していたが膨大なハードウェア規模と制勧系の制約から実音場への適用が全く試みられていなかったキルヒホッフの積分公式に基づく音場制御を実現しようというものである。具体的には,三次元音場を効率的に記述(符号化)し,それを伝送し,現在開発中のマルチセル型平面スピーカを用いることによりキルヒホッフの積分公式に基づく音場制御を実現する。聴覚特性を考慮することによりキルヒホッフの積分公式の近似がどの程度可能であるのか,キルヒホッフの積分公式を用いるにあたっての新しい空間の記述(符号化)に関して更なる考察を加え,マルチセル型平面スピーカを用いてその理論を実空間に適用したシステムを構築し,聴感的評価を行ないシステムの最適化を図る。今年度は以下のことについて研究を行った。1.三次元音場再生システムにおけるキルヒホッフの積分公式の近似,空間の記述(符号化)について理論的考察を加えた。さらに平面スピーカを用いた再生システムを構築し聴感実験を行った。2.独立成分分析(ICA)による信号分離,人間の情景分析方法を考慮した音場の空間情報の取得とそれに基づく音源分離について研究をし,それらを用いた音場の記述について考察を加えた。音源分離の技術の空間記述への適用の可能性が確かめられた。3.これらの結果を統合し,HDクラスの映像と音場の伝送システムを構築した。4.これらの結果の一部を「Matching Pursuitを用いた音源方向推定と音源分離」として発表した

人間は雑踏やパーティーの中でもある人の声あるいは音に着目して、いとも簡単にその音を聞き分けコミュニケーションをとることができる。本研究では、ある点あるいは領域の情報をそのまま記述・伝送するのではなく、人間が普段行っているように音響環境・空間情報・対人情報を含むコミュニケーションコンテンツ、コミュニケーション環境情報の理解と記述を行い、それらをオブジェクト符号化することにより高臨場感通信を目的とした三次元音場の理解と記述を行う。具体的には、マイクロホンアレーの技術を基にした音場の空間情報の把握、伝達系の予測、聴覚機構を考慮することにより複雑な系においても音環境の理解を可能とする手法を提案する。これより得られる音場の空間情報とそれを利用した音源分離手法によりオブジェクトを記述する。また、記述されたオブジェクトを伝送・再現する三次元音場再現システムを構築し、聴感的評価を行う。これまで伝達系の予測,聴覚機構を考慮することにより複雑な系においても音環境の理解を可能とする手法を提案し、これより得られる音場の空間情報とそれを利用した音源分離手法によりオブジェクトを記述してきた。本年度は、人間は通常反射特性を利用し音源方向推定等を行っているということに着目し、計算機シミュレーションを用いて設計した反射板と単一マイクロホンを用いた音源方向推定手法を提案した。実際に反射板を作成し実験によりその有効性を確認した。また、昨年度までに構築した音源方向推定を行う空間情報把握システム、音源・受音点間の伝達系の予測を用いた音源分離システムを用い、実環境での音源オブジェクトの抽出を行った。さらにコンデンサスピーカにより再生空間を囲んだ三次元音場再現システムを構築し、音場の伝送・再現実験を行った。特に音の距離感に関する検討を加え、試聴実験を行い、距離感を含めた音場再現が可能であることが確認された

　光学透過型ヘッドマウントディスプレイ(HMD)と空間認識センサを用いることにより、ビデオ透過型システムよりも自然な視覚情報と、広範囲の視点移動とオクルージョンを考慮した可視化が可能なシステムを新たに提案した。１．ビデオ透過型システムよりも自然な視覚情報呈示２．オクルージョンの不一致が生じない視覚情報呈示３．大空間における計測・可視化と広範囲の視点移動を確立、有効性を確認することができた。　今後は、複数人での観測や情報の共有が可能なシステムに発展させる。本システムを用いることにより、音源と音場の両者の計測・可視化を行い、それらを統合した音源の記述を目指す。

没入型超高精細三次元音場創生システムの構築を行い、その性能を明らかにした。本庄キャンパスに4 MHz高速1bit信号を用いた256ch音場創生システムを構築した。大規模なシステムでの信号の取り扱いが容易な高速1bit信号を用いることにより、広範囲に設置されたスピーカまでデジタル信号のまま多チャンネルの信号を少ないケーブルで伝送可能なフルデジタルシステムを実現した。システムの基本的な性能の評価、遅延和による波面制御とWFSによる波面制御を実施し、どちらの制御手法でもシミュレーション結果に近い波面が確認され、提案システムが三次元音場創生に対して適用可能であることが確認された。

　これまで申請者は，歯を介した骨伝導に着目し，小型で装着が容易な歯骨伝導デバイスの開発と歯骨伝導音の基礎的な聴感特性の把握を行い，コミュニケーションエイドとしての利用の可能性が十分あることを確認してきた．本研究では，空間を伝搬する音の集音方法、残響の影響の軽減に関して検討を行った．具体的には，これまでの研究成果に基づき頭部周辺の音の伝搬解析とそれに基づいた集音処理のための技術，低遅延な残響感抑圧手法を確立した．それにより残響の影響の少ない集音が可能であること，音の明瞭性，自然さが向上することを確認した．今後は実用化を目指し研究をすすめる所存である．

　物理モデルとスパースモデルに基づき各種問題の定式化，それを解くアルゴリズムの開発を行った．音を対象とした研究を進めるので、物理モデルとしては波動方程式を採用した．また，実際の環境にあわせて音源の空間的かつ時間的スパース性を仮定した．その条件の下で問題をモデル化，その最適解の探索を行い，光学的音場計測や音場可視化への適用，音源位置探査と推定された音源が生成する音場の推定への適用を検討した．その結果，雑音まみれの中から音情報の抽出，音が発生している位置，時間，さらには推定された音源が作り出す音場の推定を可能とした．空中のみならず、水中の音場についてもその有効性を確認した．

　これまで申請者は，歯を介した骨伝導に着目し，小型で装着が容易な歯骨伝導デバイスの開発と歯骨伝導音の基礎的な聴感特性の把握を行い，コミュニケーションエイドとしての利用の可能性が十分あることを確認してきた．本研究では，これまでの研究成果に基づき骨伝導デバイスの高度化を実現し，相互コミュニケーション可能な歯骨伝導デバイス実現のための技術を確立した．受聴特性の把握，取得された音声の評価，明瞭化を検討した．歯骨導音により取得した音声の特性，歯骨導音受聴における聴覚特性の把握を補正することにより歯骨導音の明瞭性が向上することを確認した．今後は実用化を目指し研究をすすめる所存である．

　音響光学効果，光音響効果に関する理論，それを応用した光学的音響計測，空中に任意の音源を再生するシステムの基礎の確立を目的とした．まず，可聴音場における音響光学効果の理論解析および適切なモデルの検討を行なった．固体光音響効果の理論，サーモホンの理論，伝熱理論に基づき，光音響効果を利用した音響再生システムの実現に向けた統一的な理論構築のための検討を行った．次に，それら検討に基づき，位相シフト干渉法と偏光計測技術を組み合わせ音による高速な空気の屈折率変調を定量的かつ高空間分解能で計測可能とした．音響信号で変調したレーザを物体に照射することにより非常に小さい音圧であるが音の再生を可能とした．

　保育の場は、子どもにとってはじめて家族以外の集団の中で生活する場である。様々な場面において集団でともに活動する中で社会の規律を体得することは、幼児教育の場が担う大きな役割の一つである。それ故、話を聞く場面や音楽活動等の授業場面のみならず、食事や着替え行為等の日常生活行動も幼児に とって重要な学習場面であると捉えられる。また、集団活動の規模として自分と教諭、同年代同士という小さな集団からクラス全体といった大きな集団での活動へと、年齢とともに発展してゆく。学習場面として日常生活行動が重要であること、及び年齢ごとにコミュニケーション形態が異なることは保育の場の環境設計において重要な観点である。　現在までに、幼稚園教育の場における音環境の現状把握及び実験的な環境設 計に取り組んできた。本研究では、幼児の行動に伴う発生音を学年別に観測し、発達に適した学びの場として重要な音響条件を考察した。さらに対象を日本国内の幼稚園に限らず、国外の同様の施設についても調査を加えることとした。具体的には、ドイツ、ミュンヘンの幼稚園と共同でその音環境の調査をした。　その結果、幼稚園での一斉保育活動に着目し、年齢ごとに活動の成り立ちが異なること、及びそれに伴って音環境が異なる傾向にあることについて言及すると同時に、教育の場として学びの質自体も大きく変化し、教諭のかかわりが大きく変化してゆくことを観測した。幼児の行動発達としても、他者とのかかわり方の発達から、音情報の受け取り方、行動に伴う音のフィードバックの受け方も著しい発達過程にあることが示唆された。また、学年ごとの違いが大きいことから、同じ学年でも1年間で学びの質が大きく変化してゆくことが推察できる。　以上の結果から、保育の場の音環境設計として落ち着ける適度な静けさの確保は共通して求められる要件であるといえよう。それに加え、室内での学びの形態が発達過程に沿って展開し得ることが重要であるとすると、教諭によって適宜環境設計をおこなうことが必要である。今後は、幼児の音コミュニケーシ ョン活動に着目し、その発達過程を捉え環境設計にフィードバックしてゆく所存である。

　音波伝播の解析には、音線法に代表されるような幾何音響解析手法、有限要素法や差分法に代表されるような波動音響解析手法が提案されている。高い周波数の音波が伝播する場合や、マイクロデバイス近傍の流れのように伝播する空間が狭い場合、気体中の着目点近傍の分子数が小さくなり、分子の衝突や相互作用がその物理特性に影響を及ぼすことが言及されている。このような空間の音場を解析する場合、気体分子運動に着目した分子気体力学および分子動力学法に代表されるような分子シミュレーションによる解析を行う必要がある。　本研究では熱音響現象等の解析を目指し分子運動を考慮した音場の解析を試みた。分子の衝突や相互作用から分子位置を計算する分子動力学法に着目し、分子の衝突や相互作用から分子位置を計算しつつ音波伝播の解析を試み、分子の衝突や相互作用が音波伝播に及ぼす影響について検討を行った。　具体的には、分子動力学シミュレーションを行い、分子位置を逐次求めた。求められた分子位置を、x軸方向から伝播してくる音波が観測できるような x-y 平面、x-z 平面にプロットした。気体分子は移動するが10^-14s後という非常に短い時間内に分子との衝突が起こることが分子位置と分子速度ベクトルの長さから考えることができた。これは気体分子の平均自由行程か63nmと小さく、十分な時間が経過しても空気中の分子はある一定の「塊」 で存在することを示している。また、任意の領域において巨視的な密度、速度分布を求めた。これより音波の伝播を分子運動から解析すると、粒子速度か正の値を取る場合分子数密度か小さくなり平均速度は大きな値を取る、粒子速度か負の値を取る場合分子数密度が大きくなり平均速度が小さな値を取ることが示された。さらに、圧力分布に関して、時間平均値を求めてブラウン運動の影響を最小限にすることを試みた。その結果、瞬時値と比較してグラフ全体の尖度が小さくなり、その中で尖度が大きい部分が存在し、圧力分布が最大値を取ることがわかった。その後圧力分布の大きなところが発生する。この圧力の伝播は音波によるものと考えることができる。　以上より、分子動力学法を用いて、分子の衝突や相互作用から分子位置を計算しつつ 音波伝播の解析を試み、密度分布と速度分布を求めた。今回は領域外に出てしまった分子に関して周期境界条件を用いて解析を行ったが、境界条件による誤差が現れてしまったので、シミュレーション領域を大きくとるか境界条件を改めて考える必要がある。今後は分子動力学法でこれまでに提案されている境界条件を用いて解析を行うこと、酸素や窒素など二原子分子について同様な解析か可能かどうか検討を加えてゆく所存である。

　就学前の幼児期において生活してゆく環境は非常に重要であり、その時期にふれあった人やモノなどの環境全体が後の成長に与える影響は極めて大きい。中でも音環境は、人々のコミュニケーション活動において重要な役割を果たしている。会話のような言語的コミュニケーションのみならず、「話のはずむ空間」「落ち着ける居場所」といった“場の雰囲気”や、サイン音・環境音等の外的刺激によるあらゆる行動の“動機づけ”など、音環境は人やモノを含めたコミュニケーション活動全般に深く影響していると考えられる。　本研究では、幼児の学習の場である幼稚園施設を対象とし、視覚的側面に比べてその重要性に差がつけ難く多面的な検討が必要な“音環境”に着目する。多彩な音、言語や音楽、建築学的な“音の響き”など、音響的側面における“他とのふれあい”を意識した環境づくりのための音環境観測手法について検討し、幼児の観点に立った音環境デザインの提案と実践を目指す。具体的には1) 幼児の観点に立った音環境観測手法の検討・ コミュニケーション活動の観測技術の開発・ 幼稚園における学習活動の観測2) 幼児の観点に立った音環境デザインの提案と実践・備品を用いた音空間づくりの実践を行った。音環境観察手法の検討としては、カメラ映像にマイクロホンアレーで収録した音情報をスーパーインポーズしどの場所からどのような音が発生しているかを観測可能な音響TVの開発や高速度カメラを用いた音場観察手法の検討を行った。特に音響TVに関してはそれを用いた幼稚園での活動の観測を行い、活動形態の違いによる音の発生の様子の違いを観測した。幼児の観点に立った音環境デザインの提案と実践としては、園舎室内床に絨毯を敷き込み、環境の変化前後の音響性能測定及び活動時の音環境の観測を行った。幼児にとっては新たな環境とかかわることであそびの活動が変化し、 創造的な活動の展開が促された。音響性能としての変化は残響時間の差として現れる一方、実際の活動時の音環境は一義的に変化せず、環境の変化による影響が活動形態によって異なる結果となった。

これまで音場の把握を目的として近接４点法をはじめとする手法で様々な音場を観測してきた。特に近年では実音場の精細な把握・測定を目的として、レーザ干渉計を用いた音場の観測法を試みている。本手法は光波が空気中を進む際その速度が空気の密度により変化する現象に基づきレーザ干渉計を用いて測定された光路長の変化から空気の疎密（音）を観測するものである。さらにレーザ干渉計を走査して得た音場の投影情報に計算断層撮影法を適用することで音圧分布の再構成を行ってきた。レーザを用いた音場の観測法は、広範囲の音場の空間情報を同時に計測することを可能にし、また観測対象となる音場に直接、観測器を設置することがないという特徴がある。 これまでの研究ではスピーカの再生する定常的な音場を観測の対象とし、測定信号には正弦波の連続信号を用い、特定の周波数成分について観測を行ってきた。しかし、反射音など複雑な音場を観測するには、直接音と反射音の区別など、過渡的な音場の観測を可能にする必要がある。本研究では測定信号にパルス音波を用い、レーザ干渉計によって進行波の観測を行った。平板スピーカにより駆動された平面進行波（パルス音波）の音響反射板による反射について、走査型レーザ干渉計による音波の２次元の投影と２次元の計算機シミュレーションの結果との比較を行った。また、投影情報を計算断層撮影法を用いて点の情報に再構成しなおすことでより音場の詳細な情報が得られることを示し、そこでパルス音波の点情報への再構成を試みた。また、音の干渉、反射、回折などの基礎的現象の観測を行った。特に高速道路などに設置されている防音壁の効果、スピーカアレイの指向性制御を確認することができた。 レーザを用いることで測定点自体に測定器を置く必要がないという特徴をもつことから様々な音場への応用が期待されているが、本手法を測定技術として確立するには実現できる測定精度を明らかにし、誤差の要因をできる限り予測する必要がある。本研究では提案するレーザによる測定手法における測定における誤差の基礎的な分析も行った。スピーカの再生する音場に対してレーザを用いた音圧レベル分布と騒音計を用いた結果の比較を行い，壁面の振動による誤差が充分に無視できることを確認した。 さらに、高速度カメラを用いた音場測定に関し検討を加え、発音体の振動そのものの観測、LEDと高速度カメラを用いた音場観測の基礎的実験を行い、その有用性を示した。

　近年、 実際とは異なった場所にいながらあたかも本当の場で体験するようなことを体験できるバーチャルリアリティ（人工現実感）に関心が高まってきており、さまざまな研究が行なわれている。バーチャルリアリティにおいては音より映像が主体であるかのように思われがちであるが、 実際の場の雰囲気を正確に得るためには音は重要な役割をはたす。音場の再現を目指した国内の研究としては古くはＮＨＫの牧田康雄、早大の伊藤 毅らによる立体音響再生に関する研究、東京電機大学の三浦種敏らによるＯＳＳやＮＴＴの金田　豊、三好正人らによるＭＩＮＴを使ったトランスオーラル系に関する研究、米国ではＮＡＳＡをはじめ多くの研究機関で、ヨーロッパでは Ruhr 大学の Blauert らにより両耳受聴、再生システムに関する研究が行なわれている。　本研究は、理論的に確立していたが膨大なハードウェア規模と制御系の制約から実音場への適用が全く試みられていなかったキルヒホッフの積分公式に基づく音場制御を実現しようというものである。また、そのために必要となるであろう空間の記述（符号化）について研究を行なう。キルヒホッフの積分公式の近似による波面合成法を用いることによる実現可能なスピーカ数での三次元音場再生方法の確立、あるいは新しい音場再生手法の確立を目指す。キルヒホッフの積分公式の近似がどの程度可能であるのか、キルヒホッフの積分公式を用いるにあたっての新しい空間の記述（符号化）に関して考察し、その理論を実空間に適用したシステムを構築し、 聴感的評価を行ないシステムの最適化を図る。　三次元音場再生システムにおけるキルヒホッフの積分公式の近似、キルヒホッフの積分公式を用いるにあたっての空間の記述（符号化）、2スピーカを用いた立体音響再生理論およびそれを多スピーカへ拡張した場合について理論的考察を加えた。それに基づき、パーソナルコンピュータを用いた計算機シミュレーションによりさまざまな条件での音圧分布、波面を計算し、スピーカ数の違い，方法の違いが再生音場へ及ぼす影響を調べた。また，原音場と再現音場の比較を行い考察を加えた。その結果を踏まえ実空間に適用した再生システムを構築し、音源位置を変えた音場再現の実験を行った。さらに，近接4点法による音源定位位置を求める実験、聴感実験を行い聴感的評価を行った。　その結果、従来の手法では聴感的に音源の定位はある程度得られるものの，物理測定では所望の位置への音源の定位は困難であったが，この手法により音源の数が制御系より少ない場合には近接４点法による測定によって正確な位置に定位することが確認された。　本研究では、音場制御領域を特定の点から空間に拡張し、２～３スピーカによる立体音響再生法を拡張した方法を提案し，実現可能な数の制御系で比較的広い範囲にわたり音場の再生を実現した。近接4点法を用いた実験により音源位置の定位を確認することができた。また、聴覚実験により聴感的に必要かつ十分な制御システムであることが確認できた。