JP2011211396

Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2011211396
The present invention provides an acoustic system which sets a virtual sound source in a space
between a reflection surface such as a wall of a room and a listener and enables more accurate
sound image localization. An acoustic system (10) of the present invention comprises a signal
source (21) for generating a signal wave in an audible band, a plurality of carriers for an
ultrasonic band, and a plurality of modulated waves generated by modulating the carrier wave
with the signal wave. Virtual sound source SS of the signal wave at a predetermined position in
the transmission path of the modulated wave in the space between the ultrasonic speaker SP and
the reflecting surface that reflects the modulated wave emitted from the ultrasonic speaker SP
and the listener And a control unit (filter processing unit) 22 that controls the sound pressure at
the predetermined position. [Selected figure] Figure 2
Acoustic system and setting method of virtual source thereof
[0001]
The present invention relates to an acoustic system which can be suitably used mainly for a
mixed reality system and a method of setting a virtual sound source thereof.
[0002]
In recent years, mixed reality (MR) that amplifies and expands information in the real
environment by superimposing and displaying virtual information such as computer graphics
(CG) images and characters on images of the real environment (real space) captured by a camera.
Research and development related to (Mixed Reality) technology is actively conducted.
04-05-2019
1
[0003]
In addition, the auditory elements are combined with such visual mixed reality technology, and as
the sound is generated from the virtual information superimposed and displayed in the real
environment, the direction and distance of the source of the sound Attempts have also been
made to obtain higher reality by localizing (sound image localization).
For example, Patent Document 1 discloses a technique of providing a plurality of sound
generation sources inside a headphone worn by a listener and causing a listener to localize a
sound image according to the position of the sound generation source generating the sound. .
[0004]
Unexamined-Japanese-Patent No. 5-336599
[0005]
However, in the technology of Patent Document 1, the wearing of the headphones by the listener
is a precondition, and only a single person wearing the headphones can experience the virtual
environment, and an individual with head transfer function There is also a problem that the
difference in sound image localization accuracy is lowered.
Furthermore, the listener is bothered by wearing headphones.
[0006]
The present invention has been made in view of the above-described circumstances, in which a
virtual sound source is set in a space between a reflection surface such as a wall of a room and a
listener, and accurate sound image localization without wearing headphones Acoustic system and
method for constructing the same.
[0007]
The acoustic system according to the present invention comprises a signal source for generating
an audible signal wave, and a plurality of ultrasonic speakers for generating an ultrasonic wave
carrier and emitting a modulated wave modulated by the carrier wave. In order to set a virtual
04-05-2019
2
sound source of the signal wave at a predetermined position of the transmission path of the
modulated wave in the air between the listener and a reflection surface that reflects the
modulated wave emitted from the ultrasonic speaker, And a controller configured to control a
sound pressure.
[0008]
According to the setting method of the virtual sound source in the acoustic system of the present
invention, a modulated wave obtained by modulating a carrier wave of an ultrasonic band by an
audio band signal is emitted by an ultrasonic speaker, and the emitted modulated wave is
reflected by a reflection surface. A control point is set in the transmission path of the modulated
wave in the air between the reflecting surface and the listener, and a virtual sound source of the
signal wave is set by controlling the sound pressure at the control point. .
[0009]
According to the acoustic system and the virtual sound source setting method of the present
invention, the carrier wave in the ultrasonic band is modulated by the signal wave to generate
and emit a modulated wave, and the modulated wave is reflected on the reflection surface to
generate the modulated wave. Listening to the listener (signal wave) to the listener.
Also, a virtual sound source of audible sound is set between the reflecting surface and the
listener.
For this reason, it is possible to give the listener a feeling that sound is generated from the
position and direction of the air different from the position of the actual sound source, and to
perform accurate sound image localization even without wearing headphones etc. Is possible.
[0010]
In the sound system, the control unit sets the relative relationship of the sound pressure at the
plurality of control points to a predetermined value in order to set any one of the plurality of
control points set in the transmission path as a virtual sound source. It is preferable to have a
filter that
[0011]
04-05-2019
3
Further, in the virtual sound source setting method described above, one of the control points is
set as a virtual sound source by setting a plurality of control points in the transmission path and
setting a relative relationship between sound pressures at the plurality of control points. It is
preferable to set.
[0012]
Thus, by setting a plurality of control points in the transmission path of the modulation wave and
setting the relative relationship of the sound pressure at these control points to a predetermined
value, it is possible to set the virtual sound source appropriately.
For example, if the sound pressure at one control point is set to be higher than the sound
pressure at another control point, the listener can obtain a feeling that sound is generated from
the one control point, One control point can be recognized as a virtual sound source.
[0013]
It is the schematic which shows the use form of the acoustic system which concerns on
embodiment of this invention.
It is a block diagram of an acoustic system.
It is explanatory drawing which shows the acoustic transfer system model for setting the
characteristic of a filter.
It is an explanatory view showing a basic model of a sound transfer system. It is a figure which
shows the relationship between an input-output, a transfer function, and a filter. It is a graph of
the sound pressure level-frequency characteristic which shows the output result when not using
a filter. It is a graph of the sound pressure level-frequency characteristic which shows the output
result at the time of setting a filter by condition 1. FIG. It is a graph of the sound pressure levelfrequency characteristic which shows the output result at the time of setting a filter by condition
2. FIG. It is a graph of the sound pressure level-frequency characteristic which shows the output
result at the time of setting a filter by condition 3. FIG. It is a graph of a sound pressure level-
04-05-2019
4
frequency characteristic of an original signal inputted into an acoustic system. (A) is a graph
which shows the evaluation result of the sound image localization of the subjective virtual sound
source by a listener, (b) is a table ¦ surface which shows the evaluation result. (A) is a schematic
plan view which shows the usage form of an acoustic system at the time of providing the
reflective surface (reflective member) which concerns on other embodiment in the wall surface of
a room, (b) is a perspective view of a reflective member. It is a schematic plan view which shows
the usage form of the acoustic system at the time of providing the reflective surface (reflective
member) which concerns on other embodiment on the wall surface of a room. It is a perspective
view which shows the ultrasonic speaker which concerns on other embodiment. It is a schematic
plan view which shows the use form of the ultrasonic speaker shown by FIG.
[0014]
<< Configuration of Sound System >> FIG. 1 is a schematic view showing a usage of the sound
system according to the embodiment of the present invention. The sound system 10 of this
embodiment transmits the sound radiated from the speaker SP inside the room to the listener H
who is in a specific place in the room R, and the sound source is the position of the actual
speaker SP. Instead, the sound image is localized as emitted from the virtual sound source SS set
in the indoor space. Therefore, by using the acoustic system 10 in combination with mixed reality
(MR) technology for displaying a virtual space superimposed on a real space, for example, a
virtual image in which a sound emitted from the speaker SP is displayed superimposed as if in
the air It is possible to give the listener H a feeling as if it were generated from
[0015]
In the present embodiment, an ultrasonic speaker is used as the speaker SP. The ultrasonic
speaker uses an ultrasonic wave that human beings can not perceive as sound at a high
frequency of 20 kHz or more as a carrier wave, and a modulated wave that has been spread and
modulated with a signal wave in the audible band such as voice into the air with a large
amplitude causing nonlinearity. It radiates. The modulated wave is distorted due to the nonlinearity of air in the process of propagating in the air, so the signal wave which is an audible
sound is self-demodulated due to this distortion, and a highly directional sound field is formed .
Further, in the present embodiment, the virtual sound source SS is set in the transmission path of
the modulated wave reflected by the wall surface (reflection surface) W of the room R.
[0016]
04-05-2019
5
FIG. 2 is a block diagram of an acoustic system. The sound system 10 of the present embodiment
includes a signal source 21, a filter processing unit 22, a carrier generation unit 23, a modulation
unit 24, an amplification unit 25, and an oscillator 26. Among these components, the carrier
generation unit 23, the modulation unit 24, the amplification unit 25, and the oscillator 26 are
components of the ultrasonic speaker (ultrasonic speaker system) SP of this embodiment. The
signal source 21 generates a signal wave in the audible band, such as an audio signal or an audio
signal, and outputs the signal wave to the filter processing unit 22. The filter processing unit 22
includes a filter for setting the virtual sound source SS in the space in the room, and the filter
imparts a predetermined characteristic to the signal wave and outputs the signal wave to the
modulation unit 24. Therefore, in the present embodiment, the filter processing unit 22
constitutes the control unit of the present invention.
[0017]
The carrier generation unit 23 generates a carrier consisting of ultrasonic waves of a
predetermined frequency, and outputs the carrier to the modulation unit 24. The modulation unit
24 performs spread modulation on the carrier wave input from the carrier wave generation unit
23 by the signal wave input from the filter processing unit 22 to generate a modulation wave.
Then, this modulated wave is emitted from the oscillator 26 in a state of being amplified by the
amplification unit 25.
[0018]
The signal source 21, the filter processing unit 22, the carrier wave generation unit 23, and the
modulation unit 24 according to the present embodiment are not limited to an operation unit
such as a CPU, a memory, a storage unit such as an HDD, and other personal computers
including an input / output interface It is configured. The personal computer functions as the
signal source 21, the filter processor 22, the carrier wave generator 23, and the modulator 24 by
executing software installed in the personal computer.
[0019]
<< Method of Setting Filter >> Next, although a method of setting the filter provided in the filter
04-05-2019
6
processing unit 22 will be described, the sound between the sound source and the sound
receiving point will be described using the basic model of the sound transmission system as an
example. Explain how to communicate (Basic Model of Sound Transfer System) FIG. 4 is an
explanatory view showing a basic model of the sound transfer system. In this basic model, one
sound source (speaker) SP and one sound receiving point (microphone) MIC are installed inside
the room R. The signal x (t) is input to the speaker SP, and the microphone MIC picks up the
signal radiated from the speaker SP and outputs a signal y (t).
[0020]
In FIG. 4, G (z) is a transfer function representing how sound is transmitted between the speaker
SP and the microphone MIC. The transfer function G (z) is obtained by z-transforming the
discrete sequence g (0), g (1), g (2),... Obtained by sampling the impulse response observed by the
microphone MIC. . Then, assuming that signals obtained by z-transforming the signals x (t) and y
(t) are X (z) and Y (z), respectively, there is a relationship shown in equation (1) between them.
[0021]
[0022]
On the other hand, when an input of X (z) = 1 is given to such an acoustic transmission system,
the following equation (2) can be obtained.
[0023]
[0024]
Therefore, the transfer function G (z) can be obtained by obtaining the output Y (z) obtained by
the input X (z) = 1.
Then, in the present embodiment, the characteristics of the filter are set using the relationship
between the input / outputs X (z) and Y (z) and the transfer function G (z) as described below.
04-05-2019
7
[0025]
(Sound Transfer System Model of Embodiment) FIG. 3 is an explanatory view of a sound transfer
system model for setting filter characteristics.
In order to set the virtual sound source SS on the transmission path of the modulated wave
emitted from the ultrasonic speaker SP and reflected by the reflection surface W, a plurality of
control points are set on the transmission path, and the sound pressure of this control point is
set. Control by filter.
In the present embodiment, three control points are set on the modulation wave transmission
path, and the microphones MIC1 to MIC3 are provided at each control point.
[0026]
It has been established by the "Multiple Input / Output Inverse Theorem (MINT) Theory" that the
sound pressure of N control points can be controlled by using (N + 1) or more speakers.
Therefore, also in the present embodiment, four ultrasonic speakers SP1 to SP4 are used for
three control points MIC1 to MIC3 based on the "MINT theory".
[0027]
Then, the original signal X (z) is input to the four ultrasonic speakers SP1 to SP4, the modulated
waves radiated from the ultrasonic speakers SP1 to SP4 are reflected by the reflecting surface W,
and the self-demodulated sound of the modulated waves (Audible sound) is picked up by a
plurality of microphones MIC1, MIC2 and MIC3 arranged at the control point (sound receiving
point). The outputs of the microphones MIC1, MIC2 and MIC3 are Y1 (z), Y2 (z) and Y3 (z),
respectively. The inputs X (z) are then filtered H1 (z), H2 (z), H3 (z) so that the desired outputs
Y1 (z) to Y3 (z) can be obtained at each control point MIC1 to MIC3. , H 4 (z) are processed to
predetermined characteristics.
[0028]
04-05-2019
8
FIG. 5 is a diagram showing the relationship between input / output signals and transfer
functions and filters. When the input X (z) is emitted from the ultrasonic speakers SP1 to SP4
after being processed by the four filters H1 (z) to H4 (z) and collected by one microphone MIC1,
the ultrasonic speakers SP1 to SP4 are generated. A transfer function representing how sound is
transmitted between SP4 and the microphone MIC1 can be represented by G1,1 (z), G1,2 (z),
G1,3 (z), G1,4 (z) . The transfer functions G1,1 (z) to G1,4 (z) can be obtained by the same method
as the above-described method obtained with reference to the basic model (FIG. 4). Then, the
output Y1 (z) of the microphone MIC1 can be expressed as shown in the equation (3) using the
transfer functions G1,1 (z) to G1,4 (z). Similarly, for the output Y2 (z) and the output Y3 (z), as
shown in the equations (4) and (5) using the transfer functions G2,1 to G2,4, G3,1 to G3,4 It can
be expressed in
[0029]
[0030]
Here, when the output Y (z), the transfer function G (z), and the filter H (z) are respectively
expressed as matrices as in equations (6) to (8), the above equations (3) to (5) are , Can be
expressed as equation (9).
[0031]
[0032]
[0033]
[0034]
[0035]
Then, when designing the filter, the input X (z) = 1 is input to obtain the equation (10).
04-05-2019
9
Then, by using the inverse matrix G <−1> (z) of the transfer function G (z), it becomes possible to
obtain the filter H (z) as shown in equation (11).
[0036]
[0037]
In designing the filter using equation (11), it is necessary to set the values of the outputs Y1 (z) to
Y3 (z) of the microphones MIC1 to MIC3 and their relative relationships.
Here, when it is intended to set the position of the microphone MIC1 farthest from the listener H
to the virtual sound source SS (condition 1), Y1 is generated so that the signal wave which is the
original sound is reproduced in this microphone MIC1. Determine the value of (z).
Then, the relative relationship between the sound pressures of the microphones MIC1 to MIC3 is
set as shown in the following equation (12).
[0038]
(Condition 1) Y1 (z)> Y2 (z)> Y3 (z) ... (12)
[0039]
That is, the sound pressure at the position of the microphone MIC1 farthest from the listener H is
set to be the largest, and then the sound pressure is set to decrease in the order of the
microphone MIC2 and the microphone MIC3.
By setting the relationship between the outputs Y1 (z) to Y3 (z) in this manner, the listener H can
feel the loudest audible sound produced at the position of the microphone MIC1, and an audible
sound is generated from this position. It becomes possible to localize the sound image as it does.
[0040]
04-05-2019
10
When setting the position of the microphone MIC2 to the virtual sound source SS (condition 2),
the value of the output Y2 (z) is determined so that a signal wave which is an original sound is
reproduced in the microphone MIC2.
Then, the relationship between the output Y2 (z) and the other outputs Y1 (z) and Y3 (z) is set as
shown in equation (13).
(Condition 2) Y1 (z) = Y2 (z)> Y3 (z) ... (13)
[0041]
Here, the reason that Y1 (z) = Y2 (z) is that even if the output Y1 (z) at the position of the
microphone MIC1 is the same as the output Y2 (z) at the position of the microphone MIC2, the
microphone MIC1 This is because the audible sound at the position is attenuated before being
transmitted to the listener H and the sound pressure is reduced because the user H is separated
from the listener H.
Therefore, by setting the outputs Y1 (z) to Y3 (z) of the microphones MIC1 to MIC3 as described
above, the listener H can feel the loudest audible sound generated at the position of the
microphone MIC2, and The sound image can be localized so that an audible sound is generated
from the position.
[0042]
Similarly, when setting the position of the microphone MIC3 to the virtual sound source SS
(condition 3), the value of the output Y3 (z) is determined so that the signal wave which is the
original sound is reproduced in the microphone MIC3. The relationship between the output Y3
(z) and the other outputs Y1 (z) and Y2 (z) is set as shown in equation (14).
(Condition 3) Y1 (z) = Y2 (z) = Y3 (z) ... (14)
04-05-2019
11
[0043]
Also in this case, as in the above, even if the outputs Y1 (z) and Y2 (z) in the microphones MIC1
and MIC2 are the same as the output Y3 (z) in the microphone MIC3, the microphones MIC1 and
MIC2 Because of the separation, the audible sound at the position is attenuated before being
transmitted to the listener H, and the sound pressure is reduced. Therefore, by setting the
outputs Y1 (z) to Y3 (z) of the microphones MIC1 to MIC3 as described above, the listener H can
sense the loudest audible sound generated at the position of the microphone MIC3. The sound
image can be localized so that an audible sound is generated from the position.
[0044]
(Measurement Result of Output) The output result of the microphones MIC1 to MIC3 acquired by
setting the filter by the method as described above is shown in FIGS. 7 to 9 are graphs of sound
pressure level-frequency characteristics showing the output when a filter is used. Moreover, FIG.
6 is a comparative example, and is a graph of the sound pressure level-frequency characteristic
which shows the output when not using a filter. The input was white noise having a sound
pressure level-frequency characteristic shown in FIG.
[0045]
FIG. 7 shows an output result when the filter is set according to the above (condition 1). In this
case, the position of MIC1 is taken as the virtual sound source SS. In this case, the output of
MIC1 is high, the output of MIC2 is suppressed by about 1.8 dB on average compared to MIC1,
and the output of MIC3 is suppressed by about 4.6 dB on average.
[0046]
FIG. 8 shows an output result in the case where the filter is set according to the above (condition
2). In this case, the position of MIC2 is taken as the virtual sound source SS. In this case, the
outputs of MIC1 and MIC2 are high, and the output of MIC3 is suppressed by about 4.0 dB on
average compared to MIC1 and MIC2.
04-05-2019
12
[0047]
FIG. 9 shows an output result in the case where the filter is set according to the above (condition
3). In this case, the position of MIC3 is taken as the virtual sound source SS. In this case, it can be
seen that there is almost no difference in the sound pressure levels of MIC1 to MIC3.
[0048]
Therefore, it is understood that the sound pressure at the position of each of the microphones
MIC1 to MIC3 can be appropriately controlled by using the filters H1 (z) to H4 (z).
[0049]
(Sound Image Localization Result) FIG. 11A is a graph showing an evaluation result of sound
image localization of a subjective virtual sound source by a listener, and FIG. 11B is a table
showing the evaluation result.
In this evaluation, using the filters H1 (z) to H4 (z) set as described above, as shown in FIG. 3, the
virtual sound source SS is set in the indoor space, and several listeners It is evaluated whether
the virtual sound source SS can be localized accurately. The virtual sound source SS was set at a
position separated from the wall W by distances (presentation distances) L1 to L3, and the
listener performed evaluation at a position separated from the wall W by a distance L4. The
position of the virtual sound source SS was 60 cm (= L1), 100 cm (= L2), and 140 cm (= L3) from
the wall W, and the position of the listener H was 150 cm (= L4) from the wall W. And the
distance from the position of the virtual sound source SS which each listener H localized to the
wall surface W was measured, and the average response distance was obtained.
[0050]
From the results shown in FIG. 11, although the position of the virtual sound source SS set using
the filter does not exactly coincide with the position of the virtual sound source localized by the
listener H, the wall W to the virtual sound source SS As the distance increases, the distance from
the wall W localized by the listener to the virtual sound source also increases. Therefore, it has
been confirmed that the virtual sound source SS can be set to such an extent that the distance
04-05-2019
13
from the wall surface W can be distinguished by using the filter. In addition, it has been found
that when the filter is not used, the virtual sound source SS is localized as being located closest to
the wall surface W.
[0051]
<< Other Embodiments of Reflecting Surface >> FIG. 12 (a) is a schematic plan view showing a
state in which a reflecting surface (reflection member) according to another embodiment is
provided on the wall of a room, and FIG. 12 (b) is a reflection. It is a perspective view of a
member. In the acoustic system 10 mentioned above, although the example which makes the
wall surface W of a room a reflective surface and reflects a modulated wave was shown, as
shown in FIG.12 (b), the reflective member 31 provided with several reflective surfaces is room R
It may be provided for the wall surface of The reflecting member 31 is formed in a square
pyramid having a square base and side surfaces of an equilateral triangle. And by using such a
reflecting member 31, it becomes possible to set the reflection direction of the modulated wave
as desired. For example, as shown in FIG. 12A, a plurality of ultrasonic speakers SP directed in
different directions are collectively provided at one place, and the self-demodulated wave (signal
wave) emitted from each speaker SP is a listener H Can be focused on.
[0052]
FIG. 13 is a schematic plan view showing the usage of the acoustic system in the case where a
reflective surface (reflective member) according to still another embodiment is provided on the
wall of a room. The reflecting member 31 is formed in a hemispherical shape. By using such a
reflecting member 31, it becomes possible to diffuse the modulated wave after reflection to some
extent (expand the directivity range). Therefore, it is possible to expand the audible area of the
self-demodulation wave and to cope with the movement of the listener H.
[0053]
<< Another Embodiment of Ultrasonic Speaker >> FIG. 14 is a perspective view showing an
ultrasonic speaker according to another embodiment. This ultrasonic speaker SP is provided with
a plurality of oscillators 26 in a polyhedron housing 41. In the illustrated example, oscillators 26
are provided for a plurality of faces included in a regular icosahedron. Each oscillator 26 is
attached to the housing 41 so as to be adjustable in angle so that the radiation direction of the
04-05-2019
14
modulation wave can be adjusted.
[0054]
By using such an ultrasonic speaker SP, it is possible to radiate a modulated wave from any one
place in the room R in any direction, and it is possible to set a virtual sound source at any place
in the room R. Further, as shown in FIG. 15, by using the ultrasonic speaker SP and the reflecting
member 31 in combination, it is possible to concentrate on a specific part of the room R and
transmit the modulated wave. Further, in the acoustic system 10 shown in FIG. 3, the plurality of
ultrasonic speakers SP <b> 1 to SP <b> 4 can also be configured by the ultrasonic speakers SP
shown in FIG. 14.
[0055]
The casing 41 constituting the ultrasonic speaker SP is not limited to a regular icosahedron, and
may be a polyhedron different from this, and the oscillator 26 is not each face of the casing 41
but each vertex May be provided.
[0056]
The present invention is not limited to the above embodiment, and can be suitably modified
within the scope described in the claims.
For example, the acoustic system of the present invention is not limited to use with a mixed
reality system, but can also be used as an acoustic system installed in exhibition halls, concert
halls and the like.
[0057]
DESCRIPTION OF SYMBOLS 10 Sound system 21 Signal source 22 Filter processing part H
Listening person MIC1-MIC3 microphone (control point) SP1-SP4 ultrasonic speaker SS virtual
sound source
04-05-2019
15

Download Report