JP2010272911

Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2010272911
An external sound of a moving body 1000 is provided while maintaining a positional relationship
with an occupant. A sound collection apparatus (200) having a front microphone (201, 202)
provided forward of a moving direction of a moving body (1000) and a rear microphone (211,
212) provided backward of the moving direction of the moving body (1000) , 202 based on the
first sound signal corresponding to the sound collected by 202, the first sound output signal
generation function 102 for generating the first sound output signal controlled so that the sound
can be heard from the preset virtual sound source And a sound image generation function 103
for generating a sound image formation signal in which a sound image is localized at a
predetermined control point from the first sound output signal and / or the second sound signal
corresponding to the sound collected by the rear microphones 211 and 212. And an output
control function 104 for outputting a sound to the acoustic device 400 mounted on the mobile
object 1000 based on the sound image formation signal.
Sound information providing apparatus and sound information providing method
[0001]
The present invention relates to a sound information providing apparatus and a sound
information providing method for providing sound information to a passenger of a moving body.
[0002]
There is known a technique of localizing a sound source position from correlation of signals of
sounds of surrounding vehicles detected by two microphones and localizing a sound image in the
direction of the localized sound source position (see Patent Document 1).
04-05-2019
1
[0003]
Patent 2776092 gazette
[0004]
However, in the prior art, when there are a plurality of sound sources, processing for localizing
the direction of the sound source position and processing for localizing the sound image in the
direction of the sound source position must be performed for each. The problem is that it takes
[0005]
The present invention generates a first sound output signal controlled so that a sound can be
heard from a predetermined virtual sound source, based on a first sound signal corresponding to
a sound collected in front of the traveling direction of the mobile body. A sound image forming
signal for localizing the sound image to predetermined control points set in advance based on the
first sound output signal and / or the second sound signal corresponding to the sound collected
behind the traveling direction of the moving body The above problem is solved by generating a
sound and outputting a sound based on the sound image formation signal.
[0006]
According to the present invention, the external sound collected in front of the moving direction
of the moving object is controlled so that it can be heard from the preset virtual sound source,
and the sound image of the sound heard from the virtual sound source and the sound collecting
behind the moving object Since the sound image of the generated sound is localized at each
predetermined control point in the movable body room, the positional relationship between the
sound source external to the movable body and the occupant inside the movable body is
maintained while suppressing the cost for external sound processing. Sound information emitted
by a sound source outside the moving body can be provided to the occupant inside the moving
body.
[0007]
FIG. 1 is a block diagram of an in-vehicle apparatus 1 including a sound output controller 100
according to the present embodiment.
It is a figure which shows the specific example of the hardware constitutions of the vehicle-
04-05-2019
2
mounted apparatus A of this embodiment.
It is a figure for demonstrating the functional block structure of the sound output controller 100
of this embodiment shown in FIG.
It is a figure which shows the example of installation of the sound collector 200 (201-204) of
this embodiment.
It is a figure which shows an example of the sound collection range by the back microphones
211,212.
It is a figure which shows the example of the sound collection range by front microphone
201,202 and back microphone 211,212.
FIG. 6 is a diagram for describing a visual range of a driver of a vehicle 1000. FIGS. 7A and 7B
are diagrams showing an example of the microphones 211 and 212 provided with the artificial
pinnacle member 231. FIG. It is a figure for demonstrating the path ¦ route which a sound
reaches ¦ attains to the back microphone 211 which provided the pseudo ¦ simulation pinnacle
member 231 from the sound source 1 ahead of a vehicle, and the sound source 2 behind a
vehicle. It is a figure which shows the example which provided the microphone cover 251 in the
back microphone 211 which provided the artificial pinnacle member 231. As shown in FIG. It is a
figure which shows the other example which provided the microphone cover 251 in the back
microphone 211 which provided the artificial pinnacle member 231. As shown in FIG. It is a
figure which shows the example which provided the front microphones 201 and 202 in the cover
of a light. It is a figure which shows the example of installation of the front microphones 201 and
202 provided with directivity. It is a figure for demonstrating the sound collection range of a
unidirectional microphone, and the sound collection range of a dead angle control microphone. It
is a 1st figure for demonstrating a 1st sound output signal production ¦ generation process, and
is a figure for demonstrating the processing method converted into the sound which can be
heard from a virtual sound source by convolving a filter to a 1st sound signal. It is a 2nd figure
for demonstrating a 1st sound output signal production ¦ generation process, and is a figure for
demonstrating the structure of the filter which produces the sound in a virtual sound source
from the input sound signal. It is a figure for demonstrating the creation method of the filter
using a delayer. It is a figure for demonstrating the creation method of the filter using a space
transfer characteristic. It is a figure for demonstrating the case where one virtual sound source is
arrange ¦ positioned ahead of a vehicle. It is a figure for demonstrating the case where two
04-05-2019
3
virtual sound sources are arrange ¦ positioned ahead of a vehicle. It is a figure for demonstrating
a sound image production ¦ generation process. It is a figure which shows the example at the
time of installing a back speaker in the headrest of a seat. It is a flowchart figure for
demonstrating the procedure of the provision process of the sound information of 1st
Embodiment. It is a figure which shows an example of the hardware constitutions of the sound
output controller 100 of 2nd this embodiment. It is a figure for demonstrating the functional
block structure of the sound output controller 100 of 2nd Embodiment shown in FIG. The figure
for demonstrating the production ¦ generation process of the 1st sound output signal controlled
so that it could hear from one virtual sound source of a vehicle interior based on the sound
acquired from the two front microphones 201 and 202 provided ahead of the vehicle. It is. It is a
figure for demonstrating the processing example which makes the front speaker 401 provided in
front of a vehicle output the sound collected by one microphone 201 provided in front of the
vehicle. It is a flowchart figure for demonstrating the procedure of the provision process of the
sound information of 2nd Embodiment.
[0008]
First Embodiment Hereinafter, a sound output controller 100 according to the present
embodiment will be described based on the drawings. The sound output controller 100 according
to the present embodiment is a device mounted on a vehicle 1000 as a moving body and
providing information of sound generated outside the vehicle 1000 to the interior of the vehicle
1000.
[0009]
FIG. 1 is a block diagram of an information providing apparatus A including a sound output
controller 100 according to the present embodiment.
[0010]
As shown in the figure, the information providing device A includes a sound output controller
100, a sound collecting device 200 for collecting sounds around the vehicle, and an acoustic
device 400 for outputting a sound controlled by the sound output controller 100. Have.
These respective devices are connected by a vehicle-mounted LAN such as a CAN (Controller
Area Network) and exchange information with each other.
04-05-2019
4
[0011]
Further, as shown in the figure, the sound output controller 100 according to the present
embodiment controls a sound acquired by the sound collection device 200 and stores a program
for causing the sound device 400 to output the sound. By executing a program stored in the
ROM 2 and the ROM 2, a CPU (Central Processing Unit) 1 as an operation circuit functioning as
the sound output controller 100 and a RAM (Random Access Function) functioning as an
accessible storage device. Memory 3). As an operation circuit, in place of or together with CPU
(Central Processing Unit) 1, MPU (Micro Processing Unit), DSP (Digital Signal Processor), ASIC
(Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array) Etc. can be used.
[0012]
FIG. 2 is a diagram showing a specific example of the hardware configuration of the information
providing device A shown in FIG.
[0013]
As shown in FIG. 2, information (signals) of sound collected by the front microphones 201 and
202 and the rear microphones 211 and 212 included in the sound collection device 200
provided outside the vehicle is input to the sound output controller 100. Be done.
[0014]
The front microphones 201 and 202 are installed in front of the vehicle and collect sounds in
front of the vehicle.
In the present embodiment, the front microphones 201 and 202 are preferably disposed at
positions where it is difficult for the engine sound to be input.
Further, the rear microphones 211 and 212 are installed near the left and right outer walls of the
rear of the vehicle, and collect sounds of the left and right side surfaces of the vehicle and the
rear of the vehicle. The front microphones 201 and 202 and the rear microphones 211 and 212
can use general dynamic type microphones or the like.
04-05-2019
5
[0015]
The sound output controller 100 has a microphone amplifier 11 that amplifies the sound
acquired by the sound collection device 200. The microphone amplifier 11 includes a filter and
has a function of converting the collected sound into an electric signal or the like of an
appropriate size. The microphone amplifier 11 only needs to have a function of amplifying the
gain of the microphone 200 in accordance with the dynamic range of the AD converter 12 in the
subsequent stage, and a commonly used amplification device can be used. Furthermore, the AD
converter 12 converts the acquired sound information from an analog signal to a digital signal,
and sends it to the arithmetic device 1, that is, the CPU 1. In addition, the storage device 3, i.e.,
the ROM 3 previously stores information necessary for output control of sound. Then, the
arithmetic device 1 refers to the storage device 3 and executes necessary sound output
processing with reference to necessary information. The control signal output from the
arithmetic device 1 is sent to the acoustic device 400 via the DA converter 13.
[0016]
In addition, the acoustic device 400 amplifies the electric signal and the like output from the
sound output controller 100 and outputs the signal from the speakers 401, 402, 411, 412 and
the like. As the amplification device 410 and the speakers 401, 402, 411, 412, etc., those
generally used can be used.
[0017]
FIG. 3 is a diagram for explaining a functional block configuration of the sound output controller
100 of the present embodiment shown in FIG.
[0018]
As shown in the figure, the sound output controller 100 according to the present embodiment
includes a first acquisition function 101a for acquiring a first sound signal corresponding to the
sound collected by the front microphones 201 and 202 (the sound collection device 200). A
second acquisition function 101b for acquiring a second sound signal corresponding to the
sound collected by the rear microphones 211 and 212 (the sound collection device 200), and the
sound from a predetermined virtual sound source based on the first sound signal And a first
sound output signal generation function 102 for generating a first sound output signal controlled
04-05-2019
6
to be audible, and a predetermined one set in the vehicle room based on the first sound output
signal and / or the second sound signal. And a sound output function 104 for outputting a sound
based on the generated sound image formation signal. The sound image generation function 103
generates a sound image formation signal controlled such that the sound image is localized at
each control point.
[0019]
The sound output controller 100 executes each function by cooperation of software for realizing
these functions and the hardware described above.
[0020]
First, a sound collection device 200 for collecting a sound outside the vehicle to be controlled by
the sound output controller 100 of the present embodiment will be described.
[0021]
The sound collection apparatus 200 of the present embodiment has front microphones 201 and
202 provided in front of the traveling direction of the vehicle, and rear microphones 211 and
212 provided behind the front microphones 201 and 202 in the traveling direction.
[0022]
Although not particularly limited, the front microphones 201 and 202 are preferably provided
forward of the area where the head of the occupant is predicted to be located, particularly
forward of the direction of travel, specifically forward of the line connecting both ears of the
occupant.
Furthermore, the front microphones 201 and 202 are preferably provided on the front side in
the traveling direction relative to the position of the windshield, for example, on the front nose
portion of the vehicle.
This is because the sound in front of the vehicle can not be collected by a microphone disposed
at the rear of the vehicle because the distance is too far.
04-05-2019
7
[0023]
In the present embodiment, the front microphones 201 and 202 are provided outside the vehicle
and in the vicinity of the body boundary surface ahead of the traveling direction of the vehicle.
FIG. 4 is a diagram showing an installation example of the sound collector 200 of the present
embodiment.
As shown in FIG. 4, the front microphones 201 and 202 of the present embodiment are provided
at the front end of the traveling direction of the vehicle 1000.
As described above, by providing at the front end of the vehicle 1000, the distance to the object
in front of the vehicle can be shortened, so that the sound emitted from the object in front of the
vehicle can be accurately collected. In addition, it is not limited to the aspect shown in FIG. 4, The
installation position of the front microphones 201 and 202 is good also as a front bumper part of
a vehicle, and a headlight part.
[0024]
Also, the front microphones 201 and 202 may be provided on the front side of the body ceiling
facing the moving surface of the moving body and facing the moving surface of the vehicle. That
is, it may be disposed on the joint portion between the front outer wall (wind shield) and the
ceiling of the vehicle or the roof (for example, a roof rail) on the windshield side in plan view
from above the vehicle. Thus, when the engine is mounted in front of the vehicle, the influence of
the engine noise can be eliminated and the influence of the road noise due to the friction
between the tire and the traveling surface can be prevented. In addition, since the independence
of the input signal of two front microphones 201 and 202 will become low when arrange ¦
positioning on a roof rail and its vicinity, the microphone which has sound collection directivity is
used, The direction from which the sound collection directivity is obtained It is preferable to tilt
outward away from the center of the vehicle.
[0025]
04-05-2019
8
Further, the rear microphones 211 and 212 are provided on the rear side of the front
microphones 201 and 202 in the traveling direction of the vehicle. The installation positions of
the rear microphones 211 and 212 are not particularly limited, and can be provided on the side
surface of the vehicle body, the rear door portion, the C pillar, the back door portion, the back
bumper portion, the tail lamp portion, and the like. In the present embodiment, as shown in FIG.
4, the rear microphones 211 and 212 are disposed at the rear corners of the vehicle. In addition,
when the subjects conducted a hearing experiment of sound by the test subjects, it is confirmed
that the recognition rate improves the sound emitted by the object present behind the vehicle
when the rear microphones 211 and 212 are disposed behind the C pillar of the vehicle. It was
done.
[0026]
Specifically, the sound collection range of the front microphones 201 and 202 and the rear
microphones 211 and 212 will be described. FIG. 5A is a view showing an example of a sound
collection range by the rear microphones 211 and 212, and FIG. 5B is a view showing an
example of a sound collection range by the front microphones 201 and 202 and the rear
microphones 211 and 212.
[0027]
As shown in FIG. 5A, the rear microphone 211 provided at the rear of the right side of the vehicle
along the traveling direction collects the sound generated in the sound collection range 1R which
is the area on the right side of the vehicle. Further, the rear microphone 212 provided at the rear
of the left side of the vehicle along the traveling direction collects the sound generated in the
sound collection range 1L which is the area on the left side of the vehicle. In this embodiment,
since the rear microphones 211 and 212 are disposed behind the driver, the S / N of the sound
generated by an object approaching from the rear (for example, the sound of another vehicle)
can be improved. It is possible to accurately provide information on the direction of arrival of the
approaching object and the position of the object.
[0028]
Further, as shown in FIG. 5B, the front microphone 201 provided on the right front side of the
vehicle along the traveling direction collects the sound generated in the sound collection range
04-05-2019
9
2R which is an area on the right front side of the vehicle. Further, the front microphone 202
provided on the left front side of the vehicle along the traveling direction collects the sound
generated in the sound collection range 2L which is an area on the left front side of the vehicle.
[0029]
By the way, the driver of the vehicle can recognize the presence of an object around the own
vehicle with eyes and ears. FIG. 6 is a view showing a visible range of the driver of the vehicle. As
shown in the figure, there is a limit to the range that the driver of the vehicle can visually
recognize. That is, although the area K in front of the vehicle is a visible area without moving the
sight line, the area H which is the side opposite to the driver's seat is an area which can not be
recognized unless the head is rotated. J is a range which can be visually recognized as the
occupant moves his / her eyes. Thus, it is difficult for the driver to visually recognize an object
(such as another vehicle) approaching from behind without moving his / her eyes or head.
[0030]
As described above, by providing the front microphones 201 and 202 in front of the vehicle in
addition to the rear microphones 211 and 212 at the rear of the vehicle, sounds generated
around the vehicle can be evenly collected. In particular, sounds generated in a range (region H)
which can be viewed only by rotating the driver's head (region H) and a range (region J) which
can be viewed by the driver's line of sight movement can be collected it can.
[0031]
Then, the aspect of the back microphones 211 and 212 suitable for the information provision
apparatus A of this embodiment is demonstrated.
[0032]
It is desirable that the two sounds input from the two rear microphones 211 and 212 be
established as a binaural sound source.
For this reason, in the present embodiment, the pseudo microphones 231 are provided to the
04-05-2019
10
rear microphones 211 and 212. In general, in order to precisely arrange two microphones to be
binaural sound sources, the microphones are placed in the ear canal of the dummy head.
However, in the present embodiment, it is sufficient if the sound source direction and the sound
source position of the collected environmental sound have consistency with the actual sound
source direction and the sound source position, and two sounds input from two microphones A
pseudo pinna member 231 having a curved surface that covers a part of the rear microphones
211 and 212 is provided so that it approximates a binaural sound source.
[0033]
As shown in FIG. 7, the artificial pinnacle member 231 having a curved surface that covers a part
of the rear microphones 211 and 212 is provided at the installation position of the sound
collector 200 of the vehicle. In the present embodiment, an example in which the rear
microphones 211 and 212 and the artificial pinnacle member 231 covering the same is disposed
on the side surface of the vehicle is shown. The artificial pinna member 231 of the present
embodiment has a shape that simulates the shape of a human ear, or a shape that emphasizes
features of the shape of the human ear. And the back microphones 211 and 212 are installed in
the part corresponded to the ear canal entrance part of the human ear in the artificial pinnacle
member 231 of this embodiment. Further, as shown in FIG. 7, it is preferable that the artificial
pinnacle member 231 cover the rear microphones 211 and 212 from the rear side in the
traveling direction, and set the front side in the traveling direction to be in the released state.
Thereby, the sound coming from the traveling direction of the vehicle can be recognized without
a sense of incompatibility as the sound in front. In addition, the material of the pseudo ¦
simulation pin member 231 is not specifically limited, The resin material etc. which can be shape
¦ molded in a desired shape can be used.
[0034]
FIG. 8 is a diagram for explaining a path in which the sound reaches the rear microphone 211
provided with the pseudo pinna member 231 from the sound source 1 in front of the vehicle and
the sound source 2 in rear of the vehicle. As for the sound coming from the sound source 1 in
front of the vehicle, the direct wave A and the reflected wave B and the like reflected by the
pseudo pinna member 231 are collected by the rear microphone 211. On the other hand, in the
sound coming from the sound source B at the rear of the vehicle, the diffracted wave C by the
artificial pinnacle member 231 is collected by the rear microphone 211. Thus, by using the
artificial pinnacle member 231, it is possible to collect the sound coming from the front of the
vehicle and the sound coming from the rear of the vehicle by changing the characteristics of the
04-05-2019
11
sound wave such as the phase. As a result, it is possible to separate the sound signals coming
from the front and rear direction of the vehicle and to collect the sound by discriminating the
arrival directions of the respective sounds. The sound coming from the front sound source 1 and
the rear sound source 2 is actually collected by the rear microphone 221 provided with the
artificial pinnacle member 231, and the subject is made to listen to the sound. It was possible to
distinguish the sound coming from the sound source 2 behind.
[0035]
Further, by providing the artificial pinna member 231, binaural sound can be collected. In
addition to this, the sound outside the vehicle can be faithfully (really) reproduced in the vehicle
interior by performing transaural reproduction by localizing the sound image to the control point
in the vicinity of the passenger's ear and collecting the binaural collected sound. it can. The
pseudo pinna member 231 can also be provided on the front microphones 201 and 202.
[0036]
In addition, the shape of this pseudo ¦ simulation pina member 231 is not specifically limited,
The curvature of the curved surface which covers the pseudo ¦ simulation pina member 231, a
shape, etc. can be set arbitrarily. At this time, it is preferable that the artificial pinnacle member
231 is at least characterized by the sound wave of the sound coming from the front and back and
imitated to such an extent that the user can determine the position of the sound source.
[0037]
Moreover, it is preferable to provide the microphone cover 251 which covers the back
microphones 211 and 212 from a waterproof and dustproof and soundproof viewpoint of the
back microphones 211 and 212. In the present embodiment, it is preferable that the microphone
cover 251 is designed to be able to suppress distortion of environmental sound at the time of
sound collection.
[0038]
04-05-2019
12
FIG. 9 is a view showing an example in which the microphone cover 251 is provided to the rear
microphone 211 provided with the artificial pinnacle member 231. As shown in FIG. In the
example illustrated in FIG. 9, the microphone cover 251 has a shape that covers the microphone
cover 251 with the artificial pinnacle member 231 and the rear microphone 211 with a curved
surface, and is attached to the side wall of the vehicle 1000. As shown in FIG. 9, it is preferable to
determine the shape of the microphone cover 251 so that the artificial pinnacle member 231 and
the rear microphone 211 are positioned in the portion where the curvature of the curved surface
of the microphone cover 251 is the largest. Further, on one side of the microphone cover 251, a
plurality of slits 241 sealed with a material having acoustic transparency are formed. The slit
241 is preferably provided on the rear side with respect to the traveling direction of the vehicle.
With such a configuration, it is possible to collect sound with little attenuation of environmental
sound, and it is possible to prevent generation of a booming noise inside the microphone cover
251.
[0039]
Moreover, FIG. 10 is a figure which shows the other example which provided the microphone
cover 251 in the back microphone 211 which provided the artificial pinnacle member 231. As
shown in FIG. In the example shown in FIG. 10, a small space is provided in the exterior of the
vehicle, the pseudo-auricle member 231 and the rear microphone 211 are accommodated, and
the exterior of the vehicle has a plurality of slits 241 sealed with an acoustically transparent
material. Set up. In addition, a part of the exterior of the vehicle is made to be an acoustically
transparent sound transmission wall. Here, the sound transmitting wall is a member in which the
difference between the sound wave before transmission and the sound wave after transmission is
equal to or less than a predetermined value, and the acoustic loss amount and the strain amount
are equal to or less than a predetermined value.
[0040]
Furthermore, the aspect of the front microphones 201 and 202 suitable for the information
provision apparatus A of this embodiment is demonstrated.
[0041]
By providing the rear microphones 211 and 212, it is possible to collect environmental sounds
generated on the side and the rear of the vehicle.
04-05-2019
13
Since the listening range of the microphone depends on the magnitude of the input gain, for
example, in order to collect the sound in front of the vehicle using a microphone disposed at the
rear, it is necessary to take a large input gain. However, there is an upper limit to the setting
value of the input gain, and when the sensitivity is increased, there is an obstacle such as
traveling noise of the own vehicle being relatively large, so the sound collection range of the rear
microphones 211 and 212 is as shown in FIG. It is limited to the sound collection ranges 1R and
1L shown in FIG. In this embodiment, in order to collect environmental sound generated around
the vehicle in a state in which the influence of the traveling noise of the vehicle is reduced, in
addition to the rear microphones 211 and 212 that perform binaural recording, another front
microphone 201 and 202 are provided.
[0042]
Furthermore, the installation aspect of the front microphones 201 and 202 suitable for the
information provision apparatus A of this embodiment is demonstrated.
[0043]
If a microphone is placed in front of a vehicle mounted with an engine in front of the vehicle,
such as an FF vehicle or an FR vehicle, the engine noise reduces the S / N.
For this reason, in the present embodiment, a soundproof wall is provided between the front
microphones 201 and 202 and the drive device or tire of the vehicle. FIG. 11 is a diagram
showing an example in which the front microphones 201 and 202 are provided in the cover of
the light. As shown in FIG. 11, the front microphones 201 and 202 are covered with the light
cover on the vehicle exterior side and the soundproof wall 261 on the vehicle interior side. The
soundproof wall 261 is formed of a sound absorbing material and isolates the sound emitted
from the engine.
[0044]
In addition, the light cover may be provided with a slit 251 sealed by a member having sound
transparency. The slit 251 may be provided on the front side or the rear side of the traveling
direction of the vehicle. Also, instead of the slit 251, a part of the light cover may be made of an
acoustically transparent material. As described above, by arranging the soundproof wall 261, the
04-05-2019
14
front microphones 201 and 202 can be arranged on the front side to the front end of the vehicle
even if the type of engine is the front.
[0045]
Moreover, in the present embodiment, it is preferable that the front microphones 201 and 202
have directivity for collecting sound in a predetermined direction area. Thereby, the sound
collection direction of the front microphones 201 and 202 can be arbitrarily set according to the
installation position of the front microphones 201 and 202. FIG. 12 is a view showing an
installation example of the front microphones 201 and 202 having directivity. In the example of
FIG. 12, the front microphones 201 and 202 are installed in front of the roof rail, the sound
collecting direction of the right front microphone 201 is moved from the vehicle center by a
predetermined angle to the right, and the sound collecting direction of the left front microphone
202 Is moved leftward from the center of the vehicle by a predetermined angle.
[0046]
By setting the sound collection direction of each of the front microphones 201 and 202 having
directivity in this way in the opposite direction with respect to the vehicle center, the
independence of the input signals of the two microphones can be enhanced. In particular, when
the front microphones 201 and 202 are disposed on the roof rail, since the independence of the
input signals of the two microphones is low, when the sound collection direction of the front
microphones 201 and 202 is inclined outward, the sound generated in each direction is The
sound can be collected correctly. In this case, by using the forward microphones 201 and 202
having directivity, it is possible to prevent the sound generated by the engine and the tire from
being collected.
[0047]
Furthermore, as shown in the right side of FIG. 13, the use of the front microphones 201 and
202 capable of setting a dead area not collecting sound prevents the sound generated by the
engine or tire from being collected. And can eliminate the effects of these sounds.
[0048]
Here, returning to FIG. 3, functions implemented by the above-described sound output controller
100 will be described.
04-05-2019
15
[0049]
First, the first acquisition function 101 a and the second acquisition function 101 b of the sound
output controller 100 will be described.
The sound output controller 100 acquires a first sound signal corresponding to the sound
collected by the above-described front microphones 201 and 202, and is provided behind the
traveling direction to collect the sound outside the vehicle. The second sound signal
corresponding to the sound collected by the above rear microphones 211 and 212 is acquired.
The acquired first sound signal is used for the processing of the first sound output signal
generation function 102, and the acquired second sound signal is used for the processing of the
sound image generator 103.
[0050]
Subsequently, the first sound output signal generation function 102 of the sound output
controller 100 will be described. The sound output controller 100 generates a first sound output
signal controlled so that the sound can be heard from a predetermined virtual sound source in
the occupant based on the acquired first sound signal.
[0051]
The sound output controller 100 of the present embodiment converts the first sound signal
corresponding to the sound collected by the front microphones 201 and 202 into a sound that
can be heard from a desired direction, that is, a virtual sound source. The first sound signal is a
sound signal obtained by performing processing necessary for signal processing such as
amplification processing and digital conversion on the sound collected by the front microphones
201 and 202. Furthermore, the sound output controller 100 converts the first sound signal into a
sound that can be heard from a virtual sound source, and then converts it into a desired number
of channels (that is, a number corresponding to the number of front microphones 201 etc.)
Output to These processes are executed by the AD converter 12, the arithmetic unit 1, the
04-05-2019
16
storage unit 3 and the DA converter 13 shown in FIG. It is preferable that the sound
corresponding to the first sound output signal generated by the first sound output signal
generation function 102 is theoretically equivalent (have common characteristics) to a sound
image localized at a control point described later.
[0052]
Although not particularly limited, the sound output controller 100 according to the present
embodiment forms a filter (function) using a space transfer system as a transfer system of sound
from the virtual sound source to the both ears of each passenger including the driver. By
convoluting a filter into a single sound signal, it is converted into a sound that can be heard from
a virtual sound source.
[0053]
FIG. 14 is a first diagram for explaining a first sound output signal generation process, and is a
diagram for explaining a processing method of converting a sound that can be heard from a
virtual sound source by convolving a filter into the first sound signal. is there.
[0054]
As shown in FIG. 14, by filtering the sound source signal X for monaural recording, the sound
source signal X is corrected so that it can be heard from the virtual sound source position P1.
Let G1 and G2 be time signals of spatial transfer characteristics of the sound source signal X
from the virtual sound source position P1 to the listener's ears, respectively G1 and G2, the time
signals Y1 and Y2 of the sound signal at the listener's binaural position are as follows Can be
asked.
[0055]
Y1 = X * G1 (Formula 1) Y2 = X * G2 (Formula 2) Here, * represents a convolution operation.
[0056]
FIG. 15 is a second diagram for describing the first sound output signal generation process, and
is a diagram for describing the configuration of a filter that creates a sound in a virtual sound
source from an input sound signal.
04-05-2019
17
[0057]
The first sound signals X1 to Xm corresponding to the sounds collected by the front
microphones 201 and 202 pass through two or more filter sets (for example, G11 and G12 in the
case of X1), and then both listeners At the ear (Left, Right) position, the sound is converted so as
to be audible from the virtual sound source.
The filter set used has the number of taps necessary for the spatial transfer characteristics such
as G1 and G2 in FIG. 14 to be sufficiently expressed.
For example, in the case where a virtual sound source is installed at a distance of 2 m from the
listener, if the sampling frequency of the AD converter is 8 kHz, a filter length of about 48 taps is
required.
The first sound signal input from each of the front microphones 201 and 202 is subjected to
filter processing, and the first sound output signal controlled to be audible from the virtual sound
source is added (mixed) for each of the left and right channels, It is sent to the processing system
of the latter stage.
[0058]
The filter design used in the present process can generally use a filter design method for
converting sound from a virtual sound source. For example, a filter may be created that expresses
the positional relationship with the listener, that is, the direction, using a delayer, or a filter may
be created by measuring the space transfer characteristic in which the information providing
device A is actually installed. It is also good.
[0059]
Here, each method of filter design will be described.
[0060]
04-05-2019
18
First, a method of creating a filter that expresses a positional relationship with a listener using a
delayer will be described.
FIG. 16 is a diagram for explaining a method of creating a filter using a delay element. In the
example shown in FIG. 16, one front microphone 201 is disposed at the front end of the vehicle,
and the installation position of the front microphone 201 is set as the position of the virtual
sound source. At this time, in order to express the transmission system from the installation
position of the front microphone 201 to both ears of the driver who is the listener, a delayer is
embedded in the filter (see FIG. 15). FIG. 16 shows an example of a time delay filter in which
delayers are inserted in G11 and G12. G11 simulates a space transfer system from the position of
the front microphone 201 to the left ear of the driver, and this space transfer path is temporally
based on the arrival sound from the sound source as compared with the path of the space
transfer system of G12. Arrive to arrive fast. For this reason, the G11 filter is designed to have a
peak that is faster by two taps than the G12 filter.
[0061]
Subsequently, a method of creating a filter using space transfer characteristics will be described.
In the method using the space transfer characteristic, the filter can be designed not only with the
time delay but also with the phase shift at all frequencies.
[0062]
FIG. 17 is a diagram for explaining a method of creating a filter using space transfer
characteristics. In the example shown in FIG. 17, one front microphone 201 is disposed at the
front end of the vehicle, and the placement place of the front microphone 201 is set as a virtual
sound source. At this time, the transmission system from the installation position of the front
microphone 201 to both ears of the driver who is the listener is measured using an impulse or
the like, and the response waveform is used as a filter. For example, G11 measures the transfer
characteristic from the installation position of the front microphone 201 to the driver's left ear
and performs filter processing on the system design requirements (memory size, real-time
processing performance) and virtual sound source In view of the balance of the distance to the
listener, it can be used as a filter by cutting it to an appropriate length. Although the space
transfer characteristic may be measured in real space, it may be simulated using a geometric
04-05-2019
19
method such as a wave equation or a virtual image method.
[0063]
The design method of the filter for creating the sound in the virtual sound source from the input
sound signal is not limited to the one described above, but is known at the time of filing such as
controlling only the phase or controlling only the frequency characteristic. An approach can be
used.
[0064]
Next, a method of setting the position of the virtual sound source will be described.
[0065]
Although not particularly limited, the sound output controller 100 sets the virtual sound source
in front of the line connecting the areas where the occupants' ears are located.
That is, based on the first sound signal corresponding to the sound collected by the front
microphones 201 or 201 and 202, the sound output controller 100 is set ahead of the line
connecting the areas where the both ears of the occupant are located. Generating a first sound
output signal controlled so that sound can be heard from the virtual sound source.
[0066]
Specifically, the sound output controller 100 sets the virtual sound source in front of the body
boundary in front of the traveling direction of the vehicle (mobile body).
That is, based on the first sound signal corresponding to the sound collected by the front
microphones 201 or 201 and 202, the sound output controller 100 is set ahead of the body
boundary surface in the forward direction of the vehicle. A first sound output signal controlled so
that sound can be heard from the virtual sound source is generated.
[0067]
04-05-2019
20
Also, specifically, the sound output controller 100 sets the virtual sound source at the front end
of the traveling direction of the vehicle. That is, the sound output controller 100 can hear the
sound from the virtual sound source set at the front end of the traveling direction of the vehicle
based on the first sound signal corresponding to the sound collected by the front microphones
201 or 201 and 202. Generating a first sound output signal controlled as such.
[0068]
As an additional aspect, the sound output controller 100 sets the virtual sound source on the
horizontal plane including the installation positions of the front microphones 201 or 201 and
202. That is, the sound output controller 100 is set on a horizontal plane including the
installation position of the front microphones 201 or 201 and 202 based on the first sound
signal corresponding to the sound collected by the front microphones 201 or 201 and 202. A
first sound output signal controlled so that sound can be heard from the virtual sound source is
generated. By setting the virtual sound source to the same height as the installation position of
the front microphones 201 or 201 and 202, the sound collected at the front of the vehicle can be
obtained from the virtual sound source similarly set to the front of the vehicle and at the same
height. You can make it audible.
[0069]
Thus, the sound output controller 100 sets the virtual sound source so that the environmental
sound collected in the forward direction of travel of the vehicle comes from the forward direction
of travel of the vehicle. That is, the sound output controller 100 sets the position of the virtual
sound source to a position according to the position (sound collection range) of the sound source
of the sound collected by the front microphones 201 or 201 and 202.
[0070]
By the way, the purpose of providing information on surrounding environmental sound to an
occupant (driver) driving a vehicle is, first, to notify that an object such as another vehicle
approaches when the vehicle advances, secondly It is to notify that an object such as an
installation is approached when the vehicle moves backward.
04-05-2019
21
[0071]
In order to achieve the first object, sound information is provided to indicate that the sound to be
provided comes from the front, and which direction of the sound to be provided comes from the
front and the left. There is a need.
If the driver notices the sound information coming from the front, it is possible to judge the
appropriate driving operation such as stepping on the brake, and if the driver can distinguish
from which of the left and right the sound is coming from the sound information An approach to
an object can be avoided by proper steering operation.
[0072]
From the above point of view, in the present embodiment, (1) the virtual sound source is
arranged at one place in front of the vehicle, and (2) the virtual sound source travels from the
reference line along the traveling direction from the center of the occupant. The aspect arrange ¦
positioned to two places which have a spread angle of about 60 degrees on either side of can be
selected.
[0073]
FIG. 18 is a diagram for explaining the case where one virtual sound source is disposed in front
of the vehicle.
As shown in FIG. 18, one front microphone 201 is disposed in the vicinity of the body boundary
surface ahead in the traveling direction of the vehicle, specifically, at the front end in the
traveling direction of the vehicle. The environmental sound in front of the vehicle is collected by
the front microphone 201 and converted into a first sound output signal coming from the virtual
sound source position P1. When the front microphone 201 has unidirectionality and is installed
so as to be in the sound reception range shown in FIG. 18, the sound emitted by all approaching
objects approaching from the front of the vehicle is the virtual sound source position P1.
Provided to the driver as a sound coming from the According to the arrangement of the front
microphone 201 shown in FIG. 18, the driver can be made aware of the presence of an object
approaching from the front in the traveling direction of the vehicle. With the provided sound
information, the driver can perform a decelerating operation such as an appropriate brake
operation to avoid approach to the object.
04-05-2019
22
[0074]
FIG. 19 is a diagram for describing a case where two virtual sound sources are disposed in front
of the vehicle. As shown in FIG. 19, two forward directivity front microphones 201 and 202 are
disposed at the front end of the vehicle. The front microphones 201 and 202 are arranged to be
separated by a predetermined distance or more, and collect sounds generated in different sound
reception ranges. The first sound signal corresponding to the sound collected by the front
microphone 201 is controlled to be audible from the virtual sound source position P1, and the
first sound signal corresponding to the sound collected by the front microphone 202 is from the
virtual sound source position P2 Controlled to hear. Although not particularly limited, the virtual
sound source position P1 is preferably set on a line connecting the installation position of the
front microphone 201 and the right ear of the occupant. The virtual sound source position P2 is
preferably set on a line connecting the installation position of the front microphone 202 and the
left ear of the occupant.
[0075]
By doing this, the sound input from the left and right front microphones 201 and 202 is
allocated to the left and right virtual sound source positions P1 and P2 according to the direction
in which the actual sound source is located. The driver who has listened to the sound coming
from can identify whether the object serving as the sound source is in the left or right direction.
According to the front microphones 201 and 202 and the virtual sound sources P1 and P2, it is
possible to indicate by sound whether the front object is present in the left or right direction. As
a result, the driver can operate the vehicle with the object by the brake operation and the
steering operation. Approach can be avoided.
[0076]
Finally, the sound image generation function 103 of the sound output controller 100 will be
described. The sound output controller 100 generates, based on the first sound output signal and
/ or the second sound signal, a sound image formation signal controlled so that the sound image
is localized at predetermined control points preset in the vehicle cabin. The sound based on the
generated sound image formation signal is output. The position of the control point for localizing
the first sound output signal is different from the position of the control point for localizing the
04-05-2019
23
second sound signal.
[0077]
The sound output controller 100 outputs, from the acoustic device 400, a sound corresponding
to the first sound output signal generated by the first sound output signal generation function
102 and / or the second sound signal collected by the rear microphones 211 and 212. In this
case, the influence of the transmission system from each speaker of the acoustic device 400 to a
predetermined control point (for example, near the ears of the listener) is removed, and the
sound corresponding to the first sound output signal is reproduced at the control point To
generate an acoustic image forming signal converted to the signal. These processes are executed
by the AD converter 12, the arithmetic unit 1, the storage unit 1 and the DA converter 13 shown
in FIG.
[0078]
FIG. 20 is a diagram for explaining sound image generation processing. As shown in FIG. 20, in
the filter H used for the sound image generation function 103, the input signals Y1 and Y2 are
reproduced at the control points at positions C1 and C2 of predetermined control points, that is,
the sound image is localized at the control points. Is designed as. The input signals Y1 and Y2 are
the first sound output signal and / or the second sound signal generated by the first sound
output signal generation function 102.
[0079]
In the present process, it is preferable that the following relationship be established between the
input signals Y1 and Y2 and the sound image forming signals Z1 and Z2 reproduced at the
control point.
[0080]
Y1 = Z1 (Formula 3) Y2 = Z2 (Formula 4) Therefore, the influence of the space transfer system is
eliminated using the filter H for sound image signal formation processing.
04-05-2019
24
Hereinafter, this filter H is called an inverse filter H.
[0081]
The configuration and processing method of the inverse filter H will be described with reference
to FIG. When an input signal Yn, an inverse filter Hmn (m is a sound source number, n is a
control point number), a reproduced signal (sound image forming signal at a control point) Zn,
and a space transfer characteristic Fnm for each arbitrary frequency The relationship of can be
expressed in Equation 5.
[0082]
FHY = Z (Equation 5) Here, F = [Fnm], H = [Hmn], Y = [Yn], and Z = [Zn].
[0083]
At this time, in order to satisfy the relationship of Equation 3 and Equation 4, FH = I (I is a unit
vector).
Therefore, in order to derive the inverse filter H based on F, H = F <−> ([·] <−> is a general
inverse matrix of the matrix [·]) may be calculated for each arbitrary frequency. For example, the
calculation method described in Application of inverse filter design using minimum norm
solution to transaural system: Proceedings of the Acoustical Society of Japan, pp 495-496
(1998) can be used.
[0084]
The sound output controller 100 uses the designed inverse filter H to generate a sound image
formation signal for localizing the sound image at the control point. Then, the sound output
controller 100 causes the sound device 400 to output a sound based on the generated sound
image formation signal.
[0085]
04-05-2019
25
The front speakers 401 and 402 of the acoustic device 400 are disposed forward of the traveling
direction of the vehicle. At this time, the front speakers 401 and 402 are provided at positions
corresponding to the positions of the front microphones 201 and 202. For example, it is
preferable to provide the front speakers 401 and 402 in the vehicle compartment on the line
connecting the position of the head or ears of the occupant and the front microphones 201 and
202.
[0086]
On the other hand, the rear speakers 411 and 412 are disposed rearward of the traveling
direction of the vehicle. At this time, the rear speakers 411 and 412 are provided at positions
corresponding to the positions of the rear microphones 211 and 212. For example, it is
preferable to provide the rear speakers 411 and 412 in the vehicle interior on the line
connecting the positions of the head or ears of the occupant and the rear microphones 211 and
212.
[0087]
Specifically, the rear speakers 411 and 412 of the present embodiment are disposed rearward of
the area where the head of the occupant is predicted to be located, and are disposed on the right
and left sides of the occupant.
[0088]
FIG. 21 is a view showing an example in which the rear speakers 411 and 412 are installed in the
headrest of the seat.
Based on a sound image forming signal corresponding to the second sound signal collected by
the rear microphones 211 and 212, sound is output from the rear speakers 411 and 412
provided at the rear in the traveling direction with respect to the positions of the occupants' ears.
The occupant can determine the position of an object approaching from behind with high
accuracy. A sense of localization for incoming environmental sound is increased.
04-05-2019
26
[0089]
Subsequently, a control procedure of the sound output controller 100 of the present embodiment
will be described based on FIG.
[0090]
FIG. 22 is a flow chart for explaining the procedure of the process of providing sound
information according to this embodiment.
[0091]
When the information providing device A starts operating, in step S110, the sound output
controller 100 executes power on and initialization processing.
Specifically, at the time of the initial setting process, the sound output controller 100 reads a
filter used in the first sound output signal generation process and a filter used in the sound
image generation process.
[0092]
In the subsequent step S120, the sound output controller 100 acquires the sounds collected by
the front microphones 201 and 202 and the rear microphones 211 and 212 of the sound
collection device 200, and converts them into electrical signals.
[0093]
Furthermore, in step S130, the sound output controller 100 acquires the first sound signal and
the second sound signal obtained by amplifying the electric signal converted in step S120 to an
appropriate level.
[0094]
Thereafter, in step S140, the sound output controller 100 discretely converts the first sound
signal acquired in step S130 (when the acquisition signal is a continuous signal), and based on
the first sound signal, performs filtering and channel processing. Integration processing is
performed to generate a first sound output signal controlled so that sound can be heard from a
predetermined virtual sound source.
04-05-2019
27
[0095]
Subsequently, in step S150, the sound output controller 100 discretely converts the first sound
output signal generated in step S140 and the second sound signal processed in step S130 (when
the acquisition signal is a continuous signal), Based on the first sound output signal and / or the
second sound signal, a continuous sound image formation signal controlled so that the sound
image is localized at a predetermined control point preset in the vehicle interior of the vehicle is
generated.
[0096]
Next, in step S160, the sound output controller 100 amplifies the sound image formation signal
generated in step S150.
[0097]
Next, in step S170, the sound output controller 100 converts the sound based on the sound
image formation signal amplified in step S160 into a sound signal (sound wave) and causes the
sound device 400 to output the sound signal.
[0098]
If the signal handled in the series of information processing is a continuous signal such as an
electrical signal, AD processing and DA processing are inserted before and after the first sound
output signal generation processing and the sound image generation processing, and on the
other hand, a series of When the signal handled in the information processing is obtained as a
discrete signal, the first sound output signal generation processing and the sound image
generation processing are executed without performing the AD / DA processing.
Moreover, although it is desirable to use a discrete filter from the viewpoint of cost etc. in the
first sound output signal generation processing and the sound image generation processing, a
filter capable of continuous processing may be used.
[0099]
The sound output controller 100 according to the present embodiment is configured as
described above and operates as described above, so that the following effects can be obtained.
04-05-2019
28
[0100]
The sound output controller 100 according to the present embodiment maintains the positional
relationship between the sound source outside the vehicle and the occupant inside the vehicle
while suppressing the cost relating to external sound processing, and the sound information
emitted by the sound source outside the vehicle Can be provided.
[0101]
That is, the sound output controller 100 according to the present embodiment is controlled such
that a sound can be heard from a predetermined virtual sound source based on the first sound
signal corresponding to the sound collected in front of the traveling direction of the vehicle. A
sound output signal is generated, and a sound image is generated at a predetermined control
point set in advance based on the first sound output signal and / or a second sound signal
corresponding to a sound collected behind the traveling direction of the vehicle. In order to
generate a sound image formation signal to be localized and to output a sound based on the
sound image formation signal, an external sound collected in front of the traveling direction of
the vehicle is preset at a predetermined control point in the vehicle compartment. Because the
sound source can be heard from the virtual sound source, while keeping the positional
relationship between the sound source outside the vehicle and the occupant inside the vehicle
while suppressing the cost for external sound processing, the passenger inside the vehicle hears
the sound information emitted by the sound source outside the vehicle To It can be provided.
[0102]
Further, in the information providing apparatus A of the present embodiment, the front
microphones 201 and 202 are provided in front of the vehicle, and the rear microphones 211
and 212 are separately provided behind the vehicle to evenly collect the sounds generated
around the vehicle. It can sound.
In particular, the S / N ratio of sounds generated in a range that can be viewed only by turning
the driver's head (region H in FIG. 6) and a range that can be viewed by the driver's gaze
movement (region J in FIG. 6) You can collect sounds with
[0103]
Therefore, the external sound collected in front of the traveling direction of the vehicle is
controlled to be heard from a preset virtual sound source, and the sound image of the sound
04-05-2019
29
heard from the virtual sound source and the sound image of the sound collected behind the
vehicle Is localized at a predetermined control point in the vehicle room, so that the positional
information between the sound source outside the vehicle and the occupant inside the vehicle
can be maintained to provide the occupant inside the vehicle with sound information emitted by
the sound source outside the vehicle it can.
[0104]
According to the information providing apparatus A of the present embodiment, even when the
sound insulation of the vehicle is high, the information of the sound emitted by the object around
the vehicle can be provided so that the occupant can recognize the position of the object it can.
That is, since the occupant recognizes the presence of other vehicles approaching from the front,
level crossings, traffic lights, etc., appropriate driving operations such as deceleration can be
performed, and the presence of other vehicles approaching from the rear, emergency vehicles,
etc. As it recognizes, appropriate driving operations such as turning can be performed.
[0105]
Further, in the information providing device A of the present embodiment, the front microphones
201 and 202 are provided in front of the traveling direction of the vehicle, for example, near the
body boundary of the vehicle and at the front end of the traveling direction of the vehicle. Since
sound can be collected and provided as sound heard from a predetermined virtual sound source,
the positional relationship between the sound source and the occupant can be maintained to
provide information on the sound emitted from the sound source.
[0106]
Further, in the information providing apparatus A of the present embodiment, the engine is
mounted in front of the vehicle by providing the front microphones 201 and 202 on the side of
the body ceiling facing the traveling direction of the vehicle and facing the moving surface of the
vehicle. In the case, the influence of the engine noise can be eliminated and the influence of the
road noise can be prevented.
[0107]
Further, in the information providing apparatus A of the present embodiment, the front
microphones 201 and 202 have directivity for collecting sound in a predetermined direction
04-05-2019
30
area, so that the front microphones 201 and 202 can be arranged according to the installation
position of the front microphones 201 and 202. , 202 can be set arbitrarily.
[0108]
Further, in the information providing apparatus A of the present embodiment, a soundproof wall
is provided between the front microphones 201 and 202 and the engine or tire of the vehicle, so
that the front to the front end of the vehicle The front microphones 201 and 202 can be
arranged on the
[0109]
Further, in the information providing apparatus A of the present embodiment, by providing the
artificial pinnacle member 231 having a curved surface that covers a part of the rear
microphones 211 and 212, the sound coming from the front of the vehicle and the sound coming
from the rear of the vehicle Can be collected by changing the sound wave characteristics such as
phase.
As a result, it is possible to separate the sound signals coming from the longitudinal direction of
the vehicle, and to collect the sound that can identify the arrival direction of each sound.
[0110]
Further, in the sound output controller 100 of the present embodiment, based on the first sound
signal corresponding to the sound collected by the front microphones 201 and 202, in front of
the line connecting the areas where the both ears of the occupant are located. By generating the
first sound output signal controlled so that the sound can be heard from the set virtual sound
source, the sound collected in front of the vehicle can be heard from the virtual sound source
similarly set in front of the vehicle can do.
That is, the sound information provided based on the sound collected by the front microphones
201 and 202 enables the occupant to recognize the presence of an object approaching from the
front.
04-05-2019
31
[0111]
Similarly, in the sound output controller 100 of the present embodiment, based on the first
sound signal corresponding to the sound collected by the front microphones 201 and 202, the
sound output controller 100 is set ahead of the body boundary in the front direction of the
vehicle. The above-described effect can be achieved by generating the first sound output signal
controlled so that the sound can be heard from the virtual source.
[0112]
Similarly, in the sound output controller 100 according to the present embodiment, a virtual set
at the front end of the traveling direction of the vehicle based on the first sound signal
corresponding to the sound collected by the front microphones 201 and 202. The abovementioned effect can be achieved by generating the first sound output signal controlled so that
the sound can be heard from the sound source.
[0113]
Further, in the sound output controller 100 according to the present embodiment, the first sound
signal corresponding to the sound collected by the front microphones 201 and 202 is set on the
horizontal plane including the installation position of the first sound input unit. By generating the
first sound output signal controlled so that the sound can be heard from the virtual sound source,
the sound collected in front of the vehicle can be heard from the virtual sound source similarly
set in front of the vehicle and at the same height Can be
That is, the sound information provided based on the sound collected by the front microphones
201 and 202 enables the occupant to more accurately recognize the presence of an object
approaching from the front.
[0114]
Further, in the information providing device A of the present embodiment, the rear speakers 411
and 412 of the acoustic device 400 are located behind the area where the head of the occupant
of the vehicle is predicted to be located, and behind the traveling direction. By disposing on the
left side, the occupant can determine the position of an object approaching from behind with
high accuracy.
04-05-2019
32
A sense of localization for incoming environmental sound is increased.
[0115]
Second Embodiment Subsequently, a second embodiment will be described.
The basic configuration of the information providing device A of the second embodiment is
common to the information providing device A of the first embodiment shown in FIG.
Here, in order to avoid redundant description, points different from the first embodiment will be
mainly described.
[0116]
FIG. 23 is a diagram showing an example of the hardware configuration of the sound output
controller 100 according to the second main embodiment.
[0117]
As shown in FIG. 23, the information (signal) of the sound collected by the front microphones
201 and 202 and the rear microphones 211 and 212 included in the sound collection device
200 provided outside the vehicle is input to the sound output controller 100. Be done.
Each configuration shown in FIG. 23 is common to each configuration of the first embodiment of
FIG.
[0118]
FIG. 24 is a diagram for explaining a functional block configuration of the sound output
controller 100 according to the second embodiment shown in FIG.
[0119]
04-05-2019
33
The first sound output signal generation function 112 shown in FIG. 24 generates a first sound
output signal controlled so that the sound can be heard from a predetermined virtual sound
source based on the first sound signal, and the front speakers 401 and 402 To the first sound
output function 114a that controls the sound output of the
[0120]
The sound image generation function 113 shown in FIG. 24 generates a sound image formation
signal controlled so that the sound image is localized to a predetermined control point set in
advance in the room of the vehicle based on the second sound signal. , 412 are sent out to the
second sound output function 114b that controls the sound output.
[0121]
FIG. 25 illustrates a process of generating a first sound output signal controlled so as to be heard
from one virtual sound source in the vehicle compartment based on the sounds acquired from
the two front microphones 201 and 202 provided in front of the vehicle. FIG.
In the present embodiment, processing for localizing a sound image to a designated control point
based on the first sound output signal as in the first embodiment is not performed.
That is, based on the sound acquired from the front microphones 201 and 202, the sound is
output so as to be heard from one virtual sound source set in front of the vehicle.
At this time, the sound output controller 100 may output a sound based on the first sound output
signal using the front speakers 401 and 402 installed forward in the traveling direction of the
vehicle.
[0122]
In the example shown in FIG. 25, two front microphones 201 and 202 are installed at the front
end of the vehicle.
04-05-2019
34
The sound signals collected by the front microphones 201 and 202 are amplified for each
channel, the sound collected by the front microphone 201 is output by the front speaker 401,
and the sound collected by the front microphone 202 is output by the front speaker 402. Make it
output.
[0123]
In the present embodiment, it is preferable that the front speakers 401 and 402 be provided
forward of the area where the head of the vehicle occupant is expected to be located in the
traveling direction.
Specifically, the front speakers 401 and 402 are preferably disposed in the vicinity of the root of
the A-pillar of the vehicle, etc., but may be ahead of the head of the occupant in the traveling
direction.
Thus, the sound collected in front of the vehicle can be output from the front speakers 401 and
402 provided in front of the vehicle.
[0124]
Further, it is preferable to adjust the balance between the left and right of the sound signals sent
to the respective front speakers 401 and 402 so as to obtain a stereo effect when listening from
the driver's seat.
At this time, using the sound image generation function 112, for example, the sound pressure
balance may be adjusted so that the sound image of the sound of the sound source A1 is
localized to the virtual sound source A′1 (control point).
[0125]
FIG. 26 is a diagram for explaining a processing example of causing a front speaker 401 provided
in front of the vehicle to output a sound collected by one microphone 201 provided in front of
the vehicle.
04-05-2019
35
[0126]
The sound output controller 100 amplifies the sound collected by one microphone 201 and
outputs the amplified sound from one front speaker 401 disposed in front of the driver.
The speakers 401 can be installed in accordance with the number of microphones 201.
Alternatively, two or more microphones 201 may be installed and adjusted so as to be localized
at an appropriate position using a mixer or the like.
[0127]
Since the information providing apparatus A according to the present embodiment does not use a
filter, a certain effect can be expected with a simple configuration and at low cost as compared
with a method using a virtual sound source.
[0128]
FIG. 27 is a flowchart for explaining the procedure of the process of providing sound information
according to the second embodiment.
[0129]
Steps S210 to S230 of the process of FIG. 27 are the same as steps S110 to S130 of FIG.
Here, the process after step S240 which is a process different from the first embodiment will be
described.
[0130]
In step S240, the sound output controller 100 discretely converts the first sound signal acquired
in step S230 (when the acquired signal is a continuous signal), and based on the first sound
signal, performs filter processing and channel integration processing. To generate a first sound
output signal controlled so that a sound can be heard from a predetermined virtual sound source.
04-05-2019
36
[0131]
In step S250, which is executed in parallel with step S240, the sound output controller 100
discretely converts the second sound signal processed in step S230 (when the acquisition signal
is a continuous signal), based on the second sound signal. Thus, a continuous sound image
formation signal controlled so that the sound image is localized at a predetermined control point
set in advance in the vehicle room is generated.
[0132]
Next, in step S260, the sound output controller 100 amplifies the first sound output signal
generated in step S240 and the sound image formation signal generated in step S250.
[0133]
Next, in step S270, the sound output controller 100 converts the sound based on the first sound
output signal and the sound image formation signal amplified in step S260 into a sound signal
(sound wave) and causes the sound device 400 to output the sound signal.
[0134]
According to the information providing device A of the second embodiment, the same effect as
the information providing device A of the first embodiment can be obtained.
That is, according to the information providing device A of the second embodiment, the sound
information emitted by the sound source outside the vehicle is maintained while maintaining the
positional relationship between the sound source outside the vehicle and the occupant inside the
vehicle while suppressing the cost related to external sound processing. Can be provided to the
passenger inside the vehicle.
[0135]
Further, in the present embodiment, by providing the front speakers 401 and 402 in the forward
direction of travel than the area where the head of the vehicle occupant is expected to be located,
the sound collected in front of the vehicle can be It can output from the front speakers 401 and
402 provided in front of.
04-05-2019
37
[0136]
In addition, the arrangement and characteristics of the front microphones 201 and 202 can be
the same as those of the first embodiment, and the same operations and effects can be obtained.
[0137]
Similarly, the arrangement and characteristics of the rear microphones 211 and 212 can be the
same as in the first embodiment, and the same operations and effects can be obtained.
[0138]
Furthermore, the position of the virtual sound source can be made similar to that of the first
embodiment, and the same operation and effect can be obtained.
[0139]
The embodiments described above are described to facilitate the understanding of the present
invention, and are not described to limit the present invention.
Therefore, each element disclosed in the above embodiment is intended to include all design
changes and equivalents that fall within the technical scope of the present invention.
[0140]
That is, in this specification, the information providing apparatus A mounted on a vehicle is
described as an example of one aspect of the sound information providing apparatus mounted on
a vehicle according to the present invention, but the present invention is limited to this It is not a
thing.
[0141]
Further, in the present specification, an information providing apparatus A including the sound
output controller 100 having the CPU 1, the ROM 2, and the RAM 3 will be described as one
aspect of the sound information providing apparatus according to the present invention. Absent.
04-05-2019
38
[0142]
Further, in the present specification, a sound collecting apparatus comprising the front
microphones 201 and 202 and the rear microphones 121 and 122 as one aspect of the sound
information providing apparatus having the first sound input means and the second sound input
means according to the present invention. Although the information provision apparatus A
provided with 200 is demonstrated, this invention is not limited to this.
[0143]
Further, although an example in which one or two front microphones 201 and 202 as first sound
input means are arranged has been described in this specification, the number is not limited.
Similarly, although an example in which two rear microphones 211 and 122 as second sound
input means are arranged has been described, the number is not limited.
[0144]
Moreover, in the present specification, as one aspect of the sound information providing
apparatus having the first sound output signal generation means according to the present
invention and the sound image generation means, the first acquisition function 101a, the second
acquisition function 101b, and the first Although the information providing apparatus A
including the sound output signal generation function 102, the sound image generation function
103, and the sound output controller 100 for realizing the sound output function 104 will be
described as an example, the present invention is not limited thereto. Absent.
[0145]
Further, in this specification, an information providing apparatus A including an acoustic device
400 having front speakers 401 and 402 and rear speakers 411 and 412 will be described as one
aspect of the sound output means according to the present invention. It is not limited to this.
[0146]
Further, in this specification, the information providing device A mounted on a vehicle is
described as an example of the sound information providing device mounted on a moving body,
but the moving body according to the present invention is limited to a vehicle Rather, it includes
trains, planes, forklifts, play equipment and other powered vehicles.
04-05-2019
39
[0147]
A: Information providing device 100: Sound output controller 1: CPU 2. ROM 3: RAM 200: Sound
collecting device 201 to 202: Forward microphone 211 to 212: Rear microphone 400: Acoustic
device 401 to 402: Forward speaker 411 to 412 Front speaker 300 ... Car sensor
04-05-2019
40

Download Report