Patent Translate Powered by EPO and Google Notice This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate, complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or financial decisions, should not be based on machine-translation output. DESCRIPTION JP2010272911 An external sound of a moving body 1000 is provided while maintaining a positional relationship with an occupant. A sound collection apparatus (200) having a front microphone (201, 202) provided forward of a moving direction of a moving body (1000) and a rear microphone (211, 212) provided backward of the moving direction of the moving body (1000) , 202 based on the first sound signal corresponding to the sound collected by 202, the first sound output signal generation function 102 for generating the first sound output signal controlled so that the sound can be heard from the preset virtual sound source And a sound image generation function 103 for generating a sound image formation signal in which a sound image is localized at a predetermined control point from the first sound output signal and / or the second sound signal corresponding to the sound collected by the rear microphones 211 and 212. And an output control function 104 for outputting a sound to the acoustic device 400 mounted on the mobile object 1000 based on the sound image formation signal. Sound information providing apparatus and sound information providing method [0001] The present invention relates to a sound information providing apparatus and a sound information providing method for providing sound information to a passenger of a moving body. [0002] There is known a technique of localizing a sound source position from correlation of signals of sounds of surrounding vehicles detected by two microphones and localizing a sound image in the direction of the localized sound source position (see Patent Document 1). 04-05-2019 1 [0003] Patent 2776092 gazette [0004] However, in the prior art, when there are a plurality of sound sources, processing for localizing the direction of the sound source position and processing for localizing the sound image in the direction of the sound source position must be performed for each. The problem is that it takes [0005] The present invention generates a first sound output signal controlled so that a sound can be heard from a predetermined virtual sound source, based on a first sound signal corresponding to a sound collected in front of the traveling direction of the mobile body. A sound image forming signal for localizing the sound image to predetermined control points set in advance based on the first sound output signal and / or the second sound signal corresponding to the sound collected behind the traveling direction of the moving body The above problem is solved by generating a sound and outputting a sound based on the sound image formation signal. [0006] According to the present invention, the external sound collected in front of the moving direction of the moving object is controlled so that it can be heard from the preset virtual sound source, and the sound image of the sound heard from the virtual sound source and the sound collecting behind the moving object Since the sound image of the generated sound is localized at each predetermined control point in the movable body room, the positional relationship between the sound source external to the movable body and the occupant inside the movable body is maintained while suppressing the cost for external sound processing. Sound information emitted by a sound source outside the moving body can be provided to the occupant inside the moving body. [0007] FIG. 1 is a block diagram of an in-vehicle apparatus 1 including a sound output controller 100 according to the present embodiment. It is a figure which shows the specific example of the hardware constitutions of the vehicle- 04-05-2019 2 mounted apparatus A of this embodiment. It is a figure for demonstrating the functional block structure of the sound output controller 100 of this embodiment shown in FIG. It is a figure which shows the example of installation of the sound collector 200 (201-204) of this embodiment. It is a figure which shows an example of the sound collection range by the back microphones 211,212. It is a figure which shows the example of the sound collection range by front microphone 201,202 and back microphone 211,212. FIG. 6 is a diagram for describing a visual range of a driver of a vehicle 1000. FIGS. 7A and 7B are diagrams showing an example of the microphones 211 and 212 provided with the artificial pinnacle member 231. FIG. It is a figure for demonstrating the path ¦ route which a sound reaches ¦ attains to the back microphone 211 which provided the pseudo ¦ simulation pinnacle member 231 from the sound source 1 ahead of a vehicle, and the sound source 2 behind a vehicle. It is a figure which shows the example which provided the microphone cover 251 in the back microphone 211 which provided the artificial pinnacle member 231. As shown in FIG. It is a figure which shows the other example which provided the microphone cover 251 in the back microphone 211 which provided the artificial pinnacle member 231. As shown in FIG. It is a figure which shows the example which provided the front microphones 201 and 202 in the cover of a light. It is a figure which shows the example of installation of the front microphones 201 and 202 provided with directivity. It is a figure for demonstrating the sound collection range of a unidirectional microphone, and the sound collection range of a dead angle control microphone. It is a 1st figure for demonstrating a 1st sound output signal production ¦ generation process, and is a figure for demonstrating the processing method converted into the sound which can be heard from a virtual sound source by convolving a filter to a 1st sound signal. It is a 2nd figure for demonstrating a 1st sound output signal production ¦ generation process, and is a figure for demonstrating the structure of the filter which produces the sound in a virtual sound source from the input sound signal. It is a figure for demonstrating the creation method of the filter using a delayer. It is a figure for demonstrating the creation method of the filter using a space transfer characteristic. It is a figure for demonstrating the case where one virtual sound source is arrange ¦ positioned ahead of a vehicle. It is a figure for demonstrating the case where two 04-05-2019 3 virtual sound sources are arrange ¦ positioned ahead of a vehicle. It is a figure for demonstrating a sound image production ¦ generation process. It is a figure which shows the example at the time of installing a back speaker in the headrest of a seat. It is a flowchart figure for demonstrating the procedure of the provision process of the sound information of 1st Embodiment. It is a figure which shows an example of the hardware constitutions of the sound output controller 100 of 2nd this embodiment. It is a figure for demonstrating the functional block structure of the sound output controller 100 of 2nd Embodiment shown in FIG. The figure for demonstrating the production ¦ generation process of the 1st sound output signal controlled so that it could hear from one virtual sound source of a vehicle interior based on the sound acquired from the two front microphones 201 and 202 provided ahead of the vehicle. It is. It is a figure for demonstrating the processing example which makes the front speaker 401 provided in front of a vehicle output the sound collected by one microphone 201 provided in front of the vehicle. It is a flowchart figure for demonstrating the procedure of the provision process of the sound information of 2nd Embodiment. [0008] First Embodiment Hereinafter, a sound output controller 100 according to the present embodiment will be described based on the drawings. The sound output controller 100 according to the present embodiment is a device mounted on a vehicle 1000 as a moving body and providing information of sound generated outside the vehicle 1000 to the interior of the vehicle 1000. [0009] FIG. 1 is a block diagram of an information providing apparatus A including a sound output controller 100 according to the present embodiment. [0010] As shown in the figure, the information providing device A includes a sound output controller 100, a sound collecting device 200 for collecting sounds around the vehicle, and an acoustic device 400 for outputting a sound controlled by the sound output controller 100. Have. These respective devices are connected by a vehicle-mounted LAN such as a CAN (Controller Area Network) and exchange information with each other. 04-05-2019 4 [0011] Further, as shown in the figure, the sound output controller 100 according to the present embodiment controls a sound acquired by the sound collection device 200 and stores a program for causing the sound device 400 to output the sound. By executing a program stored in the ROM 2 and the ROM 2, a CPU (Central Processing Unit) 1 as an operation circuit functioning as the sound output controller 100 and a RAM (Random Access Function) functioning as an accessible storage device. Memory 3). As an operation circuit, in place of or together with CPU (Central Processing Unit) 1, MPU (Micro Processing Unit), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array) Etc. can be used. [0012] FIG. 2 is a diagram showing a specific example of the hardware configuration of the information providing device A shown in FIG. [0013] As shown in FIG. 2, information (signals) of sound collected by the front microphones 201 and 202 and the rear microphones 211 and 212 included in the sound collection device 200 provided outside the vehicle is input to the sound output controller 100. Be done. [0014] The front microphones 201 and 202 are installed in front of the vehicle and collect sounds in front of the vehicle. In the present embodiment, the front microphones 201 and 202 are preferably disposed at positions where it is difficult for the engine sound to be input. Further, the rear microphones 211 and 212 are installed near the left and right outer walls of the rear of the vehicle, and collect sounds of the left and right side surfaces of the vehicle and the rear of the vehicle. The front microphones 201 and 202 and the rear microphones 211 and 212 can use general dynamic type microphones or the like. 04-05-2019 5 [0015] The sound output controller 100 has a microphone amplifier 11 that amplifies the sound acquired by the sound collection device 200. The microphone amplifier 11 includes a filter and has a function of converting the collected sound into an electric signal or the like of an appropriate size. The microphone amplifier 11 only needs to have a function of amplifying the gain of the microphone 200 in accordance with the dynamic range of the AD converter 12 in the subsequent stage, and a commonly used amplification device can be used. Furthermore, the AD converter 12 converts the acquired sound information from an analog signal to a digital signal, and sends it to the arithmetic device 1, that is, the CPU 1. In addition, the storage device 3, i.e., the ROM 3 previously stores information necessary for output control of sound. Then, the arithmetic device 1 refers to the storage device 3 and executes necessary sound output processing with reference to necessary information. The control signal output from the arithmetic device 1 is sent to the acoustic device 400 via the DA converter 13. [0016] In addition, the acoustic device 400 amplifies the electric signal and the like output from the sound output controller 100 and outputs the signal from the speakers 401, 402, 411, 412 and the like. As the amplification device 410 and the speakers 401, 402, 411, 412, etc., those generally used can be used. [0017] FIG. 3 is a diagram for explaining a functional block configuration of the sound output controller 100 of the present embodiment shown in FIG. [0018] As shown in the figure, the sound output controller 100 according to the present embodiment includes a first acquisition function 101a for acquiring a first sound signal corresponding to the sound collected by the front microphones 201 and 202 (the sound collection device 200). A second acquisition function 101b for acquiring a second sound signal corresponding to the sound collected by the rear microphones 211 and 212 (the sound collection device 200), and the sound from a predetermined virtual sound source based on the first sound signal And a first sound output signal generation function 102 for generating a first sound output signal controlled 04-05-2019 6 to be audible, and a predetermined one set in the vehicle room based on the first sound output signal and / or the second sound signal. And a sound output function 104 for outputting a sound based on the generated sound image formation signal. The sound image generation function 103 generates a sound image formation signal controlled such that the sound image is localized at each control point. [0019] The sound output controller 100 executes each function by cooperation of software for realizing these functions and the hardware described above. [0020] First, a sound collection device 200 for collecting a sound outside the vehicle to be controlled by the sound output controller 100 of the present embodiment will be described. [0021] The sound collection apparatus 200 of the present embodiment has front microphones 201 and 202 provided in front of the traveling direction of the vehicle, and rear microphones 211 and 212 provided behind the front microphones 201 and 202 in the traveling direction. [0022] Although not particularly limited, the front microphones 201 and 202 are preferably provided forward of the area where the head of the occupant is predicted to be located, particularly forward of the direction of travel, specifically forward of the line connecting both ears of the occupant. Furthermore, the front microphones 201 and 202 are preferably provided on the front side in the traveling direction relative to the position of the windshield, for example, on the front nose portion of the vehicle. This is because the sound in front of the vehicle can not be collected by a microphone disposed at the rear of the vehicle because the distance is too far. 04-05-2019 7 [0023] In the present embodiment, the front microphones 201 and 202 are provided outside the vehicle and in the vicinity of the body boundary surface ahead of the traveling direction of the vehicle. FIG. 4 is a diagram showing an installation example of the sound collector 200 of the present embodiment. As shown in FIG. 4, the front microphones 201 and 202 of the present embodiment are provided at the front end of the traveling direction of the vehicle 1000. As described above, by providing at the front end of the vehicle 1000, the distance to the object in front of the vehicle can be shortened, so that the sound emitted from the object in front of the vehicle can be accurately collected. In addition, it is not limited to the aspect shown in FIG. 4, The installation position of the front microphones 201 and 202 is good also as a front bumper part of a vehicle, and a headlight part. [0024] Also, the front microphones 201 and 202 may be provided on the front side of the body ceiling facing the moving surface of the moving body and facing the moving surface of the vehicle. That is, it may be disposed on the joint portion between the front outer wall (wind shield) and the ceiling of the vehicle or the roof (for example, a roof rail) on the windshield side in plan view from above the vehicle. Thus, when the engine is mounted in front of the vehicle, the influence of the engine noise can be eliminated and the influence of the road noise due to the friction between the tire and the traveling surface can be prevented. In addition, since the independence of the input signal of two front microphones 201 and 202 will become low when arrange ¦ positioning on a roof rail and its vicinity, the microphone which has sound collection directivity is used, The direction from which the sound collection directivity is obtained It is preferable to tilt outward away from the center of the vehicle. [0025] 04-05-2019 8 Further, the rear microphones 211 and 212 are provided on the rear side of the front microphones 201 and 202 in the traveling direction of the vehicle. The installation positions of the rear microphones 211 and 212 are not particularly limited, and can be provided on the side surface of the vehicle body, the rear door portion, the C pillar, the back door portion, the back bumper portion, the tail lamp portion, and the like. In the present embodiment, as shown in FIG. 4, the rear microphones 211 and 212 are disposed at the rear corners of the vehicle. In addition, when the subjects conducted a hearing experiment of sound by the test subjects, it is confirmed that the recognition rate improves the sound emitted by the object present behind the vehicle when the rear microphones 211 and 212 are disposed behind the C pillar of the vehicle. It was done. [0026] Specifically, the sound collection range of the front microphones 201 and 202 and the rear microphones 211 and 212 will be described. FIG. 5A is a view showing an example of a sound collection range by the rear microphones 211 and 212, and FIG. 5B is a view showing an example of a sound collection range by the front microphones 201 and 202 and the rear microphones 211 and 212. [0027] As shown in FIG. 5A, the rear microphone 211 provided at the rear of the right side of the vehicle along the traveling direction collects the sound generated in the sound collection range 1R which is the area on the right side of the vehicle. Further, the rear microphone 212 provided at the rear of the left side of the vehicle along the traveling direction collects the sound generated in the sound collection range 1L which is the area on the left side of the vehicle. In this embodiment, since the rear microphones 211 and 212 are disposed behind the driver, the S / N of the sound generated by an object approaching from the rear (for example, the sound of another vehicle) can be improved. It is possible to accurately provide information on the direction of arrival of the approaching object and the position of the object. [0028] Further, as shown in FIG. 5B, the front microphone 201 provided on the right front side of the vehicle along the traveling direction collects the sound generated in the sound collection range 04-05-2019 9 2R which is an area on the right front side of the vehicle. Further, the front microphone 202 provided on the left front side of the vehicle along the traveling direction collects the sound generated in the sound collection range 2L which is an area on the left front side of the vehicle. [0029] By the way, the driver of the vehicle can recognize the presence of an object around the own vehicle with eyes and ears. FIG. 6 is a view showing a visible range of the driver of the vehicle. As shown in the figure, there is a limit to the range that the driver of the vehicle can visually recognize. That is, although the area K in front of the vehicle is a visible area without moving the sight line, the area H which is the side opposite to the driver's seat is an area which can not be recognized unless the head is rotated. J is a range which can be visually recognized as the occupant moves his / her eyes. Thus, it is difficult for the driver to visually recognize an object (such as another vehicle) approaching from behind without moving his / her eyes or head. [0030] As described above, by providing the front microphones 201 and 202 in front of the vehicle in addition to the rear microphones 211 and 212 at the rear of the vehicle, sounds generated around the vehicle can be evenly collected. In particular, sounds generated in a range (region H) which can be viewed only by rotating the driver's head (region H) and a range (region J) which can be viewed by the driver's line of sight movement can be collected it can. [0031] Then, the aspect of the back microphones 211 and 212 suitable for the information provision apparatus A of this embodiment is demonstrated. [0032] It is desirable that the two sounds input from the two rear microphones 211 and 212 be established as a binaural sound source. For this reason, in the present embodiment, the pseudo microphones 231 are provided to the 04-05-2019 10 rear microphones 211 and 212. In general, in order to precisely arrange two microphones to be binaural sound sources, the microphones are placed in the ear canal of the dummy head. However, in the present embodiment, it is sufficient if the sound source direction and the sound source position of the collected environmental sound have consistency with the actual sound source direction and the sound source position, and two sounds input from two microphones A pseudo pinna member 231 having a curved surface that covers a part of the rear microphones 211 and 212 is provided so that it approximates a binaural sound source. [0033] As shown in FIG. 7, the artificial pinnacle member 231 having a curved surface that covers a part of the rear microphones 211 and 212 is provided at the installation position of the sound collector 200 of the vehicle. In the present embodiment, an example in which the rear microphones 211 and 212 and the artificial pinnacle member 231 covering the same is disposed on the side surface of the vehicle is shown. The artificial pinna member 231 of the present embodiment has a shape that simulates the shape of a human ear, or a shape that emphasizes features of the shape of the human ear. And the back microphones 211 and 212 are installed in the part corresponded to the ear canal entrance part of the human ear in the artificial pinnacle member 231 of this embodiment. Further, as shown in FIG. 7, it is preferable that the artificial pinnacle member 231 cover the rear microphones 211 and 212 from the rear side in the traveling direction, and set the front side in the traveling direction to be in the released state. Thereby, the sound coming from the traveling direction of the vehicle can be recognized without a sense of incompatibility as the sound in front. In addition, the material of the pseudo ¦ simulation pin member 231 is not specifically limited, The resin material etc. which can be shape ¦ molded in a desired shape can be used. [0034] FIG. 8 is a diagram for explaining a path in which the sound reaches the rear microphone 211 provided with the pseudo pinna member 231 from the sound source 1 in front of the vehicle and the sound source 2 in rear of the vehicle. As for the sound coming from the sound source 1 in front of the vehicle, the direct wave A and the reflected wave B and the like reflected by the pseudo pinna member 231 are collected by the rear microphone 211. On the other hand, in the sound coming from the sound source B at the rear of the vehicle, the diffracted wave C by the artificial pinnacle member 231 is collected by the rear microphone 211. Thus, by using the artificial pinnacle member 231, it is possible to collect the sound coming from the front of the vehicle and the sound coming from the rear of the vehicle by changing the characteristics of the 04-05-2019 11 sound wave such as the phase. As a result, it is possible to separate the sound signals coming from the front and rear direction of the vehicle and to collect the sound by discriminating the arrival directions of the respective sounds. The sound coming from the front sound source 1 and the rear sound source 2 is actually collected by the rear microphone 221 provided with the artificial pinnacle member 231, and the subject is made to listen to the sound. It was possible to distinguish the sound coming from the sound source 2 behind. [0035] Further, by providing the artificial pinna member 231, binaural sound can be collected. In addition to this, the sound outside the vehicle can be faithfully (really) reproduced in the vehicle interior by performing transaural reproduction by localizing the sound image to the control point in the vicinity of the passenger's ear and collecting the binaural collected sound. it can. The pseudo pinna member 231 can also be provided on the front microphones 201 and 202. [0036] In addition, the shape of this pseudo ¦ simulation pina member 231 is not specifically limited, The curvature of the curved surface which covers the pseudo ¦ simulation pina member 231, a shape, etc. can be set arbitrarily. At this time, it is preferable that the artificial pinnacle member 231 is at least characterized by the sound wave of the sound coming from the front and back and imitated to such an extent that the user can determine the position of the sound source. [0037] Moreover, it is preferable to provide the microphone cover 251 which covers the back microphones 211 and 212 from a waterproof and dustproof and soundproof viewpoint of the back microphones 211 and 212. In the present embodiment, it is preferable that the microphone cover 251 is designed to be able to suppress distortion of environmental sound at the time of sound collection. [0038] 04-05-2019 12 FIG. 9 is a view showing an example in which the microphone cover 251 is provided to the rear microphone 211 provided with the artificial pinnacle member 231. As shown in FIG. In the example illustrated in FIG. 9, the microphone cover 251 has a shape that covers the microphone cover 251 with the artificial pinnacle member 231 and the rear microphone 211 with a curved surface, and is attached to the side wall of the vehicle 1000. As shown in FIG. 9, it is preferable to determine the shape of the microphone cover 251 so that the artificial pinnacle member 231 and the rear microphone 211 are positioned in the portion where the curvature of the curved surface of the microphone cover 251 is the largest. Further, on one side of the microphone cover 251, a plurality of slits 241 sealed with a material having acoustic transparency are formed. The slit 241 is preferably provided on the rear side with respect to the traveling direction of the vehicle. With such a configuration, it is possible to collect sound with little attenuation of environmental sound, and it is possible to prevent generation of a booming noise inside the microphone cover 251. [0039] Moreover, FIG. 10 is a figure which shows the other example which provided the microphone cover 251 in the back microphone 211 which provided the artificial pinnacle member 231. As shown in FIG. In the example shown in FIG. 10, a small space is provided in the exterior of the vehicle, the pseudo-auricle member 231 and the rear microphone 211 are accommodated, and the exterior of the vehicle has a plurality of slits 241 sealed with an acoustically transparent material. Set up. In addition, a part of the exterior of the vehicle is made to be an acoustically transparent sound transmission wall. Here, the sound transmitting wall is a member in which the difference between the sound wave before transmission and the sound wave after transmission is equal to or less than a predetermined value, and the acoustic loss amount and the strain amount are equal to or less than a predetermined value. [0040] Furthermore, the aspect of the front microphones 201 and 202 suitable for the information provision apparatus A of this embodiment is demonstrated. [0041] By providing the rear microphones 211 and 212, it is possible to collect environmental sounds generated on the side and the rear of the vehicle. 04-05-2019 13 Since the listening range of the microphone depends on the magnitude of the input gain, for example, in order to collect the sound in front of the vehicle using a microphone disposed at the rear, it is necessary to take a large input gain. However, there is an upper limit to the setting value of the input gain, and when the sensitivity is increased, there is an obstacle such as traveling noise of the own vehicle being relatively large, so the sound collection range of the rear microphones 211 and 212 is as shown in FIG. It is limited to the sound collection ranges 1R and 1L shown in FIG. In this embodiment, in order to collect environmental sound generated around the vehicle in a state in which the influence of the traveling noise of the vehicle is reduced, in addition to the rear microphones 211 and 212 that perform binaural recording, another front microphone 201 and 202 are provided. [0042] Furthermore, the installation aspect of the front microphones 201 and 202 suitable for the information provision apparatus A of this embodiment is demonstrated. [0043] If a microphone is placed in front of a vehicle mounted with an engine in front of the vehicle, such as an FF vehicle or an FR vehicle, the engine noise reduces the S / N. For this reason, in the present embodiment, a soundproof wall is provided between the front microphones 201 and 202 and the drive device or tire of the vehicle. FIG. 11 is a diagram showing an example in which the front microphones 201 and 202 are provided in the cover of the light. As shown in FIG. 11, the front microphones 201 and 202 are covered with the light cover on the vehicle exterior side and the soundproof wall 261 on the vehicle interior side. The soundproof wall 261 is formed of a sound absorbing material and isolates the sound emitted from the engine. [0044] In addition, the light cover may be provided with a slit 251 sealed by a member having sound transparency. The slit 251 may be provided on the front side or the rear side of the traveling direction of the vehicle. Also, instead of the slit 251, a part of the light cover may be made of an acoustically transparent material. As described above, by arranging the soundproof wall 261, the 04-05-2019 14 front microphones 201 and 202 can be arranged on the front side to the front end of the vehicle even if the type of engine is the front. [0045] Moreover, in the present embodiment, it is preferable that the front microphones 201 and 202 have directivity for collecting sound in a predetermined direction area. Thereby, the sound collection direction of the front microphones 201 and 202 can be arbitrarily set according to the installation position of the front microphones 201 and 202. FIG. 12 is a view showing an installation example of the front microphones 201 and 202 having directivity. In the example of FIG. 12, the front microphones 201 and 202 are installed in front of the roof rail, the sound collecting direction of the right front microphone 201 is moved from the vehicle center by a predetermined angle to the right, and the sound collecting direction of the left front microphone 202 Is moved leftward from the center of the vehicle by a predetermined angle. [0046] By setting the sound collection direction of each of the front microphones 201 and 202 having directivity in this way in the opposite direction with respect to the vehicle center, the independence of the input signals of the two microphones can be enhanced. In particular, when the front microphones 201 and 202 are disposed on the roof rail, since the independence of the input signals of the two microphones is low, when the sound collection direction of the front microphones 201 and 202 is inclined outward, the sound generated in each direction is The sound can be collected correctly. In this case, by using the forward microphones 201 and 202 having directivity, it is possible to prevent the sound generated by the engine and the tire from being collected. [0047] Furthermore, as shown in the right side of FIG. 13, the use of the front microphones 201 and 202 capable of setting a dead area not collecting sound prevents the sound generated by the engine or tire from being collected. And can eliminate the effects of these sounds. [0048] Here, returning to FIG. 3, functions implemented by the above-described sound output controller 100 will be described. 04-05-2019 15 [0049] First, the first acquisition function 101 a and the second acquisition function 101 b of the sound output controller 100 will be described. The sound output controller 100 acquires a first sound signal corresponding to the sound collected by the above-described front microphones 201 and 202, and is provided behind the traveling direction to collect the sound outside the vehicle. The second sound signal corresponding to the sound collected by the above rear microphones 211 and 212 is acquired. The acquired first sound signal is used for the processing of the first sound output signal generation function 102, and the acquired second sound signal is used for the processing of the sound image generator 103. [0050] Subsequently, the first sound output signal generation function 102 of the sound output controller 100 will be described. The sound output controller 100 generates a first sound output signal controlled so that the sound can be heard from a predetermined virtual sound source in the occupant based on the acquired first sound signal. [0051] The sound output controller 100 of the present embodiment converts the first sound signal corresponding to the sound collected by the front microphones 201 and 202 into a sound that can be heard from a desired direction, that is, a virtual sound source. The first sound signal is a sound signal obtained by performing processing necessary for signal processing such as amplification processing and digital conversion on the sound collected by the front microphones 201 and 202. Furthermore, the sound output controller 100 converts the first sound signal into a sound that can be heard from a virtual sound source, and then converts it into a desired number of channels (that is, a number corresponding to the number of front microphones 201 etc.) Output to These processes are executed by the AD converter 12, the arithmetic unit 1, the 04-05-2019 16 storage unit 3 and the DA converter 13 shown in FIG. It is preferable that the sound corresponding to the first sound output signal generated by the first sound output signal generation function 102 is theoretically equivalent (have common characteristics) to a sound image localized at a control point described later. [0052] Although not particularly limited, the sound output controller 100 according to the present embodiment forms a filter (function) using a space transfer system as a transfer system of sound from the virtual sound source to the both ears of each passenger including the driver. By convoluting a filter into a single sound signal, it is converted into a sound that can be heard from a virtual sound source. [0053] FIG. 14 is a first diagram for explaining a first sound output signal generation process, and is a diagram for explaining a processing method of converting a sound that can be heard from a virtual sound source by convolving a filter into the first sound signal. is there. [0054] As shown in FIG. 14, by filtering the sound source signal X for monaural recording, the sound source signal X is corrected so that it can be heard from the virtual sound source position P1. Let G1 and G2 be time signals of spatial transfer characteristics of the sound source signal X from the virtual sound source position P1 to the listener's ears, respectively G1 and G2, the time signals Y1 and Y2 of the sound signal at the listener's binaural position are as follows Can be asked. [0055] Y1 = X * G1 (Formula 1) Y2 = X * G2 (Formula 2) Here, * represents a convolution operation. [0056] FIG. 15 is a second diagram for describing the first sound output signal generation process, and is a diagram for describing the configuration of a filter that creates a sound in a virtual sound source from an input sound signal. 04-05-2019 17 [0057] The first sound signals X1 to Xm corresponding to the sounds collected by the front microphones 201 and 202 pass through two or more filter sets (for example, G11 and G12 in the case of X1), and then both listeners At the ear (Left, Right) position, the sound is converted so as to be audible from the virtual sound source. The filter set used has the number of taps necessary for the spatial transfer characteristics such as G1 and G2 in FIG. 14 to be sufficiently expressed. For example, in the case where a virtual sound source is installed at a distance of 2 m from the listener, if the sampling frequency of the AD converter is 8 kHz, a filter length of about 48 taps is required. The first sound signal input from each of the front microphones 201 and 202 is subjected to filter processing, and the first sound output signal controlled to be audible from the virtual sound source is added (mixed) for each of the left and right channels, It is sent to the processing system of the latter stage. [0058] The filter design used in the present process can generally use a filter design method for converting sound from a virtual sound source. For example, a filter may be created that expresses the positional relationship with the listener, that is, the direction, using a delayer, or a filter may be created by measuring the space transfer characteristic in which the information providing device A is actually installed. It is also good. [0059] Here, each method of filter design will be described. [0060] 04-05-2019 18 First, a method of creating a filter that expresses a positional relationship with a listener using a delayer will be described. FIG. 16 is a diagram for explaining a method of creating a filter using a delay element. In the example shown in FIG. 16, one front microphone 201 is disposed at the front end of the vehicle, and the installation position of the front microphone 201 is set as the position of the virtual sound source. At this time, in order to express the transmission system from the installation position of the front microphone 201 to both ears of the driver who is the listener, a delayer is embedded in the filter (see FIG. 15). FIG. 16 shows an example of a time delay filter in which delayers are inserted in G11 and G12. G11 simulates a space transfer system from the position of the front microphone 201 to the left ear of the driver, and this space transfer path is temporally based on the arrival sound from the sound source as compared with the path of the space transfer system of G12. Arrive to arrive fast. For this reason, the G11 filter is designed to have a peak that is faster by two taps than the G12 filter. [0061] Subsequently, a method of creating a filter using space transfer characteristics will be described. In the method using the space transfer characteristic, the filter can be designed not only with the time delay but also with the phase shift at all frequencies. [0062] FIG. 17 is a diagram for explaining a method of creating a filter using space transfer characteristics. In the example shown in FIG. 17, one front microphone 201 is disposed at the front end of the vehicle, and the placement place of the front microphone 201 is set as a virtual sound source. At this time, the transmission system from the installation position of the front microphone 201 to both ears of the driver who is the listener is measured using an impulse or the like, and the response waveform is used as a filter. For example, G11 measures the transfer characteristic from the installation position of the front microphone 201 to the driver's left ear and performs filter processing on the system design requirements (memory size, real-time processing performance) and virtual sound source In view of the balance of the distance to the listener, it can be used as a filter by cutting it to an appropriate length. Although the space transfer characteristic may be measured in real space, it may be simulated using a geometric 04-05-2019 19 method such as a wave equation or a virtual image method. [0063] The design method of the filter for creating the sound in the virtual sound source from the input sound signal is not limited to the one described above, but is known at the time of filing such as controlling only the phase or controlling only the frequency characteristic. An approach can be used. [0064] Next, a method of setting the position of the virtual sound source will be described. [0065] Although not particularly limited, the sound output controller 100 sets the virtual sound source in front of the line connecting the areas where the occupants' ears are located. That is, based on the first sound signal corresponding to the sound collected by the front microphones 201 or 201 and 202, the sound output controller 100 is set ahead of the line connecting the areas where the both ears of the occupant are located. Generating a first sound output signal controlled so that sound can be heard from the virtual sound source. [0066] Specifically, the sound output controller 100 sets the virtual sound source in front of the body boundary in front of the traveling direction of the vehicle (mobile body). That is, based on the first sound signal corresponding to the sound collected by the front microphones 201 or 201 and 202, the sound output controller 100 is set ahead of the body boundary surface in the forward direction of the vehicle. A first sound output signal controlled so that sound can be heard from the virtual sound source is generated. [0067] 04-05-2019 20 Also, specifically, the sound output controller 100 sets the virtual sound source at the front end of the traveling direction of the vehicle. That is, the sound output controller 100 can hear the sound from the virtual sound source set at the front end of the traveling direction of the vehicle based on the first sound signal corresponding to the sound collected by the front microphones 201 or 201 and 202. Generating a first sound output signal controlled as such. [0068] As an additional aspect, the sound output controller 100 sets the virtual sound source on the horizontal plane including the installation positions of the front microphones 201 or 201 and 202. That is, the sound output controller 100 is set on a horizontal plane including the installation position of the front microphones 201 or 201 and 202 based on the first sound signal corresponding to the sound collected by the front microphones 201 or 201 and 202. A first sound output signal controlled so that sound can be heard from the virtual sound source is generated. By setting the virtual sound source to the same height as the installation position of the front microphones 201 or 201 and 202, the sound collected at the front of the vehicle can be obtained from the virtual sound source similarly set to the front of the vehicle and at the same height. You can make it audible. [0069] Thus, the sound output controller 100 sets the virtual sound source so that the environmental sound collected in the forward direction of travel of the vehicle comes from the forward direction of travel of the vehicle. That is, the sound output controller 100 sets the position of the virtual sound source to a position according to the position (sound collection range) of the sound source of the sound collected by the front microphones 201 or 201 and 202. [0070] By the way, the purpose of providing information on surrounding environmental sound to an occupant (driver) driving a vehicle is, first, to notify that an object such as another vehicle approaches when the vehicle advances, secondly It is to notify that an object such as an installation is approached when the vehicle moves backward. 04-05-2019 21 [0071] In order to achieve the first object, sound information is provided to indicate that the sound to be provided comes from the front, and which direction of the sound to be provided comes from the front and the left. There is a need. If the driver notices the sound information coming from the front, it is possible to judge the appropriate driving operation such as stepping on the brake, and if the driver can distinguish from which of the left and right the sound is coming from the sound information An approach to an object can be avoided by proper steering operation. [0072] From the above point of view, in the present embodiment, (1) the virtual sound source is arranged at one place in front of the vehicle, and (2) the virtual sound source travels from the reference line along the traveling direction from the center of the occupant. The aspect arrange ¦ positioned to two places which have a spread angle of about 60 degrees on either side of can be selected. [0073] FIG. 18 is a diagram for explaining the case where one virtual sound source is disposed in front of the vehicle. As shown in FIG. 18, one front microphone 201 is disposed in the vicinity of the body boundary surface ahead in the traveling direction of the vehicle, specifically, at the front end in the traveling direction of the vehicle. The environmental sound in front of the vehicle is collected by the front microphone 201 and converted into a first sound output signal coming from the virtual sound source position P1. When the front microphone 201 has unidirectionality and is installed so as to be in the sound reception range shown in FIG. 18, the sound emitted by all approaching objects approaching from the front of the vehicle is the virtual sound source position P1. Provided to the driver as a sound coming from the According to the arrangement of the front microphone 201 shown in FIG. 18, the driver can be made aware of the presence of an object approaching from the front in the traveling direction of the vehicle. With the provided sound information, the driver can perform a decelerating operation such as an appropriate brake operation to avoid approach to the object. 04-05-2019 22 [0074] FIG. 19 is a diagram for describing a case where two virtual sound sources are disposed in front of the vehicle. As shown in FIG. 19, two forward directivity front microphones 201 and 202 are disposed at the front end of the vehicle. The front microphones 201 and 202 are arranged to be separated by a predetermined distance or more, and collect sounds generated in different sound reception ranges. The first sound signal corresponding to the sound collected by the front microphone 201 is controlled to be audible from the virtual sound source position P1, and the first sound signal corresponding to the sound collected by the front microphone 202 is from the virtual sound source position P2 Controlled to hear. Although not particularly limited, the virtual sound source position P1 is preferably set on a line connecting the installation position of the front microphone 201 and the right ear of the occupant. The virtual sound source position P2 is preferably set on a line connecting the installation position of the front microphone 202 and the left ear of the occupant. [0075] By doing this, the sound input from the left and right front microphones 201 and 202 is allocated to the left and right virtual sound source positions P1 and P2 according to the direction in which the actual sound source is located. The driver who has listened to the sound coming from can identify whether the object serving as the sound source is in the left or right direction. According to the front microphones 201 and 202 and the virtual sound sources P1 and P2, it is possible to indicate by sound whether the front object is present in the left or right direction. As a result, the driver can operate the vehicle with the object by the brake operation and the steering operation. Approach can be avoided. [0076] Finally, the sound image generation function 103 of the sound output controller 100 will be described. The sound output controller 100 generates, based on the first sound output signal and / or the second sound signal, a sound image formation signal controlled so that the sound image is localized at predetermined control points preset in the vehicle cabin. The sound based on the generated sound image formation signal is output. The position of the control point for localizing the first sound output signal is different from the position of the control point for localizing the 04-05-2019 23 second sound signal. [0077] The sound output controller 100 outputs, from the acoustic device 400, a sound corresponding to the first sound output signal generated by the first sound output signal generation function 102 and / or the second sound signal collected by the rear microphones 211 and 212. In this case, the influence of the transmission system from each speaker of the acoustic device 400 to a predetermined control point (for example, near the ears of the listener) is removed, and the sound corresponding to the first sound output signal is reproduced at the control point To generate an acoustic image forming signal converted to the signal. These processes are executed by the AD converter 12, the arithmetic unit 1, the storage unit 1 and the DA converter 13 shown in FIG. [0078] FIG. 20 is a diagram for explaining sound image generation processing. As shown in FIG. 20, in the filter H used for the sound image generation function 103, the input signals Y1 and Y2 are reproduced at the control points at positions C1 and C2 of predetermined control points, that is, the sound image is localized at the control points. Is designed as. The input signals Y1 and Y2 are the first sound output signal and / or the second sound signal generated by the first sound output signal generation function 102. [0079] In the present process, it is preferable that the following relationship be established between the input signals Y1 and Y2 and the sound image forming signals Z1 and Z2 reproduced at the control point. [0080] Y1 = Z1 (Formula 3) Y2 = Z2 (Formula 4) Therefore, the influence of the space transfer system is eliminated using the filter H for sound image signal formation processing. 04-05-2019 24 Hereinafter, this filter H is called an inverse filter H. [0081] The configuration and processing method of the inverse filter H will be described with reference to FIG. When an input signal Yn, an inverse filter Hmn (m is a sound source number, n is a control point number), a reproduced signal (sound image forming signal at a control point) Zn, and a space transfer characteristic Fnm for each arbitrary frequency The relationship of can be expressed in Equation 5. [0082] FHY = Z (Equation 5) Here, F = [Fnm], H = [Hmn], Y = [Yn], and Z = [Zn]. [0083] At this time, in order to satisfy the relationship of Equation 3 and Equation 4, FH = I (I is a unit vector). Therefore, in order to derive the inverse filter H based on F, H = F <−> ([·] <−> is a general inverse matrix of the matrix [·]) may be calculated for each arbitrary frequency. For example, the calculation method described in Application of inverse filter design using minimum norm solution to transaural system: Proceedings of the Acoustical Society of Japan, pp 495-496 (1998) can be used. [0084] The sound output controller 100 uses the designed inverse filter H to generate a sound image formation signal for localizing the sound image at the control point. Then, the sound output controller 100 causes the sound device 400 to output a sound based on the generated sound image formation signal. [0085] 04-05-2019 25 The front speakers 401 and 402 of the acoustic device 400 are disposed forward of the traveling direction of the vehicle. At this time, the front speakers 401 and 402 are provided at positions corresponding to the positions of the front microphones 201 and 202. For example, it is preferable to provide the front speakers 401 and 402 in the vehicle compartment on the line connecting the position of the head or ears of the occupant and the front microphones 201 and 202. [0086] On the other hand, the rear speakers 411 and 412 are disposed rearward of the traveling direction of the vehicle. At this time, the rear speakers 411 and 412 are provided at positions corresponding to the positions of the rear microphones 211 and 212. For example, it is preferable to provide the rear speakers 411 and 412 in the vehicle interior on the line connecting the positions of the head or ears of the occupant and the rear microphones 211 and 212. [0087] Specifically, the rear speakers 411 and 412 of the present embodiment are disposed rearward of the area where the head of the occupant is predicted to be located, and are disposed on the right and left sides of the occupant. [0088] FIG. 21 is a view showing an example in which the rear speakers 411 and 412 are installed in the headrest of the seat. Based on a sound image forming signal corresponding to the second sound signal collected by the rear microphones 211 and 212, sound is output from the rear speakers 411 and 412 provided at the rear in the traveling direction with respect to the positions of the occupants' ears. The occupant can determine the position of an object approaching from behind with high accuracy. A sense of localization for incoming environmental sound is increased. 04-05-2019 26 [0089] Subsequently, a control procedure of the sound output controller 100 of the present embodiment will be described based on FIG. [0090] FIG. 22 is a flow chart for explaining the procedure of the process of providing sound information according to this embodiment. [0091] When the information providing device A starts operating, in step S110, the sound output controller 100 executes power on and initialization processing. Specifically, at the time of the initial setting process, the sound output controller 100 reads a filter used in the first sound output signal generation process and a filter used in the sound image generation process. [0092] In the subsequent step S120, the sound output controller 100 acquires the sounds collected by the front microphones 201 and 202 and the rear microphones 211 and 212 of the sound collection device 200, and converts them into electrical signals. [0093] Furthermore, in step S130, the sound output controller 100 acquires the first sound signal and the second sound signal obtained by amplifying the electric signal converted in step S120 to an appropriate level. [0094] Thereafter, in step S140, the sound output controller 100 discretely converts the first sound signal acquired in step S130 (when the acquisition signal is a continuous signal), and based on the first sound signal, performs filtering and channel processing. Integration processing is performed to generate a first sound output signal controlled so that sound can be heard from a predetermined virtual sound source. 04-05-2019 27 [0095] Subsequently, in step S150, the sound output controller 100 discretely converts the first sound output signal generated in step S140 and the second sound signal processed in step S130 (when the acquisition signal is a continuous signal), Based on the first sound output signal and / or the second sound signal, a continuous sound image formation signal controlled so that the sound image is localized at a predetermined control point preset in the vehicle interior of the vehicle is generated. [0096] Next, in step S160, the sound output controller 100 amplifies the sound image formation signal generated in step S150. [0097] Next, in step S170, the sound output controller 100 converts the sound based on the sound image formation signal amplified in step S160 into a sound signal (sound wave) and causes the sound device 400 to output the sound signal. [0098] If the signal handled in the series of information processing is a continuous signal such as an electrical signal, AD processing and DA processing are inserted before and after the first sound output signal generation processing and the sound image generation processing, and on the other hand, a series of When the signal handled in the information processing is obtained as a discrete signal, the first sound output signal generation processing and the sound image generation processing are executed without performing the AD / DA processing. Moreover, although it is desirable to use a discrete filter from the viewpoint of cost etc. in the first sound output signal generation processing and the sound image generation processing, a filter capable of continuous processing may be used. [0099] The sound output controller 100 according to the present embodiment is configured as described above and operates as described above, so that the following effects can be obtained. 04-05-2019 28 [0100] The sound output controller 100 according to the present embodiment maintains the positional relationship between the sound source outside the vehicle and the occupant inside the vehicle while suppressing the cost relating to external sound processing, and the sound information emitted by the sound source outside the vehicle Can be provided. [0101] That is, the sound output controller 100 according to the present embodiment is controlled such that a sound can be heard from a predetermined virtual sound source based on the first sound signal corresponding to the sound collected in front of the traveling direction of the vehicle. A sound output signal is generated, and a sound image is generated at a predetermined control point set in advance based on the first sound output signal and / or a second sound signal corresponding to a sound collected behind the traveling direction of the vehicle. In order to generate a sound image formation signal to be localized and to output a sound based on the sound image formation signal, an external sound collected in front of the traveling direction of the vehicle is preset at a predetermined control point in the vehicle compartment. Because the sound source can be heard from the virtual sound source, while keeping the positional relationship between the sound source outside the vehicle and the occupant inside the vehicle while suppressing the cost for external sound processing, the passenger inside the vehicle hears the sound information emitted by the sound source outside the vehicle To It can be provided. [0102] Further, in the information providing apparatus A of the present embodiment, the front microphones 201 and 202 are provided in front of the vehicle, and the rear microphones 211 and 212 are separately provided behind the vehicle to evenly collect the sounds generated around the vehicle. It can sound. In particular, the S / N ratio of sounds generated in a range that can be viewed only by turning the driver's head (region H in FIG. 6) and a range that can be viewed by the driver's gaze movement (region J in FIG. 6) You can collect sounds with [0103] Therefore, the external sound collected in front of the traveling direction of the vehicle is controlled to be heard from a preset virtual sound source, and the sound image of the sound 04-05-2019 29 heard from the virtual sound source and the sound image of the sound collected behind the vehicle Is localized at a predetermined control point in the vehicle room, so that the positional information between the sound source outside the vehicle and the occupant inside the vehicle can be maintained to provide the occupant inside the vehicle with sound information emitted by the sound source outside the vehicle it can. [0104] According to the information providing apparatus A of the present embodiment, even when the sound insulation of the vehicle is high, the information of the sound emitted by the object around the vehicle can be provided so that the occupant can recognize the position of the object it can. That is, since the occupant recognizes the presence of other vehicles approaching from the front, level crossings, traffic lights, etc., appropriate driving operations such as deceleration can be performed, and the presence of other vehicles approaching from the rear, emergency vehicles, etc. As it recognizes, appropriate driving operations such as turning can be performed. [0105] Further, in the information providing device A of the present embodiment, the front microphones 201 and 202 are provided in front of the traveling direction of the vehicle, for example, near the body boundary of the vehicle and at the front end of the traveling direction of the vehicle. Since sound can be collected and provided as sound heard from a predetermined virtual sound source, the positional relationship between the sound source and the occupant can be maintained to provide information on the sound emitted from the sound source. [0106] Further, in the information providing apparatus A of the present embodiment, the engine is mounted in front of the vehicle by providing the front microphones 201 and 202 on the side of the body ceiling facing the traveling direction of the vehicle and facing the moving surface of the vehicle. In the case, the influence of the engine noise can be eliminated and the influence of the road noise can be prevented. [0107] Further, in the information providing apparatus A of the present embodiment, the front microphones 201 and 202 have directivity for collecting sound in a predetermined direction 04-05-2019 30 area, so that the front microphones 201 and 202 can be arranged according to the installation position of the front microphones 201 and 202. , 202 can be set arbitrarily. [0108] Further, in the information providing apparatus A of the present embodiment, a soundproof wall is provided between the front microphones 201 and 202 and the engine or tire of the vehicle, so that the front to the front end of the vehicle The front microphones 201 and 202 can be arranged on the [0109] Further, in the information providing apparatus A of the present embodiment, by providing the artificial pinnacle member 231 having a curved surface that covers a part of the rear microphones 211 and 212, the sound coming from the front of the vehicle and the sound coming from the rear of the vehicle Can be collected by changing the sound wave characteristics such as phase. As a result, it is possible to separate the sound signals coming from the longitudinal direction of the vehicle, and to collect the sound that can identify the arrival direction of each sound. [0110] Further, in the sound output controller 100 of the present embodiment, based on the first sound signal corresponding to the sound collected by the front microphones 201 and 202, in front of the line connecting the areas where the both ears of the occupant are located. By generating the first sound output signal controlled so that the sound can be heard from the set virtual sound source, the sound collected in front of the vehicle can be heard from the virtual sound source similarly set in front of the vehicle can do. That is, the sound information provided based on the sound collected by the front microphones 201 and 202 enables the occupant to recognize the presence of an object approaching from the front. 04-05-2019 31 [0111] Similarly, in the sound output controller 100 of the present embodiment, based on the first sound signal corresponding to the sound collected by the front microphones 201 and 202, the sound output controller 100 is set ahead of the body boundary in the front direction of the vehicle. The above-described effect can be achieved by generating the first sound output signal controlled so that the sound can be heard from the virtual source. [0112] Similarly, in the sound output controller 100 according to the present embodiment, a virtual set at the front end of the traveling direction of the vehicle based on the first sound signal corresponding to the sound collected by the front microphones 201 and 202. The abovementioned effect can be achieved by generating the first sound output signal controlled so that the sound can be heard from the sound source. [0113] Further, in the sound output controller 100 according to the present embodiment, the first sound signal corresponding to the sound collected by the front microphones 201 and 202 is set on the horizontal plane including the installation position of the first sound input unit. By generating the first sound output signal controlled so that the sound can be heard from the virtual sound source, the sound collected in front of the vehicle can be heard from the virtual sound source similarly set in front of the vehicle and at the same height Can be That is, the sound information provided based on the sound collected by the front microphones 201 and 202 enables the occupant to more accurately recognize the presence of an object approaching from the front. [0114] Further, in the information providing device A of the present embodiment, the rear speakers 411 and 412 of the acoustic device 400 are located behind the area where the head of the occupant of the vehicle is predicted to be located, and behind the traveling direction. By disposing on the left side, the occupant can determine the position of an object approaching from behind with high accuracy. 04-05-2019 32 A sense of localization for incoming environmental sound is increased. [0115] Second Embodiment Subsequently, a second embodiment will be described. The basic configuration of the information providing device A of the second embodiment is common to the information providing device A of the first embodiment shown in FIG. Here, in order to avoid redundant description, points different from the first embodiment will be mainly described. [0116] FIG. 23 is a diagram showing an example of the hardware configuration of the sound output controller 100 according to the second main embodiment. [0117] As shown in FIG. 23, the information (signal) of the sound collected by the front microphones 201 and 202 and the rear microphones 211 and 212 included in the sound collection device 200 provided outside the vehicle is input to the sound output controller 100. Be done. Each configuration shown in FIG. 23 is common to each configuration of the first embodiment of FIG. [0118] FIG. 24 is a diagram for explaining a functional block configuration of the sound output controller 100 according to the second embodiment shown in FIG. [0119] 04-05-2019 33 The first sound output signal generation function 112 shown in FIG. 24 generates a first sound output signal controlled so that the sound can be heard from a predetermined virtual sound source based on the first sound signal, and the front speakers 401 and 402 To the first sound output function 114a that controls the sound output of the [0120] The sound image generation function 113 shown in FIG. 24 generates a sound image formation signal controlled so that the sound image is localized to a predetermined control point set in advance in the room of the vehicle based on the second sound signal. , 412 are sent out to the second sound output function 114b that controls the sound output. [0121] FIG. 25 illustrates a process of generating a first sound output signal controlled so as to be heard from one virtual sound source in the vehicle compartment based on the sounds acquired from the two front microphones 201 and 202 provided in front of the vehicle. FIG. In the present embodiment, processing for localizing a sound image to a designated control point based on the first sound output signal as in the first embodiment is not performed. That is, based on the sound acquired from the front microphones 201 and 202, the sound is output so as to be heard from one virtual sound source set in front of the vehicle. At this time, the sound output controller 100 may output a sound based on the first sound output signal using the front speakers 401 and 402 installed forward in the traveling direction of the vehicle. [0122] In the example shown in FIG. 25, two front microphones 201 and 202 are installed at the front end of the vehicle. 04-05-2019 34 The sound signals collected by the front microphones 201 and 202 are amplified for each channel, the sound collected by the front microphone 201 is output by the front speaker 401, and the sound collected by the front microphone 202 is output by the front speaker 402. Make it output. [0123] In the present embodiment, it is preferable that the front speakers 401 and 402 be provided forward of the area where the head of the vehicle occupant is expected to be located in the traveling direction. Specifically, the front speakers 401 and 402 are preferably disposed in the vicinity of the root of the A-pillar of the vehicle, etc., but may be ahead of the head of the occupant in the traveling direction. Thus, the sound collected in front of the vehicle can be output from the front speakers 401 and 402 provided in front of the vehicle. [0124] Further, it is preferable to adjust the balance between the left and right of the sound signals sent to the respective front speakers 401 and 402 so as to obtain a stereo effect when listening from the driver's seat. At this time, using the sound image generation function 112, for example, the sound pressure balance may be adjusted so that the sound image of the sound of the sound source A1 is localized to the virtual sound source A′1 (control point). [0125] FIG. 26 is a diagram for explaining a processing example of causing a front speaker 401 provided in front of the vehicle to output a sound collected by one microphone 201 provided in front of the vehicle. 04-05-2019 35 [0126] The sound output controller 100 amplifies the sound collected by one microphone 201 and outputs the amplified sound from one front speaker 401 disposed in front of the driver. The speakers 401 can be installed in accordance with the number of microphones 201. Alternatively, two or more microphones 201 may be installed and adjusted so as to be localized at an appropriate position using a mixer or the like. [0127] Since the information providing apparatus A according to the present embodiment does not use a filter, a certain effect can be expected with a simple configuration and at low cost as compared with a method using a virtual sound source. [0128] FIG. 27 is a flowchart for explaining the procedure of the process of providing sound information according to the second embodiment. [0129] Steps S210 to S230 of the process of FIG. 27 are the same as steps S110 to S130 of FIG. Here, the process after step S240 which is a process different from the first embodiment will be described. [0130] In step S240, the sound output controller 100 discretely converts the first sound signal acquired in step S230 (when the acquired signal is a continuous signal), and based on the first sound signal, performs filter processing and channel integration processing. To generate a first sound output signal controlled so that a sound can be heard from a predetermined virtual sound source. 04-05-2019 36 [0131] In step S250, which is executed in parallel with step S240, the sound output controller 100 discretely converts the second sound signal processed in step S230 (when the acquisition signal is a continuous signal), based on the second sound signal. Thus, a continuous sound image formation signal controlled so that the sound image is localized at a predetermined control point set in advance in the vehicle room is generated. [0132] Next, in step S260, the sound output controller 100 amplifies the first sound output signal generated in step S240 and the sound image formation signal generated in step S250. [0133] Next, in step S270, the sound output controller 100 converts the sound based on the first sound output signal and the sound image formation signal amplified in step S260 into a sound signal (sound wave) and causes the sound device 400 to output the sound signal. [0134] According to the information providing device A of the second embodiment, the same effect as the information providing device A of the first embodiment can be obtained. That is, according to the information providing device A of the second embodiment, the sound information emitted by the sound source outside the vehicle is maintained while maintaining the positional relationship between the sound source outside the vehicle and the occupant inside the vehicle while suppressing the cost related to external sound processing. Can be provided to the passenger inside the vehicle. [0135] Further, in the present embodiment, by providing the front speakers 401 and 402 in the forward direction of travel than the area where the head of the vehicle occupant is expected to be located, the sound collected in front of the vehicle can be It can output from the front speakers 401 and 402 provided in front of. 04-05-2019 37 [0136] In addition, the arrangement and characteristics of the front microphones 201 and 202 can be the same as those of the first embodiment, and the same operations and effects can be obtained. [0137] Similarly, the arrangement and characteristics of the rear microphones 211 and 212 can be the same as in the first embodiment, and the same operations and effects can be obtained. [0138] Furthermore, the position of the virtual sound source can be made similar to that of the first embodiment, and the same operation and effect can be obtained. [0139] The embodiments described above are described to facilitate the understanding of the present invention, and are not described to limit the present invention. Therefore, each element disclosed in the above embodiment is intended to include all design changes and equivalents that fall within the technical scope of the present invention. [0140] That is, in this specification, the information providing apparatus A mounted on a vehicle is described as an example of one aspect of the sound information providing apparatus mounted on a vehicle according to the present invention, but the present invention is limited to this It is not a thing. [0141] Further, in the present specification, an information providing apparatus A including the sound output controller 100 having the CPU 1, the ROM 2, and the RAM 3 will be described as one aspect of the sound information providing apparatus according to the present invention. Absent. 04-05-2019 38 [0142] Further, in the present specification, a sound collecting apparatus comprising the front microphones 201 and 202 and the rear microphones 121 and 122 as one aspect of the sound information providing apparatus having the first sound input means and the second sound input means according to the present invention. Although the information provision apparatus A provided with 200 is demonstrated, this invention is not limited to this. [0143] Further, although an example in which one or two front microphones 201 and 202 as first sound input means are arranged has been described in this specification, the number is not limited. Similarly, although an example in which two rear microphones 211 and 122 as second sound input means are arranged has been described, the number is not limited. [0144] Moreover, in the present specification, as one aspect of the sound information providing apparatus having the first sound output signal generation means according to the present invention and the sound image generation means, the first acquisition function 101a, the second acquisition function 101b, and the first Although the information providing apparatus A including the sound output signal generation function 102, the sound image generation function 103, and the sound output controller 100 for realizing the sound output function 104 will be described as an example, the present invention is not limited thereto. Absent. [0145] Further, in this specification, an information providing apparatus A including an acoustic device 400 having front speakers 401 and 402 and rear speakers 411 and 412 will be described as one aspect of the sound output means according to the present invention. It is not limited to this. [0146] Further, in this specification, the information providing device A mounted on a vehicle is described as an example of the sound information providing device mounted on a moving body, but the moving body according to the present invention is limited to a vehicle Rather, it includes trains, planes, forklifts, play equipment and other powered vehicles. 04-05-2019 39 [0147] A: Information providing device 100: Sound output controller 1: CPU 2. ROM 3: RAM 200: Sound collecting device 201 to 202: Forward microphone 211 to 212: Rear microphone 400: Acoustic device 401 to 402: Forward speaker 411 to 412 Front speaker 300 ... Car sensor 04-05-2019 40
© Copyright 2021 DropDoc