JP2007281981

Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2007281981
An object of the present invention is to pick up narrations clearly by judging the presence or
absence of narration according to the distance between an imaging device and a photographer. A
distance measurement unit (200) measures a distance between a photographer. The narration
sound source supply unit 310 adjusts the level of the narration sound source by the
photographer according to the distance to the photographer. The shooting sound source supply
unit 320 adjusts the level of the shooting sound source of the subject according to the distance
between the user and the photographer. The sound source synthesis unit 330 synthesizes the
sound sources supplied from the narration sound source supply unit 310 and the imaging sound
source supply unit 320. The band control unit 340 boosts the voice band of the sound source
synthesized by the sound source synthesis unit 330 according to the distance to the
photographer. As a result, the level and frequency characteristics of the sound source are
adjusted according to the distance to the photographer, and the narration is collected clearly.
[Selected figure] Figure 2
Imaging device
[0001]
The present invention relates to an image pickup apparatus, and more particularly to an image
pickup apparatus which picks up an object and picks up a surrounding sound source, a
processing method thereof and a program causing a computer to execute the method.
[0002]
03-05-2019
1
An imaging device such as a video camera often incorporates a microphone in order to pick up a
sound source around the imaging device in accordance with imaging of a subject.
This microphone is mainly intended to pick up sound that matches the angle of view of the lens,
and has directivity suitable for picking up the sound of the subject.
[0003]
Here, when the photographer tries to add narration, the voice tends to be unclear because the
photographer is located behind the imaging device. For example, at an athletic meet, music is
often broadcasted, and the voices of supporters are also large. As described above, since the
directivity of the microphones is directed to the subject, even if the photographer himself
narrates from the back, they are obscured by those sounds.
[0004]
Therefore, in the conventional imaging device, the directivity of the microphone is manually
switched depending on the presence or absence of narration. As such a technique, for example, a
device has been proposed in which a push mechanism switch is provided and the photographer
switches the directivity of the microphone by pressing the switch in the narration mode (see, for
example, Patent Document 1). ). Unexamined-Japanese-Patent No. 2002-345074 (FIG. 1)
[0005]
However, manually switching the directivity of the microphone according to the presence or
absence of narration is a complicated operation for the photographer. In addition, providing a
new switch in the imaging device can be a factor that hinders downsizing of the imaging device.
[0006]
Therefore, an object of the present invention is to perform narration collection clearly by
determining the presence or absence of narration by the distance between the imaging device
and the photographer.
03-05-2019
2
[0007]
The present invention has been made to solve the above-mentioned problems, and a first aspect
of the present invention is an imaging apparatus for imaging a subject and picking up sound
sources in the vicinity, and a predetermined part of the imaging apparatus and the
predetermined part thereof An image pickup apparatus comprising: distance measuring means
for measuring a distance to an object existing in a specific direction of the image; and sound
source adjusting means for adjusting a level of a sound source from the specific direction
according to the distance It is.
This brings about the effect ¦ action of adjusting the level of the sound source from the specific
direction according to the distance with the object which exists in the specific direction of the
predetermined location of an imaging device. That is, it is possible to control to pick up the
narration by the photographer clearly according to the distance to the photographer.
[0008]
In the first aspect, the sound source adjustment means may increase the level of the sound
source from the specific direction when the distance is shorter than a predetermined length, and
when the distance is longer than the predetermined length, the specific The level of the sound
source from the direction may be increased. Furthermore, the sound source adjusting means may
increase the level of the sound source from the specific direction as the distance decreases, and
may increase the level of the sound source from the specific direction as the distance increases.
[0009]
In addition, the first aspect may further include band control means for controlling the level of
the predetermined band in accordance with the distance. Thereby, control can be performed so
as to have a frequency characteristic suitable for narration and sound collection. In this case, the
band control means may increase the level of the predetermined band when the distance is
shorter than the predetermined length, and may increase the level of the predetermined band
when the distance is longer than the predetermined length. . Furthermore, the band control
means may increase the level of the predetermined band as the distance decreases, and may
increase the level of the predetermined band as the distance increases.
03-05-2019
3
[0010]
Further, according to a second aspect of the present invention, there is provided an image pickup
apparatus for picking up an object, comprising: distance measuring means for measuring a
distance between a predetermined position of the image pickup apparatus and an object existing
in a specific direction of the predetermined position; According to another aspect of the present
invention, there is provided an image pickup apparatus comprising: sound pickup means for
picking up a sound source around the image pickup apparatus; and directivity adjustment means
for changing the directivity of the sound pickup means according to the distance. This brings
about the effect ¦ action of changing the directivity of sound collection according to the distance
between the object which exists in the specific direction of the predetermined location of an
imaging device.
[0011]
Further, according to a third aspect of the present invention, in an imaging apparatus for imaging
a subject, distance measuring means for measuring a distance between a predetermined location
of the imaging apparatus and an object present in a specific direction of the predetermined
location; A first microphone having directivity in the direction of the subject, a directional
microphone level adjusting means for adjusting and outputting the level of the first microphone
according to the distance, and a directivity having at least the specific direction The second
microphone level adjustment means for adjusting and outputting the level of the second
microphone according to the distance, the second microphone level adjustment means, and the
second microphone level adjustment means And an combining unit configured to combine the
output. Thus, in the combined arrangement of the first microphone and the second microphone,
the level of the surrounding sound source is adjusted according to the distance to the object
present in the specific direction of the predetermined position of the imaging device. Bring.
[0012]
Further, according to a fourth aspect of the present invention, there is provided an image pickup
apparatus for picking up an object, comprising: distance measuring means for measuring a
distance between a predetermined position of the image pickup apparatus and an object existing
in a specific direction of the predetermined position; A unidirectional directional microphone
03-05-2019
4
having directivity in the direction of an object, a bidirectional microphone having directivity in
both directions perpendicular to the direction of the object, the unidirectional directional
microphone, and the bidirectional microphone An adder-subtractor for adding / subtracting an
output, an adder-subtractor level adjusting means for adjusting and outputting the level of the
adder / subtractor according to the distance, and a bi-directional microphone for adjusting the
level of the bidirectional microphone according to the distance Directional microphone level
adjusting means; combining means for combining the outputs of the adder / subtractor level
adjusting means and the bi-directional microphone level adjusting means; An imaging apparatus,
characterized by Bei. Thus, in the combined arrangement of the unidirectional directional
microphone and the bidirectional microphone, the level of the surrounding sound source is
adjusted according to the distance to the object existing in the specific direction of the
predetermined position of the imaging device. Bring
[0013]
Further, according to a fifth aspect of the present invention, in an imaging apparatus for imaging
a subject, distance measuring means for measuring a distance between a predetermined location
of the imaging apparatus and an object present in a specific direction of the predetermined
location is opposed Of the four non-directional microphones, each of which has four nondirectional microphones having non-directivity arranged at each vertex of a quadrangle where
straight lines connecting the two vertexes are orthogonal to each other Addition means for
generating a signal, subtraction means for subtracting two mutually facing outputs of the four
nondirectional microphones to generate two bidirectional signals, adding the nondirectional
signal and the bidirectional signal An imaging apparatus comprising: an addition / combination
unit for combining and combining; and an addition / combination unit level adjustment means
for adjusting and outputting the level of the addition / combination unit according to the
distance. Thus, when four omnidirectional microphones are arranged at each vertex of the
square, the level of the surrounding sound source is adjusted according to the distance between
the object and the object located in the specific direction at the predetermined position of the
imaging device. Bring about the action.
[0014]
Further, according to a sixth aspect of the present invention, in an imaging device for imaging a
subject, distance measuring means for measuring a distance between a predetermined position of
the imaging device and an object existing in a specific direction of the predetermined position; A
first directional microphone having directivity in the direction of the subject, a second directional
03-05-2019
5
microphone having directivity in the direction opposite to the direction of the subject, and
bidirectional directions in the vertical direction with respect to the direction of the subject A
directional coupler, a summing combiner for summing and combining the outputs of the first and
second directional microphones and the dual directional microphone, and a level of the summing
combiner according to the distance And an adder-combiner level adjusting means for adjusting
and outputting the signal. Thus, in the combined arrangement of the first and second directional
microphones and the bi-directional microphone, the level of the ambient sound source is
determined according to the distance between the object and the object located in a specific
direction at a predetermined position of the imaging device. It brings about the effect of making
it adjust.
[0015]
Further, according to a seventh aspect of the present invention, in an imaging device for picking
up an object and picking up a surrounding sound source, a distance between a predetermined
portion of the imaging device and an object existing in a specific direction of the predetermined
portion An imaging method comprising: a procedure for measuring; and a procedure for
increasing the level of the sound source from the specific direction when the distance becomes
shorter than a predetermined length, or a program causing a computer to execute these
procedures It is. This brings about the effect ¦ action of adjusting the level of the sound source
from the specific direction according to the distance with the object which exists in the specific
direction of the predetermined location of an imaging device.
[0016]
According to the present invention, it is possible to determine the presence of narration based on
the distance between the imaging device and the photographer, and to achieve an excellent effect
that the narration can be collected clearly.
[0017]
Next, embodiments of the present invention will be described in detail with reference to the
drawings.
[0018]
FIG. 1 is a diagram showing a configuration example of an imaging device 100 according to an
03-05-2019
6
embodiment of the present invention.
The imaging apparatus 100 includes a finder 110, a light emitting element 121, a light receiving
element 122, a distance calculating circuit 123, a microphone 131, a sound source control circuit
132, a lens 140, an imaging element 150, and an image processing circuit 160. And a
multiplexing circuit 170.
[0019]
The finder 110 shows the composition of a captured image to the photographer, and has a form
realized by an observation hole penetrating the imaging device, a form using liquid crystal, or the
like.
Here, an electronic view finder (EVF: Electric View Finder) will be described as one example. The
electronic view finder electronically projects information acquired from an image pickup element
onto an eyepiece, and generally uses liquid crystal therein.
[0020]
The light emitting element 121 and the light receiving element 122 perform light emission and
light reception for measuring the distance to the photographer, respectively, and are provided
inside the viewfinder 110 or in the vicinity thereof. For example, an infrared light emitting diode
is used as the light emitting element 121. The light receiving element 122 is an element for
receiving light emitted from the light emitting element 121 and reflected to the photographer,
and for example, a silicon photo cell (SPC) or the like is used.
[0021]
The distance calculation circuit 123 is a circuit that calculates the distance based on the time
until the light received from the light emitting element 121 and reflected by the photographer is
received by the light receiving element 122. The distance calculation circuit 123 supplies the
distance to the sound source control circuit 132 via the signal line 209. In addition, although the
example of the distance measurement by an optical sensor was demonstrated here, you may
03-05-2019
7
utilize not only this but an ultrasonic sensor etc. FIG.
[0022]
The microphone 131 picks up a sound source around the imaging device 100. The microphone
131 is configured by combining a plurality of microphones as described later.
[0023]
The sound source control circuit 132 controls the sound source from the microphone 131 based
on the distance between the user and the photographer calculated by the distance calculation
circuit 123. The control content of the sound source control circuit 132 differs depending on the
type of microphone serving as the sound source. The sound source control circuit 132 may
combine sound sources of a plurality of microphones of the microphone 131 to generate a sound
source having a desired directivity. The sound source control circuit 132 supplies an audio signal
to the multiplexing circuit 170 through a signal line 349.
[0024]
The lens 140 is an optical element for acquiring an image of a subject. The imaging element 150
is a photoelectric conversion element that converts an image of a subject acquired through the
lens 140 into an electrical signal, and is realized by, for example, a charge coupled device (CCD).
[0025]
The image processing circuit 160 converts an image signal supplied from the imaging device
150 from an analog signal to a digital signal, and performs image processing such as white
balance. The multiplexing circuit 170 multiplexes the image signal supplied from the image
processing circuit 160 and the audio signal supplied from the sound source control circuit 132
to generate an audio attached moving image signal.
[0026]
03-05-2019
8
FIG. 2 is a diagram showing a configuration example of the sound source supply unit 300 of the
imaging device 100 according to the embodiment of the present invention. The sound source
supply unit 300 controls the sound source according to the distance supplied from the distance
measurement unit 200, and supplies an audio signal to the multiplexing circuit 170. The sound
source supply unit 300 corresponds to the microphone 131 and the sound source control circuit
132 of FIG. 1, receives a distance from the distance measurement unit 200 through the signal
line 209, and multiplexes audio signals through the signal line 349. The circuit 170 is supplied.
[0027]
The distance measuring unit 200 measures the distance to the photographer, and corresponds to
the light emitting element 121, the light receiving element 122, and the distance calculating
circuit 123 in FIG. The distance measured by the distance measuring unit 200 is supplied to each
part of the sound source supply unit 300 via the signal line 209.
[0028]
The sound source supply unit 300 includes a narration sound source supply unit 310, a shooting
sound source supply unit 320, a sound source synthesis unit 330, and a band control unit 340.
[0029]
The narration sound source supply unit 310 supplies a narration sound source by the
photographer via the signal line 319.
The imaging sound source supply unit 320 supplies the sound source of the subject through the
signal line 321. The narration sound source supply unit 310 and the photographing sound
source supply unit 320 adjust the level of the sound source based on the distance supplied from
the distance measurement unit 200.
[0030]
03-05-2019
9
As the adjustment contents by the narration sound source supply unit 310 and the
photographing sound source supply unit 320, for example, if the distance between the user and
the photographer is shorter than a predetermined distance, the sound source level from the
narration sound source supply unit 310 is large ( It is possible to adjust so as to be high) and to
adjust the level of the sound source from the shooting sound source supply unit 320 to be low
(low). On the contrary, if the distance to the photographer is longer than a predetermined
distance, the sound source level from the narration sound source supply unit 310 is adjusted to
be large, and the shooting sound source supply unit 320 It is possible to adjust so that the level
of the sound source of is reduced. Which method to use depends on the preference of the
photographer. That is, when the face is brought close to the image pickup apparatus, the former
is adopted if it is desired to add narration, and when the face is moved away from the image
pickup apparatus, the latter is adopted.
[0031]
Also, it may be turned on or off with reference to a predetermined threshold, but not limited to
this, for example, as the distance to the photographer is shorter, the level of the sound source
from the narration sound source supply unit 310 It is possible to adjust so as to gradually
increase and to adjust so that the level of the sound source from the shooting sound source
supply unit 320 gradually decreases. Also, conversely, the adjustment is made so that the level of
the sound source from the narration sound source supply unit 310 increases as the distance
between the photographer and the predetermined distance increases, and the image from the
shooting sound source supply unit 320 It is possible to adjust so that the level of a sound source
becomes small.
[0032]
The sound source synthesis unit 330 synthesizes the sound sources supplied from the narration
sound source supply unit 310 and the imaging sound source supply unit 320. As the
combination in the sound source combination unit 330, simple addition or addition averaging
can be considered. The sound source synthesized by the sound source synthesis unit 330 is
supplied to the band control unit 340 via the signal line 339.
[0033]
03-05-2019
10
The band control unit 340 controls the band of the sound source supplied from the sound source
combining unit 330 based on the distance supplied from the distance measurement unit 200. As
the control by the band control unit 340, for example, it is conceivable to adjust so that the level
of the sound source in the voice band becomes large if the distance between the user and the
photographer is shorter than a predetermined distance. Also, conversely, if the distance to the
photographer is longer than a predetermined distance, it may be considered to adjust the level of
the sound source in the voice band to be large. The band control unit 340 can be realized by, for
example, a band pass filter. The sound source whose band has been manipulated by the band
control unit 340 is supplied to the multiplexing circuit 170 through the signal line 349.
[0034]
FIG. 3 is a diagram showing a first arrangement example of the microphones of the imaging
device 100 according to the embodiment of the present invention. In this first arrangement
example, two microphones, a nondirectional microphone 381 and a unidirectional microphone
382, are arranged.
[0035]
The nondirectional microphone 381 is a microphone having no directivity. The unidirectional
microphone 382 is a microphone having directivity in the imaging direction, and is disposed in
the imaging direction relative to the nondirectional microphone 381. The distance between the
nondirectional microphone 381 and the unidirectional microphone 382 is, for example, about 10
to 15 millimeters.
[0036]
FIG. 4 is a diagram showing an example of the directivity characteristic of the microphone in the
first arrangement example according to the embodiment of the present invention. The directional
characteristic is a polar coordinate display of sensitivity levels from the entire circumferential
direction of each microphone, and the imaging direction of the imaging device is 0 °. Also, the
radial sensitivity level of this directional characteristic is relative, and the center shows zero
sensitivity.
03-05-2019
11
[0037]
FIG. 4A shows an example of the directivity characteristic of the nondirectional microphone 381
and has the same level of sensitivity characteristic in all directions. FIG. 4B is an example of the
directivity characteristic of the unidirectional microphone 382, and has directivity in the imaging
direction.
[0038]
FIG. 5 is a view showing a configuration example of the narration sound source supply unit 310
and the imaging sound source supply unit 320 using the microphones in the first arrangement
example according to the embodiment of the present invention.
[0039]
In this example, the narration sound source supply unit 310 includes the nondirectional
microphone 381 and the narration sound source adjustment unit 311, and the imaging sound
source supply unit 320 includes the unidirectional microphone 382 and the imaging sound
source adjustment unit 321.
[0040]
The nondirectional microphone 381 is a microphone having the directivity characteristic of FIG.
4A and supplies a sound source through a signal line 318.
The unidirectional microphone 382 is a microphone having the directional characteristic of FIG.
4B and supplies a sound source through a signal line 328.
[0041]
The narration sound source adjustment unit 311 and the photographing sound source
adjustment unit 321 adjust the level of the sound source of the nondirectional microphone 381
and the unidirectional microphone 382 based on the distance supplied from the distance
measurement unit 200.
03-05-2019
12
The narration sound source adjusting unit 311 and the photographing sound source adjusting
unit 321 supply a sound source to the sound source combining unit 330 via the signal lines 319
and 329, respectively.
[0042]
FIG. 6 is a diagram showing an example of level control of the microphone in the embodiment of
the present invention. FIG. 6A shows an example in which the level of the sound source is on / off
controlled depending on whether the distance to the photographer is shorter than a
predetermined length. That is, if the distance to the photographer is shorter than the switching
point, the level of the narration sound source 601 is turned on, and the level of the imaging
sound source 602 is turned off. Thereby, when the photographer brings the face close to the
imaging apparatus 100, the nondirectional microphone 381 becomes effective as a sound source
and the unidirectional microphone 382 becomes invalid as a sound source. With the directional
characteristics as shown in FIG. 4A, narration by the photographer is clearly picked up.
[0043]
On the other hand, when the distance to the photographer is longer than the switching point, the
level of the narration sound source 601 is turned off, and the level of the imaging sound source
602 is turned on. As a result, when the photographer moves the face away from the imaging
apparatus 100, the nondirectional microphone 381 becomes invalid as a sound source and the
unidirectional microphone 382 becomes effective as a sound source. With the directional
characteristics as shown in FIG. 4B, the sound source of the subject is clearly picked up.
[0044]
FIG. 6 (b) is an example in which the level of the sound source is variably controlled in
accordance with the distance to the photographer. FIG. 6A shows an example in which the on /
off control of the sound source is performed based on the switching point, but in the example of
FIG. 6B, the sound source changes logarithmically according to the distance to the photographer
Let As a result, as the photographer brings the face closer to the imaging apparatus 100, the
level of the sound source of the nondirectional microphone 381 increases and the level of the
sound source of the unidirectional microphone 382 decreases. As a result of the composition by
03-05-2019
13
the section 330, the directivity characteristic is closer to that in FIG. 4A than in FIG. 4B, and the
narration by the photographer is clearly picked up.
[0045]
On the other hand, as the photographer moves the face away from the imaging apparatus 100,
the sound source level of the nondirectional microphone 381 decreases and the sound source
level of the unidirectional microphone 382 increases. As a result of the synthesis by 330, the
directivity characteristic is closer to that in FIG. 4B than in FIG. 4A, and the sound source of the
subject is clearly picked up.
[0046]
Although FIG. 6 illustrates an example in which the level of the narration sound source 601 is
increased when the distance to the photographer is short, as described above, this
correspondence relationship may be reversed.
In addition, although the narration source supply unit 310 has been described here as an
example including the omnidirectional microphone 381, assuming that the photographer is
positioned behind the imaging apparatus 100, unidirectivity with directivity in the rear is
provided. A microphone may be provided.
[0047]
FIG. 7 is a diagram showing an example of band control of the microphone in the embodiment of
the present invention. This band control is performed by the band control unit 340.
[0048]
FIG. 7A shows an example of control of the sound source level for emphasizing the voice band. In
this example, the sound source of the signal line 339 is boosted to a level 604, assuming that
narration is performed when the distance to the photographer is shorter than the switching
point. That is, the sound source of about 400 Hz to 4 KHz corresponding to the voice band is
controlled to be larger than the normal level 603. This makes it possible to pick up the narration
03-05-2019
14
by the photographer more clearly.
[0049]
FIG. 7B is a control example in which the boost amount of the voice band is varied according to
the distance to the photographer. In the example of FIG. 7A, the on / off control of the boost of
the sound source is performed based on the switching point. However, in the example of FIG. 7B,
the boost amount according to the distance to the photographer Changes logarithmically. As a
result, as the photographer brings the face closer to the imaging apparatus 100, narration by the
photographer is more clearly picked up.
[0050]
Although FIG. 7 illustrates an example in which the level of the voice band is increased when the
distance to the photographer is short, as described above, this correspondence may be reversed.
[0051]
FIG. 8 is a diagram showing a second arrangement example of the microphones of the imaging
device 100 according to the embodiment of the present invention.
In this second arrangement example, two microphones of omnidirectional microphones 383 and
384 are arranged.
[0052]
Nondirectional microphones 383 and 384 are microphones having no directivity. The distance
between the nondirectional microphones 383 and 384 is, for example, about 10 to 15
millimeters.
[0053]
FIG. 9 is a view showing a configuration example of the narration sound source supply unit 310
and the imaging sound source supply unit 320 using the microphones in the second
03-05-2019
15
arrangement example according to the embodiment of the present invention.
[0054]
The sound source by the nondirectional microphone 383 is similar to the nondirectional
microphone 381 of FIG. 5 and can be used as a narration sound source by the signal line 318 as
it is.
[0055]
On the other hand, the sound source by the nondirectional microphone 384 is converted into a
sound source having directivity and is used as a photographing sound source by the signal line
328.
The sound source generated by the nondirectional microphone 383 is delayed by the delay unit
322, and a difference signal between the delayed sound source and the sound source generated
by the nondirectional microphone 384 is generated by the subtraction unit 323.
The generated differential signal is adjusted in frequency characteristic by the equalizer 324 and
supplied to the signal line 328. That is, the nondirectional microphone 384, the delay unit 322,
the subtractor 323, and the equalizer 324 constitute a unidirectional microphone 389. Here, the
delay amount by the delay unit 322 is set as a sound velocity signal according to the distance
between the nondirectional microphones 383 and 384.
[0056]
Thereby, the omnidirectional microphones 383 and 384 according to the second arrangement
example of FIG. 8 can generate sound sources equivalent to the omnidirectional microphone 381
and the unidirectional microphone 382 of the first arrangement example. The same directional
characteristics as in the first arrangement example can be realized.
[0057]
FIG. 10 is a diagram showing a third arrangement example of the microphones of the imaging
device 100 according to the embodiment of the present invention.
03-05-2019
16
In this third arrangement example, two microphones, a bi-directional microphone 385 and a unidirectional microphone 386, are arranged and generally referred to as a mid-side microphone.
[0058]
The bi-directional microphone 385 is a microphone having directivity in both right and left
directions. The unidirectional microphone 386 is a microphone having directivity in the imaging
direction. The distance between the bi-directional microphone 385 and the unidirectional
microphone 386 is, for example, about 10 to 15 millimeters.
[0059]
FIG. 11 is a diagram showing an example of generation of the directivity characteristic of the
microphone in the third arrangement example according to the embodiment of the present
invention. As shown in FIG. 11A, the bidirectional microphone 385 has directivity 501 in the
right direction and directivity 502 in the left direction. Also, the unidirectional microphone 386
has directivity 503 in the shooting direction.
[0060]
Therefore, if the sound source of the bi-directional microphone 385 and the sound source of the
uni-directional microphone 386 are subjected to addition averaging processing at the same level,
the reverse phase side is canceled, and the directivity 504 of the right channel in FIG. Also, if the
sound source of the bi-directional microphone 385 and the sound source of the uni-directional
microphone 386 are subjected to subtraction averaging processing at the same level, the reverse
phase side is canceled and directivity 505 of the left channel in FIG.
[0061]
In addition, by changing the synthesis ratio of the sound source of the bidirectional microphone
385 and the sound source of the unidirectional microphone 386 in the averaging process and
03-05-2019
17
the subtraction averaging process, the angle formed by the main axes of the right channel and
the left channel is continuously changed. It can be done. That is, when the level of the sound
source of the unidirectional microphone 386 is larger than the level of the sound source of the
bidirectional microphone 385, the main axis is closed in the shooting direction, and conversely,
the level of the sound source of the bidirectional microphone 385 is unidirectional. If the level is
higher than the sound source level of the microphone 386, the main axis opens.
[0062]
FIG. 12 is a diagram showing an example of synthesizing the sound sources of the microphones
in the third arrangement example according to the embodiment of the present invention.
[0063]
The addition unit 325 adds and averages the sound source of the bidirectional microphone 385
and the sound source of the unidirectional microphone 386, and supplies the directivity 504 of
the right channel to the signal line 328-R.
The subtraction unit 326 performs subtraction averaging processing on the sound source of the
bidirectional microphone 385 and the sound source of the unidirectional microphone 386, and
supplies the directivity 505 of the left channel to the signal line 328-L.
[0064]
Here, although the adding unit 325 and the subtracting unit 326 add and average or subtract the
sound source of the bi-directional microphone 385 and the sound source of the uni-directional
microphone 386 at the same level, as described above, By changing the synthesis ratio of each
sound source, it is possible to change the angle formed by the main axes of the right channel and
the left channel.
[0065]
The sound sources generated in this manner provide stereo sound sources via signal lines 328-R
and L.
03-05-2019
18
By using this stereo sound source as the photographing sound source of FIG. 5, level control
according to the first arrangement example can be performed.
[0066]
FIG. 13 is a diagram showing an example of the directivity characteristic of the microphone in
the third arrangement example according to the embodiment of the present invention.
[0067]
FIG. 13A is an example of the directivity characteristic of the bidirectional microphone 385,
which has directivity in the left-right direction.
FIG. 13B is an example of the directivity characteristic of the stereo sound source generated by
the circuit shown in FIG. 12, and has directivity at predetermined angles of the right channel and
the left channel.
[0068]
Therefore, for example, if the distance between the user and the photographer is shorter than the
switching point, the sound source combining unit 330 synthesizes the sound source of the bidirectional microphone 385 so that the sound source is adopted, such as the directivity
characteristic of FIG. The narration by the photographer is clearly picked up by the directional
characteristic.
[0069]
On the other hand, if the distance between the user and the photographer is longer than the
switching point, the sound source combining unit 330 synthesizes the stereo sound source
generated by the circuit shown in FIG. 12 so that the stereo sound source is adopted. The sound
source of the subject is clearly picked up by stereo with the directivity characteristics as shown
in FIG.
[0070]
Here, although the example using a stereo sound source as a photography sound source was
explained, this photography sound source may use surround sound sources, such as 5.1 channel.
03-05-2019
19
[0071]
FIG. 14 is a diagram showing the arrangement and directivity of a 5.1 channel surround sound
source.
The 5.1 channel of this surround sound source has a directivity pattern 591 in the shooting
direction, a directivity pattern 592 in the front left direction, a directivity pattern 593 in the front
right direction, a directivity pattern 594 in the rear left direction and a rear right direction 5
channels of the directivity pattern 595 and 0.1 channel of the low frequency band of the
directivity pattern 596 in the omnidirectional direction.
In addition, 0.1 channel of a low frequency band is for obtaining a feeling of weight of a bass of
about 100 Hz or less.
[0072]
A surround sound field can be obtained by collecting and recording such a surround sound
source and reproducing it with an existing surround compatible system.
Therefore, when narration is not performed, sound is collected by increasing the sound collection
level equally or in the shooting direction from each direction, and when narration is performed,
the directivity pattern 594 in the rear left direction and the directivity pattern 595 in the rear
right direction Make the sound collection level higher than other channels. As a result, narration
by the photographer is clearly picked up. In addition to the sound collection level, the directivity
may be changed so as to direct the sound collection direction to the photographer.
[0073]
FIG. 15 is a diagram showing a fourth arrangement example of the microphones of the imaging
device 100 according to the embodiment of the present invention. In this fourth arrangement
example, four microphones of nondirectional microphones 391 to 394 are arranged. The
distance between the nondirectional microphones 391 to 394 is, for example, about 10 to 15
03-05-2019
20
millimeters. Further, the line connecting the nondirectional microphones 391 and 393 and the
straight line connecting the nondirectional microphones 394 and 392 may be orthogonal to each
other, and the mutual positional relationship is not limited to this.
[0074]
None of these nondirectional microphones 391 to 394 have directivity in a specific direction, but
by combining and combining them, it is possible to generate the surround sound source shown in
FIG.
[0075]
FIG. 16 is a diagram showing an example of generation of the directivity characteristic of the
microphone in the fourth arrangement example according to the embodiment of the present
invention.
[0076]
When the sound source of the nondirectional microphone 393 is subtracted from the sound
source of the nondirectional microphone 391 to adjust the frequency characteristics, a
bidirectional signal 506 as shown in FIG. 16A is generated.
Further, when the frequency characteristic is adjusted by subtracting the sound source of the
nondirectional microphone 392 from the sound source of the nondirectional microphone 394, a
bidirectional signal 507 as shown in FIG. 16 (b) is generated.
Furthermore, a nondirectional signal is generated by combining and adding arbitrary sound
sources of the nondirectional microphones 391 to 394.
[0077]
FIG. 17 is a diagram showing an example of synthesizing sound sources of microphones in the
fourth arrangement example according to the embodiment of the present invention.
[0078]
03-05-2019
21
The subtraction unit 421 subtracts the sound source of the nondirectional microphone 393 from
the sound source of the nondirectional microphone 391 to generate the vertical bi-directional
signal 506 in FIG.
The subtractor 422 subtracts the sound source of the nondirectional microphone 392 from the
sound source of the nondirectional microphone 394 to generate the bidirectional signal 507 in
the lateral direction of FIG. The addition unit 423 generates a nondirectional signal by adding all
the sound sources of the nondirectional microphones 391 to 394.
[0079]
The level variable unit 424 multiplies the vertical bi-directional signal 506 in FIG. 16A by Ks.
Also, the level variable unit 425 multiplies the horizontal bi-directional signal 507 in FIG. 16B by
Kc. Here, Ks and Kc are direction coefficients determined by the pointing direction. The direction
coefficient will be described later.
[0080]
The addition and synthesis unit 426 combines three signals of the nondirectional signal supplied
from the addition unit 423, the signal supplied from the level variable unit 424, and the signal
supplied from the level variable unit 425 by addition averaging processing. It is a thing. The
sound source synthesized by the addition synthesis unit 426 is a sound source having any
directivity. Therefore, the sound source supplied from the adding and combining unit 426
through the signal line 428 can be used as a sound source of any channel of the surround sound
source.
[0081]
Here, the vertical bi-directional signal 506 is represented by a sine function sin (t) at time t, and
the horizontal bi-directional signal 507 is represented by a cosine function cos (t) at time t. The
sound source X to be generated can be represented by the following equation. X=(1+Ks・
sin(t)+Kc・cos(t))/ 2
03-05-2019
22
[0082]
FIG. 18 is a diagram showing the direction factor in the embodiment of the present invention.
[0083]
The direction coefficient Ks 611 draws a sine curve according to the direction angle of
directivity, and the direction coefficient Kc 612 draws a cosine curve according to the direction
angle of directivity.
That is, the direction coefficients Ks 611 and Kc 612 are real numbers according to the
directional angle of directivity in the range of −1 to 1.
[0084]
For example, if the directional angle of directivity is set to 45 °, then both Ks and Kc will be
reciprocals of the square root of 2 (≒ 0.7). Therefore, bi-directional signals 506 and 507 are
subjected to addition averaging processing at the same level in addition synthesis section 426,
and non-directional signals are addition averaging processing. FIG. 19 shows this situation.
[0085]
That is, the signals of directivity 511 in FIG. 19A are obtained by averaging the bidirectional
signals 506 and 507 at the same level. Then, this and the nondirectional 512 signal are subjected
to addition averaging processing, whereby a directional 513 signal having a 45 ° directional
angle in FIG. 19B is obtained.
[0086]
Thus, by setting the direction coefficients Ks and Kc, it is possible to generate a signal having
directivity at any direction angle. Also, a surround sound source can be generated by using the
signal generated in this manner. Then, by using these sound sources as the shooting sound
03-05-2019
23
source and the narration sound source in FIG. 2, the narration by the photographer can be more
clearly collected under the environment of the surround sound source.
[0087]
FIG. 20 is a diagram showing a fifth arrangement example of the microphones of the imaging
device 100 according to the embodiment of the present invention. In this fifth arrangement
example, three microphones of unidirectional microphones 395 and 396 and bi-directional
microphone 397 are arranged.
[0088]
The unidirectional microphone 395 is a microphone having directivity in the imaging direction.
The unidirectional microphone 396 is a microphone having directivity at the back opposite to the
imaging direction. The bi-directional microphone 397 is a microphone having directivity in both
the right and left directions. The distance between these microphones is, for example, about 10
to 15 millimeters.
[0089]
FIG. 21 is a diagram showing an example of synthesizing sound sources of microphones in the
fifth arrangement example according to the embodiment of the present invention.
[0090]
The level variable unit 431 multiplies the sound source of the unidirectional microphone 395 by
(1 + Kc).
The level variable unit 432 is for multiplying the sound source of the unidirectional microphone
396 by (1-Kc). Further, the level variable unit 433 multiplies the sound source of the
bidirectional microphone 397 by Ks. The direction coefficients Kc and Ks are the same as those
described with reference to FIG.
03-05-2019
24
[0091]
The adding and combining unit 434 combines the three signals supplied from the level change
units 431 to 433 by the addition and averaging process. The sound source synthesized by the
addition synthesis unit 434 is a sound source having any directivity. Therefore, the sound source
supplied from the adding and combining unit 434 through the signal line 438 can be used as a
sound source of any channel of the surround sound source.
[0092]
Here, if the bi-directional signal in the longitudinal direction is represented as a cosine function
cos (t) at time t, the sound source of the unidirectional microphone 395 is (1 + cos (t)). Also, the
sound source of the unidirectional microphone 396 is (1−cos (t)). Then, when the lateral bidirectional signal 507 is represented as a sine function sin (t) at time t, the sound source Y
synthesized by the addition synthesis unit 434 can be expressed by the following equation.
Y=((1+Kc)・(1+cos(t))/2 +(1−Kc)・(1−cos(t))/2
+Ks・sin(t))/ 2
[0093]
FIG. 22 is a diagram showing an example of generation of the directivity characteristic of the
microphone in the fifth arrangement example according to the embodiment of the present
invention.
[0094]
22A shows the directivity 521 of the sound source of the unidirectional microphone 395, the
directivity 522 of the sound source of the unidirectional microphone 396, and the directivity 523
of the sound source of the bidirectional microphone 397. ing.
[0095]
In the equation of the sound source Y synthesized by the addition synthesis unit 434, when the
direction angle is set to 0 °, Ks = 0 and Kc = 1, so the sound source of the unidirectional
microphone 395 is connected to the signal line 438. It is output.
03-05-2019
25
When the directional angle of directivity is set to 45 °, Ks and Kc both become reciprocals of the
square root of 2 (≒ 0.7), and therefore, the addition / synthesis unit 434 performs addition
averaging processing, as shown in FIG. As in the directivity 524 of b), a unidirectional signal is
generated in the 45 ° direction.
[0096]
In addition, when the directional angle of directivity is set to 90 °, Ks = 1 and Kc = 0, so that the
level variable units 431 and 432 generate nondirectional signals, and the addition synthesis unit
434 generates bidirectional signals. By averaging with the bidirectional signal of the microphone
397, a unidirectional signal in the 90 ° direction is generated.
[0097]
Similarly, Kc is synthesized with a negative coefficient in the directional angle range of 90 ° to
180 °, and Ks and kc are synthesized with the negative coefficient in the directional angle range
of 180 ° to 270 °, Ks is synthesized with a negative coefficient when the direction angle of sex
is in the range of 270 ° to 0 °.
For example, if the directional angle of directivity is set to 315 °, then Kc will be the reciprocal
of the square root of 2 (≒ 0.7) and Ks will be the negative of the reciprocal of the square root of
2 (≒ −0.7) .
As a result, addition averaging processing is performed in the addition synthesis unit 434, and a
single directivity signal is generated in the direction of 315 ° as the directivity 525 of FIG. 22
(b).
[0098]
Thus, by setting the direction coefficients Ks and Kc, it is possible to generate a signal having
directivity at any direction angle. Also, a surround sound source can be generated by using the
signal generated in this manner. Then, by using these sound sources as the shooting sound
source and the narration sound source in FIG. 2, the narration by the photographer can be more
clearly collected under the environment of the surround sound source.
03-05-2019
26
[0099]
FIG. 23 is a diagram showing an example of a processing procedure of the imaging device 100
according to the embodiment of the present invention.
[0100]
If the power of the imaging apparatus 100 is in the on state (step S901), the distance measuring
unit 200 measures the distance to the photographer (step S902).
Then, according to the measured distance, the shooting sound source supply unit 320 and the
narration sound source supply unit 310 respectively adjust the shooting sound source and the
narration sound source (steps S903 and S904).
[0101]
The contents of sound source adjustment in steps S 903 and S 904 are as described with
reference to FIG. 6. For example, with a predetermined distance (switching point) as a reference,
the narration sound source is turned on if it is closer to the switching point. The sound source
can be turned off. Further, instead of the on / off control, the narration sound source level may
be adjusted to be gradually increased as the distance to the photographer is shortened, and the
photography sound source level may be adjusted to be gradually reduced.
[0102]
The shooting sound source and the narration sound source adjusted in these steps S903 and
S904 are synthesized by the sound source synthesizing unit 330 (step S905). Although the
synthesized sound source may be supplied as it is to the multiplexing circuit 170, the band
control unit 340 may perform band control (step S906) to boost the voice band so that the
narration may be recorded more clearly. desirable.
[0103]
03-05-2019
27
As described above, according to the embodiment of the present invention, according to the
distance between the user and the photographer measured by the distance measuring unit 200,
the photographing sound source supplying unit 320 and the narration sound source supplying
unit 310 respectively By adjusting the narration sound source, the narration can be collected
clearly.
[0104]
In the embodiment of the present invention, although the example applied to the microphone of
the imaging device 100 has been described, the present invention is not limited to this, and can
be applied to improvement of sound collection characteristics in a megaphone, for example. .
[0105]
In addition, the embodiment of the present invention shows an example for embodying the
present invention, and as shown below, it has correspondences with the invention specific
matters in the claims, respectively, but is limited thereto Various modifications can be made
without departing from the scope of the present invention.
[0106]
That is, in claim 1, the distance measuring means corresponds to the distance measuring unit
200, for example.
Further, the sound source adjusting means corresponds to, for example, the narration sound
source adjusting unit 311 or the photographing sound source adjusting unit 321.
[0107]
Further, in claim 6, the band control means corresponds to, for example, the band control unit
340.
[0108]
Further, in claim 12, the distance measuring means corresponds to the distance measuring unit
200, for example.
03-05-2019
28
Also, the first microphone corresponds to, for example, a unidirectional microphone 382 or 389.
The first microphone level adjustment unit corresponds to, for example, the imaging sound
source adjustment unit 321.
The second microphone corresponds to, for example, the nondirectional microphone 383. The
second microphone level adjustment means corresponds to, for example, the narration sound
source adjustment unit 311. Also, the combining means corresponds to, for example, the sound
source combining unit 330.
[0109]
In claim 13, the distance measuring means corresponds to, for example, the distance measuring
unit 200. Also, a unidirectional microphone corresponds to, for example, a unidirectional
microphone 386. Also, the bi-directional microphone corresponds to, for example, the bidirectional microphone 385. Further, the adder / subtractor corresponds to, for example, the
adder 325 and the subtractor 326. The adder / subtractor level adjustment means corresponds
to, for example, the photographing sound source adjustment unit 321. Further, the bidirectional
microphone level adjustment means corresponds to, for example, the narration sound source
adjustment unit 311. Also, the combining means corresponds to, for example, the sound source
combining unit 330.
[0110]
In claim 14, the distance measuring means corresponds to, for example, the distance measuring
unit 200. Also, nondirectional microphones correspond to, for example, nondirectional
microphones 391 to 394. Also, the addition means corresponds to, for example, the addition unit
423. Also, subtraction means correspond to the subtraction units 421 and 422, for example.
Also, the addition and combining unit corresponds to, for example, the level change units 424
and 425 and the addition and combining unit 426. Further, the addition synthesizer level
adjustment means corresponds to, for example, the narration sound source adjustment unit 311
or the photographing sound source adjustment unit 321.
03-05-2019
29
[0111]
Further, in claim 15, the distance measuring means corresponds to the distance measuring unit
200, for example. Also, the first directional microphone corresponds to, for example, a
unidirectional microphone 395. Also, the second directional microphone corresponds to, for
example, a unidirectional microphone 396. Also, the bi-directional microphone corresponds to,
for example, the bi-directional microphone 397. Also, the addition and combining unit
corresponds to, for example, the level change units 431 to 433 and the addition and combining
unit 434. Further, the addition synthesizer level adjustment means corresponds to, for example,
the narration sound source adjustment unit 311 or the photographing sound source adjustment
unit 321.
[0112]
In the claims 16 and 17, the procedure for measuring the distance between a predetermined
position of the imaging device and an object present in a specific direction of the predetermined
position corresponds to, for example, step S902. A procedure for increasing the level of the
sound source from the specific direction when the distance is shorter than the predetermined
length corresponds to, for example, step S903 or S904.
[0113]
The processing procedure described in the embodiment of the present invention may be
regarded as a method having a series of these procedures, and a program for causing a computer
to execute the series of procedures or a recording medium storing the program. You may think of
it as
[0114]
It is a figure showing an example of 1 composition of imaging device 100 in an embodiment of
the invention.
It is a figure which shows one structural example of the sound source supply part 300 of the
imaging device 100 in embodiment of this invention. It is a figure which shows the 1st example
03-05-2019
30
of arrangement ¦ positioning of the microphone of the imaging device 100 in embodiment of this
invention. It is a figure which shows an example of the directional characteristic of the
microphone in the 1st example of arrangement ¦ positioning by embodiment of this invention. It
is a figure which shows the structural example of the narration sound source supply part 310
using the microphone in the 1st example of arrangement ¦ positioning by embodiment of this
invention, and the imaging ¦ photography sound source supply part 320. It is a figure which
shows the example of the level control of the microphone in embodiment of this invention. It is a
figure which shows the example of band control of the microphone in embodiment of this
invention. This band control is performed by the band control unit 340. It is a figure which
shows the 2nd example of arrangement ¦ positioning of the microphone of the imaging device
100 in embodiment of this invention. It is a figure which shows the structural example of the
narration sound source supply part 310 and the imaging ¦ photography sound source supply
part 320 using the microphone in the 2nd example of arrangement ¦ positioning by embodiment
of this invention. It is a figure which shows the 3rd example of arrangement ¦ positioning of the
microphone of the imaging device 100 in embodiment of this invention. It is a figure which
shows the example of production ¦ generation of the directional characteristic of the microphone
in the 3rd example of arrangement ¦ positioning by embodiment of this invention. It is a figure
which shows the synthesis example of the sound source of the microphone in the 3rd example of
arrangement ¦ positioning by embodiment of this invention. It is a figure which shows an
example of the directivity characteristic of the microphone in the 3rd example of arrangement ¦
positioning by embodiment of this invention. It is a figure which shows arrangement ¦
positioning and directivity characteristic of a 5.1 channel surround sound source. It is a figure
which shows the 4th example of arrangement ¦ positioning of the microphone of the imaging
device 100 in embodiment of this invention. It is a figure which shows the example of production
¦ generation of the directional characteristic of the microphone in the 4th example of
arrangement ¦ positioning by embodiment of this invention. It is a figure which shows the
synthesis example of the sound source of the microphone in the 4th example of arrangement ¦
positioning by embodiment of this invention. It is a figure which shows the direction coefficient
in embodiment of this invention. It is a figure which shows an example of the directivity
characteristic of the microphone in the 4th example of arrangement ¦ positioning by embodiment
of this invention. It is a figure which shows the 5th example of arrangement ¦ positioning of the
microphone of the imaging device 100 in embodiment of this invention. It is a figure which
shows the synthesis example of the sound source of the microphone in the 5th example of
arrangement ¦ positioning by embodiment of this invention. It is a figure which shows the
example of production ¦ generation of the directional characteristic of the microphone in the 5th
example of arrangement ¦ positioning by embodiment of this invention. It is a figure which shows
an example of the process sequence of the imaging device 100 in embodiment of this invention.
Explanation of sign
03-05-2019
31
[0115]
Reference Signs List 100 imaging apparatus 110 finder 121 light emitting element 122 light
receiving element 123 distance calculation circuit 131 microphone 132 sound source control
circuit 140 lens 150 image pickup element 160 image processing circuit 170 multiplexing
circuit 200 distance measuring unit 300 sound source supply unit 310 narration sound source
supply unit 311 narration Sound source adjustment unit 320 Shooting sound source supply unit
321 Shooting sound source adjustment unit 322 Delay unit 323 Subtraction unit 324 Equalizer
325 Addition unit 326 Subtraction unit 330 Sound source combination unit 340 Band control
unit 381 Nondirectional microphone 382 Unidirectional microphone 383, 384 None Directional
microphones 385 Bidirectional microphones 386, 389 Unidirectional microphones 391-394
Omnidirectional microphones 395, 396 Unidirectional microphones 397 Bidirectional
microphones Tropism microphone 421 and 422 subtraction unit 423 adding unit
424,425,431〜433 level variable unit 426,434 addition synthesis section
03-05-2019
32