JP2017038293

Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2017038293
Abstract: To provide a sound collection control device, a sound collection system, a sound
collection control method and a computer program capable of improving the accuracy of
collecting a desired sound. According to one embodiment, a sound collection control device has a
control unit and a collection unit. The control unit controls collection timing of sound data
detected by a plurality of sound sensors installed in the house. The collection unit collects sound
data from the plurality of sound sensors in a period in which the noise generating device
generates no noise according to the control of the control unit. [Selected figure] Figure 3
Sound collection control device, sound collection system, sound collection control method and
computer program
[0001]
Embodiments of the present invention relate to a sound collection control device, a sound
collection system, a sound collection control method, and a computer program.
[0002]
Conventionally, cameras are often used to observe residents in a house.
However, constant observation with a camera can give a feeling of pressure that residents are
constantly monitored. Furthermore, it also becomes a problem on personal information
protection. Therefore, it is conceivable to use sound for residents' observation. However, if the
03-05-2019
1
collected sound is used as it is, the observation accuracy of the resident will deteriorate due to
the noise from the outside of the house and the noise generated from the electric device etc. in
the house. Furthermore, in order to collect sound in a house, the problem on personal
information protection by collecting a conversation etc. of a resident will also occur. Therefore,
there were cases where the desired sound could not be collected.
[0003]
JP, 2014-160314, A
[0004]
The problem to be solved by the present invention is to provide a sound collection control device,
a sound collection system, a sound collection control method and a computer program that can
improve the accuracy of collecting a desired sound.
[0005]
The sound collection control device of the embodiment has a control unit and a collection unit.
The control unit controls collection timing of sound data detected by a plurality of sound sensors
installed in the house.
The collection unit collects sound data from the plurality of sound sensors in a period in which
the noise generating device generates no noise according to the control of the control unit.
[0006]
FIG. 1 shows a system configuration of a sound collection system 100 according to an
embodiment. FIG. 2 is a view showing a specific example of the arrangement of the sound sensor
10 in the house 1; FIG. 2 is a schematic block diagram showing the configuration of a sound
collection control device 20. 6 is a flowchart showing a flow of sound collection control
processing of the sound collection control device 20. FIG. 8 is a view showing another example of
the arrangement of the sound sensor 10 in the house 1;
03-05-2019
2
[0007]
Hereinafter, a sound collection control device, a sound collection system, a sound collection
control method, and a computer program according to the embodiment will be described with
reference to the drawings. FIG. 1 is a diagram showing a system configuration of a sound
collection system 100 according to the embodiment. The sound collection system 100 includes a
sound sensor 10 and a sound collection controller 20. A noise device 30 is connected to the
sound collection controller 20. The sound sensor 10, the sound collection controller 20, and the
noise device 30 are installed in the house 1. Although FIG. 1 shows a configuration in which the
sound collection system 100 includes four sound sensors 10, the sound collection system 100
may be configured to include three or less sound sensors 10, or five or more. The sound sensor
10 may be configured to be provided. Further, two or more noise devices 30 may be connected
to the sound collection control device 20.
[0008]
The sound sensor 10 is a sensor that detects a sound. For example, the sound sensor 10 is a
microphone. The sound sensor 10 is data of the detected sound (hereinafter referred to as
sound data . ) Is output to the sound collection controller 20. The sound sensor 10 may be a
nondirectional microphone, a unidirectional microphone, or a bidirectional microphone. Also, the
sound sensor 10 may be provided indoors or outdoors. The sound collection control device 20
performs control for collecting desired sound data included in the sound data detected by the
sound sensor 10. The desired sound data is sound data without noise included in the sound data.
For example, the desired sound data is a living sound (for example, voice, footsteps, etc.) used to
determine the presence or absence of a resident. Here, the noise is an operation noise generated
when the noise device 30 is operating or a noise from the outside of the house 1. For example, in
the case where the noise device 30 is a washing machine, the operation noise at the time of
washing or rinsing in the washing machine corresponds to the noise. また。 The noise from the
outside of the house 1 is a running noise of a vehicle or the like. The noise device 30 is an
electrical device that uses power and generates noise. The noise device 30 is, for example, a
home appliance (for example, a washing machine, a fan, an air conditioner, etc.).
[0009]
FIG. 2 is a view showing a specific example of the arrangement of the sound sensor 10 in the
03-05-2019
3
house 1. The sound sensor 10 is disposed at a predetermined position in the house 1 as shown in
FIG. FIG. 2 shows an example in which nine sound sensors 10-1 to 10-9 are arranged. These
sound sensors 10-1 to 10-9 are arranged at different positions in contact with or embedded in
the wall (indoor or outdoor), floor, ceiling, door and window of the house 1, respectively. Each
sound sensor 10 detects a sound around its own device. For example, when each sound sensor
10 is a nondirectional microphone, each sound sensor 10 detects sound from the surroundings
(for example, 360 °) of the own device. In addition, when each sound sensor 10 is a directional
microphone, each sound sensor 10 detects a sound from a specific area. The sound collection
control device 20 can specify the range in which the noise device 30 generating the noise is
located by the collected sound data. More specifically, the sound collection control device 20
detects the sound of similar features and forms three sound sensors 10 forming each vertex of a
triangle (for example, the sound sensors 10-1 and 10-2). And 10-4) can specify the range in
which the noise device 30 is located.
[0010]
FIG. 3 is a schematic block diagram showing the configuration of the sound collection controller
20. As shown in FIG. The sound collection control device 20 includes a CPU (Central Processing
Unit), a memory, an auxiliary storage device, and the like connected by a bus, and executes a
sound collection control program. By executing the sound collection control program, the sound
collection control device 20 functions as a device including the determination unit 201, the
control unit 202, the collection unit 203, and the noise removal unit 204. Note that all or part of
the functions of the sound collection control device 20 may be realized using hardware such as
an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field
programmable gate array (FPGA). Good. Also, the sound collection control program may be
recorded on a computer readable recording medium. The computer readable recording medium
is, for example, a flexible disk, a magneto-optical disk, a ROM (Read Only Memory), a portable
medium such as a CD-ROM, or a storage device such as a hard disk built in a computer system.
Also, the sound collection control program may be transmitted and received via a
telecommunication line.
[0011]
The determination unit 201 determines whether the noise device 30 is operating. Specifically,
the determination unit 201 determines whether the noise device 30 is in the on state or in the off
state. When the noise device 30 is in the on state, the determination unit 201 determines that the
noise device 30 is operating. When the noise device 30 is in the off state, the determination unit
03-05-2019
4
201 determines that the noise device 30 is not operating. The control unit 202 controls the
collection timing of sound data detected by the sound sensor 10. For example, the control unit
202 controls the collection unit 203 in a period with little noise to collect sound data detected by
the sound sensor 10. The low noise period is a period during which the noise device 30 does not
generate noise. More specifically, the low noise period is a period in which the control unit 202
controls the noise device 30 so as not to generate noise.
[0012]
Under the control of the control unit 202, the collection unit 203 collects sound data from each
sound sensor 10 during a period of low noise. The noise removal unit 204 removes noise
included in the sound data collected by the collection unit 203. Specifically, the noise removing
unit 204 removes external noise included in the sound data by filtering.
[0013]
Next, processing when the collection unit 203 collects sound data will be specifically described.
When collecting the sound data, the collecting unit 203 collects Tr data continuously for a
predetermined Tw time (first time), and then Tr time elapses as Tr time (second time) is not
collected according to a constant repetition cycle Tr. Sound data is collected intermittently by
repeating the Tw time collection again later. Furthermore, the collection unit 203 performs
intermittent collection satisfying the relationship of FL> = 1 / (2 × Tr) and FH <= 1 / (2 × Tw)
where the non-collection frequency band is FL to FH [Hz]. do. The non-collection frequency band
corresponds to the voice band, and is FL to 20 Hz and FH to 10 kHz. For example, if Tw <= 1 / (2
× FH) = 1 / (2 × 10 kHz) to 50 us Tr> = 1 / (2 × FL) = 1 / (2 × 20 Hz) to 25 ms, speech is It
can be collected as information but can not be identified as speech. Therefore, although it is
probably understood that a person is emitting a sound, it becomes a folded sound and the
contents of the conversation can not be understood at all in principle.
[0014]
To collect sound data intermittently and in accordance with a constant cycle corresponds to
collection by sampling. That is, according to the sampling theorem, the frequency at which the
data collected at the repetition period Tr can be reproduced is determined by 1 / (2 × Tr). Also,
the lower limit of the frequency that can be collected during continuous collection time during
03-05-2019
5
the collection time Tw is determined by 1 / (2 × Tw). Therefore, the frequency obtained by the
intermittent collection satisfying the relationship of FL> = 1 / (2 × Tr) and FH <= 1 / (2 × Tw) is
a frequency component higher than FH or a frequency component lower than FL It becomes. If
FL to FH are applied to the voice frequency band, the data obtained by intermittent collection
becomes data that can not be decoded as voice, and life sound can be collected but collection that
achieves the purpose of not collecting voice information It becomes. As described above, by not
performing data sampling in accordance with the sampling theorem from the start of processing
according to the sampling theorem, it becomes possible to collect more secure sound data in
consideration of personal information. In this case, the voice band information is included in the
inspection data as a aliasing frequency, but since the original information has already been lost,
for example, it is impossible in principle to reproduce conversations between persons from the
collected data become.
[0015]
FIG. 4 is a flowchart showing the flow of the sound collection control process of the sound
collection control device 20. The process of FIG. 4 is performed at certain time intervals (eg,
every one minute). The determination unit 201 determines whether the noise device 30 is
operating (step S101). If the noise device 30 is operating (YES in step S101), the sound collection
control device 20 waits for a predetermined time (for example, 10 seconds) (step S102). After
waiting for a fixed time, the determination unit 201 determines whether the noise device 30 is
operating (step S103). When the noise device 30 is operating (YES in step S103), the control unit
202 determines whether a predetermined time has elapsed (step S104). The predetermined time
is, for example, a predetermined time or more and less than the sound collection control
processing start time interval. The predetermined time may be set in advance.
[0016]
When the predetermined time has not elapsed (step S104-NO), the sound collection control
device 20 repeatedly executes the process after step S102. On the other hand, when the
predetermined time has elapsed (YES in step S104), the control unit 202 controls the operating
noise device 30 so as not to generate noise (step S105). For example, the control unit 202 stops
the operation of the operating noise device 30. Thereafter, the control unit 202 controls the
collection unit 203 to collect sound data from each sound sensor 10. The collection unit 203
collects sound data from each sound sensor 10 according to the control of the control unit 202
(step S106). The collecting unit 203 outputs the plurality of collected sound data to the noise
removing unit 204. The noise removing unit 204 removes external noise included in each sound
03-05-2019
6
data (step S107).
[0017]
Specifically, the noise removing unit 204 removes external noise by the following process. In this
case, the noise removing unit 204 uses a microphone having directivity toward the outside. The
outdoor noise (in particular, low frequency components) collected by the microphone has its
phase inverted by 180 degrees by an electric circuit connected to the microphone, and is input to
the sound collection controller 20 as a negative phase sound. Then, the noise removing unit 204
is installed at a position close to the microphone directed to the indoor side where the external
noise (external noise detected by the microphone directed to the indoor side) directly entering
the room from the outside and the external noise are detected. The phases are mutually canceled
by the negative phase sound input from the microphone on the outdoor side, and external noise
is reduced. At this time, the amplitude of the antiphase sound is adjusted so that the synthesized
sound is minimized. In addition, it can be easily realized by integrating the directional
microphone on the indoor side and the directional microphone on the outdoor side. Therefore, in
the present embodiment, a microphone in which a directional microphone on the indoor side and
a directional microphone on the outdoor side are integrally configured may be used.
[0018]
In addition, in the process of step S101, when the noise device 30 is not operating (step S101NO), the control unit 202 executes the process of step S106 and subsequent steps. Moreover, in
the process of step S103, when the noise apparatus 30 is not operating (step S103-NO), the
control part 202 performs the process after step S106.
[0019]
According to the sound collection control device 20 configured as described above, desired
sound data can be collected. Hereinafter, this effect will be described in detail. The sound
collection control device 20 controls the operating noise device 30 so as not to generate noise
before collecting sound data. As a result, when the sound collection controller 20 collects sound
data, the noise device 30 that generates noise is eliminated. In this manner, the sound collection
control device 20 can collect sound data under a situation where the noise due to the noise
device 30 is small. Furthermore, at the time of sound data collection, sound data collection is
03-05-2019
7
performed intermittently. By this collection method, the sound collection control device 20 can
collect sound data so that personal information such as a conversation is not restored from the
collected sound data. Then, the sound collection control device 20 removes noise from the
outside of the house 1 included in the collected sound data by filtering. Therefore, unnecessary
noise can be removed. Therefore, it becomes possible to collect desired sound data.
[0020]
Hereinafter, modifications of the sound collection system 100 will be described. In the present
embodiment, as a method of controlling the noise device 30 so as not to generate noise, the
configuration in which the noise device 30 is stopped is shown, but it is not necessary to be
limited to this. For example, the control unit 202 may put the operating noise device 30 into an
idle state, instead of stopping the operating noise device 30. Then, after making the operating
noise device 30 idle, the control unit 202 controls the collection unit 203 to collect sound data.
By this configuration, sound data can be collected in a situation where noise generated at the
time of sound data collection is reduced. Therefore, it becomes possible to collect desired sound
data.
[0021]
If it is determined that the noise device 30 is operating during the collection of sound data by the
collection unit 203, the control unit 202 controls the collection unit 203 to temporarily stop
collection of sound data by the collection unit 203. It may be configured to By being configured
in this manner, the sound collection control device 20 can reduce the possibility of collecting the
noise generated by the noise device 30. This can improve the accuracy of collecting the desired
sound.
[0022]
In the present embodiment, the determination unit 201 determines whether the noise device 30
is operating according to whether the noise device 30 is on or off. However, whether the noise
device 30 is operating The determination of whether or not it is not necessary to be limited to
this. For example, the determination unit 201 may determine whether the noise device 30 is
operating based on the distribution pattern of the feature quantity of the noise generated by the
noise device 30. When configured in this manner, the sound collection control device 20 includes
03-05-2019
8
a noise device information storage unit. The noise device information storage unit is configured
using a storage device such as a magnetic hard disk drive or a semiconductor storage device. The
noise device information storage unit is information on the distribution pattern of the feature
quantities of noise generated by the noise device 30 (hereinafter referred to as noise pattern .
Remember). For example, if the noise device 30 is a washing machine, the noise device
information storage unit stores a noise pattern of noise generated when the washing machine is
used for washing and rinsing. Thus, the noise device information storage unit stores the noise
pattern of each noise device 30. The operation in such a case will be described below.
[0023]
When the sound collection control process is started, the control unit 202 controls the collection
unit 203 to collect sound data from the sound sensor 10. The determination unit 201 acquires a
distribution pattern of feature quantities of sound data from the collected sound data. Then, the
determination unit 201 compares the acquired distribution pattern of the feature amount with
the noise pattern to determine whether the noise device 30 is operating. For example, when the
distribution pattern of the feature amount of the collected sound data matches one of the noise
patterns, the determination unit 201 determines that the noise device 30 is operating. If the
determination unit 201 determines that the noise device 30 is operating, the control unit 202
controls the noise device 30 determined to be operating so as not to generate noise. Thereafter,
the control unit 202 controls the collection unit 203 to collect sound data.
[0024]
The sound collection control device 20 may be configured to include an output unit. When
collection of sound data by the collection unit 203 is started, the output unit outputs a
notification indicating that collection of sound data is in progress to the resident. For example,
the output unit may notify that it is in the process of collecting by blinking the light, or may
notify the output device that outputs the image or the character on the screen that it is in the
process of collecting the image or the character. A sound such as music may be output to a sound
output device (speaker) for notification, or may be notified by another method. For example, the
output device can be configured using a CRT (Cathode Ray Tube), a liquid crystal display, an
organic EL (Electro-Luminescent) display, or the like.
[0025]
03-05-2019
9
The sound collection control device 20 may be configured to include a setting unit. The setting
unit sets a time zone input by the resident using an input device (not shown) as a time zone for
collecting sound data. In such a configuration, when the set time zone comes, the control unit
202 controls the collection unit 203 to collect sound data from the plurality of sound sensors 10.
By this configuration, sound data is collected in a time zone desired by the resident. Therefore,
the degree of freedom of sound data collection is improved.
[0026]
When the noise device 30 is operating and the noise is intermittently generated, the control unit
202 determines the timing at which the power consumption falls below a predetermined
threshold value from the transition of the power consumption of the operating noise device 30. It
may be determined as the sound data collection timing. When configured in this manner, the
control unit 202 controls the collection unit 203 at the determined collection timing to collect
sound data. This process will be described by way of example, for example, when the noise device
30 is a washing machine. The washing machine seems to always make a loud noise. However,
there is a pause time during which the motor is not rotating between forward rotation and
reverse rotation. At rest, the washing machine consumes less power and less noise is generated.
Therefore, the control unit 202 monitors the power consumption of the washing machine, and
determines the timing (for example, at rest) when the power consumption becomes less than a
predetermined threshold by grasping the pause time as the sound data collection timing.
[0027]
The sound collection control device 20 may be configured to include an audio processing unit.
When configured in this manner, the collection unit 203 may not collect sound data
intermittently. The details will be described below. The sound processing unit is referred to as
sound data from which noise from the outside has been removed by the noise removing unit 204
(hereinafter referred to as noise-removed sound data ). By filtering the audio frequency band
data included in the denoised sound data. More specifically, the voice processing unit attenuates
data in the voice frequency band included in the noise-removed sound data by using an analog
filter for removing voice band with respect to the noise-removed sound data. The analog filter for
voice band elimination is a filter that attenuates the voice band (for example, 200 Hz to 4 kHz)
and passes the other bands.
03-05-2019
10
[0028]
The collection result of the sound data by the sound collection controller 20 may be used for any
processing thereafter. For example, it may be used to determine whether there is a person in the
house 1 based on the collection result, it may be used to determine which room in the house 1
the person is in, or the person sleeps It may be used for the determination of whether it is
medium or not, and may be used for other determinations. When the sound data collection result
is used to determine whether there is a person in the house 1 or in which room in the house 1
the person is, the vibration data collection result by the vibration sensor is also the sound data It
may be used according to the collection result.
[0029]
The arrangement of the sound sensor 10 need not be limited to the arrangement described
above. For example, the sound sensor 10 may be arranged as shown in FIG. FIG. 5 is a view
showing another example of the arrangement of the sound sensor 10 in the house 1. In the
example shown in FIG. 5, twelve sound sensors 10-10 to 10-21 are disposed in the house 1.
These sound sensors 10-10 to 10-21 are arranged at different positions in contact with or
embedded in the wall, floor, ceiling, door and window of the house 1 respectively. Each sound
sensor 10 detects a sound around its own device. For example, when each sound sensor 10 is a
nondirectional microphone, each sound sensor 10 detects sound from the surroundings (for
example, 360 °) of the own device. The sound collection controller 20 can specify the range in
which the noise device 30 is located by the collected sound data. More specifically, the sound
collection control device 20 detects the sound of the similar feature and forms four sound
sensors 10 forming each vertex of the square (for example, the sound sensors 10-10 and 10-11).
, 10-14 and 10-15) can specify the range in which the noise device 30 is located.
[0030]
According to at least one embodiment described above, the control unit 202 that controls the
collection timing of the sound data detected by the sound sensor 10 installed in the home 1 and
the noise device that generates noise according to the control of the control unit 202 By having
the collection unit 203 that collects sound data from the sound sensor 10 in a period in which no
noise 30 is generated, the accuracy of collecting a desired sound can be improved.
[0031]
03-05-2019
11
While certain embodiments of the present invention have been described, these embodiments
have been presented by way of example only, and are not intended to limit the scope of the
invention.
These embodiments can be implemented in other various forms, and various omissions,
replacements, and modifications can be made without departing from the scope of the invention.
These embodiments and modifications thereof are included in the invention described in the
claims and the equivalents thereof as well as included in the scope and the gist of the invention.
[0032]
DESCRIPTION OF SYMBOLS 10 ... Sound sensor, 20 ... Sound collection control apparatus, 30 ...
Noise apparatus, 201 ... Determination part, 202 ... Control part, 203 ... Collection part, 204 ...
Noise removal part
03-05-2019
12