US20180035195A1 - Instrument with remote object detection unit - Google Patents
Instrument with remote object detection unit Download PDFInfo
- Publication number
- US20180035195A1 US20180035195A1 US15/727,135 US201715727135A US2018035195A1 US 20180035195 A1 US20180035195 A1 US 20180035195A1 US 201715727135 A US201715727135 A US 201715727135A US 2018035195 A1 US2018035195 A1 US 2018035195A1
- Authority
- US
- United States
- Prior art keywords
- head
- antenna
- worn
- remote object
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims description 63
- 238000004891 communication Methods 0.000 claims description 8
- 230000002708 enhancing effect Effects 0.000 claims description 5
- 230000008447 perception Effects 0.000 claims description 4
- 238000000034 method Methods 0.000 description 28
- 210000003128 head Anatomy 0.000 description 13
- 230000006978 adaptation Effects 0.000 description 8
- 206010011878 Deafness Diseases 0.000 description 4
- 230000010370 hearing loss Effects 0.000 description 4
- 231100000888 hearing loss Toxicity 0.000 description 4
- 208000016354 hearing loss disease Diseases 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 210000000613 ear canal Anatomy 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 208000032041 Hearing impaired Diseases 0.000 description 2
- 230000001143 conditioned effect Effects 0.000 description 2
- 230000001939 inductive effect Effects 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 206010048865 Hypoacusis Diseases 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 230000004886 head movement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000010408 sweeping Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1016—Earpieces of the intra-aural type
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
- G01S13/06—Systems determining position data of a target
- G01S13/42—Simultaneous measurement of distance and other co-ordinates
- G01S13/422—Simultaneous measurement of distance and other co-ordinates sequential lobing, e.g. conical scan
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/40—Arrangements for obtaining a desired directivity characteristic
- H04R25/405—Arrangements for obtaining a desired directivity characteristic by combining a plurality of transducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/552—Binaural
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
- H04R25/554—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired using a wireless connection, e.g. between microphone and amplifier or using Tcoils
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1033—Cables or cables storage, e.g. cable reels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/41—Detection or adaptation of hearing aid parameters or programs to listening situation, e.g. pub, forest
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/51—Aspects of antennas or their circuitry in or for hearing aids
Definitions
- the present disclosure relates to an instrument having a remote object detection unit for detecting remote objects. Moreover, the present disclosure relates to a method for detecting remote objects using an instrument having a remote object detection unit.
- Sound processing in environments having multiple sound sources is cumbersome and detection and separation of active sound sources is an active field when using instruments having directional microphone systems.
- the apparatus comprising a directional microphone system having adaptable directionality.
- the apparatus comprising a processor for adapting the adaptable directionality of the directional microphone system.
- the apparatus comprising a remote object detection unit configured to detect a remote object by detecting a transmitted signal reflected from the object, the processor being adapted to direct the directionality of the directional microphone system based on the detection of the remote object.
- the remote object detection unit allows detection of remote objects, which detection may be used to control the directional microphone system and/or warning of the user.
- the remote object detection unit is adapted to transmit and/or receive independently of the directional microphone system.
- a second aspect relates to a method of operating an apparatus having a directional microphone system having adaptable directionality, a processor for adapting the adaptable directionality of the directional microphone system, and a remote object detection unit configured to detect a remote object.
- the method comprising a step of transmitting from the remote object detection unit an electromagnetic signal.
- the method comprising a step of receiving at the remote object detection unit a reflected electromagnetic signal.
- the method comprising a step of determining whether a remote object is present based on the reflected electromagnetic signal and the relative direction to the remote object.
- the steps of transmitting and receiving may be performed iteratively so as to sweep a number of sections iteratively or according to a schedule or scheme.
- a third aspect relates to a system, where a head-worn apparatus and a remotely worn device are in wireless communication.
- One or both of the apparatuses/devices of the system may comprise an antenna having adaptable directionality for transmission and/or reception of wireless signals.
- the directionality of the antenna may be adapted based on information on where the recipient and/or transmitting device is placed relative to the other device.
- the adaptation of the antenna may lower the risk of interfering signals reducing the link quality.
- the two devices of the system may exchange information on the relative direction to the other device so that the directionality of the antenna may be even faster adapted to establish a good wireless link between the two devices.
- the direction from one device of the system towards the other may be determined using an remote object detection unit transmitting an electromagnetic signal as outlined elsewhere in the present specification.
- Such a system may comprise a head-worn apparatus for enhancing sound perception of a first user and a remotely positioned device configured to be in wireless communication with the head-worn apparatus and to be positioned at a second user.
- the head-worn apparatus may have a housing adapted or configred to be worn at the head of the user, and an antenna configured to receive a wireless signal from the remotely positioned device, and an output transducer to provide a signal perceived as sound by the second user.
- the remotely positioned device may comprise a microphone system configured to receive ambient sound, and a direction determination system configured to determine a desired direction.
- an antenna having adaptable directionality may be included, further included may be a processor for adapting the adaptable directionality of the antenna based on the desired direction, and the processor may then be configured to transmit, via the antenna, a signal based on the ambient sound received via the microphone.
- the antenna may have a relatively narrow beam, which may then be adapted to be directed towards the other device during use.
- An initial direction may be obtain, e.g. via a scan for an optimal link direction using the antenna to e.g. sweep through a number of directions.
- One of the devices may e.g. be configured to transmit a beacon signal during acquisition or determination of the link direction.
- the two devices may be configured to exchange information on e.g. link quality, such as signal-to-noise measures, packet loss information, or other quality measures/indicators.
- At least one of the devices comprise an adaptive antenna so that the transmit and/or receive direction may be adapted.
- both devices may include an antenna with adaptable or configurable directionalities. If even further devices or apparatuses are part of the system, e.g. multiple students each having at least one hearing aid, each of the devices or apparatuses may include such an antenna having adaptable directionality.
- a person may wear two hearing aids, often referred to as a binaural hearing aid system, where each ear is fitted with a respective hearing aid.
- the hearing aids need not be of the same type.
- a person may e.g. have a hearing aid providing air born sound to one ear, and e.g. a bone-conducting hearing aid at the other ear, or even an implanted system.
- a desired direction may be determined from at least the device having an antenna with adaptable directionality. This could be achieved e.g. by performing a sweep with antenna so as to emit a signal, such as a beacon signal, or correspondingly receive such a signal.
- a sensor may provided information on movement of the person carrying the respective device. This could for instance be an accelerometer indicating that the head of the user is turned, tilted or moved in another way. This additional information could help keeping the directionality of the antenna in an optimal direction.
- the antenna having adaptable directionality may have a number of discrete directions that the antenna is able to receive and/or transmit.
- the antenna having adaptable directionality may have angular limits between which the directionality is definable.
- the antenna having adaptable directionality may be adaptable both in vertical and/or horizontal directions relative to the wearer.
- the embodiments of the disclosure preferably seeks to mitigate, alleviate or eliminate one or more of the above mentioned disadvantages singly or in any combination.
- the method according to the second aspect may also be used for aiding a blind-source separation algorithm as detecting the presence of an object may help the algorithm to more quickly separate sources.
- the method as disclosed may be embodied in a computer program product being adapted to enable a computerized system comprising at least one apparatus having data storage means in connection therewith to control a remote object detection unit in an apparatus according to the first aspect of the disclosure.
- FIG. 1 schematically illustrates a hearing aid positioned at an ear of a person
- FIG. 2 schematically illustrates a head of a user where a hearing aid is placed at a right ear where a remote object detection device scans in an angle of a degrees
- FIG. 3 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of ⁇ degrees
- FIG. 4 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of ⁇ degrees
- FIG. 5 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of ⁇ degrees
- FIG. 6 schematically illustrates steps of a method
- FIG. 7 is a schematic illustration of two devices each having an adaptable antenna system
- FIG. 8 schematically illustrates steps for operating a hearing device having an adaptable antenna.
- FIG. 1 schematically illustrates an apparatus 10 having a housing.
- the apparatus is positioned at an ear of a person and comprises two parts or housings. One housing is positioned behind the ear, and one housing is positioned at the ear canal or ear canal opening. The two parts or housings are connected by connector.
- the apparatus illustrated is a hearing aid, but the functionality described herein could also be used in a hand-held microphone, or even in a stationary device, e.g. a conference telephone or device connected to e.g. a TV.
- the apparatus 10 comprises a directional microphone system in the housing, which directional microphone system has adaptable directionality.
- This directional microphone system could for instance be established using two, three or even more, omnidirectional microphones positioned spaced apart by a known distances. By using combinations of the signals from two, three more microphones allows establishment of a directional microphone system. This combination could include delay and/or phase-shift of the signal.
- the apparatus 10 further comprises a processor for adapting the adaptable directionality of the directional microphone system. This processor performs the needed adaptation of the directionality.
- the adaptation may include acoustic processing for identifying sound sources. Often hearing aids are equipped with directional microphone system so that sound is picked up from a preferred direction, such as substantially from in front of a person using the hearing aid.
- Sound processing algorithms may be used to track the relative movement of a sound source identified via the directional microphone system.
- a remote object detection unit may be employed.
- the remote object detection unit is configured to detect a remote object, such as a person or an inanimate object, by detecting a transmitted signal which has been reflected from the object. This operation is similar to the operation of a maritime 3 or 10 cm radar; however, at e.g. 79 GHz the wavelength is suitable for small form factor, low-power modules, which may be incorporated in housings to be worn at an ear of a person or held in the hand. Such devices may be incorporated in a 28 nm CMOS RFIC design.
- the processor is then adapted to direct the directionality of the directional microphone system based on the detection of the remote object.
- the remote object detection unit detects may be set up to sweep a certain angle interval relative to the housing.
- the remote object detection unit may be configured to sweep an area or angle at certain intervals.
- the remote object detection unit may be setup for detecting objects according to previously detected object, e.g. if one object has been identified recently, a scheme for sweeping may be adapted accordingly. This scheme could be aimed at detecting new sound sources and/or to maintain the direction of the directional microphone system pointed at the sound source, which may be shifted due to head movements and/or the sound source moving.
- This scheme could be aimed at detecting new sound sources and/or to maintain the direction of the directional microphone system pointed at the sound source, which may be shifted due to head movements and/or the sound source moving.
- the remote object detection unit may be used to keep track of possible sound sources, and the directional microphone system and the accompanying audio processing algorithms, may then be used to point out the desired sound target from the identified possible sound sources. This may alleviate the sound processing as less time and processing is used to identify active sound targets.
- the remote object detection unit may be configured to transmit, and receive, an electromagnetic signal having a carrier frequency within the 1 to 100 GHz frequency range.
- this remote object detection unit When this remote object detection unit is included in a housing carried by a person, it is possible to determine the speed of a detected remote object, or at least the relative speed of the detected remote object. This could be done using the Doppler effect, which also provides information on the relative movement of the remote object, i.e. closing in or moving away. The determined speed, possibly along with the direction, could be used to determine if imminent danger of collision. This could be advantageous when the user is moving around in a busy environment, such as a city centre with cars, busses, trucks, bicycles and people. A speaker unit could then provide an acoustic signal upon detection of a remote object having a speed above a given threshold, as this could indicate e.g. an approaching vehicle.
- the remote object detection unit could also be used as a proximity warning system indicating that an object is within a given distance from the user. Combinations of the properties of the remote objects may also be used, e.g. an approaching vehicle having a speed above some threshold within a given distance will cause the speaker to emit a sound. Further, a small vibrational unit may be included in the housing to provide a vibrational sensation at the ear. For binaural systems, that is system with a hearing aid at each ear, it is also possible to provide directionality the warning, so that if something is approaching from the left, a warning is given at the left ear, etc.
- the remote object detection unit Depending on the resolution level of the remote object detection unit, it is possible to characterise the remote object as one of: a person, a car, a bicycle, a fixed metallic object.
- the apparatus is described as a hearing aid but could also be a hand-held microphone, a wearable device or a stationary device.
- a stationary device could be a so-called TV-box.
- FIG. 2 schematically illustrates a head of a user where a hearing aid is placed at a right ear where a remote object detection device scans in an angle of a degrees.
- the angle a may be determined by the characteristics of the antenna used. As illustrated in FIG. 4 the angle may be larger than shown in FIG. 1 .
- FIG. 3 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of ⁇ degrees.
- FIG. 4 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of ⁇ degrees.
- the angular restriction could extend backwards of the head so as to allow the directional microphone system to adapt and pick up sounds emanating from behind the user, e.g. a caretaker pushing a wheel chair.
- FIG. 5 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of ⁇ degrees.
- Each angular section is divided into a number of subsections.
- the subsections are illustrated as being separated, but in practice there will be some overlap due to the directionality characteristics of the antenna used for the remote object detection unit.
- the subsections may be scanned consecutively, randomly or according to a fixed scheme. Whichever method is used, the method may be adapted according to which environment the user is in.
- FIG. 6 schematically illustrates steps of a method of operating an apparatus having a directional microphone system having adaptable directionality, a processor for adapting the adaptable directionality of the directional microphone system, and a remote object detection unit configured to detect a remote object.
- an apparatus could be an apparatus as discussed in relation to FIGS. 1-5 .
- the method comprises a step of transmitting from the remote object detection unit an electromagnetic signal.
- the method comprises a step of receiving at the remote object detection unit a reflected electromagnetic signal.
- the remote object detection unit thus emits a signal in a given direction and awaits an echo. This allows detecting an angular direction to the remote object, if present. Further processing and analysis of the echo may provide information on the speed of the remote object, e.g. based on the Doppler Effect.
- the directional microphone system may then provide information on whether any detected remote object is an active sound source or not. If active, the directionality of the directional microphone system may be adapted based on the detection of a remote object directional microphone system.
- the adaptation of the directionality of the directional microphone system may be conditioned on the remote object being classified as a sound source. In the cocktail scenario, one source may be identified as a preferred source and the directional microphone system may be adapted accordingly, even if more active sound sources are identified.
- a combination of the remote object detection unit and the directional microphone system may be used for identifying remote active sound sources.
- a classification of the remote object may include determining if the remote object is a human or a machine. This could be used for automatically determining if a warning signal should be issued for warning the user of an approaching vehicle.
- the remote object detection unit can be used to detect active and silent remote objects and the directionality of the directional microphone system could be used for scanning the remote objects detected by the remote object detection unit to classify them as active or silent.
- a further use of the knowledge of the direction to a source is to adapt a directional antenna, such as an array antenna comprising two or more smaller antennae elements.
- the array antenna could comprise two, three, four, five, or more elements.
- the loss of wireless link from e.g. a remote microphone will result in a loss of audio packets between the transmitting device and the receiving device, and therefore loss of audibility.
- a student wearing a hearing aid linked to a remote microphone of the teacher may have the adverse effect of the student not understanding what the teacher said.
- the antenna could be positioned at, such as under, a surface intended to face away from the teachers body.
- This part of a portable device, such as a teacher microphone could provide a surface having a relatively large area for positioning multiple antenna elements.
- an antenna could be formed at or under a side wall of the hearing aid housing that is configured to be positioned behind the ear of the user, whereas a second part is configured to be positioned in the ear canal, e.g. having a receiver and/or ear mold.
- a receiver and/or ear mold Such as configuration is, as described above, often referred to as either a receiver-in-the-ear or behind-the-ear.
- the antenna When a, relative, direction from one device towards the other, remotely placed, device is determined, the antenna may be adapted so that the signal transmitted from the antenna is directed towards the other device. Thereby the energy needed to ensure optimal transmission under the given circumstances are provided. This is most relevant for relatively high frequencies, such as around 1-10 GHz, such as around the frequencies used for Bluetooth, WiFi and the like protocols, such as at 2.4 GHz, such as at 5 GHz.
- the determination of the direction may also be used for controlling the adaptable directionality of the microphone. Further, the above-mentioned electromagnetic signal transmission system may be used as at least part of the direction determination.
- the antenna with adaptable directionality could be embodied as an antenna array, or multiple antenna arrays, with smaller radiating elements combined with signal processing and beamforming.
- the antenna array could e.g. be a line of 2, 3, 4 or more smaller antennae with switchable elements.
- the antenna array could be e.g. a square with 2 ⁇ 2, 3 ⁇ 3, 4 ⁇ 4 or other combinations of smaller antennae with switchable elements.
- the antenna array could be e.g. arranged as a rectangle with 2 ⁇ 3, 2 ⁇ 4, 3 ⁇ 4, 3 ⁇ 5, 4 ⁇ 5 or other combinations and/or permutations of smaller antennae with switchable elements.
- a phased array architecture could employ beam steering and forming using RF-phase and/or amplitude shifters, or beam forming networks.
- the adaptation of the antenna may be performed continuously, periodically or event based. Further, adaptation may, in some cases, be performed just prior, and/or during, transmission of data.
- FIG. 7 schematically illustrates two devices each having an adaptable antenna system.
- One of the device is to be worn by e.g. a teacher and the other by a student.
- one device e.g. being a hearing aid
- the other device e.g. a microphone device
- the microphone device could simply be placed on a table during a social event for improved microphone reception.
- the microphone device is to be positioned remote from e.g. the hearing aid user, which could be a, young, student in a classroom setting. As the teacher moves around, the wireless link may be disturbed, especially when the antenna is a highly directional antenna.
- a link having a high link quality e.g. expressed by a low packet loss or the like, may be established and maintained even when the source, or the device having the antenna, is moving or shifting.
- FIG. 7 this is illustrated by three antennae elements together forming an antenna array. Both devices are illustrated having the same array, however, the two, or more, devices need not implement the same type or structure.
- the head-worn apparatus may include that the device is configured to transmit the detected direction towards the remote device via the wireless to the remote device, and wherein the remote device is configured to adapt the direction of the adaptable antenna based at least in part on the relative direction from the head-worn device.
- At least one device in a system is able to include information from the other device when determining how to adapt the directionality of the adaptable antenna. This could increase the efficiency of the system and possibly lower the time needed to establish the desired direction.
- One or more devices of the system may include a positioning device configured to provide a signal representing the position of that device as e.g. a coordinate set in a global coordinate system. Having more devices of the system including such a positioning system could allow for an adaptation of the antenna based on at least two coordinate sets.
- Other direction indicators may be included, e.g from a radar system in one or more of the devices as disclosed herein.
- One or more of the devices of the system may be configured to transmit a beacon signal that another device of the system may register.
- This beacon signal may e.g. be used to determine the direction to the device emitting the beacon signal.
- the determination of the direction may e.g. be based at least in part on determining signal strength of the beacon signal. This could be achieved using an antenna having adaptable directionality.
- a hearing aid may be provided where the microphone system may be adapted based on a determined direction to a source. Further, an antenna having adaptable directionality may be adapted based on the determined direction to a wireless source. Still further, both a microphone system and an antenna may be adapted based on a determined direction to a source emitting both sound and a wireless signal.
- a teacher may carry a device with a microphone and a wireless system for broadcasting a signal based on the microphone.
- One or more students may then have each their hearing aid or aids which each include an adaptable antenna, each of which are configured to determine a direction to the teacher to establish and maintain a wireless connection to be able to receive wirelessly the signal based on the microphone.
- the system may include a stationary unit routing the wireless signal from the teacher, which stationary unit then broadcast a signal to the students respective hearing aids.
- the antenna system may be configured to search a fixed number of directions. This could e.g. be two directions where a signal strength indication is obtained from both directions and the direction having the stronger indication is then chosen. Further numbers of spots or directions may be used. In a situation where e.g. three directions are relied upon, the three directions may form a triangular geometry, seen in a direction directly towards the antenna. This could allow for optimising the directionality in situations where the transmitting antenna is located at an elevated position relative to the receiving antenna, such as a teacher standing in a classroom while the student or students are sitting down.
- the antenna is able to transmit and/or receive in allows for greater flexibility.
- inductive communication e.g. a telecoil
- inductive systems e.g. for through-the-head communication.
- the directionality pattern should favour the angle of incidence of the several hearing devices.
- Directionality could also favour the hearing devices that would otherwise have the lowest wireless communication signal-to-noise ratio.
- a head-worn apparatus for enhancing sound perception of a user, the apparatus having a housing adapted to be worn at the head of the user, the head-worn apparatus comprising: a directional microphone system having adaptable directionality, where the directional microphone system comprises a plurality of omnidirectional microphones, a remote object detection unit configured to emit an electromagnetic signal and to detect a remote object by detecting an electromagnetic signal reflected off the object, a processor for adapting the adaptable directionality of the directional microphone system based on the detection of the remote object, wherein the processor is adapted to enhance sound from the object according to the users specific hearing loss.
- the head-worn apparatus according to item 3, further comprising a speaker unit, which provides an acoustic signal upon detection of a remote object having a speed above a threshold.
- the remote object detection unit characterises the remote object as one of: a person, a car, a bicycle, a fixed metallic object.
- the head-worn apparatus according to any one of items 1, wherein the apparatus is a hearing aid or a hand-held microphone.
- a hearing aid comprising an input device for receiving a sound signal, a processor for processing the sound signal to compensate for a user's hearing loss, an output transducer for providing the processed signal to the user in a form perceivable as sound, a remote object detection unit for detecting objects remote from the hearing aid by detecting reflections of an electromagnetic signal transmitted from the remote detection unit and reflected by the remote object.
- a method of operating a head-worn apparatus having a directional microphone system having adaptable directionality, a processor for adapting the adaptable directionality of the directional microphone system, and a remote object detection unit configured to detect a remote object comprising: transmitting from the remote object detection unit an electromagnetic signal, receiving at the remote object detection unit a reflected electromagnetic signal, determining whether a remote object is present based on the reflected electromagnetic signal and the relative direction to the remote object, and adapting the directionality of the directional microphone system based on the detection of a remote object.
- the apparatus includes a classifying unit for classifying objects as sound or not-sound sources, the adaptation of the directionality of the directional microphone system is conditioned on the remote object being classified as a sound source.
- the method may include determining speed of remote object, and provided the speed is above a threshold, the method comprises issuing a warning signal.
- any of the disclosed embodiments may be physically, functionally and logically implemented in any suitable way such as in a single unit, in a plurality of units or as part of separate functional units. It is intended that the structural features of the devices described above, in the detailed description and in the claims may be combined with steps of the method, when appropriately substituted by a corresponding process. Embodiments of the method have the same advantages as the corresponding systems.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- General Physics & Mathematics (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
The present disclosure relates to an apparatus having a directional antenna system having adaptable directionality and a direction determination system configured to determine a desired direction, the directionality of the directional antenna system may be modified or adapted based on the desired direction.
Description
- This application is a Continuation-in-Part of co-pending application Ser. No. 14/699,060, filed on Apr. 29, 2015, and claims priority under 35 U.S.C. §119(a) to European Application Nos. EP 14166645.3, filed on Apr. 30, 2014, and EP 17195126.2, filed on Oct. 6, 2017, all of which are hereby expressly incorporated by reference into the present application.
- The present disclosure relates to an instrument having a remote object detection unit for detecting remote objects. Moreover, the present disclosure relates to a method for detecting remote objects using an instrument having a remote object detection unit.
- Sound processing in environments having multiple sound sources is cumbersome and detection and separation of active sound sources is an active field when using instruments having directional microphone systems.
- Persons with hearing loss usually have a hard time in crowded areas and areas with heavy traffic, putting themselves in danger of being hit by a vehicle, e.g. a car, a bus, a bicycle or the like. Further, people with hearing loss and reduced eyesight are even more exposed to dangers in traffic.
- Hence, an improved apparatus would be advantageous. It is a further object of the present disclosure to provide an alternative to the prior art.
- In particular, it may be seen as an object of the present disclosure to provide an apparatus that solves, at least alleviates or provides an alternative the above mentioned problems of the prior art with enhancing sounds from desired sources and/or provides warnings of impinging dangers.
- Thus, the above described object and several other objects are intended to be obtained in a first aspect by providing an apparatus having a housing.
- The apparatus comprising a directional microphone system having adaptable directionality. The apparatus comprising a processor for adapting the adaptable directionality of the directional microphone system. The apparatus comprising a remote object detection unit configured to detect a remote object by detecting a transmitted signal reflected from the object, the processor being adapted to direct the directionality of the directional microphone system based on the detection of the remote object. The remote object detection unit allows detection of remote objects, which detection may be used to control the directional microphone system and/or warning of the user. The remote object detection unit is adapted to transmit and/or receive independently of the directional microphone system.
- A second aspect relates to a method of operating an apparatus having a directional microphone system having adaptable directionality, a processor for adapting the adaptable directionality of the directional microphone system, and a remote object detection unit configured to detect a remote object. The method comprising a step of transmitting from the remote object detection unit an electromagnetic signal. The method comprising a step of receiving at the remote object detection unit a reflected electromagnetic signal. The method comprising a step of determining whether a remote object is present based on the reflected electromagnetic signal and the relative direction to the remote object. The steps of transmitting and receiving may be performed iteratively so as to sweep a number of sections iteratively or according to a schedule or scheme.
- A third aspect relates to a system, where a head-worn apparatus and a remotely worn device are in wireless communication. One or both of the apparatuses/devices of the system may comprise an antenna having adaptable directionality for transmission and/or reception of wireless signals. The directionality of the antenna may be adapted based on information on where the recipient and/or transmitting device is placed relative to the other device. The adaptation of the antenna may lower the risk of interfering signals reducing the link quality. The two devices of the system may exchange information on the relative direction to the other device so that the directionality of the antenna may be even faster adapted to establish a good wireless link between the two devices. The direction from one device of the system towards the other may be determined using an remote object detection unit transmitting an electromagnetic signal as outlined elsewhere in the present specification.
- Such a system may comprise a head-worn apparatus for enhancing sound perception of a first user and a remotely positioned device configured to be in wireless communication with the head-worn apparatus and to be positioned at a second user. In the system, the head-worn apparatus may have a housing adapted or configred to be worn at the head of the user, and an antenna configured to receive a wireless signal from the remotely positioned device, and an output transducer to provide a signal perceived as sound by the second user. Further, the remotely positioned device may comprise a microphone system configured to receive ambient sound, and a direction determination system configured to determine a desired direction. In the remotely positioned device, an antenna having adaptable directionality may be included, further included may be a processor for adapting the adaptable directionality of the antenna based on the desired direction, and the processor may then be configured to transmit, via the antenna, a signal based on the ambient sound received via the microphone. This is contemplated to allow for maintaining a wireless link between the two devices of the system even when one, or both, devices are moving relatively to each other. The antenna may have a relatively narrow beam, which may then be adapted to be directed towards the other device during use.
- An initial direction may be obtain, e.g. via a scan for an optimal link direction using the antenna to e.g. sweep through a number of directions. One of the devices may e.g. be configured to transmit a beacon signal during acquisition or determination of the link direction. The two devices may be configured to exchange information on e.g. link quality, such as signal-to-noise measures, packet loss information, or other quality measures/indicators.
- In the above mentioned system, at least one of the devices comprise an adaptive antenna so that the transmit and/or receive direction may be adapted. In a system with such two devices, both devices may include an antenna with adaptable or configurable directionalities. If even further devices or apparatuses are part of the system, e.g. multiple students each having at least one hearing aid, each of the devices or apparatuses may include such an antenna having adaptable directionality.
- A person may wear two hearing aids, often referred to as a binaural hearing aid system, where each ear is fitted with a respective hearing aid.
- The hearing aids need not be of the same type. A person may e.g. have a hearing aid providing air born sound to one ear, and e.g. a bone-conducting hearing aid at the other ear, or even an implanted system.
- Initially, a desired direction may be determined from at least the device having an antenna with adaptable directionality. This could be achieved e.g. by performing a sweep with antenna so as to emit a signal, such as a beacon signal, or correspondingly receive such a signal. When the desired direction is determined and a wireless link is established or being established, a sensor may provided information on movement of the person carrying the respective device. This could for instance be an accelerometer indicating that the head of the user is turned, tilted or moved in another way. This additional information could help keeping the directionality of the antenna in an optimal direction.
- The antenna having adaptable directionality may have a number of discrete directions that the antenna is able to receive and/or transmit. The antenna having adaptable directionality may have angular limits between which the directionality is definable. The antenna having adaptable directionality may be adaptable both in vertical and/or horizontal directions relative to the wearer.
- In general, the embodiments of the disclosure preferably seeks to mitigate, alleviate or eliminate one or more of the above mentioned disadvantages singly or in any combination. The method according to the second aspect may also be used for aiding a blind-source separation algorithm as detecting the presence of an object may help the algorithm to more quickly separate sources.
- The method as disclosed may be embodied in a computer program product being adapted to enable a computerized system comprising at least one apparatus having data storage means in connection therewith to control a remote object detection unit in an apparatus according to the first aspect of the disclosure.
- The individual features of each aspect may each be combined with any or all features of the other aspects. These and other aspects, features and/or advantages will be apparent from and elucidated with reference to the embodiments described hereinafter.
- The apparatus/method will now be described in more detail with regard to the accompanying figures. The figures illustrates exemplary implementations and is not to be construed as being limiting to other possible embodiments falling within the scope of the attached claim set.
-
FIG. 1 schematically illustrates a hearing aid positioned at an ear of a person, -
FIG. 2 schematically illustrates a head of a user where a hearing aid is placed at a right ear where a remote object detection device scans in an angle of a degrees, -
FIG. 3 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of α degrees, -
FIG. 4 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of β degrees, -
FIG. 5 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of γ degrees, -
FIG. 6 schematically illustrates steps of a method, and -
FIG. 7 is a schematic illustration of two devices each having an adaptable antenna system, -
FIG. 8 schematically illustrates steps for operating a hearing device having an adaptable antenna. - The figures are schematic and simplified for clarity, and they just show details to improve the understanding of the claims, while other details are left out. Throughout, the same reference numerals are used for identical or corresponding parts.
-
FIG. 1 schematically illustrates an apparatus 10 having a housing. The apparatus is positioned at an ear of a person and comprises two parts or housings. One housing is positioned behind the ear, and one housing is positioned at the ear canal or ear canal opening. The two parts or housings are connected by connector. The apparatus illustrated is a hearing aid, but the functionality described herein could also be used in a hand-held microphone, or even in a stationary device, e.g. a conference telephone or device connected to e.g. a TV. - The apparatus 10 comprises a directional microphone system in the housing, which directional microphone system has adaptable directionality. This directional microphone system could for instance be established using two, three or even more, omnidirectional microphones positioned spaced apart by a known distances. By using combinations of the signals from two, three more microphones allows establishment of a directional microphone system. This combination could include delay and/or phase-shift of the signal. The apparatus 10 further comprises a processor for adapting the adaptable directionality of the directional microphone system. This processor performs the needed adaptation of the directionality. The adaptation may include acoustic processing for identifying sound sources. Often hearing aids are equipped with directional microphone system so that sound is picked up from a preferred direction, such as substantially from in front of a person using the hearing aid.
- Sound processing algorithms may be used to track the relative movement of a sound source identified via the directional microphone system. In addition to this, or in the alternative, a remote object detection unit may be employed. The remote object detection unit is configured to detect a remote object, such as a person or an inanimate object, by detecting a transmitted signal which has been reflected from the object. This operation is similar to the operation of a maritime 3 or 10 cm radar; however, at e.g. 79 GHz the wavelength is suitable for small form factor, low-power modules, which may be incorporated in housings to be worn at an ear of a person or held in the hand. Such devices may be incorporated in a 28 nm CMOS RFIC design.
- Advantageously the processor is then adapted to direct the directionality of the directional microphone system based on the detection of the remote object.
- For conserving power, the remote object detection unit detects may be set up to sweep a certain angle interval relative to the housing. In order not to expose the head to excessive electromagnetic power or electromagnetic power over a longer period of time, the remote object detection unit may be configured to sweep an area or angle at certain intervals. The remote object detection unit may be setup for detecting objects according to previously detected object, e.g. if one object has been identified recently, a scheme for sweeping may be adapted accordingly. This scheme could be aimed at detecting new sound sources and/or to maintain the direction of the directional microphone system pointed at the sound source, which may be shifted due to head movements and/or the sound source moving. In environments where multiple people are present, e.g. the classic cocktail party scenario, the remote object detection unit may be used to keep track of possible sound sources, and the directional microphone system and the accompanying audio processing algorithms, may then be used to point out the desired sound target from the identified possible sound sources. This may alleviate the sound processing as less time and processing is used to identify active sound targets.
- Generally, the remote object detection unit may be configured to transmit, and receive, an electromagnetic signal having a carrier frequency within the 1 to 100 GHz frequency range.
- When this remote object detection unit is included in a housing carried by a person, it is possible to determine the speed of a detected remote object, or at least the relative speed of the detected remote object. This could be done using the Doppler effect, which also provides information on the relative movement of the remote object, i.e. closing in or moving away. The determined speed, possibly along with the direction, could be used to determine if imminent danger of collision. This could be advantageous when the user is moving around in a busy environment, such as a city centre with cars, busses, trucks, bicycles and people. A speaker unit could then provide an acoustic signal upon detection of a remote object having a speed above a given threshold, as this could indicate e.g. an approaching vehicle. The remote object detection unit could also be used as a proximity warning system indicating that an object is within a given distance from the user. Combinations of the properties of the remote objects may also be used, e.g. an approaching vehicle having a speed above some threshold within a given distance will cause the speaker to emit a sound. Further, a small vibrational unit may be included in the housing to provide a vibrational sensation at the ear. For binaural systems, that is system with a hearing aid at each ear, it is also possible to provide directionality the warning, so that if something is approaching from the left, a warning is given at the left ear, etc.
- Depending on the resolution level of the remote object detection unit, it is possible to characterise the remote object as one of: a person, a car, a bicycle, a fixed metallic object.
- Overall, the apparatus is described as a hearing aid but could also be a hand-held microphone, a wearable device or a stationary device. An example of a stationary device could be a so-called TV-box.
-
FIG. 2 schematically illustrates a head of a user where a hearing aid is placed at a right ear where a remote object detection device scans in an angle of a degrees. The angle a may be determined by the characteristics of the antenna used. As illustrated inFIG. 4 the angle may be larger than shown inFIG. 1 . -
FIG. 3 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of α degrees. By having two hearing aids each scanning an area the combined area scanned is larger, and thereby the security established for the user. Further, the larger area allows tracking and/or detection of people speaking in front of the user. -
FIG. 4 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of β degrees. Generally the angular restriction could extend backwards of the head so as to allow the directional microphone system to adapt and pick up sounds emanating from behind the user, e.g. a caretaker pushing a wheel chair. -
FIG. 5 schematically illustrates a head of a user where a hearing aid is placed at each ear where each remote object detection device scans in an angle of γ degrees. Each angular section is divided into a number of subsections. The subsections are illustrated as being separated, but in practice there will be some overlap due to the directionality characteristics of the antenna used for the remote object detection unit. As mentioned, the subsections may be scanned consecutively, randomly or according to a fixed scheme. Whichever method is used, the method may be adapted according to which environment the user is in. -
FIG. 6 schematically illustrates steps of a method of operating an apparatus having a directional microphone system having adaptable directionality, a processor for adapting the adaptable directionality of the directional microphone system, and a remote object detection unit configured to detect a remote object. Such an apparatus could be an apparatus as discussed in relation toFIGS. 1-5 . The method comprises a step of transmitting from the remote object detection unit an electromagnetic signal. The method comprises a step of receiving at the remote object detection unit a reflected electromagnetic signal. The remote object detection unit thus emits a signal in a given direction and awaits an echo. This allows detecting an angular direction to the remote object, if present. Further processing and analysis of the echo may provide information on the speed of the remote object, e.g. based on the Doppler Effect. - The directional microphone system may then provide information on whether any detected remote object is an active sound source or not. If active, the directionality of the directional microphone system may be adapted based on the detection of a remote object directional microphone system. Advantageously, the adaptation of the directionality of the directional microphone system may be conditioned on the remote object being classified as a sound source. In the cocktail scenario, one source may be identified as a preferred source and the directional microphone system may be adapted accordingly, even if more active sound sources are identified. A combination of the remote object detection unit and the directional microphone system may be used for identifying remote active sound sources.
- A classification of the remote object may include determining if the remote object is a human or a machine. This could be used for automatically determining if a warning signal should be issued for warning the user of an approaching vehicle.
- The remote object detection unit can be used to detect active and silent remote objects and the directionality of the directional microphone system could be used for scanning the remote objects detected by the remote object detection unit to classify them as active or silent.
- A further use of the knowledge of the direction to a source is to adapt a directional antenna, such as an array antenna comprising two or more smaller antennae elements. The array antenna could comprise two, three, four, five, or more elements.
- This is advantageous in areas where may wireless signals are present, but also, or alternatively, when two devices needs to communicate wirelessly, such as a hearing aid, or binaural hearing aid system, and an external device having an antenna and a microphone.
- Also, in some cases many wireless signal will be present in the same area from different kinds of wireless transmitters and receivers. Interference may cause the wireless link to be lost or degraded.
- For users of hearing aids with wireless link, the loss of wireless link from e.g. a remote microphone will result in a loss of audio packets between the transmitting device and the receiving device, and therefore loss of audibility. For example, for a student wearing a hearing aid linked to a remote microphone of the teacher may have the adverse effect of the student not understanding what the teacher said.
- For a portable device, such as a teacher microphone, the antenna could be positioned at, such as under, a surface intended to face away from the teachers body. This part of a portable device, such as a teacher microphone, could provide a surface having a relatively large area for positioning multiple antenna elements.
- In a hearing aid, e.g. to be positioned in the area behind the users ear, an antenna could be formed at or under a side wall of the hearing aid housing that is configured to be positioned behind the ear of the user, whereas a second part is configured to be positioned in the ear canal, e.g. having a receiver and/or ear mold. Such as configuration is, as described above, often referred to as either a receiver-in-the-ear or behind-the-ear.
- When a, relative, direction from one device towards the other, remotely placed, device is determined, the antenna may be adapted so that the signal transmitted from the antenna is directed towards the other device. Thereby the energy needed to ensure optimal transmission under the given circumstances are provided. This is most relevant for relatively high frequencies, such as around 1-10 GHz, such as around the frequencies used for Bluetooth, WiFi and the like protocols, such as at 2.4 GHz, such as at 5 GHz.
- The determination of the direction may also be used for controlling the adaptable directionality of the microphone. Further, the above-mentioned electromagnetic signal transmission system may be used as at least part of the direction determination.
- The antenna with adaptable directionality could be embodied as an antenna array, or multiple antenna arrays, with smaller radiating elements combined with signal processing and beamforming. The antenna array could e.g. be a line of 2, 3, 4 or more smaller antennae with switchable elements. Alternatively, the antenna array could be e.g. a square with 2×2, 3×3, 4×4 or other combinations of smaller antennae with switchable elements. Further, the antenna array could be e.g. arranged as a rectangle with 2×3, 2×4, 3×4, 3×5, 4×5 or other combinations and/or permutations of smaller antennae with switchable elements.
- A phased array architecture could employ beam steering and forming using RF-phase and/or amplitude shifters, or beam forming networks.
- The adaptation of the antenna may be performed continuously, periodically or event based. Further, adaptation may, in some cases, be performed just prior, and/or during, transmission of data.
-
FIG. 7 schematically illustrates two devices each having an adaptable antenna system. One of the device is to be worn by e.g. a teacher and the other by a student. In other scenarios, one device, e.g. being a hearing aid, is worm by a hearing impaired user, and the other device, e.g. a microphone device, is worn by, or at least positioned near, a person talking that the hearing impaired user wish to hear more clearly, e.g. .a spouse, or someone giving a lecture, or the microphone device could simply be placed on a table during a social event for improved microphone reception. - The microphone device is to be positioned remote from e.g. the hearing aid user, which could be a, young, student in a classroom setting. As the teacher moves around, the wireless link may be disturbed, especially when the antenna is a highly directional antenna. By employing an antenna having an adaptable directionality, a link having a high link quality, e.g. expressed by a low packet loss or the like, may be established and maintained even when the source, or the device having the antenna, is moving or shifting.
- In
FIG. 7 this is illustrated by three antennae elements together forming an antenna array. Both devices are illustrated having the same array, however, the two, or more, devices need not implement the same type or structure. - The head-worn apparatus may include that the device is configured to transmit the detected direction towards the remote device via the wireless to the remote device, and wherein the remote device is configured to adapt the direction of the adaptable antenna based at least in part on the relative direction from the head-worn device.
- It may be advantageous that at least one device in a system is able to include information from the other device when determining how to adapt the directionality of the adaptable antenna. This could increase the efficiency of the system and possibly lower the time needed to establish the desired direction.
- One or more devices of the system may include a positioning device configured to provide a signal representing the position of that device as e.g. a coordinate set in a global coordinate system. Having more devices of the system including such a positioning system could allow for an adaptation of the antenna based on at least two coordinate sets. Other direction indicators may be included, e.g from a radar system in one or more of the devices as disclosed herein.
- One or more of the devices of the system may be configured to transmit a beacon signal that another device of the system may register. This beacon signal may e.g. be used to determine the direction to the device emitting the beacon signal. The determination of the direction may e.g. be based at least in part on determining signal strength of the beacon signal. This could be achieved using an antenna having adaptable directionality.
- Thus, a hearing aid may be provided where the microphone system may be adapted based on a determined direction to a source. Further, an antenna having adaptable directionality may be adapted based on the determined direction to a wireless source. Still further, both a microphone system and an antenna may be adapted based on a determined direction to a source emitting both sound and a wireless signal.
- In a system, e.g. located in a school, a teacher may carry a device with a microphone and a wireless system for broadcasting a signal based on the microphone. One or more students may then have each their hearing aid or aids which each include an adaptable antenna, each of which are configured to determine a direction to the teacher to establish and maintain a wireless connection to be able to receive wirelessly the signal based on the microphone.
- The system may include a stationary unit routing the wireless signal from the teacher, which stationary unit then broadcast a signal to the students respective hearing aids.
- When obtaining, or searching for, a direction, the antenna system may be configured to search a fixed number of directions. This could e.g. be two directions where a signal strength indication is obtained from both directions and the direction having the stronger indication is then chosen. Further numbers of spots or directions may be used. In a situation where e.g. three directions are relied upon, the three directions may form a triangular geometry, seen in a direction directly towards the antenna. This could allow for optimising the directionality in situations where the transmitting antenna is located at an elevated position relative to the receiving antenna, such as a teacher standing in a classroom while the student or students are sitting down.
- Having multiple angles and directions that the antenna is able to transmit and/or receive in allows for greater flexibility.
- In addition to the, relatively, high frequency antenna with adaptable directionality, other types of wireless communication may be available in the hearing aid, such as inductive communication, e.g. a telecoil and/or other inductive systems, e.g. for through-the-head communication.
- In the use case where a signal must reach several hearing devices, e.g. a teacher microphone system transmitting to several students, the directionality pattern should favour the angle of incidence of the several hearing devices. Directionality could also favour the hearing devices that would otherwise have the lowest wireless communication signal-to-noise ratio.
- Some aspects of the present disclosure relates to the following items.
- 1. A head-worn apparatus for enhancing sound perception of a user, the apparatus having a housing adapted to be worn at the head of the user, the head-worn apparatus comprising: a directional microphone system having adaptable directionality, where the directional microphone system comprises a plurality of omnidirectional microphones, a remote object detection unit configured to emit an electromagnetic signal and to detect a remote object by detecting an electromagnetic signal reflected off the object, a processor for adapting the adaptable directionality of the directional microphone system based on the detection of the remote object, wherein the processor is adapted to enhance sound from the object according to the users specific hearing loss.
- 2. The head-worn apparatus according to item 1, wherein the remote object detection unit is configured to transmit an electromagnetic signal having a carrier frequency within the 1 to 100 GHz frequency range.
- 3. The head-worn apparatus according to item 1, wherein the remote object detection unit is configured to determine the speed of the remote object, such as the relative speed of the remote object.
- 4. The head-worn apparatus according to item 3, further comprising a speaker unit, which provides an acoustic signal upon detection of a remote object having a speed above a threshold.
- 5. The head-worn apparatus according to any one of items 1, wherein the remote object detection unit characterises the remote object as one of: a person, a car, a bicycle, a fixed metallic object.
- 6. The head-worn apparatus according to any one of items 1, wherein the apparatus is a hearing aid or a hand-held microphone.
- 7. A hearing aid comprising an input device for receiving a sound signal, a processor for processing the sound signal to compensate for a user's hearing loss, an output transducer for providing the processed signal to the user in a form perceivable as sound, a remote object detection unit for detecting objects remote from the hearing aid by detecting reflections of an electromagnetic signal transmitted from the remote detection unit and reflected by the remote object.
- 8. A method of operating a head-worn apparatus having a directional microphone system having adaptable directionality, a processor for adapting the adaptable directionality of the directional microphone system, and a remote object detection unit configured to detect a remote object, the method comprising: transmitting from the remote object detection unit an electromagnetic signal, receiving at the remote object detection unit a reflected electromagnetic signal, determining whether a remote object is present based on the reflected electromagnetic signal and the relative direction to the remote object, and adapting the directionality of the directional microphone system based on the detection of a remote object.
- 9. The method according to item 8, wherein the apparatus includes a classifying unit for classifying objects as sound or not-sound sources, the adaptation of the directionality of the directional microphone system is conditioned on the remote object being classified as a sound source.
- 10. The method according to item 9, wherein the classification of the remote object includes determining if the remote object is a human or a machine.
- 11. The method according to any one of item 7-10, wherein the directional microphone system is used for identifying remote active sound sources.
- 12. The method according to item 11, wherein the remote object detection unit detects active and silent remote objects and the directionality of the directional microphone system scans the remote objects detected by the remote object detection unit to classify them as active or silent.
- 13. The method according to any one of item 7-12, further comprising: determining speed of remote object, and provided the speed is above a threshold, the method comprises issuing a warning signal.
- As described above, the method may include determining speed of remote object, and provided the speed is above a threshold, the method comprises issuing a warning signal.
- Combinations of the above embodiments and many other embodiments will be apparent to those of skill in the art upon reading and understanding the above description.
- The apparatus and/or method steps as set out in the claims may be implemented by means of hardware, software, firmware or any combination of these. Some of the features could also be implemented as software running on one or more data processors and/or digital signal processors.
- The individual elements of any of the disclosed embodiments may be physically, functionally and logically implemented in any suitable way such as in a single unit, in a plurality of units or as part of separate functional units. It is intended that the structural features of the devices described above, in the detailed description and in the claims may be combined with steps of the method, when appropriately substituted by a corresponding process. Embodiments of the method have the same advantages as the corresponding systems.
- Although the present disclosure discusses specific embodiments, the claims should not be construed as being in any way limited to the presented examples. Although specific embodiments have been illustrated and described herein, it will be appreciated by those of ordinary skill in the art, that any arrangement which is calculated to achieve the same purpose may be substituted for the specific embodiments shown. The scope of protection is defined by the accompanying claim set. In the context of the claims, the terms “comprising” or “comprises” do not exclude other possible elements or steps. Also, the mentioning of references such as “a” or “an” etc. should not be construed as excluding a plurality. The use of reference signs in the claims with respect to elements indicated in the figures shall also not be construed as limiting the scope of the claims. Furthermore, individual features mentioned in different claims, may possibly be advantageously combined, and the mentioning of these features in different claims does not exclude that a combination of features is not possible and advantageous.
Claims (15)
1. A system comprising a head-worn apparatus for enhancing sound perception of a first user and a remotely positioned device configured to be in wireless communication with the head-worn apparatus and to be positioned at a second user,
the head-worn apparatus having a housing adapted to be worn at the head of the user, and an antenna configured to receive a wireless signal from the remotely positioned device, and an output transducer to provide a signal perceived as sound by the second user,
the remotely positioned device comprising:
a microphone system configured to receive ambient sound,
a direction determination system configured to determine a desired direction,
an antenna having adaptable directionality,
a processor for adapting the adaptable directionality of the antenna based on the desired direction, and the processor configured to transmit, via the antenna, a signal based on the ambient sound received via the microphone.
2. The system according to claim 1 , wherein the head-worn device includes a direction determination system configured to determine a desired direction, and further in the head-worn device:
the antenna having adaptable directionality, and
the processor is configured to adapt the adaptable directionality of the antenna based on the desired direction.
3. The system according to claim 1 , wherein the direction determination system comprises a remote object detection unit configured to emit an electromagnetic signal and to detect a remote object by detecting an electromagnetic signal reflected off the object, the desired direction being based on the direction to the detected remote object, and optionally, the direction determination system includes a sensor to detect movement or change of orientation of the head-worn apparatus and/or the remotely positioned device, the sensor optionally being one or more of: a gyroscope, a tilt sensor and/or an accelerometer.
4. The system according to claim 1 , wherein the head-worn and/or the remotely positioned device includes a positioning device configured to provide a signal representing the position of that device as e.g. a coordinate set in a global coordinate system.
5. The system of claim 1 , wherein the head-worn apparatus is configured to transmit the desired direction towards the remote device via the wireless to the remote device, and wherein the remote device is configured to adapt the direction of the adaptable directionality of the antenna based at least in part on the relative direction from the head-worn device.
6. A system comprising a head-worn apparatus for enhancing sound perception of a first user and a remotely positioned device configured to be in wireless communication with the head-worn apparatus and to be positioned at a second user,
the head-worn apparatus having a housing adapted to be worn at the head of the user, and an antenna configured to receive a wireless signal from the remotely positioned device, and an output transducer to provide a signal perceived as sound by the second user,
a direction determination system configured to determine a desired direction,
an antenna having adaptable directionality,
a processor configured to adapt the adaptable directionality of the antenna based on the desired direction, and
the remotely positioned device comprising:
a microphone system configured to receive ambient sound,
an antenna configured to emit and/or receive an electromagnetic signal, and
a processor configured to transmit, via the antenna, a signal based on the ambient sound received via the microphone.
7. The system of claim 6 , wherein the remotely positioned device includes a direction determination system configured to determine a desired direction,
the antenna having adaptable directionality, and
the processor is configured to adapt the adaptable directionality of the antenna based on the desired direction.
8. The system according to claim 6 , wherein the direction determination system comprises a remote object detection unit configured to emit an electromagnetic signal and to detect a remote object by detecting an electromagnetic signal reflected off the object, the desired direction being based on the direction to the detected remote object, and optionally, the direction determination system includes a sensor to detect movement or change of orientation of the head-worn apparatus and/or the remotely positioned device, the sensor optionally being one or more of: a gyroscope, a tilt sensor and/or an accelerometer.
9. The system of claim 6 , wherein the head-worn apparatus is configured to transmit the desired direction towards the remote device via the wireless to the remote device, and wherein the remote device is configured to adapt the direction of the adaptable directionality of the antenna based at least in part on the relative direction from the head-worn device.
10. The system according to claim 6 , wherein the head-worn and/or the remotely positioned device includes a positioning device configured to provide a signal representing the position of that device as e.g. a coordinate set in a global coordinate system.
11. The system according to claim 6 , wherein the head-worn and/or the remotely positioned device is/are configured to transmit a beacon signal.
12. The system according to claim 8 , wherein the remote object detection unit is configured to transmit an electromagnetic signal having a carrier frequency within the 1 to 100 GHz frequency range.
13. A head-worn apparatus, such as a hearing aid, having a housing adapted to be worn at the head of a user, and an antenna configured to receive a wireless signal from the remotely positioned device, and an output transducer to provide a signal perceived as sound by the user,
a direction determination system configured to determine a desired direction,
an antenna having adaptable directionality,
a processor configured to adapt the adaptable directionality of the antenna based on the desired direction.
14. The head-worn apparatus of claim 13 , wherein the direction determination system comprises a remote object detection unit configured to emit an electromagnetic signal and to detect a remote object by detecting an electromagnetic signal reflected off the object, the desired direction being based on the direction to the detected remote object.
15. The head-worn apparatus of claim 13 , wherein the direction determination system includes a sensor to detect movement or change of orientation of the head-worn apparatus, the sensor optionally being one or more of: a gyroscope, a tilt sensor and/or an accelerometer.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/727,135 US10244300B2 (en) | 2014-04-30 | 2017-10-06 | Instrument with remote object detection unit |
Applications Claiming Priority (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP14166645.3A EP2941019B1 (en) | 2014-04-30 | 2014-04-30 | Hearing aid with remote object detection unit |
EP14166645.3 | 2014-04-30 | ||
EP14166645 | 2014-04-30 | ||
US14/699,060 US9813825B2 (en) | 2014-04-30 | 2015-04-29 | Instrument with remote object detection unit |
EP17195126.2A EP3468229A1 (en) | 2017-10-06 | 2017-10-06 | Instrument with remote object detection unit |
US15/727,135 US10244300B2 (en) | 2014-04-30 | 2017-10-06 | Instrument with remote object detection unit |
EP17195126.2 | 2017-10-06 | ||
EP17195126 | 2017-10-06 |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/699,060 Continuation-In-Part US9813825B2 (en) | 2014-04-30 | 2015-04-29 | Instrument with remote object detection unit |
Publications (2)
Publication Number | Publication Date |
---|---|
US20180035195A1 true US20180035195A1 (en) | 2018-02-01 |
US10244300B2 US10244300B2 (en) | 2019-03-26 |
Family
ID=61010461
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/727,135 Active US10244300B2 (en) | 2014-04-30 | 2017-10-06 | Instrument with remote object detection unit |
Country Status (1)
Country | Link |
---|---|
US (1) | US10244300B2 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110223686A (en) * | 2019-05-31 | 2019-09-10 | 联想(北京)有限公司 | Audio recognition method, speech recognition equipment and electronic equipment |
CN110772239A (en) * | 2019-10-18 | 2020-02-11 | 南京科思尼克智能科技有限公司 | Non-contact physiological sign monitoring system |
US10798499B1 (en) | 2019-03-29 | 2020-10-06 | Sonova Ag | Accelerometer-based selection of an audio source for a hearing device |
US11086311B2 (en) | 2016-05-09 | 2021-08-10 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for data collection having intelligent data collection bands |
US11126173B2 (en) | 2017-08-02 | 2021-09-21 | Strong Force Iot Portfolio 2016, Llc | Data collection systems having a self-sufficient data acquisition box |
US11221613B2 (en) | 2016-05-09 | 2022-01-11 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for noise detection and removal in a motor |
US11432083B2 (en) * | 2019-10-09 | 2022-08-30 | Oticon A/S | Hearing aid battery connected to ear shell |
US11774944B2 (en) | 2016-05-09 | 2023-10-03 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for the industrial internet of things |
US12140930B2 (en) | 2016-05-09 | 2024-11-12 | Strong Force Iot Portfolio 2016, Llc | Method for determining service event of machine from sensor data |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120008807A1 (en) * | 2009-12-29 | 2012-01-12 | Gran Karl-Fredrik Johan | Beamforming in hearing aids |
US20120274502A1 (en) * | 2011-04-29 | 2012-11-01 | Searete Llc | Personal electronic device with a micro-impulse radar |
US20120280824A1 (en) * | 2011-05-02 | 2012-11-08 | Eric Allen Zelepugas | Audio awareness apparatus, system, and method of using the same |
US20130023954A1 (en) * | 2011-07-19 | 2013-01-24 | Cochlear Limited | Implantable Remote Control |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4586195A (en) | 1984-06-25 | 1986-04-29 | Siemens Corporate Research & Support, Inc. | Microphone range finder |
US5617102A (en) | 1994-11-18 | 1997-04-01 | At&T Global Information Solutions Company | Communications transceiver using an adaptive directional antenna |
US20030154017A1 (en) | 1996-09-25 | 2003-08-14 | Ellis Christ G. | Apparatus and method for vehicle counting, tracking and tagging |
JP4016826B2 (en) | 2002-12-10 | 2007-12-05 | 株式会社デンソー | Object labeling method and apparatus, program |
US20040175008A1 (en) | 2003-03-07 | 2004-09-09 | Hans-Ueli Roeck | Method for producing control signals, method of controlling signal and a hearing device |
US7738666B2 (en) * | 2006-06-01 | 2010-06-15 | Phonak Ag | Method for adjusting a system for providing hearing assistance to a user |
ATE473603T1 (en) | 2007-04-17 | 2010-07-15 | Harman Becker Automotive Sys | ACOUSTIC LOCALIZATION OF A SPEAKER |
NL1037342C2 (en) | 2009-10-02 | 2011-04-05 | Inventor Invest Holding B V | SECURITY SYSTEM AND METHOD FOR PROTECTING AN AREA. |
WO2012093345A1 (en) | 2011-01-05 | 2012-07-12 | Koninklijke Philips Electronics N.V. | An audio system and method of operation therefor |
DK2941019T3 (en) | 2014-04-30 | 2019-11-25 | Oticon As | Hearing aid with remote object detection device |
EP3057340B1 (en) | 2015-02-13 | 2019-05-22 | Oticon A/s | A partner microphone unit and a hearing system comprising a partner microphone unit |
US10321245B2 (en) | 2016-03-15 | 2019-06-11 | Starkey Laboratories, Inc. | Adjustable elliptical polarization phasing and amplitude weighting for a hearing instrument |
-
2017
- 2017-10-06 US US15/727,135 patent/US10244300B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120008807A1 (en) * | 2009-12-29 | 2012-01-12 | Gran Karl-Fredrik Johan | Beamforming in hearing aids |
US20120274502A1 (en) * | 2011-04-29 | 2012-11-01 | Searete Llc | Personal electronic device with a micro-impulse radar |
US20120280824A1 (en) * | 2011-05-02 | 2012-11-08 | Eric Allen Zelepugas | Audio awareness apparatus, system, and method of using the same |
US20130023954A1 (en) * | 2011-07-19 | 2013-01-24 | Cochlear Limited | Implantable Remote Control |
Cited By (79)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11392109B2 (en) | 2016-05-09 | 2022-07-19 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for data collection in an industrial refining environment with haptic feedback and data storage control |
US11353851B2 (en) | 2016-05-09 | 2022-06-07 | Strong Force Iot Portfolio 2016, Llc | Systems and methods of data collection monitoring utilizing a peak detection circuit |
US11137752B2 (en) | 2016-05-09 | 2021-10-05 | Strong Force loT Portfolio 2016, LLC | Systems, methods and apparatus for data collection and storage according to a data storage profile |
US11169511B2 (en) | 2016-05-09 | 2021-11-09 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for network-sensitive data collection and intelligent process adjustment in an industrial environment |
US12282837B2 (en) | 2016-05-09 | 2025-04-22 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for processing data collected in an industrial environment using neural networks |
US12259711B2 (en) | 2016-05-09 | 2025-03-25 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for the industrial internet of things |
US12244359B2 (en) | 2016-05-09 | 2025-03-04 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for monitoring pumps and fans |
US11181893B2 (en) | 2016-05-09 | 2021-11-23 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for data communication over a plurality of data paths |
US11194319B2 (en) | 2016-05-09 | 2021-12-07 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for data collection in a vehicle steering system utilizing relative phase detection |
US11194318B2 (en) | 2016-05-09 | 2021-12-07 | Strong Force Iot Portfolio 2016, Llc | Systems and methods utilizing noise analysis to determine conveyor performance |
US11221613B2 (en) | 2016-05-09 | 2022-01-11 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for noise detection and removal in a motor |
US11243528B2 (en) | 2016-05-09 | 2022-02-08 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for data collection utilizing adaptive scheduling of a multiplexer |
US11243522B2 (en) | 2016-05-09 | 2022-02-08 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial Internet of Things data collection environment with intelligent data collection and equipment package adjustment for a production line |
US11243521B2 (en) | 2016-05-09 | 2022-02-08 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for data collection in an industrial environment with haptic feedback and data communication and bandwidth control |
US11256243B2 (en) | 2016-05-09 | 2022-02-22 | Strong Force loT Portfolio 2016, LLC | Methods and systems for detection in an industrial Internet of Things data collection environment with intelligent data collection and equipment package adjustment for fluid conveyance equipment |
US11256242B2 (en) | 2016-05-09 | 2022-02-22 | Strong Force Iot Portfolio 2016, Llc | Methods and systems of chemical or pharmaceutical production line with self organizing data collectors and neural networks |
US11262737B2 (en) | 2016-05-09 | 2022-03-01 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for monitoring a vehicle steering system |
US11269319B2 (en) | 2016-05-09 | 2022-03-08 | Strong Force Iot Portfolio 2016, Llc | Methods for determining candidate sources of data collection |
US11281202B2 (en) | 2016-05-09 | 2022-03-22 | Strong Force Iot Portfolio 2016, Llc | Method and system of modifying a data collection trajectory for bearings |
US11307565B2 (en) | 2016-05-09 | 2022-04-19 | Strong Force Iot Portfolio 2016, Llc | Method and system of a noise pattern data marketplace for motors |
US11327475B2 (en) | 2016-05-09 | 2022-05-10 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for intelligent collection and analysis of vehicle data |
US11334063B2 (en) | 2016-05-09 | 2022-05-17 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for policy automation for a data collection system |
US11340589B2 (en) | 2016-05-09 | 2022-05-24 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial Internet of Things data collection environment with expert systems diagnostics and process adjustments for vibrating components |
US11347215B2 (en) | 2016-05-09 | 2022-05-31 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial internet of things data collection environment with intelligent management of data selection in high data volume data streams |
US11347206B2 (en) | 2016-05-09 | 2022-05-31 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for data collection in a chemical or pharmaceutical production process with haptic feedback and control of data communication |
US11347205B2 (en) | 2016-05-09 | 2022-05-31 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for network-sensitive data collection and process assessment in an industrial environment |
US11353850B2 (en) | 2016-05-09 | 2022-06-07 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for data collection and signal evaluation to determine sensor status |
US11353852B2 (en) | 2016-05-09 | 2022-06-07 | Strong Force Iot Portfolio 2016, Llc | Method and system of modifying a data collection trajectory for pumps and fans |
US11397422B2 (en) | 2016-05-09 | 2022-07-26 | Strong Force Iot Portfolio 2016, Llc | System, method, and apparatus for changing a sensed parameter group for a mixer or agitator |
US11360459B2 (en) | 2016-05-09 | 2022-06-14 | Strong Force Iot Portfolio 2016, Llc | Method and system for adjusting an operating parameter in a marginal network |
US11366455B2 (en) | 2016-05-09 | 2022-06-21 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for optimization of data collection and storage using 3rd party data from a data marketplace in an industrial internet of things environment |
US11366456B2 (en) | 2016-05-09 | 2022-06-21 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial internet of things data collection environment with intelligent data management for industrial processes including analog sensors |
US11372394B2 (en) | 2016-05-09 | 2022-06-28 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial internet of things data collection environment with self-organizing expert system detection for complex industrial, chemical process |
US11372395B2 (en) | 2016-05-09 | 2022-06-28 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial Internet of Things data collection environment with expert systems diagnostics for vibrating components |
US11378938B2 (en) | 2016-05-09 | 2022-07-05 | Strong Force Iot Portfolio 2016, Llc | System, method, and apparatus for changing a sensed parameter group for a pump or fan |
US11385623B2 (en) | 2016-05-09 | 2022-07-12 | Strong Force Iot Portfolio 2016, Llc | Systems and methods of data collection and analysis of data from a plurality of monitoring devices |
US11385622B2 (en) | 2016-05-09 | 2022-07-12 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for characterizing an industrial system |
US11392111B2 (en) | 2016-05-09 | 2022-07-19 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for intelligent data collection for a production line |
US11119473B2 (en) | 2016-05-09 | 2021-09-14 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for data collection and processing with IP front-end signal conditioning |
US11086311B2 (en) | 2016-05-09 | 2021-08-10 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for data collection having intelligent data collection bands |
US11774944B2 (en) | 2016-05-09 | 2023-10-03 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for the industrial internet of things |
US11397421B2 (en) | 2016-05-09 | 2022-07-26 | Strong Force Iot Portfolio 2016, Llc | Systems, devices and methods for bearing analysis in an industrial environment |
US11402826B2 (en) | 2016-05-09 | 2022-08-02 | Strong Force Iot Portfolio 2016, Llc | Methods and systems of industrial production line with self organizing data collectors and neural networks |
US11409266B2 (en) | 2016-05-09 | 2022-08-09 | Strong Force Iot Portfolio 2016, Llc | System, method, and apparatus for changing a sensed parameter group for a motor |
US11415978B2 (en) | 2016-05-09 | 2022-08-16 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for enabling user selection of components for data collection in an industrial environment |
US12237873B2 (en) | 2016-05-09 | 2025-02-25 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for balancing remote oil and gas equipment |
US12191926B2 (en) | 2016-05-09 | 2025-01-07 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial internet of things data collection environment with noise detection and system response for vibrating components |
US12140930B2 (en) | 2016-05-09 | 2024-11-12 | Strong Force Iot Portfolio 2016, Llc | Method for determining service event of machine from sensor data |
US12099911B2 (en) | 2016-05-09 | 2024-09-24 | Strong Force loT Portfolio 2016, LLC | Systems and methods for learning data patterns predictive of an outcome |
US11493903B2 (en) | 2016-05-09 | 2022-11-08 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for a data marketplace in a conveyor environment |
US11507064B2 (en) | 2016-05-09 | 2022-11-22 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for industrial internet of things data collection in downstream oil and gas environment |
US11507075B2 (en) | 2016-05-09 | 2022-11-22 | Strong Force Iot Portfolio 2016, Llc | Method and system of a noise pattern data marketplace for a power station |
US11573558B2 (en) | 2016-05-09 | 2023-02-07 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for sensor fusion in a production line environment |
US11586181B2 (en) | 2016-05-09 | 2023-02-21 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for adjusting process parameters in a production environment |
US11586188B2 (en) | 2016-05-09 | 2023-02-21 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for a data marketplace for high volume industrial processes |
US11609552B2 (en) | 2016-05-09 | 2023-03-21 | Strong Force Iot Portfolio 2016, Llc | Method and system for adjusting an operating parameter on a production line |
US11609553B2 (en) | 2016-05-09 | 2023-03-21 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for data collection and frequency evaluation for pumps and fans |
US11646808B2 (en) | 2016-05-09 | 2023-05-09 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for adaption of data storage and communication in an internet of things downstream oil and gas environment |
US11663442B2 (en) | 2016-05-09 | 2023-05-30 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial Internet of Things data collection environment with intelligent data management for industrial processes including sensors |
US11728910B2 (en) | 2016-05-09 | 2023-08-15 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial internet of things data collection environment with expert systems to predict failures and system state for slow rotating components |
US11755878B2 (en) | 2016-05-09 | 2023-09-12 | Strong Force Iot Portfolio 2016, Llc | Methods and systems of diagnosing machine components using analog sensor data and neural network |
US11770196B2 (en) | 2016-05-09 | 2023-09-26 | Strong Force TX Portfolio 2018, LLC | Systems and methods for removing background noise in an industrial pump environment |
US12079701B2 (en) | 2016-05-09 | 2024-09-03 | Strong Force Iot Portfolio 2016, Llc | System, methods and apparatus for modifying a data collection trajectory for conveyors |
US12039426B2 (en) | 2016-05-09 | 2024-07-16 | Strong Force Iot Portfolio 2016, Llc | Methods for self-organizing data collection, distribution and storage in a distribution environment |
US11791914B2 (en) | 2016-05-09 | 2023-10-17 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial Internet of Things data collection environment with a self-organizing data marketplace and notifications for industrial processes |
US11797821B2 (en) | 2016-05-09 | 2023-10-24 | Strong Force Iot Portfolio 2016, Llc | System, methods and apparatus for modifying a data collection trajectory for centrifuges |
US11836571B2 (en) | 2016-05-09 | 2023-12-05 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for enabling user selection of components for data collection in an industrial environment |
US11838036B2 (en) | 2016-05-09 | 2023-12-05 | Strong Force Iot Portfolio 2016, Llc | Methods and systems for detection in an industrial internet of things data collection environment |
US11996900B2 (en) | 2016-05-09 | 2024-05-28 | Strong Force Iot Portfolio 2016, Llc | Systems and methods for processing data collected in an industrial environment using neural networks |
US11397428B2 (en) | 2017-08-02 | 2022-07-26 | Strong Force Iot Portfolio 2016, Llc | Self-organizing systems and methods for data collection |
US11442445B2 (en) | 2017-08-02 | 2022-09-13 | Strong Force Iot Portfolio 2016, Llc | Data collection systems and methods with alternate routing of input channels |
US11175653B2 (en) | 2017-08-02 | 2021-11-16 | Strong Force Iot Portfolio 2016, Llc | Systems for data collection and storage including network evaluation and data storage profiles |
US11144047B2 (en) | 2017-08-02 | 2021-10-12 | Strong Force Iot Portfolio 2016, Llc | Systems for data collection and self-organizing storage including enhancing resolution |
US11126173B2 (en) | 2017-08-02 | 2021-09-21 | Strong Force Iot Portfolio 2016, Llc | Data collection systems having a self-sufficient data acquisition box |
US10798499B1 (en) | 2019-03-29 | 2020-10-06 | Sonova Ag | Accelerometer-based selection of an audio source for a hearing device |
CN110223686A (en) * | 2019-05-31 | 2019-09-10 | 联想(北京)有限公司 | Audio recognition method, speech recognition equipment and electronic equipment |
US11778395B2 (en) | 2019-10-09 | 2023-10-03 | Oticon A/S | Hearing aid battery connected to ear shell |
US11432083B2 (en) * | 2019-10-09 | 2022-08-30 | Oticon A/S | Hearing aid battery connected to ear shell |
CN110772239A (en) * | 2019-10-18 | 2020-02-11 | 南京科思尼克智能科技有限公司 | Non-contact physiological sign monitoring system |
Also Published As
Publication number | Publication date |
---|---|
US10244300B2 (en) | 2019-03-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10244300B2 (en) | Instrument with remote object detection unit | |
EP3566468B1 (en) | Microphone assembly to be worn at a user's chest | |
KR101320209B1 (en) | Self steering directional loud speakers and a method of operation thereof | |
US9813825B2 (en) | Instrument with remote object detection unit | |
KR101491582B1 (en) | Tracking an object in augmented reality | |
EP2643983B1 (en) | Hearing assistance system and method | |
US8817578B2 (en) | Sonic wave output device, voice communication device, sonic wave output method and program | |
EP3582511A2 (en) | Directional sound modification | |
US20160161595A1 (en) | Narrowcast messaging system | |
US20160161594A1 (en) | Swarm mapping system | |
US20100278012A1 (en) | Human echolocation system | |
WO2021227571A1 (en) | Smart device, and method and system for controlling smart speaker | |
US12052545B2 (en) | Hearing aid system integrable in an eyeglass frame | |
EP2736272A1 (en) | Wearable microphone array apparatus | |
CN107276706A (en) | A kind of directive property source of sound broadcast system based on UWB | |
US9390713B2 (en) | Systems and methods for filtering sound in a defined space | |
US20070165866A1 (en) | Method and apparatus to facilitate conveying audio content | |
US9255982B2 (en) | Apparatus and method for the binaural reproduction of audio sonar signals | |
EP3468229A1 (en) | Instrument with remote object detection unit | |
CN207039828U (en) | A kind of earphone with source of sound identification and positioning | |
TWI687104B (en) | Directional sound playing system and method | |
EP4411417A1 (en) | A method of assisting a visually impaired user | |
WO2019229657A1 (en) | Directional multi channel adaptive beamforming loud-speaker system | |
CN112188363B (en) | Audio playing control method and device, electronic equipment and readable storage medium | |
KR20240113296A (en) | System for setting channel automatically of untact typed speaker |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |