US20140288930A1 - Voice recognition device and voice recognition method - Google Patents

Voice recognition device and voice recognition method Download PDF

Info

Publication number
US20140288930A1
US20140288930A1 US14/068,087 US201314068087A US2014288930A1 US 20140288930 A1 US20140288930 A1 US 20140288930A1 US 201314068087 A US201314068087 A US 201314068087A US 2014288930 A1 US2014288930 A1 US 2014288930A1
Authority
US
United States
Prior art keywords
voice recognition
microphone
controller
external device
contents
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US14/068,087
Other versions
US9147396B2 (en
Inventor
Junichi Kotani
Tomohiro Koganei
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Corp filed Critical Panasonic Corp
Assigned to PANASONIC CORPORATION reassignment PANASONIC CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KOTANI, JUNICHI, KOGANEI, TOMOHIRO
Publication of US20140288930A1 publication Critical patent/US20140288930A1/en
Assigned to PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD. reassignment PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PANASONIC CORPORATION
Priority to US14/828,634 priority Critical patent/US9520132B2/en
Application granted granted Critical
Publication of US9147396B2 publication Critical patent/US9147396B2/en
Assigned to PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD. reassignment PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD. CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED APPLICATION NUMBERS 13/384239, 13/498734, 14/116681 AND 14/301144 PREVIOUSLY RECORDED ON REEL 034194 FRAME 0143. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Assignors: PANASONIC CORPORATION
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/08—Mouthpieces; Microphones; Attachments therefor

Definitions

  • the present disclosure relates to a voice recognition device and a voice recognition method.
  • Unexamined Japanese Patent Publication No. 2011-118822 discloses a television device. This television device collects surrounding sound. The television device receives an audio signal from a mobile phone. The television device extracts an operation instruction based on an audio signal based on the collected voice and the received audio signal.
  • An object of the present disclosure is to provide a voice recognition device that controls its own device by accepting a designation made by voice from a user, wherein even in a situation in which voice recognition cannot be accurately performed, an alternative means can be recommended for the user.
  • the voice recognition device includes a communication interface that communicates with an external device, a first microphone that collects sound to produce audio data, and a controller that analyzes the audio data produced by the first microphone, determines contents of a designation corresponding to an analysis result, and then controls its own device based on a determination result, and yet controls its own device to urge a user to use the external device when the contents of the designation corresponding to the analysis result cannot be determined.
  • a voice recognition method includes communicating with an external device, collecting sound to produce audio data, analyzing the audio data to determine contents of a designation corresponding to an analysis result, and then controlling the device based on a determination result, and yet, urging a user to use the external device when the contents of the designation corresponding to the analysis result cannot be determined.
  • a voice recognition device that controls its own device by accepting a designation made by voice from a user, and can recommend an alternative means to the user even in a situation in which voice recognition cannot be accurately performed.
  • FIG. 1 is a block diagram for explaining an electric configuration of an entire system
  • FIG. 2 is a flow chart for explaining an initial operation of a television device when the device is turned on;
  • FIG. 3 is a flow chart for explaining an operation of the television device when an operation designation is accepted by voice
  • FIG. 4 is a schematic diagram for explaining an example of a display screen of the television device
  • FIG. 5 is a flow chart for explaining an operation of the television device when a designation is accepted by acquiring audio data from an external device;
  • FIG. 6 is a flow chart for explaining an operation of a television device according to another embodiment.
  • FIG. 7 is a schematic diagram for explaining an example of a display screen of the television device according to the other embodiment.
  • FIG. 1 is a block diagram showing an electric configuration of the system according to the embodiment.
  • the system according to the present embodiment includes television device 100 and mobile terminal 200 .
  • Television device 100 includes microphone 103 .
  • Television device 100 accepts a designation by voice from a user through microphone 103 .
  • Television device 100 analyzes the voice accepted from the user, determines contents of the designation corresponding to an analysis result, and controls its own device based on a determination result.
  • television device 100 may not be able to accurately determine the contents of the designation from the user.
  • television device 100 includes communication interface 108 , microphone 103 , and controller 105 .
  • Communication interface 108 communicates with mobile terminal 200 .
  • Microphone 103 collects sound to produce audio data.
  • Controller 105 analyzes the audio data produced by microphone 103 , determines contents of a designation corresponding to an analysis result, and controls its own device based on a determination result. When the contents of the designation corresponding to the analysis result cannot be determined, controller 105 controls its own device to urge a user to use mobile terminal 200 .
  • television device 100 can recommend an alternative means for a user even in a situation in which voice recognition cannot be accurately performed.
  • the system according to the present embodiment includes television device 100 and mobile terminal 200 .
  • Television device 100 includes antenna 101 , tuner 102 , microphone 103 , A/D converter 104 , controller 105 , monitor 106 , memory 107 , and communication interface 108 .
  • Antenna 101 receives digital broadcasting.
  • Tuner 102 extracts digital broadcasting of a channel selected by a user from digital broadcasting received through antenna 101 .
  • Tuner 102 produces a video stream based on the extracted digital broadcasting.
  • Microphone 103 collects sound surrounding television device 100 and converts the sound into an analog audio signal.
  • A/D converter 104 amplifies the audio signal input from microphone 103 and converts the audio signal into digital audio data.
  • Controller 105 is a control unit that controls the whole of television device 100 .
  • controller 105 is configured by a semiconductor chip.
  • Controller 105 performs various processing on the video stream acquired from tuner 102 and the digital audio data acquired from A/D converter 104 .
  • controller 105 performs decoding processing to the video stream acquired from tuner 102 .
  • Controller 105 executes echo cancellation serving as processing of removing an audio component output from a loudspeaker (not shown) built in television device 100 on the digital audio data acquired from A/D converter 104 .
  • Controller 105 executes digital filter processing serving as processing of removing noise on the digital audio data acquired from A/D converter 104 .
  • Controller 105 analyzes the digital audio data to which echo cancellation and the digital filter processing are executed, and executes voice recognition processing to determine contents of a designation corresponding to an analysis result. For example, controller 105 determines whether the designation corresponding to the analysis result is a designation to switch channels of television device 100 , a designation for volume adjustment, or a designation to input a character string of a search keyword on a Web browser.
  • Monitor 106 displays an image represented by decoded image data acquired from controller 105 .
  • monitor 106 is configured by a liquid crystal panel.
  • Memory 107 stores various pieces of information therein.
  • memory 107 is configured by a flash memory.
  • Memory 107 stores, for example, a control program to control the whole of television device 100 and dictionary data used in the voice recognition processing.
  • the dictionary data mentioned herein is a set of typical audio data representing various designations to television device 100 .
  • Controller 105 calculates a degree of similarity between audio data produced based on voice input by a user and audio data included in the dictionary data. Controller 105 executes voice recognition processing if determined that a designation having a high degree of similarity is made by a user.
  • Communication interface 108 establishes communication with mobile terminal 200 to transmit/receive data.
  • communication interface 108 is configured by a Wi-Fi (registered trademark) module.
  • the mobile terminal 200 includes microphone 201 , controller 202 , phone-call interface 203 , loudspeaker 204 , and communication interface 205 .
  • Microphone 201 collects sound surrounding mobile terminal 200 and produces digital audio data.
  • Controller 202 is a control unit that controls the whole of mobile terminal 200 .
  • controller 202 is configured by a semiconductor chip.
  • Phone-call interface 203 is a module to communicate via telephone with a telephone base station.
  • phone-call interface 203 is configured by a 3G communication module.
  • Loudspeaker 204 outputs sound.
  • a user inputs voice through microphone 201 during telephone communication and listens to voice output by an intended party through loudspeaker 204 .
  • Communication interface 205 establishes communication with television device 100 to transmit/receive data.
  • communication interface 108 is configured by a Wi-Fi (registered trademark) module.
  • FIG. 2 is a flow chart for explaining the operation in an active state of television device 100 .
  • Controller 105 When the power supply of television device 100 is turned on, controller 105 is activated. When controller 105 is activated, control of the flow chart shown in FIG. 2 is started. Controller 105 specifies a communication method by which television device 100 is connected to mobile terminal 200 through communication interface 108 (S 11 ). For example, controller 105 specifies whether a connection method between television device 100 and mobile terminal 200 is a connection method by a wireless LAN, a connection method by a wired LAN, or the like.
  • controller 105 When the communication method is specified, controller 105 performs an inquiry to mobile terminal 200 whether television device 100 can be designated by using microphone 201 (S 12 ). More specifically, controller 105 performs an inquiry to mobile terminal 200 whether a voice recognition application is installed in mobile terminal 200 or about basic information or the like of mobile terminal 200 .
  • the voice recognition application herein is an application that, when a voice input is accepted, produces digital audio data from the acquired voice, transmits the produced digital audio data to a host device such as television device 100 , and causes the host device to perform voice recognition.
  • the basic information of mobile terminal 200 includes a machine name of mobile terminal 200 , an IP address, a MAC address, information representing a format of digital audio data transmitted by mobile terminal 200 , and the like.
  • controller 105 determines whether mobile terminal 200 notifies television device 100 of a designation by using microphone 201 (S 13 ). For example, when a voice recognition application is installed in mobile terminal 200 , controller 105 determines that television device 100 can be notified of the instruction by using microphone 201 .
  • controller 105 stores the basic information of mobile terminal 200 and information representing that television device 100 can be notified of the designation by using microphone 201 in memory 107 (S 14 ).
  • controller 105 stores the basic information of mobile terminal 200 and information representing that television device 100 cannot be notified of the designation by using microphone 201 in memory 107 (S 15 ).
  • controller 105 determines whether there is an external device that has not been confirmed (S 16 ). When the presence of all the external devices are confirmed (No in step S 16 ), controller 105 drops out of the processing in the flow chart in FIG. 2 . On the other hand, when it is determined that there is an external device that has not been confirmed (Yes in step S 16 ), controller 105 repeats the processing subsequent to step S 11 . [1-3-2. Operation Performed upon Acceptance of Designation by Voice]
  • FIG. 3 is a flow chart for explaining an operation of television device 100 when a designation is accepted by voice from a user.
  • FIG. 4 is a schematic diagram for explaining an example of a display screen of television device 100 .
  • FIG. 5 is a flow chart for explaining an operation of television device 100 when a designation is accepted by acquiring audio data from mobile terminal 200 .
  • controller 105 determines whether voice recognition can be sufficiently performed (S 21 ). More specifically, controller 105 compares digital audio data acquired through microphone 103 with various audio data included in the dictionary data stored in memory 107 to determine whether there is audio data that is similar to the various audio data at a predetermined level or more or to determine whether the volume of digital audio data acquired through microphone 103 is a predetermined level or more.
  • controller 105 determines whether digital audio data serving as an object of voice recognition is acquired through microphone 103 (S 22 ).
  • controller 105 determines whether an external device in which a microphone can be used is present around controller 105 (S 23 ). More specifically, controller 105 refers to information stored in memory 107 and representing that television device 100 can be notified of a designation by using a microphone to determine whether an external device in which a microphone can be used is present around controller 105 .
  • controller 105 controls monitor 106 to display a screen that urges a user to use the external device (S 24 ). More specifically, monitor 106 displays a screen as shown in FIG. 4 .
  • controller 105 switches modes of mobile terminal 200 such that television device 100 can be notified of a designation through microphone 201 (S 25 ). For example, controller 105 notifies mobile terminal 200 of a command to activate the voice recognition application installed in mobile terminal 200 through communication interface 108 .
  • television device 100 consequently waits until television device 100 accepts a designation by audio data from mobile terminal 200 .
  • processing according to the flow chart shown in FIG. 5 is started.
  • Controller 105 acquires digital audio data from mobile terminal 200 through communication interface 108 (S 31 ). When the digital audio data is acquired, controller 105 executes voice recognition processing on the acquired digital audio data (S 32 ). When the voice recognition processing is executed, controller 105 determines whether the voice recognition can be sufficiently executed (S 33 ). More specifically, controller 105 analyzes the acquired digital audio data to determine whether contents of a designation corresponding to an analysis result can be determined.
  • controller 105 controls television device 100 to perform an operation according to contents of a designation corresponding a determined analysis result (S 34 ).
  • controller 105 controls monitor 106 to display a screen so as to urge a user to input voice again (S 35 ).
  • television device 100 includes communication interface 108 , microphone 103 , and controller 105 .
  • Communication interface 108 communicates with mobile terminal 200 .
  • Microphone 103 collects sound to produce audio data.
  • Controller 105 analyzes the audio data produced by microphone 103 , determines contents of a designation corresponding to an analysis result, and controls its own device based on a determination result. When the contents of the designation corresponding to the analysis result cannot be determined, controller 105 controls its own device to urge a user to use mobile terminal 200 .
  • television device 100 can recommend an alternative means for a user to input a designation with mobile terminal 200 even in a situation in which voice recognition cannot be accurately performed.
  • Mobile terminal 200 includes microphone 201 .
  • controller 105 controls television device 100 to urge a user to use microphone 201 .
  • television device 100 can recommend an alternative means for a user to input a designation with microphone 201 provided in mobile terminal 200 even in a situation in which voice recognition cannot be accurately performed.
  • Television device 100 further includes monitor 106 that displays an image.
  • controller 105 controls monitor 106 to display a message to urge a user to use mobile terminal 200 .
  • television device 100 can visually recommend an alternative means for a user to input a designation with microphone 201 provided in mobile terminal 200 even in a situation in which voice recognition cannot be accurately performed.
  • controller 105 controls communication interface 108 to transmit a command to mobile terminal 200 for setting mobile terminal 200 to a mode in which microphone 201 can be used.
  • television device 100 can automatically activate mobile terminal 200 while recommending an alternative means for a user to input a designation with microphone 201 provided in mobile terminal 200 , even in a situation in which voice recognition cannot be accurately performed.
  • the technique in the present disclosure can be applied to not only the embodiment but also an embodiment to which change, replacement, addition, omission, and the like are appropriately performed.
  • step S 23 in FIG. 3 when it is determined that there is an external device in which a microphone can be used, a screen as shown in FIG. 4 is displayed.
  • the configuration is not necessarily limited thereto.
  • controller 105 determines in step S 23 that there is an external device in which a microphone can be used, control as shown in the flow chart in FIG. 6 may be started.
  • controller 105 determines whether there are a plurality of external devices in which microphones are used (S 30 ).
  • controller 105 controls monitor 106 to display a screen as shown in FIG.
  • controller 105 waits until the external device is selected (S 32 ).
  • the external device is selected (Yes in step S 32 )
  • a command to activate a voice recognition application installed in the selected external device is transmitted to the selected external device through communication interface 108 (S 25 ).
  • television device 100 may be configured to store a voice pattern of a specific individual in association with an external device, analyze a voice pattern of digital audio data acquired through microphone 103 , and transmit a command to activate a voice recognition application to an external device stored in association with the analyzed voice pattern.
  • television device 100 can automatically activate a voice recognition application installed in an external device owned by a person who utters voice.
  • television device 100 displays the screen as shown in FIG. 4 .
  • the configuration is not necessarily limited thereto.
  • television device 100 may display a screen that urges a user to use a normal remote controller without using a method of voice recognition.
  • constituent elements described in the accompanying drawings and the detailed description can include not only constituent elements that are required to solve the problems but also constituent elements that are not required to solve the problems to illustrate the above technique. Accordingly, even when the optional constituent elements are described in the accompanying drawings and the detailed description, it not should be immediately concluded that the optional constituent elements are necessary.
  • the technique in the present disclosure can be applied to a voice recognition device such as a television device, a DVD recorder, and an audio player that accepts a designation by voice.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The voice recognition device according to the present disclosure includes a communication interface that communicates with an external device, a first microphone that collects sound to produce audio data, and a controller that analyzes the audio data produced by the first microphone, determines contents of a designation corresponding to an analysis result, and then controls its own device based on a determination result, and yet controls its own device to urge a user to use the external device when the contents of the designation corresponding to the analysis result cannot be determined.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of the Invention The present disclosure relates to a voice recognition device and a voice recognition method.
  • 2. Description of the Related Art
  • Unexamined Japanese Patent Publication No. 2011-118822 discloses a television device. This television device collects surrounding sound. The television device receives an audio signal from a mobile phone. The television device extracts an operation instruction based on an audio signal based on the collected voice and the received audio signal.
    • SUMMARY OF THE INVENTION
  • An object of the present disclosure is to provide a voice recognition device that controls its own device by accepting a designation made by voice from a user, wherein even in a situation in which voice recognition cannot be accurately performed, an alternative means can be recommended for the user.
  • In order to achieve the above object, the voice recognition device according to the present disclosure includes a communication interface that communicates with an external device, a first microphone that collects sound to produce audio data, and a controller that analyzes the audio data produced by the first microphone, determines contents of a designation corresponding to an analysis result, and then controls its own device based on a determination result, and yet controls its own device to urge a user to use the external device when the contents of the designation corresponding to the analysis result cannot be determined.
  • A voice recognition method according to the present disclosure includes communicating with an external device, collecting sound to produce audio data, analyzing the audio data to determine contents of a designation corresponding to an analysis result, and then controlling the device based on a determination result, and yet, urging a user to use the external device when the contents of the designation corresponding to the analysis result cannot be determined.
  • According to the present disclosure, there is provided a voice recognition device that controls its own device by accepting a designation made by voice from a user, and can recommend an alternative means to the user even in a situation in which voice recognition cannot be accurately performed.
    • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram for explaining an electric configuration of an entire system;
  • FIG. 2 is a flow chart for explaining an initial operation of a television device when the device is turned on;
  • FIG. 3 is a flow chart for explaining an operation of the television device when an operation designation is accepted by voice;
  • FIG. 4 is a schematic diagram for explaining an example of a display screen of the television device;
  • FIG. 5 is a flow chart for explaining an operation of the television device when a designation is accepted by acquiring audio data from an external device;
  • FIG. 6 is a flow chart for explaining an operation of a television device according to another embodiment; and
  • FIG. 7 is a schematic diagram for explaining an example of a display screen of the television device according to the other embodiment.
    •  DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Embodiments will be described below with reference to the accompanying drawings as necessary. An excessively detailed description may not be made. For example, a detailed explanation of generally-known facts and an overlapping explanation of substantially the same configuration may not be made. This is to avoid the following explanation from being unnecessarily redundant and to allow the persons skilled in the art easy to understand the explanation.
  • The present inventor(s) provides the accompanying drawings and the following explanation to allow the persons skilled in the art to sufficiently understand the present disclosure, and does not intend to limit the concept described in scope of claims by the accompanying drawings and the following explanation.
    • First Embodiment
  • A first embodiment will be described below with reference to the accompanying drawings.
  • [1-1. Outline]
  • An outline of a system according to the present embodiment will be described below with reference to FIG. 1. FIG. 1 is a block diagram showing an electric configuration of the system according to the embodiment.
  • The system according to the present embodiment includes television device 100 and mobile terminal 200. Television device 100 includes microphone 103. Television device 100 accepts a designation by voice from a user through microphone 103. Television device 100 analyzes the voice accepted from the user, determines contents of the designation corresponding to an analysis result, and controls its own device based on a determination result.
  • However, when voice representing a designation of a user is small, television device 100 may not be able to accurately determine the contents of the designation from the user.
  • Therefore, television device 100 includes communication interface 108, microphone 103, and controller 105. Communication interface 108 communicates with mobile terminal 200. Microphone 103 collects sound to produce audio data. Controller 105 analyzes the audio data produced by microphone 103, determines contents of a designation corresponding to an analysis result, and controls its own device based on a determination result. When the contents of the designation corresponding to the analysis result cannot be determined, controller 105 controls its own device to urge a user to use mobile terminal 200.
  • In this manner, television device 100 can recommend an alternative means for a user even in a situation in which voice recognition cannot be accurately performed.
  • [1-2. Electric Configuration]
  • An electric configuration of a system according to the present embodiment will be described below with reference to FIG. 1. As described above, the system according to the present embodiment includes television device 100 and mobile terminal 200. Television device 100 includes antenna 101, tuner 102, microphone 103, A/D converter 104, controller 105, monitor 106, memory 107, and communication interface 108.
  • Antenna 101 receives digital broadcasting. Tuner 102 extracts digital broadcasting of a channel selected by a user from digital broadcasting received through antenna 101. Tuner 102 produces a video stream based on the extracted digital broadcasting. Microphone 103 collects sound surrounding television device 100 and converts the sound into an analog audio signal. A/D converter 104 amplifies the audio signal input from microphone 103 and converts the audio signal into digital audio data.
  • Controller 105 is a control unit that controls the whole of television device 100. For example, controller 105 is configured by a semiconductor chip. Controller 105 performs various processing on the video stream acquired from tuner 102 and the digital audio data acquired from A/D converter 104. For example, controller 105 performs decoding processing to the video stream acquired from tuner 102. Controller 105 executes echo cancellation serving as processing of removing an audio component output from a loudspeaker (not shown) built in television device 100 on the digital audio data acquired from A/D converter 104. Controller 105 executes digital filter processing serving as processing of removing noise on the digital audio data acquired from A/D converter 104. Controller 105 analyzes the digital audio data to which echo cancellation and the digital filter processing are executed, and executes voice recognition processing to determine contents of a designation corresponding to an analysis result. For example, controller 105 determines whether the designation corresponding to the analysis result is a designation to switch channels of television device 100, a designation for volume adjustment, or a designation to input a character string of a search keyword on a Web browser.
  • Monitor 106 displays an image represented by decoded image data acquired from controller 105. For example, monitor 106 is configured by a liquid crystal panel.
  • Memory 107 stores various pieces of information therein. For example, memory 107 is configured by a flash memory. Memory 107 stores, for example, a control program to control the whole of television device 100 and dictionary data used in the voice recognition processing. The dictionary data mentioned herein is a set of typical audio data representing various designations to television device 100. Controller 105 calculates a degree of similarity between audio data produced based on voice input by a user and audio data included in the dictionary data. Controller 105 executes voice recognition processing if determined that a designation having a high degree of similarity is made by a user.
  • Communication interface 108 establishes communication with mobile terminal 200 to transmit/receive data. For example, communication interface 108 is configured by a Wi-Fi (registered trademark) module.
  • The mobile terminal 200 includes microphone 201, controller 202, phone-call interface 203, loudspeaker 204, and communication interface 205. Microphone 201 collects sound surrounding mobile terminal 200 and produces digital audio data. Controller 202 is a control unit that controls the whole of mobile terminal 200. For example, controller 202 is configured by a semiconductor chip. Phone-call interface 203 is a module to communicate via telephone with a telephone base station. For example, phone-call interface 203 is configured by a 3G communication module. Loudspeaker 204 outputs sound. A user inputs voice through microphone 201 during telephone communication and listens to voice output by an intended party through loudspeaker 204. Communication interface 205 establishes communication with television device 100 to transmit/receive data. For example, communication interface 108 is configured by a Wi-Fi (registered trademark) module.
  • [1-3. Operation]
  • [1-3-1. Operation in Active State]
  • An operation in an active state of television device 100 will be described with reference to FIG. 2. FIG. 2 is a flow chart for explaining the operation in an active state of television device 100.
  • When the power supply of television device 100 is turned on, controller 105 is activated. When controller 105 is activated, control of the flow chart shown in FIG. 2 is started. Controller 105 specifies a communication method by which television device 100 is connected to mobile terminal 200 through communication interface 108 (S11). For example, controller 105 specifies whether a connection method between television device 100 and mobile terminal 200 is a connection method by a wireless LAN, a connection method by a wired LAN, or the like.
  • When the communication method is specified, controller 105 performs an inquiry to mobile terminal 200 whether television device 100 can be designated by using microphone 201 (S12). More specifically, controller 105 performs an inquiry to mobile terminal 200 whether a voice recognition application is installed in mobile terminal 200 or about basic information or the like of mobile terminal 200. The voice recognition application herein is an application that, when a voice input is accepted, produces digital audio data from the acquired voice, transmits the produced digital audio data to a host device such as television device 100, and causes the host device to perform voice recognition. The basic information of mobile terminal 200 includes a machine name of mobile terminal 200, an IP address, a MAC address, information representing a format of digital audio data transmitted by mobile terminal 200, and the like.
  • As a result of the inquiry, when an answer is acquired from mobile terminal 200 through communication interface 108, controller 105 determines whether mobile terminal 200 notifies television device 100 of a designation by using microphone 201 (S13). For example, when a voice recognition application is installed in mobile terminal 200, controller 105 determines that television device 100 can be notified of the instruction by using microphone 201.
  • When it is determined that television device 100 is notified of the designation by using microphone 201 (Yes in step S13), controller 105 stores the basic information of mobile terminal 200 and information representing that television device 100 can be notified of the designation by using microphone 201 in memory 107 (S14). On the other hand, when it is determined that television device 100 is not notified of the designation by using microphone 201 (No in step S13), controller 105 stores the basic information of mobile terminal 200 and information representing that television device 100 cannot be notified of the designation by using microphone 201 in memory 107 (S15).
  • Upon completion of the processing in step S14 or the processing in step S15, controller 105 determines whether there is an external device that has not been confirmed (S16). When the presence of all the external devices are confirmed (No in step S16), controller 105 drops out of the processing in the flow chart in FIG. 2. On the other hand, when it is determined that there is an external device that has not been confirmed (Yes in step S16), controller 105 repeats the processing subsequent to step S11. [1-3-2. Operation Performed upon Acceptance of Designation by Voice]
  • An operation performed when television device 100 accepts a designation by voice from a user will be described with reference to FIGS. 3 to 5. FIG. 3 is a flow chart for explaining an operation of television device 100 when a designation is accepted by voice from a user. FIG. 4 is a schematic diagram for explaining an example of a display screen of television device 100. FIG. 5 is a flow chart for explaining an operation of television device 100 when a designation is accepted by acquiring audio data from mobile terminal 200.
  • Upon completion of the operation in the activation state, when a designation is made by voice from a user, processing according to the flow chart shown in FIG. 3 is started. When a designation by voice is accepted from the user through microphone 103, controller 105 determines whether voice recognition can be sufficiently performed (S21). More specifically, controller 105 compares digital audio data acquired through microphone 103 with various audio data included in the dictionary data stored in memory 107 to determine whether there is audio data that is similar to the various audio data at a predetermined level or more or to determine whether the volume of digital audio data acquired through microphone 103 is a predetermined level or more.
  • When it is determined that sufficient voice recognition cannot be performed (No in step S21), controller 105 determines whether digital audio data serving as an object of voice recognition is acquired through microphone 103 (S22).
  • When it is determined that the digital audio data is acquired through microphone 103 (Yes in step S22), controller 105 determines whether an external device in which a microphone can be used is present around controller 105 (S23). More specifically, controller 105 refers to information stored in memory 107 and representing that television device 100 can be notified of a designation by using a microphone to determine whether an external device in which a microphone can be used is present around controller 105.
  • It is determined that the external device in which a microphone can be used is present around controller 105 (Yes in step S23), controller 105 controls monitor 106 to display a screen that urges a user to use the external device (S24). More specifically, monitor 106 displays a screen as shown in FIG. 4.
  • When the screen as shown in FIG. 4 is displayed on monitor 106, controller 105 switches modes of mobile terminal 200 such that television device 100 can be notified of a designation through microphone 201 (S25). For example, controller 105 notifies mobile terminal 200 of a command to activate the voice recognition application installed in mobile terminal 200 through communication interface 108.
  • In this state, television device 100 consequently waits until television device 100 accepts a designation by audio data from mobile terminal 200. When television device 100 accepts the designation by audio data from mobile terminal 200, processing according to the flow chart shown in FIG. 5 is started.
  • Controller 105 acquires digital audio data from mobile terminal 200 through communication interface 108 (S31). When the digital audio data is acquired, controller 105 executes voice recognition processing on the acquired digital audio data (S32). When the voice recognition processing is executed, controller 105 determines whether the voice recognition can be sufficiently executed (S33). More specifically, controller 105 analyzes the acquired digital audio data to determine whether contents of a designation corresponding to an analysis result can be determined.
  • When it is determined that voice recognition can be sufficiently executed (Yes in step S33), controller 105 controls television device 100 to perform an operation according to contents of a designation corresponding a determined analysis result (S34). On the other hand, when it is determined that the voice recognition cannot be sufficiently executed (No in step S33), controller 105 controls monitor 106 to display a screen so as to urge a user to input voice again (S35).
  • [1-4. Effects or the Like]
  • As described above, television device 100 according to the present embodiment includes communication interface 108, microphone 103, and controller 105. Communication interface 108 communicates with mobile terminal 200. Microphone 103 collects sound to produce audio data. Controller 105 analyzes the audio data produced by microphone 103, determines contents of a designation corresponding to an analysis result, and controls its own device based on a determination result. When the contents of the designation corresponding to the analysis result cannot be determined, controller 105 controls its own device to urge a user to use mobile terminal 200.
  • In this manner, television device 100 can recommend an alternative means for a user to input a designation with mobile terminal 200 even in a situation in which voice recognition cannot be accurately performed.
  • Mobile terminal 200 includes microphone 201. In television device 100, when the contents of the designation corresponding to the analysis result cannot be determined, controller 105 controls television device 100 to urge a user to use microphone 201.
  • In this manner, television device 100 can recommend an alternative means for a user to input a designation with microphone 201 provided in mobile terminal 200 even in a situation in which voice recognition cannot be accurately performed.
  • Television device 100 further includes monitor 106 that displays an image. In television device 100, when the contents of the designation corresponding to the analysis result cannot be determined, controller 105 controls monitor 106 to display a message to urge a user to use mobile terminal 200.
  • In this manner, television device 100 can visually recommend an alternative means for a user to input a designation with microphone 201 provided in mobile terminal 200 even in a situation in which voice recognition cannot be accurately performed.
  • In television device 100, when the contents of the designation corresponding to the analysis result cannot be determined, controller 105 controls communication interface 108 to transmit a command to mobile terminal 200 for setting mobile terminal 200 to a mode in which microphone 201 can be used.
  • In this manner, television device 100 can automatically activate mobile terminal 200 while recommending an alternative means for a user to input a designation with microphone 201 provided in mobile terminal 200, even in a situation in which voice recognition cannot be accurately performed.
    • Another Embodiment
  • As described above, as an illustration of the technique disclosed in this application, the first embodiment has been described. However, the technique in the present disclosure can be applied to not only the embodiment but also an embodiment to which change, replacement, addition, omission, and the like are appropriately performed.
  • Thus, another embodiment will be illustrated below.
  • In the first embodiment, in step S23 in FIG. 3, when it is determined that there is an external device in which a microphone can be used, a screen as shown in FIG. 4 is displayed. However, the configuration is not necessarily limited thereto. For example, when controller 105 determines in step S23 that there is an external device in which a microphone can be used, control as shown in the flow chart in FIG. 6 may be started. In this case, when it is determined that the external device in which a microphone can be used is present, controller 105 determines whether there are a plurality of external devices in which microphones are used (S30). When it is determined that the plurality of external devices are present (Yes in step S30), controller 105 controls monitor 106 to display a screen as shown in FIG. 7 that causes a user to select any one of the plurality of external devices (S31). When the screen as shown in FIG. 7 is displayed on monitor 106, controller 105 waits until the external device is selected (S32). When the external device is selected (Yes in step S32), a command to activate a voice recognition application installed in the selected external device is transmitted to the selected external device through communication interface 108 (S25).
  • In this manner, when a plurality of external devices are present around television device 100, a situation in which the voice recognition applications are automatically activated in all the external devices can be avoided.
  • In addition, for example, television device 100 according to the first embodiment may be configured to store a voice pattern of a specific individual in association with an external device, analyze a voice pattern of digital audio data acquired through microphone 103, and transmit a command to activate a voice recognition application to an external device stored in association with the analyzed voice pattern.
  • In this manner, when voice recognition cannot be sufficiently performed, television device 100 can automatically activate a voice recognition application installed in an external device owned by a person who utters voice.
  • In the first embodiment, it is assumed that, when the digital audio data acquired through microphone 103 cannot be sufficiently recognized as voice, television device 100 displays the screen as shown in FIG. 4. However, the configuration is not necessarily limited thereto. For example, when digital audio data acquired through microphone 103 cannot be sufficiently recognized as voice, television device 100 may display a screen that urges a user to use a normal remote controller without using a method of voice recognition.
  • As described above, as an illustration of the technique in the present disclosure, the embodiment is described. For this purpose, the accompanying drawings and the detailed description are provided.
  • Thus, the constituent elements described in the accompanying drawings and the detailed description can include not only constituent elements that are required to solve the problems but also constituent elements that are not required to solve the problems to illustrate the above technique. Accordingly, even when the optional constituent elements are described in the accompanying drawings and the detailed description, it not should be immediately concluded that the optional constituent elements are necessary.
  • Since the above embodiments illustrate the technique in the present disclosure, various changes, replacements, additions, and omissions can be executed in the scope of claims or a scope equivalent thereto.
  • The technique in the present disclosure can be applied to a voice recognition device such as a television device, a DVD recorder, and an audio player that accepts a designation by voice.

Claims (8)

What is claimed is:
1. A voice recognition device comprising:
a communication interface that communicates with an external device;
a first microphone that collects sound to produce audio data; and
a controller that analyzes the audio data produced by the first microphone, determines contents of a designation corresponding to an analysis result, and then controls its own device based on a determination result, and yet controls its own device to urge a user to use the external device when the contents of the designation corresponding to the analysis result cannot be determined.
2. The voice recognition device according to claim 1,
wherein the external device further includes a second microphone, and
the controller controls its own device to urge a user to use the second microphone when the contents of the designation corresponding to the analysis result cannot be determined.
3. The voice recognition device according to claim 1, further comprising:
a monitor that displays an image,
wherein the controller controls the monitor to display a message to urge a user to use the external device when the contents of the designation corresponding to the analysis result cannot be determined.
4. The voice recognition device according to claim 2,
wherein the controller, when the contents of the designation corresponding to the analysis result cannot be determined, controls the communication interface to transmit a command to the external device to set the external device to a mode in which the second microphone can be used.
5. A voice recognition method comprising:
communicating with an external device;
collecting sound to produce audio data; and
analyzing the audio data to determine contents of a designation corresponding to an analysis result, and then controlling the device based on a determination result, and yet, urging a user to use the external device when the contents of the designation corresponding to the analysis result cannot be determined.
6. The voice recognition method according to claim 5,
wherein when the contents of the designation corresponding to the analysis result cannot be determined, a user is urged to use a microphone included in the external device.
7. The voice recognition method according to claim 5,
wherein when the contents of the designation corresponding to the analysis result cannot be determined, a message to urge a user to use the external device is displayed.
8. The voice recognition method according to claim 6,
wherein when the contents of the designation corresponding to the analysis result cannot be determined, a command to set the external device to a mode in which the microphone can be used is transmitted to the external device.
US14/068,087 2013-03-25 2013-10-31 Voice recognition device and voice recognition method Expired - Fee Related US9147396B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/828,634 US9520132B2 (en) 2013-03-25 2015-08-18 Voice recognition device and voice recognition method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013061417A JP6114915B2 (en) 2013-03-25 2013-03-25 Voice input selection device and voice input selection method
JP2013-061417 2013-03-25

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/828,634 Continuation US9520132B2 (en) 2013-03-25 2015-08-18 Voice recognition device and voice recognition method

Publications (2)

Publication Number Publication Date
US20140288930A1 true US20140288930A1 (en) 2014-09-25
US9147396B2 US9147396B2 (en) 2015-09-29

Family

ID=51569784

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/068,087 Expired - Fee Related US9147396B2 (en) 2013-03-25 2013-10-31 Voice recognition device and voice recognition method
US14/828,634 Expired - Fee Related US9520132B2 (en) 2013-03-25 2015-08-18 Voice recognition device and voice recognition method

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/828,634 Expired - Fee Related US9520132B2 (en) 2013-03-25 2015-08-18 Voice recognition device and voice recognition method

Country Status (2)

Country Link
US (2) US9147396B2 (en)
JP (1) JP6114915B2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150356972A1 (en) * 2013-03-25 2015-12-10 Panasonic Intellectual Property Management Co., Ltd. Voice recognition device and voice recognition method
US20160240196A1 (en) * 2015-02-16 2016-08-18 Alpine Electronics, Inc. Electronic Device, Information Terminal System, and Method of Starting Sound Recognition Function
CN110418226A (en) * 2018-04-28 2019-11-05 北京唱吧科技股份有限公司 Microphone and microphone system

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6819672B2 (en) * 2016-03-31 2021-01-27 ソニー株式会社 Information processing equipment, information processing methods, and programs
KR102471499B1 (en) * 2016-07-05 2022-11-28 삼성전자주식회사 Image Processing Apparatus and Driving Method Thereof, and Computer Readable Recording Medium
TWI700630B (en) * 2018-05-31 2020-08-01 技嘉科技股份有限公司 Voice-controlled display device and method for retriving voice signal
JP7346827B2 (en) * 2019-01-29 2023-09-20 コニカミノルタ株式会社 Image forming apparatus, image forming system, and method for controlling the image forming apparatus

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5795228A (en) * 1996-07-03 1998-08-18 Ridefilm Corporation Interactive computer-based entertainment system
US6868045B1 (en) * 1999-09-14 2005-03-15 Thomson Licensing S.A. Voice control system with a microphone array
US6959095B2 (en) * 2001-08-10 2005-10-25 International Business Machines Corporation Method and apparatus for providing multiple output channels in a microphone
US7149691B2 (en) * 2001-07-27 2006-12-12 Siemens Corporate Research, Inc. System and method for remotely experiencing a virtual environment
US20090110225A1 (en) * 2007-10-31 2009-04-30 Hyun Soo Kim Method and apparatus for sound source localization using microphones
US20100016052A1 (en) * 2006-10-11 2010-01-21 Wms Gaming Inc. Location-linked audio/video
US20100020951A1 (en) * 2008-07-22 2010-01-28 Basart Edwin J Speaker Identification and Representation For a Phone
US20100225471A1 (en) * 2009-03-04 2010-09-09 Oki Electric Industry Co., Ltd. Information providing server, server system, and method
US7822213B2 (en) * 2004-06-28 2010-10-26 Samsung Electronics Co., Ltd. System and method for estimating speaker's location in non-stationary noise environment
US7885818B2 (en) * 2002-10-23 2011-02-08 Koninklijke Philips Electronics N.V. Controlling an apparatus based on speech
US20110054891A1 (en) * 2009-07-23 2011-03-03 Parrot Method of filtering non-steady lateral noise for a multi-microphone audio device, in particular a "hands-free" telephone device for a motor vehicle
US8237770B2 (en) * 2004-10-15 2012-08-07 Lifesize Communications, Inc. Audio based on speaker position and/or conference location

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS58110921A (en) * 1981-12-25 1983-07-01 Matsushita Electric Ind Co Ltd Heating device
JPH0683388A (en) * 1992-09-04 1994-03-25 Fujitsu Ten Ltd Speech recognition device
US5822718A (en) * 1997-01-29 1998-10-13 International Business Machines Corporation Device and method for performing diagnostics on a microphone
JP2001326989A (en) * 2000-05-18 2001-11-22 Canon Inc Audio signal processing device, audio signal processing method, and video camera
KR20020032621A (en) 2000-07-28 2002-05-03 요트.게.아. 롤페즈 System for controlling an apparatus with speech commands
US6944880B1 (en) * 2000-09-29 2005-09-13 Digeo, Inc. Methods for audio capture and communication during television broadcasts
US7023498B2 (en) 2001-11-19 2006-04-04 Matsushita Electric Industrial Co. Ltd. Remote-controlled apparatus, a remote control system, and a remote-controlled image-processing apparatus
JP4050574B2 (en) 2001-11-19 2008-02-20 松下電器産業株式会社 Remote control target device, remote control system, and image processing apparatus
US7142894B2 (en) * 2003-05-30 2006-11-28 Nokia Corporation Mobile phone for voice adaptation in socially sensitive environment
US7783018B1 (en) * 2006-06-24 2010-08-24 Goldberg Mark S Directory display and configurable entry system
US8140325B2 (en) * 2007-01-04 2012-03-20 International Business Machines Corporation Systems and methods for intelligent control of microphones for speech recognition applications
US8948415B1 (en) * 2009-10-26 2015-02-03 Plantronics, Inc. Mobile device with discretionary two microphone noise reduction
JP2011118822A (en) * 2009-12-07 2011-06-16 Nec Casio Mobile Communications Ltd Electronic apparatus, speech detecting device, voice recognition operation system, and voice recognition operation method and program
JP2014178339A (en) * 2011-06-03 2014-09-25 Nec Corp Voice processing system, utterer's voice acquisition method, voice processing device and method and program for controlling the same
JP6114915B2 (en) * 2013-03-25 2017-04-19 パナソニックＩｐマネジメント株式会社 Voice input selection device and voice input selection method

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5795228A (en) * 1996-07-03 1998-08-18 Ridefilm Corporation Interactive computer-based entertainment system
US6868045B1 (en) * 1999-09-14 2005-03-15 Thomson Licensing S.A. Voice control system with a microphone array
US7149691B2 (en) * 2001-07-27 2006-12-12 Siemens Corporate Research, Inc. System and method for remotely experiencing a virtual environment
US6959095B2 (en) * 2001-08-10 2005-10-25 International Business Machines Corporation Method and apparatus for providing multiple output channels in a microphone
US7885818B2 (en) * 2002-10-23 2011-02-08 Koninklijke Philips Electronics N.V. Controlling an apparatus based on speech
US7822213B2 (en) * 2004-06-28 2010-10-26 Samsung Electronics Co., Ltd. System and method for estimating speaker's location in non-stationary noise environment
US8237770B2 (en) * 2004-10-15 2012-08-07 Lifesize Communications, Inc. Audio based on speaker position and/or conference location
US20100016052A1 (en) * 2006-10-11 2010-01-21 Wms Gaming Inc. Location-linked audio/video
US20090110225A1 (en) * 2007-10-31 2009-04-30 Hyun Soo Kim Method and apparatus for sound source localization using microphones
US20100020951A1 (en) * 2008-07-22 2010-01-28 Basart Edwin J Speaker Identification and Representation For a Phone
US20100225471A1 (en) * 2009-03-04 2010-09-09 Oki Electric Industry Co., Ltd. Information providing server, server system, and method
US20110054891A1 (en) * 2009-07-23 2011-03-03 Parrot Method of filtering non-steady lateral noise for a multi-microphone audio device, in particular a "hands-free" telephone device for a motor vehicle

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150356972A1 (en) * 2013-03-25 2015-12-10 Panasonic Intellectual Property Management Co., Ltd. Voice recognition device and voice recognition method
US9520132B2 (en) * 2013-03-25 2016-12-13 Panasonic Intellectual Property Management Co., Ltd. Voice recognition device and voice recognition method
US20160240196A1 (en) * 2015-02-16 2016-08-18 Alpine Electronics, Inc. Electronic Device, Information Terminal System, and Method of Starting Sound Recognition Function
US9728187B2 (en) * 2015-02-16 2017-08-08 Alpine Electronics, Inc. Electronic device, information terminal system, and method of starting sound recognition function
CN110418226A (en) * 2018-04-28 2019-11-05 北京唱吧科技股份有限公司 Microphone and microphone system

Also Published As

Publication number Publication date
US9520132B2 (en) 2016-12-13
US20150356972A1 (en) 2015-12-10
US9147396B2 (en) 2015-09-29
JP2014186184A (en) 2014-10-02
JP6114915B2 (en) 2017-04-19

Similar Documents

Publication Publication Date Title
US9520132B2 (en) Voice recognition device and voice recognition method
US11823304B2 (en) Picture display device, and setting modification method and setting modification program therefor
EP2894633B1 (en) Image display apparatus
KR102210433B1 (en) Electronic device for speech recognition and method thereof
EP3160151B1 (en) Video display device and operation method therefor
US20160063894A1 (en) Electronic apparatus having a voice guidance function, a system having the same, and a corresponding voice guidance method
EP3663905A1 (en) Information processing device, speech recognition system, and information processing method
CN105532634A (en) Ultrasonic wave mosquito repel method, device and system
US12052556B2 (en) Terminal, audio cooperative reproduction system, and content display apparatus
CN103763597A (en) Remote control method for control equipment and device thereof
JP2014071124A (en) Television receiver, and voice recognition method of television receiver
CN113726939B (en) System, method, medium and equipment for testing functions of terminal radio
US10212476B2 (en) Image display apparatus and image displaying method
KR101452226B1 (en) Smart Phone and Internet Used Broadcasting Equipment
JP2021105998A (en) Video display device
KR102359163B1 (en) Electronic device for speech recognition and method thereof
KR102594683B1 (en) Electronic device for speech recognition and method thereof
JP7668406B2 (en) Information Processing Method
KR20210104689A (en) Information processing device, control method, information processing terminal, information processing method
KR20060063455A (en) How to control sound output of TV system
JP2012227806A (en) Video display device and video display method

Legal Events

Date Code Title Description
AS Assignment

Owner name: PANASONIC CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KOTANI, JUNICHI;KOGANEI, TOMOHIRO;SIGNING DATES FROM 20131004 TO 20131018;REEL/FRAME:032535/0287

AS Assignment

Owner name: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PANASONIC CORPORATION;REEL/FRAME:034194/0143

Effective date: 20141110

Owner name: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LT

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PANASONIC CORPORATION;REEL/FRAME:034194/0143

Effective date: 20141110

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

AS Assignment

Owner name: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD., JAPAN

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED APPLICATION NUMBERS 13/384239, 13/498734, 14/116681 AND 14/301144 PREVIOUSLY RECORDED ON REEL 034194 FRAME 0143. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:PANASONIC CORPORATION;REEL/FRAME:056788/0362

Effective date: 20141110

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20230929

OSZAR »