KR20220057046A - Electronic device, and method for determining device to perform task in electronic device - Google Patents

Abstract

According to various embodiments, an electronic device comprises: a communication module; a memory; and a processor set to obtain first information for performing a task, identify a first task corresponding to the first information, identify a first device, which satisfies a plurality of conditions corresponding to the first task, among a plurality of devices, and request the first device to perform the first task through the communication module. Other various embodiments may be provided.

Description

ELECTRONIC DEVICE, AND METHOD FOR DETERMINING DEVICE TO PERFORM TASK IN ELECTRONIC DEVICE

Various embodiments relate to an electronic device capable of determining an optimal device capable of performing a task corresponding to a user's utterance from among a plurality of devices in a house, and a method for determining a device for performing a task in the electronic device .

The Internet of Things (IoT) refers to a technology in which various devices with built-in sensors and communication functions are connected to the Internet, and may provide a monitor and control function for each of various devices connected through the Internet.

In the home, only a single device monitoring or control function is provided using the Internet of Things (IoT).

In addition, in order for the user to use various devices in the house through the voice service, the user must make a speech designating a specific device for performing the service together with the contents of the service execution.

Also, even if there is another optimal device capable of performing a better service than the specific device designated by the user among various devices in the house, only the specific device designated by the user may perform the service requested by the user.

According to various embodiments of the present disclosure, an electronic device capable of determining an optimal device capable of performing a task corresponding to a user's utterance from among a plurality of devices in a home, and a method of determining a device for performing a task in the electronic device will be.

According to various embodiments of the present disclosure, an electronic device capable of providing a home modeling service by synthesizing contexts collected at home and a method of determining a device for performing a task in the electronic device are provided.

According to various embodiments, an electronic device capable of determining the overall state of a home and providing an optimal service in a multi-modality environment of the home to increase user convenience and performing a task in the electronic device It relates to a method of determining a device for

The electronic device according to various embodiments of the present disclosure obtains and analyzes a communication module, a memory, and a user utterance, obtains first information for performing a task, identifies a first task corresponding to the first information, and and a processor configured to identify a first device that satisfies a plurality of conditions corresponding to the first task among devices, and to request the first device to perform the first task through the communication module.

According to various embodiments of the present disclosure, a method of determining a device for performing a task in an electronic device includes obtaining first information for performing a task, identifying a first task corresponding to the first information, and a plurality of devices checking a first device that satisfies a plurality of conditions corresponding to the first task, and requesting the first device to perform the first task through the communication module.

According to various embodiments of the present disclosure, the electronic device may determine an optimal device capable of performing a requested service from among various devices in the home, and may allow the optimal device to perform a service requested by a user. In addition, the electronic device determines an additional device so that the user can conveniently control an optimal device that performs a service corresponding to the request, and uses the additional device to allow the user to conveniently control the optimal device. can do. In addition, the electronic device may provide a continuous service to the user by determining a device capable of performing the service from among a variety of different types of devices in the home.

In addition, the electronic device may provide a home modeling service by synthesizing the contexts collected in the home, determine the overall state of the home, and provide an optimal service in the multi-modality environment of the home. This has the effect of increasing user convenience.

1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure;
FIG. 2 is a diagram for explaining an operation of an electronic device controlling a plurality of devices in your house, according to various embodiments of the present disclosure;
3 is a block diagram of an electronic device according to various embodiments of the present disclosure;
4 is a block diagram of a device management unit of an electronic device according to various embodiments of the present disclosure;
5 is a flowchart illustrating an operation of determining a device for performing a task in an electronic device according to various embodiments of the present disclosure;
6 is a flowchart illustrating an operation of determining a device for performing a task in an electronic device according to various embodiments of the present disclosure;
8 is a diagram for describing an operation of determining a device for performing a task in an electronic device according to various embodiments of the present disclosure;
7 is a flowchart illustrating an operation of determining whether to perform a second task in an electronic device according to various embodiments of the present disclosure;
9 is a diagram for describing an operation of determining a device for performing a task in an electronic device according to various embodiments of the present disclosure;
10A to 10B are diagrams for explaining a device switching operation for performing a task in a second device according to various embodiments of the present disclosure;

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

FIG. 2 is a diagram 200 for explaining an operation of an electronic device controlling a plurality of devices in your house, according to various embodiments of the present disclosure.

Referring to FIG. 2 , a plurality of devices 221 to 229 and an electronic device 201 capable of managing the plurality of devices may be included in a home.

According to various embodiments, the electronic device 201 is a primary device capable of performing a Home IoT Edge function, and in a state in which communication is established with the plurality of devices 221 to 229 , the plurality of devices The plurality of devices may be managed while transmitting/receiving information to/from each of (221 to 229).

According to an embodiment, the electronic device 201 and the plurality of devices 221 to 229 may include all or some of the configurations of the electronic device 101 as shown in FIG. 1 .

According to an embodiment, at least one device among the plurality of devices 221 to 229 may be set as a primary device capable of performing a Home IoT Edge function.

According to an embodiment, among the various devices 201 and 221 to 229 in the house, among the non-portable devices (eg, the TV devices 201 , 221 and 222 , the refrigerator 223 , and the AI speaker 225 ) At least one may be set as a primary device capable of performing the Home IoT Edge function.

According to an embodiment, the electronic device 201 may receive and store device information from each of the plurality of devices 221 to 229 .

According to an embodiment, the device information includes device configuration information (eg, display information, speaker information, microphone information, and voice service support information) and device status information (eg, power on/off information, currently performed information). function information, location information, etc.).

According to an embodiment, when first information for performing a task is received, the electronic device 201 identifies a first task corresponding to the first information, and each of the plurality of devices 221 to 229 A first device capable of performing the first task may be determined based on the device information on the device and a plurality of conditions corresponding to the first task, and a request may be made to the first device to perform the first task.

According to an embodiment, the electronic device 201 checks the second task for the first device when receiving status information according to the first task performance from the first device, and the first device A second device capable of performing the second task is determined from among the plurality of devices 221 to 229 based on the state information of , and a plurality of conditions corresponding to the second task, and It may request to perform the second task.

According to an embodiment, one of the portable devices (eg, the watch phone 227 and the smart phone 229 ) among the plurality of devices 221 to 229 may be set as the second device.

3 is a block diagram 300 of an electronic device according to various embodiments of the present disclosure.

Referring to FIG. 3 , an electronic device 201 (eg, the electronic device 101 of FIG. 1 ) includes a processor 320 (eg, the processor 120 of FIG. 1 , and a memory 230 ) (eg, FIG. 1 ). of the memory 130 , the display 260 (eg, the display module 160 of FIG. 1 ), and the communication module 290 (eg, the communication module of FIG. 1 )).

According to various embodiments, the processor 320 may control the overall operation of the electronic device 201 .

According to various embodiments, the processor 320 manages a plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 2 ) in the house in the electronic device 201 , and performs a task among the plurality of devices. The device manager 310 is capable of determining an optimal first device capable of performing the first task corresponding to the first information for execution and determining a second device capable of performing the second task for the first device. ) may be included.

According to an embodiment, the device management unit 310 may be included in the processor 320 or configured separately.

According to various embodiments, the processor 320 (eg, the device management unit 310 ) may obtain and analyze first information for performing a task, and identify the first task based on the analyzed first information. there is.

According to an embodiment, when the processor 320 acquires the user's utterance information and identifies the acquired user utterance information as the first information, the processor 320 may identify a first task corresponding to the user's utterance information. For example, the processor 320 may check the user's utterance information "Tell me the way to the Chinese house" as first information, and a first task corresponding to the user uttered information as the first information (eg, directions). ) can be checked.

According to an embodiment, the processor 320 acquires state change information of the in-house device, checks the acquired state change information of the in-house device as the first information, and corresponds to the state change information of the in-house device. You can check the first task. For example, the processor 320 may check, as the first information, a state change of an indoor device in which the indoor air conditioner changes from an off state to an on state, as the first information, and corresponds to the first information, which is the state change of the indoor device. The first task (eg, weather information guidance) may be checked.

According to an embodiment, the processor 320 may obtain preset specific time information, check the specific time information as the first information, and identify a first task corresponding to the specific time information . For example, the processor 320 may check a preset every Monday 2:00 pm as first information, and check a first task (eg, watching a drama) corresponding to the specific time information, which is the first information. .

According to an embodiment, the processor 320 obtains state change information of the premises, identifies the acquired state change information as the first information, and performs a first task corresponding to the state change information of the premises. can be checked. For example, the processor 320 may be configured to provide state information (eg : temperature, humidity, light quantity, etc. each change above or below a reference value), confirms the acquired state change information as first information, and corresponds to the first information, the state change information of the house The first task (eg, outputting information about the currently changed indoor temperature, humidity, or amount of light) may be checked.

According to an embodiment of the present disclosure, the processor 320 may obtain location information of a user in the premises and check the acquired location information of the user in the premises as the first information. For example, when it is confirmed that the user enters a specific room among a plurality of rooms in the house, location information of the user located in the specific room is checked as the first information, and the first information, the home You can check the first task (eg, output the user's schedule information) corresponding to the location information of the user.

According to various embodiments of the present disclosure, the processor 320 (eg, the device management unit 310 ) may include a plurality of devices (eg, the plurality of devices 221 to 221 to 229)), the device information received from each may be collected and stored in the memory 230 .

According to an embodiment, the processor 320 (eg, the device management unit 310 ) may include a plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 2 ) as shown in Table 1 below. ) may be collected and stored in the memory 230 by collecting device information (eg, device configuration information and device status information) received from each.

Device type device name Display resolution information
(display resolution) Ball rate size information
(max decibel) voice service
support information
(bixby) power state
information
(power) user's
Current activity information Device A (221) my TV1 FHD 100 enable off - Device B (222) my TV2 HD 90 - on - Device C (223) my Fridge WVGA - - - - Device D (225) my speaker - 95 enable on - Device E (227) my watch VGA 10 disable on 5 (running) Device F (229) my phone HD 95 enable on 1 (idle)

As shown in <Table 1>, the device information for a plurality of devices (devices A to F) may include device configuration information and device status information. The configuration information of the device may include essential configuration information that does not change, such as display resolution, volume size information, and voice service support information. The device status information may include information that can be changed according to the device status, such as power status information and user activity information. The user's activity information indicates information obtainable from a portable device (eg, device E to device F) that the user can hold or wear. The device information about the devices of the . may include various information (eg, location information and information currently being performed by the device) to perform a task.

According to various embodiments of the present disclosure, the processor 320 (eg, the device management unit 310 ) may identify a first task based on first information for performing the task, and may determine the type of the first task. .

According to an embodiment, the processor 320 (eg, the device management unit 310 ) may check a plurality of conditions corresponding to the first task among a plurality of conditions set for each type of task.

According to an embodiment, the plurality of conditions set for each type of task include a first condition for configuration information of a device for performing a task, a second condition for status information of a device for performing a task, and an apparatus for performing a task. Third condition information for information on the number of may be included, and the first to third conditions may be sequentially applied. The first condition represents a constraint condition that must be included, the second condition represents a preference condition for selecting a device more suitable for performing a task, and the third condition represents a plurality of devices. It may indicate the number of devices to be selected.

According to an embodiment, the processor 320 (eg, the device management unit 310 ) may check a plurality of conditions corresponding to the first task among a plurality of conditions set for each type of task. The processor 320 may determine first candidate devices that satisfy a first condition for performing the first task among the plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 1 ). . The processor 320 determines second candidate devices that satisfy a second condition for performing the first task from among the first candidate devices, and selects a third candidate for performing the first task from among the second candidate devices. A first device that satisfies the candidate condition may be determined.

For example, if the processor 320 acquires the user's utterance "Tell me how to get to a nearby Chinese restaurant" as the first information for performing the task, the processor 320 may determine that the first task is the type of the task for "Navigating". can In the processor 320, a plurality of conditions corresponding to the first task for “guidance” among a plurality of conditions set for each task type, for example, a context of “power” exists. It is possible to check the first condition that the volume size is maximum, the second condition that the maximum volume size is preferred, and the third condition that the number of devices for performing the first task is one device. Based on Table 1, the processor 320 selects first candidate devices (eg, devices) that satisfy the first condition having a context of power among a plurality of devices (eg, devices A to F). A, B, D, E, and F) can be determined. The processor 320 arranges the first candidate devices (eg, device A, device B, device D, device E, and device F) from among the first candidate devices (eg, device A, device B, device D, device E, and device F) in order of increasing volume size to be a second candidate satisfying a second condition. Devices (eg device A > device D = device F > device B > device E) can be determined. The processor 320 is configured to select the device A as the second candidate device (eg, device A) satisfying the second condition satisfies the third condition that the number of devices for performing the first task is one device. It may be determined as the first device for performing the first task.

According to an embodiment, the processor 320 (eg, the device management unit 310 ) sets each of the plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 2 ) according to the type of task. You can register in advance a method to perform a task according to it. For example, as shown in Table 2 below, the processor 320 performs a task such as “guiding a route” by the plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 2 ). One way to do this is to register in advance.

How to perform the "Guidance" task Device A (221) Guided by audio and screen Device B (222) Guided by audio and screen Device C (225) guide to the screen Device D (229) Guided by audio

According to an embodiment, the processor 320 (eg, the device management unit 310 ) performs the first task among the plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 2 ). If the first device capable of performing the execution is determined, the first device may request the first device to perform the first task. According to an embodiment, the processor 320 (eg, the device management unit 310 ) may include When a device (eg, device A) performs a first task using audio and a screen, and receives status information informing that the first task is performed from the first device, the status information is collected as device information It may be stored in the memory 230 .

According to various embodiments of the present disclosure, the processor 320 (eg, the device management unit 310 ) requests the first device to perform the first task corresponding to the first information for performing the task, and then sets the first device to the first device. It is possible to determine whether to perform the second task for

According to an embodiment, the processor 320 (eg, the device management unit 310 ), upon receiving status information informing that the first task is performed from the first device, determines whether to perform the second task and confirm the second task for the first device according to the determination to perform the second task. According to an embodiment, the processor 320 (eg, the device management unit 310 ) checks a plurality of conditions (eg, first to third conditions) for determining whether to perform the second task. In addition, when all or at least some of the plurality of conditions are satisfied, it may be determined to perform the second task. The processor 320 is configured to enable the first task corresponding to the first information for performing the task among the plurality of conditions to terminate the function of the first device (eg, a user utterance requesting termination of the function of the first device); If the first condition of not being related is satisfied, it may be determined to perform the second task. The processor 320 determines the number of functions (eg, a display function, a speaker function, or a voice support function, etc.) that the first device can perform based on the configuration information of the first device among the plurality of conditions. When the second condition of a predetermined number or more is satisfied, it may be determined to perform the second task. The processor 320 may determine to perform the second task when a third condition that the first device is a non-portable device among the plurality of conditions is satisfied.

According to an embodiment, when the processor 320 (eg, the device management unit 310 ) determines to perform the second task, the processor 320 performs an additional service for the first task performed by the first device. a second task for, and/or a second task for controlling a function of the first device may be identified.

According to various embodiments, the processor 320 (eg, the device management unit 310 ) requests the first device to perform the first task corresponding to the first information for performing the task, and then When it is determined to perform the second task, it is possible to determine a second device for performing the first task. According to an embodiment, the processor 320 (eg, the device management unit 310 ) is configured to: A plurality of conditions corresponding to the second task among a plurality of set conditions may be checked.

According to an embodiment, the processor 320 (eg, the device management unit 310 ) may check a plurality of conditions corresponding to the second task among a plurality of conditions set for each type of task. The processor 320 may determine first candidate devices that satisfy a first condition for performing the second task among the plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 1 ). . The processor 320 determines second candidate devices that satisfy a second condition for performing the second task among the first candidate devices, and a third candidate device for performing the second task among the second candidate devices. A second device that satisfies the candidate condition may be determined.

For example, the processor 320 (eg, device management unit 310 ) may perform a first task (“eg, guidance on directions to a nearby Chinese restaurant”) from the first device (eg, device A 221 , TV device). ), the display of menu information (eg, menu information for additional search for a nearby Chinese restaurant) for performing additional services for the first task performed by the first device and/or a second task for displaying menu information (eg, TV remote control menu) for controlling a function of the first device (eg, a TV function of device A). Reference numeral 320 denotes a plurality of conditions corresponding to the second task among a plurality of conditions corresponding to the second task, for example, a first condition in which a context of display exists and including activity information of the user, a user A second condition having the lowest activity information of , and a third condition that the number of devices for performing the second task is 1. The processor 320 may determine a plurality of Among the devices (devices A to F), first candidate devices (eg, device F and device E), which are portable devices that have a display context and satisfy the first condition including user activity information, are determined. The processor 320 may include a device F (eg, a smartphone 229)) may be determined as the second device for performing the second task.

According to an embodiment, the processor 320 (eg, the device management unit 310 ) requests the second device to perform the second task, and performs the execution of the second task received from the second device. State information indicating the execution may be collected as device information and stored in the memory 230 .

According to an embodiment, the processor 320 (eg, the device management unit 310 ) may include the plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 2 ) as shown in Table 3 below. )), a method in which each of the portable devices (eg, device E and device F) can perform the second task according to the type of non-portable devices (eg, device A to device D) can be registered in advance. there is.

A portable device capable of performing a second task Non-portable devices capable of performing the first task How to perform the second task. device E(227) device A Display menu information for performing the second task of device A device B -[No registered action] device C Display menu information for performing the second task of device C device D Display menu information for performing the second task of device D device F(223) device A Display menu information and activate voice service to perform the second task of device A device B Display menu information and activate voice service to perform the second task of device B device C Display menu information and activate voice service to perform the second task of device C device D Display menu information and activate voice service to perform the second task of device D

According to various embodiments of the present disclosure, the processor 320 (eg, the device management unit 310 ) receives, from the second device that has requested to perform the second task, information about another device that has been changed for performing the first task, It may request the other device among the devices (eg, the plurality of devices 221 to 229 of FIG. 2 ) to perform the first task. According to an embodiment, the processor 320 (eg, the device management unit) 310), when receiving information on another device selected by a user from a second device capable of providing a device change service for performing the first task, the first device for performing the first task The processor 320 may request the second device to perform a second task for the other device by requesting an end, and requesting the other device to perform the first task.

For example, the processor 320 requests a first device (eg, a TV device) to perform a first task, and sends a second device (eg, a smart phone) to a second task (eg, a smart phone) for the first device. : Display remote control menu for TV control) can be requested. When the processor 320 receives information on another device (eg, a refrigerator) selected by a user from a second device capable of providing a device change service for performing the first task, the first device (eg, a TV) device) to end the execution of the first task, and the other device (eg, a refrigerator) may request the execution of the first task. The processor 320 may request the second device (eg, a smart phone) to perform a second task (eg, display a remote control menu for controlling the refrigerator) for the other device (eg, a refrigerator).

According to various embodiments, the memory 330 may include a plurality of devices (eg, the plurality of devices 221 of FIG. 2 ) in the house managed by the electronic device 301 (eg, the electronic device 201 of FIG. 2 ). to 229)), the device information may be collected and stored.

According to an embodiment, the memory 330 collects and stores device information received from a plurality of devices (eg, a plurality of devices 221 to 229 of FIG. 2 ) as shown in Table 1 above. can be

According to an embodiment, as shown in Table 2, in the memory 330, the plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 2 ) perform a task according to the type of task. Methods that can be performed can be registered and stored in advance,

According to an embodiment, as shown in Table 3, the memory 330 is a portable device among the plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 2 ) (eg: Device E and device F) A method for performing the second task may be registered and stored in advance according to types of non-portable devices (eg, devices A to D).

According to an embodiment, the memory 330 may store a plurality of conditions set for each task type.

According to various embodiments, the display 360 may display a function currently being performed by the electronic device 301 under the control of the processor 320 .

According to an embodiment, the display 36 performs a first task corresponding to first information for performing a task among the plurality of devices (eg, the plurality of devices 221 to 229 of FIG. 2 ). Information on the first device determined for the purpose and/or information on the second device determined to perform the second task for the first device may be displayed.

According to various embodiments, the communication module 390 may include a plurality of communication circuits using different communication technologies.

According to an embodiment, the communication module 390 may include a mobile communication module (not shown) or a sub communication module (not shown) that performs short-range communication with a wireless LAN. The communication module 390 may communicate with an external device using at least one antenna (not shown) under the control of the processor 320 .

According to an embodiment, the communication module 390 may include at least one of a wireless LAN module (not shown) and a short-range communication module (not shown), and includes an NFC communication module as the short-range communication module (not shown); It may include a Bluetooth legacy communication module and/or a BLE communication module.

4 is a block diagram 400 of a device management unit of an electronic device according to various embodiments of the present disclosure.

Referring to FIG. 4 , the device management unit 310 may include a device collection unit 311 and a device detection unit 313 .

According to various embodiments of the present disclosure, the device collection unit 311 may include a plurality of devices (eg, the electronic device 201 of FIG. 2 and/or the electronic device 301 of FIG. 3 ) in the house managed by the electronic device (eg: Device information of each of the plurality of devices 211 to 219 of FIG. 2 may be collected.

According to an embodiment, when each of the plurality of devices is initially connected to the electronic device, the device collection unit 311 may collect and store device configuration information received from each of the plurality of devices. .

According to an embodiment, the device collection unit 311 may collect and store device status information received from each of the plurality of devices whenever the status information of each of the plurality of devices is changed.

According to an embodiment, the device collection unit 311 may collect and store device information of each of the plurality of devices as shown in Table 1 above.

According to an embodiment, the device collection unit 311 may provide device information collected from each of the plurality of devices to the device detection unit 313 .

According to various embodiments of the present disclosure, the device detection unit 313 identifies a first task corresponding to first information for performing a task, and includes a plurality of devices (eg, a plurality of devices 221 to 229 of FIG. 2 ). may identify a first device to perform the first task, identify a second task for the first device, and determine a second device to perform the second task among the plurality of devices.

According to an embodiment, when the user's utterance is acquired with the first information, the device detection unit 313 parses and analyzes the user's utterance, and identifies a first task based on the analysis information of the user's utterance. can

According to an embodiment, the device detection unit 313 checks a plurality of conditions corresponding to the first task among a plurality of conditions set for each task type, and corresponds to the first task among the plurality of devices. It is possible to determine a first device that satisfies a plurality of conditions, and request the first device to perform the first task.

According to an embodiment, the device detection unit 313 checks a second task for the first device that has performed the first task, and corresponds to the second task among a plurality of conditions set for each task type. A plurality of conditions to be performed may be checked, a second device satisfying a plurality of conditions corresponding to the second task from among the plurality of devices may be determined, and a request may be made to the second device to perform the second task.

According to various embodiments, the electronic device (eg, the electronic device of FIG. 1 , the electronic device 201 of FIG. 2 , the electronic device 301 of FIG. 3 , or the electronic device 501 of FIG. 5 may include a communication module (eg, the electronic device 501 of FIG. 5 ). : Obtaining first information for performing a communication module 290 of FIG. 3), a memory (eg, the memory 230 of FIG. 3), and a task, and confirming a first task corresponding to the first information, A processor configured to identify a first device that satisfies a plurality of conditions corresponding to the first task among a plurality of devices, and to request the first device to perform the first task through the communication module (eg, FIG. 1 processor 122 or processor 320 of FIG. 3 ).

According to various embodiments, the processor may be configured to store device information collected from the plurality of devices in the memory.

According to various embodiments, the processor checks a plurality of conditions corresponding to the first task among a plurality of conditions set for each task type,

It may be configured to determine a first device that satisfies a plurality of conditions corresponding to the first task from among the plurality of devices based on device information collected from the plurality of devices stored in the memory.

According to various embodiments of the present disclosure, the processor identifies first candidate devices that satisfy a first condition indicating a constraint condition on configuration information of a device for performing the first task among the plurality of devices, and Checking second candidate devices that satisfy a second condition indicating a preference condition for state information of a device for performing the first task among the candidate devices, and performing the first task among the second candidate devices It may be configured to identify the first device that satisfies the third condition for the number information of .

According to various embodiments of the present disclosure, the processor may be configured to collect state information notifying the performance of the first task received from the first device as device information and store the collected state information in the memory.

According to various embodiments, the processor identifies a second task for the first device, identifies a second device that satisfies a plurality of conditions corresponding to the second task among the plurality of devices, and It may be configured to request the second device to perform the second task through a communication module.

According to various embodiments, the processor is configured to confirm the second task for performing an additional service for the first task performed by the first device or the second task for controlling a function of the first device can be set.

According to various embodiments, the processor is configured to satisfy a plurality of conditions corresponding to the second task among the plurality of devices based on device information collected from the plurality of devices stored in the memory of the electronic device. It may be set to verify the second device.

According to various embodiments of the present disclosure, the processor is configured to identify first candidate devices that satisfy a first condition for configuration information of a device for performing the second task and user activity information among the plurality of devices, and Check second candidate devices that satisfy a second condition for state information of devices for performing the second task from among one candidate devices, and information on the number of devices for performing the second task among the second candidate devices It may be set to check the second device that satisfies the third condition for .

According to various embodiments of the present disclosure, the processor may be configured to collect state information notifying the execution of the second task received from the second device as device information and store the collected state information in the memory of the electronic device.

5 is a flowchart 500 for explaining an operation of determining a device for performing a task in an electronic device according to various embodiments of the present disclosure. The determining operation of the device for performing the task may include operations 501 to 521 . According to an embodiment, at least one of operations 501 to 521 may be omitted, the order of some operations may be changed, or another operation may be added.

In operation 501 , the electronic device 501 (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , or the electronic device 301 of FIG. 3 ) transmits first information for performing a task. can be obtained

According to an embodiment, the electronic device 501 may store at least one of user's utterance information, state change information of an in-house device, specific time information, in-house state change information, and in-house user location information to perform a task. The first information may be obtained. For example, when the first information is user utterance information, the user's utterance may be received through a microphone of the electronic device or the user's utterance may be received from an indoor device communicatively connected to the electronic device 501 .

In operation 503 , the electronic device 501 may identify first information for performing a task, and may identify a first task corresponding to the first information.

According to an embodiment, if the electronic device 501 identifies the first information as the user's utterance information, it may parse the user's utterance and identify a first task that the user intends to perform.

According to an embodiment, when the electronic device 501 identifies the first information as state change information of the indoor device, the electronic device 501 responds to a state change (eg, the air conditioner changes from an off state to an on state) of the indoor device. A first task (eg, today's weather information guide) may be checked.

According to an embodiment, when the electronic device 501 identifies the first information as specific time information, a first task (eg, watching a drama) to be performed on specific time information (eg, every Monday at 2 PM) ) can be checked.

According to an embodiment, when the electronic device 501 identifies the first information as the state change information of the premises, the state change information of the premises (eg, each of the current temperature, humidity, or amount of light in the premises is equal to or greater than a reference value) Alternatively, it is possible to check the first task (eg, output information about the currently changed temperature, humidity, or amount of light in the house) corresponding to the following).

According to an embodiment, when the electronic device 501 identifies the first information as the user location information in the house, the electronic device 501 determines the first information corresponding to the user location information in the house (eg, location information of a user located in a specific room). 1 You can check the task (eg, output the user's schedule information).

In operation 505 , the electronic device 501 may determine a first device to perform a first task among a plurality of devices.

According to an embodiment, the electronic device 501 checks a plurality of conditions corresponding to the first task from among a plurality of conditions set for each task type, and checks a plurality of conditions at home managed by the electronic device 501 . Among the devices (eg, the plurality of devices 211 to 219 of FIG. 2 ), a first device 521 satisfying a plurality of conditions corresponding to the first task may be determined.

According to an embodiment, the electronic device 501 sequentially applies a plurality of conditions corresponding to the first task to obtain a first device 521 satisfying a plurality of conditions corresponding to the first task. can decide

In operation 507, the electronic device 501 may request the first device to perform the first task.

In operation 509 , the first device 521 may perform a first task.

According to an embodiment, the first device 521 may perform the first task according to the request of the electronic device 501 .

In operation 511 , the first device 521 may transmit status information informing of the performance of the first task to the electronic device 501 .

According to an embodiment, the first device 521 transmits status information indicating that the first device 521 is currently performing the first task and/or status information notifying the completion of the first task performance to the electronic device It can be transmitted to 501 .

In operation 513 , the electronic device 501 may identify a second task for the first device 521 .

According to an embodiment, the electronic device 501 determines whether to perform the second task and determines whether to perform the second task when receiving status information indicating that the first task is performed from the first device 521 . If it is determined that , the second task for the first device may be confirmed.

According to an embodiment, the electronic device 501 may check a plurality of conditions (eg, first to third conditions) for determining whether to perform the second task, and check all of the plurality of conditions or When at least a part is satisfied, it may be determined to perform the second task. The plurality of conditions include a first condition that the first task corresponding to the first information for performing the task is not related to termination of the function of the first device (eg, a user utterance requesting termination of the function of the first device); a second condition that the number of functions (eg, a display function, a speaker function, or a voice support function, etc.) that the first device can perform based on the configuration information of the first device is equal to or greater than a certain number; and A third condition may include a non-portable device.

According to an embodiment, when the electronic device 501 determines to perform the second task for the first device, the electronic device 501 provides a second service for the first task performed by the first device 521 . A task and/or a second task for controlling a function of the first device 521 may be identified.

In operation 515 , the electronic device 501 may identify a second device 523 that will perform the second task among the plurality of devices.

According to an embodiment, the electronic device 501 checks a plurality of conditions corresponding to the second task from among a plurality of conditions set for each task type, and checks a plurality of conditions at home managed by the electronic device 501 . A second device 523 that satisfies a plurality of conditions corresponding to the second task among the devices (eg, the plurality of devices 211 to 219 of FIG. 2 ) may be determined.

According to an embodiment, the electronic device 501 sequentially applies a plurality of conditions corresponding to the first task to obtain a second device 523 that satisfies a plurality of conditions corresponding to the second task. can decide

In operation 517 , the electronic device 501 may request the second device 523 to perform the second task.

In operation 519, the second device 523 may perform a second task.

According to an embodiment, the second device 523 may perform the second task according to the request of the electronic device 501 .

In operation 521 , the second device 523 may transmit status information informing of the execution of the second task to the electronic device 501 .

According to an embodiment, when the electronic device 501 receives information on another device selected by the user from the second device 523 that can provide a device change service for performing the first task, the The first device 521 may request an end of the execution of the first task, and the other device may request the first task to be performed. The electronic device 501 may request the second device 523 to perform a second task for the other device.

6 is a flowchart 600 for explaining an operation of determining a device for performing a task in an electronic device according to various embodiments of the present disclosure. The operation of determining the apparatus for performing the task may include operations 601 to 621 . According to an embodiment, at least one of operations 601 to 621 may be omitted, the order of some operations may be changed, or another operation may be added. The determining operations of the device for performing the task include the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , the electronic device 301 of FIG. 3 , the processor 320 of FIG. 3 , or the electronic device of FIG. 5 . may be performed on the device 501 .

In operation 601 , the electronic device 301 may obtain first information for performing a task.

According to an embodiment, the electronic device 301 may store at least one of user's utterance information, state change information of an in-house device, specific time information, in-house state change information, and in-house user location information to perform a task. The first information may be obtained. For example, when the first information is user utterance information, the user's utterance may be received through a microphone of the electronic device or the user's utterance may be received from an indoor device communicatively connected to the electronic device 501 .

In operation 603 , the electronic device 301 may identify first information for performing a task, and may identify a first task corresponding to the first information.

According to an embodiment, when the electronic device 301 identifies the first information as the user's utterance information, the electronic device 301 may parse the user's utterance to identify the first task the user intends to perform.

According to an embodiment, when the electronic device 301 identifies the first information as the state change information of the indoor device, the electronic device 301 responds to the state change of the indoor device (eg, the air conditioner changes from the off state to the on state). A first task (eg, today's weather information guide) may be checked.

According to an embodiment, when the electronic device 301 identifies the first information as specific time information, a first task (eg, watching a drama) to be performed on specific time information (eg, every Monday at 2 PM) ) can be checked.

According to an embodiment, when the electronic device 301 identifies the first information as the state change information of the house, the state change information of the house (eg, each of the temperature, humidity, or light quantity of the current house is greater than or equal to a reference value) or below) corresponding to the first task (eg, outputting information about currently changed temperature, humidity, or light amounts in the house) may be checked.

According to an embodiment, when the electronic device 301 identifies the first information as the user location information in the house, the electronic device 301 determines that the first information corresponds to the user location information in the house (eg, location information of a user located in a specific room). 1 You can check the task (eg, output the user's schedule information).

In operation 605, the electronic device 301 may check a plurality of conditions corresponding to the first task.

According to an embodiment, the electronic device 601 may identify a plurality of conditions corresponding to the first task among a plurality of conditions set for each task type.

In operation 607 , the electronic device 301 may determine a first device that satisfies a plurality of conditions corresponding to the first task from among the plurality of devices.

According to an embodiment, the electronic device 301 performs the first task among a plurality of devices in the house managed by the electronic device 301 (eg, the plurality of devices 211 to 219 of FIG. 2 ). First candidate devices that satisfy the first condition for configuration information of the device for execution may be identified. The electronic device 301 may identify second candidate devices that satisfy a second condition for state information of a device for performing the first task among the first candidate devices. The electronic device 301 may determine the first device that satisfies a third condition for information on the number of devices for performing the first task among the second candidate devices.

In operation 609, the electronic device 301 may request the first device to perform the first task.

611 in action. The electronic device 301 may receive status information notifying the performance of the first task from the first device.

According to an embodiment, the electronic device 301 may collect and store the state information received from the first device as device information.

In operation 613 , the electronic device 301 may identify a second task for the first device.

According to an embodiment, when the electronic device 301 receives status information informing that the first task is performed, a second task for an additional service for the first task performed by the first device and/or A second task for controlling the function of the first device may be identified.

According to an embodiment, the electronic device 301 determines whether to perform the second task when receiving status information indicating that the first task is performed from the first device, and determines whether the second task is performed. If determined, the second task for the first device may be confirmed.

According to an embodiment, the electronic device 301 may check a plurality of conditions (eg, first to third conditions) for determining whether to perform the second task, and check all of the plurality of conditions or When at least a part is satisfied, it may be determined to perform the second task. The plurality of conditions include a first condition that the first task corresponding to the first information for performing the task is not related to termination of the function of the first device (eg, a user utterance requesting termination of the function of the first device); a second condition that the number of functions (eg, a display function, a speaker function, or a voice support function, etc.) that the first device can perform based on the configuration information of the first device is equal to or greater than a certain number; and A third condition may include a non-portable device.

According to an embodiment, when the electronic device 301 determines to perform the second task for the first device, a second task for an additional service for the first task performed by the first device or/ and a second task for controlling a function of the first device.

In operation 615 , the electronic device 301 may check a plurality of conditions corresponding to the second task.

According to an embodiment, the electronic device 301 may identify a plurality of conditions corresponding to the second task among a plurality of conditions set for each task type.

In operation 617 , the electronic device 301 may determine a second device that satisfies a plurality of conditions corresponding to the second task from among the plurality of devices.

According to an embodiment, the electronic device 301 performs the second task among a plurality of devices (eg, the plurality of devices 211 to 219 of FIG. 2 ) in the house managed by the electronic device 301 . First candidate devices that satisfy the first conditions for the configuration information of the device for execution and the user's activation information may be identified. The electronic device 301 may identify second candidate devices that satisfy a second condition for state information of a device for performing the second task among the first candidate devices. The electronic device 301 may determine the second device that satisfies a third condition for information on the number of devices for performing the second task among the second candidate devices.

In operation 619 , the electronic device 301 may request the second device to perform the second task.

In operation 621 , the electronic device 301 may receive status information informing that the second task is performed from the second device.

According to an embodiment, the electronic device 301 may collect and store the state information received from the second device as device information.

According to an embodiment, when receiving information on another device selected by a user from a second device capable of providing a device change service for performing the first task, the electronic device 301 sends the information to the first device. It is possible to request an end of the execution of the first task, and request the other device to perform the first task. The electronic device may request the second device to perform a second task for the other device.

7 is a flowchart 700 for explaining an operation of determining whether to perform a second task in an electronic device according to various embodiments of the present disclosure. The determining operation of the device for performing the task may include operations 701 to 709 . According to an embodiment, at least one of operations 701 to 709 may be omitted, the order of some operations may be changed, or another operation may be added. The determining operations of the device for performing the task include the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , the electronic device 301 of FIG. 3 , the processor 320 of FIG. 3 , or the electronic device of FIG. 5 . may be performed on the device 501 .

In operation 701 , the electronic device 301 determines whether the second task for the first device is to be performed, and the first task corresponding to the first information for performing the task among a plurality of conditions is determined by the first device. It may be checked whether the first condition that is not related to function termination (eg, a user utterance requesting termination of the function of the first device) is satisfied.

In step 701 , if it is determined that the first task is a task for terminating a function (or operation) of the first device, it is determined that the first condition is not satisfied, and in step 711 , the electronic device 301 determines that the first condition is not satisfied. It may be determined not to perform the second task.

In operation 701, if the electronic device 301 determines that the first condition is satisfied, in operation 703, the first device performs the It may be checked whether the second condition that the number of available functions (eg, a display function, a speaker function, or a voice support function, etc.) is equal to or greater than a predetermined number is satisfied.

In operation 703 , if it is determined that the number of functions that the first device can perform is less than or equal to a predetermined number, the electronic device 301 determines that the second condition is not satisfied, and in operation 711 , the second You can decide not to perform the task.

In step 703, if the electronic device 301 determines that the second condition is satisfied, in step 705 whether the first device satisfies the third condition that the first device is a non-portable device among the plurality of conditions can be checked

In operation 705, when the first device is identified as a portable device (eg, a watch phone and a smart phone), the electronic device 301 determines that the third condition is not satisfied, and in operation 711 It may be determined not to perform the second task.

In operation 705 , if the third condition is satisfied, the electronic device 301 may determine to perform the second task in operation 707 .

In operation 709 , the electronic device 31 may identify a second task for the first device when it is determined to perform the second task.

8 is a diagram 800 for explaining an operation of determining a device for performing a task in an electronic device according to various embodiments of the present disclosure.

Referring to FIG. 8 , an electronic device 801 (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , or the electronic device 301 of FIG. 3 ) performs a first task for performing a task. If the user's utterance 811a of "show the recently taken photo" is acquired as information, the first task of "showing the photo" can be identified by analyzing the user's utterance.

The electronic device 801 prefers a first condition in which a context of power exists as a plurality of conditions corresponding to the first task among a plurality of conditions set for each task type, and the display resolution is the highest. A second condition to be performed and a third condition in which there is one device performing the first task may be checked.

The electronic device 801, with reference to <Table 1>, refers to the first device in which the context of power is present among a plurality of devices (eg, devices A to F) in the house managed by the electronic device 801 . First candidate devices that satisfy the first condition (eg, device A, device B, device D, device E, and device F) may be determined. The electronic device 801 evaluates the second condition in the order of the display resolutions while the context of the display exists among the first candidate devices (eg, device A, device B, device D, device E, and device F). Satisfying second candidate devices (eg, device A > device B = device F > device E) may be determined. The electronic device 801 selects the device A as the second candidate device (eg, device A) satisfying the second condition satisfies the third condition that the number of devices for performing the first task is one device. It may be determined as a first device for performing the first task.

The electronic device 801 may request the first device 821 to perform a first task (811b).

The first device 821 may receive a recent photo from a server or other devices according to the request of the electronic device 801 , and display it on the display of the first device 821 .

The electronic device 801 may receive status information notifying the performance of the first task from the first device 821 ( 811c ).

When the electronic device 801 receives status information informing that the first task is performed from the first device 821 , the first task performed by the first device 821 (eg, showing a recent photo) The second task for performing an additional service for , or the second task for controlling a function of the first device 821 may be identified. The electronic device 801 is configured to display menu information for providing an additional service (eg, a photo search service, etc.) for a first task (eg, showing a recent photo) in the first device 821 . You can check the task. The electronic device 801 may identify a second task of displaying menu information for controlling an original function (eg, a TV function) in the first device 821 .

In the electronic device 801, the display context exists as a plurality of conditions corresponding to the second task among a plurality of conditions set for each task type, and the first condition in which the user's activity information exists and the volume size are A second condition in which the maximum is preferred and a third condition in which there is one device for performing the second task may be identified.

The electronic device 801 includes a context of a display among a plurality of devices (eg, devices A to F) in the house managed by the electronic device 801 with reference to <Table 1>, and a user It is possible to determine first candidate devices (eg, devices E to F) that satisfy the first condition in which activity information of . The electronic device 801 may determine a second candidate device (eg, device F) that satisfies the second condition having the largest volume size among first candidate devices (eg, device E to device F). The electronic device 801 sets the second candidate device (eg, device F) to a second device 829 because the second candidate device (eg, device F) satisfies the third condition that there is one task performing device. can be decided with

The electronic device 801 may request the second device 829 to perform a second task (811d).

The second device 829 provides an additional service (eg, a photo search service, etc.) for a second task (eg, a first task (eg, showing a recent picture) according to the request of the electronic device 801 ). and/or display menu information for controlling an original function (eg, a TV function) in the first device 821), and the user uses the second device 829 to One device 821 can be controlled (811f).

9 is a diagram 900 for explaining an operation of determining a device for performing a task in an electronic device according to various embodiments of the present disclosure.

Referring to FIG. 9 , an electronic device 901 (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , or the electronic device 301 of FIG. 3 ) performs a first task for performing a task. If the user's utterance 911a, "Tell me how to get to a nearby Chinese house" is acquired as information, the first task of "Guidance" can be identified by analyzing the user's utterance.

The electronic device 801, among a plurality of conditions set for each task type, prefers a first condition in which a context of power exists and a voice service authenticity is impossible as a plurality of conditions corresponding to the first task, a maximum volume size A second condition to be performed and a third condition in which there is one first task performing device may be checked.

The electronic device 901, with reference to <Table 1>, refers to the first device in which the context of power is present among a plurality of devices (eg, devices A to F) in the house managed by the electronic device 901 . First candidate devices that satisfy the first condition (eg, device A, device B, device D, device E, and device F) may be determined. The electronic device 801 arranges the second candidate devices (eg, device A, device B, device D, device E, and device F) from among first candidate devices in an order of increasing volume size to satisfy the second condition. Candidate devices (eg, device A > device D = device F > device B > device E) may be determined. The electronic device 801 determines that the second candidate device (eg, device A) satisfying the second condition satisfies the third condition that there is one device for performing the first task, so that the second candidate device (eg, device A) satisfies the third condition. : Device A 921) may be determined as the first device.

The electronic device 901 may request the first device 921 to perform a first task ( 911b ).

The first device 921 receives, from a server or other devices, road information of the most recent Chinese restaurant closest to the user's house according to the request of the electronic device 901 , and sets the speaker of the first device 921 . The first task of outputting "path information of the nearest recent Chinese restaurant" may be performed.

The electronic device 901 may receive status information notifying the performance of the first task from the first device 921 ( 911c ).

When the electronic device 301 receives status information informing that the first task is performed from the first device 921 , the first task performed by the first device 921 (eg, directions to the nearest Chinese restaurant) is received. ), the second task for performing an additional service and/or the second task for controlling a function of the first device 921 may be identified. The electronic device 901 provides a menu for providing an additional service (eg, an additional search service for the nearest Chinese restaurant, etc.) for the first task (eg, directions to the nearest Chinese restaurant) in the first device 921 . A second task for displaying information may be checked. The electronic device 901 may identify a second task of displaying menu information for controlling an original function (eg, a TV function) in the first device 921 .

The electronic device 901 includes a first condition in which a context of display exists as a plurality of conditions corresponding to the second task among a plurality of conditions set for each task type, a first condition in which activity information of a user exists, and a current condition of the user. A second condition with the lowest activity information and a third condition with one second task performing device may be identified.

In the electronic device 901, with reference to <Table 1>, a display context exists among a plurality of devices (eg, devices A to F) in the house managed by the electronic device 901 , and a user It is possible to determine first candidate devices (eg, devices E to F) that satisfy the first condition in which current activity information of . The electronic device 901 determines a second candidate device (eg, device F) that satisfies the second condition in which the user's current activity information is the lowest among the first candidate devices (eg, device E to device F). can The electronic device 901 sets the second candidate device (eg, device F 929 ) to the second candidate device (eg, device F 929 ) when the second candidate device (eg, device F) satisfies the third condition that there is one task performing device. device can be determined.

The electronic device 901 may request the second device 929 to perform a second task (911d).

The second device 929 may display menu information corresponding to the second task on the display of the second device according to the request of the electronic device 901 .

The electronic device 901 may receive status information notifying the execution of the second task from the second device 929 ( 911e ).

In response to the request of the electronic device 901 , the second device 929 provides an additional service (eg, an additional search service for the nearest Chinese restaurant) for a second task (eg, a first task (eg, directions to a nearby Chinese restaurant)). etc.) to display menu information and/or display menu information for controlling an original function (eg, a TV function) in the first device 721 ), and the user can use the second device 929 . can be used to control the first device 921 ( 911f ).

In addition to the embodiments shown in FIGS. 8-9 , the electronic device (eg, the electronic device 301 of FIG. 3 ) uses the first information for task execution to change the state of the indoor device (eg, the air conditioner from an off state to an on state) ) and a first task (eg, today's weather information guide) corresponding to the state change information of the in-house device is confirmed, through a first device (eg, a speaker) among a plurality of devices in the home. The first task may be performed.

In addition, the electronic device (eg, the electronic device 301 of FIG. 3 ) checks specific time information (eg, every Monday at 2:00 pm) as first information for performing a task, and determines the first information corresponding to the specific time information. When the first task (eg, watching a drama) is confirmed, the first task is performed through a first device (eg, a TV device) among a plurality of devices in the house, and the second task is performed with a second device (eg, a smart phone). (eg, display the remote control menu for TV control) can be performed.

In addition, the electronic device (eg, the electronic device 301 of FIG. 3 ) includes, as the first information for performing the task, information on state change in the house (eg, each of the temperature, humidity, or light quantity of the current house is equal to or greater than or equal to a reference value). ) and the first task corresponding to the state change information in the house (eg, output information on the currently changed temperature, humidity, or amount of light in the house), the first device among the plurality of devices in the house (eg, : speaker) to perform the first task.

Also, the electronic device (eg, the electronic device 301 of FIG. 3 ) identifies the user location information in the home as first information for performing the task, and a first task corresponding to the user location information in the home (eg: When checking the user's schedule information output), the first task is performed through a first device (eg, a speaker) existing in a specific room in which the user is located among a plurality of devices in the house, and a second device (eg, a smart phone) is used. ) to perform the second task (eg, display a remote control menu for TV control).

10A to 10B are diagrams 1000a to 1000b for explaining a device switching operation for performing a task in a second device according to various embodiments of the present disclosure.

As shown in FIG. 10A , the second device 1023 (eg, the smart phone 229 of FIG. 2 ) displays a second task (eg, a remote control menu for TV control) for the first device (eg, a TV device). ), the user performs the first task through the selection of the device change menu 1003 for providing a device change service for performing the first task (eg, “showing the photo taken yesterday”). When another device (eg, a refrigerator) is selected for use, information on the other device (eg, refrigerator) selected by the user is displayed on the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 ) or It can be transmitted to the electronic device 301 of FIG. 3 .

When the electronic device receives information on the other device (eg, refrigerator) selected by the user from the second device 1023 , the electronic device sends the first task (eg, “yesterday” to the first device (eg, TV device) It is possible to request an end of the execution of the "showing the picture taken") and to request the other device (eg, a refrigerator) to perform the first task (eg, "showing the picture taken yesterday"). The electronic device may request the second device 1023 (eg, a smart phone) to perform a second task (eg, display a remote control menu for controlling the refrigerator) for the other device (eg, a refrigerator). .

As shown in FIG. 10B , the second device 1023 (eg, the smart phone 229 of FIG. 2 ) performs a second task (eg, refrigerator control) for the other device (eg, refrigerator) from the electronic device. Upon receiving a request (eg, display of a remote control menu for TV control), a second task (eg, display of a remote control menu for TV control) for the other device (eg, refrigerator) may be performed.

According to various embodiments of the present disclosure, a method of determining a device for performing a task in an electronic device includes obtaining first information for performing a task, identifying a first task corresponding to the first information, and a plurality of devices. The method may include checking a first device that satisfies a plurality of conditions corresponding to the first task among them, and requesting the first device to perform the first task through the communication module.

According to various embodiments, the method may further include storing device information collected from the plurality of devices in the memory of the electronic device.

According to various embodiments, the checking of the first device includes checking a plurality of conditions corresponding to the first task among a plurality of conditions set for each task type, and the plurality of devices stored in the memory. and identifying a first device that satisfies a plurality of conditions corresponding to the first task from among the plurality of devices, based on the device information collected from the .

According to various embodiments, the identifying of the first device may include selecting first candidate devices that satisfy a first condition indicating a constraint on configuration information of a device for performing the first task among the plurality of devices. checking, checking second candidate devices that satisfy a second condition indicating a preference condition for state information of a device for performing the first task among the first candidate devices, and the second candidate devices and checking the first device that satisfies a third condition for information on the number of devices for performing the first task.

According to various embodiments of the present disclosure, the method may further include collecting status information notifying performance of the first task received from the first device as device information and storing the collected status information as device information in a memory of the electronic device.

According to various embodiments, the operation of identifying a second task for the first device, the operation of identifying a second device satisfying a plurality of conditions corresponding to the second task among the plurality of devices, and the electronic The method may further include requesting the second device to perform the second task through a communication module of the device.

According to various embodiments, the confirming of the second task for the first device may include the second task or a function of the first device for performing an additional service for the first task performed by the first device. and confirming the second task for controlling

According to various embodiments, the checking of the second device may include, based on device information collected from the plurality of devices stored in the memory of the electronic device, corresponding to the second task among the plurality of devices. It may include checking the second device that satisfies a plurality of conditions.

According to various embodiments, the checking of the second device may include a first candidate device that satisfies a first condition for configuration information and user activity information of a device for performing the second task among the plurality of devices. identifying second candidate devices that satisfy a second condition for state information of a device for performing the second task among the first candidate devices, and the second candidate devices among the second candidate devices and checking the second device that satisfies a third condition for information on the number of devices for performing two tasks.

According to various embodiments of the present disclosure, the method may further include collecting status information notifying the execution of the second task received from the second device as device information and storing the collected status information in the memory of the electronic device.

The electronic device according to various embodiments disclosed in this document may be a device of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed online (eg download or upload), directly between smartphones (eg smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Claims (20)

In an electronic device,
communication module;
Memory; and
Obtaining first information for performing a task, and confirming a first task corresponding to the first information,
Checking a first device that satisfies a plurality of conditions corresponding to the first task among a plurality of devices,
and a processor configured to request the first device to perform the first task through the communication module.
The method of claim 1, wherein the processor comprises:
An electronic device configured to store device information collected from the plurality of devices in the memory.
The method of claim 1, wherein the processor comprises:
Checking a plurality of conditions corresponding to the first task among a plurality of conditions set for each task type,
an electronic device configured to determine a first device satisfying a plurality of conditions corresponding to the first task from among the plurality of devices based on device information collected from the plurality of devices stored in the memory.
The method of claim 1, wherein the processor comprises:
check first candidate devices that satisfy a first condition indicating a constraint on configuration information of a device for performing the first task among the plurality of devices;
check second candidate devices that satisfy a second condition indicating a preference condition for state information of a device for performing the first task among the first candidate devices;
The electronic device configured to identify the first device that satisfies a third condition for information on the number of devices for performing the first task among the second candidate devices.
The method of claim 1, wherein the processor comprises:
The electronic device is configured to collect status information notifying the performance of the first task received from the first device as device information and store the collected state information in the memory.
The method of claim 1, wherein the processor comprises:
identify a second task for the first device;
check a second device that satisfies a plurality of conditions corresponding to the second task among the plurality of devices;
an electronic device configured to request the second device to perform the second task through the communication module.
The method of claim 6, wherein the processor comprises:
An electronic device configured to confirm the second task for performing an additional service for the first task performed by the first device or the second task for controlling a function of the first device.
The method of claim 6, wherein the processor comprises:
an electronic device configured to identify a second device that satisfies a plurality of conditions corresponding to the second task from among the plurality of devices based on device information collected from the plurality of devices stored in the memory of the electronic device.
The method of claim 6, wherein the processor comprises:
identifying first candidate devices that satisfy a first condition for configuration information of a device for performing the second task and user activity information among the plurality of devices;
check second candidate devices that satisfy a second condition for state information of a device for performing the second task among the first candidate devices;
The electronic device configured to identify the second device that satisfies a third condition for information on the number of devices for performing the second task among the second candidate devices.
The method of claim 6, wherein the processor comprises:
The electronic device is configured to collect status information informing that the second task is performed, received from the second device, as device information and store it in a memory of the electronic device.
A method for determining a device for performing a task in an electronic device comprises:
obtaining first information for performing a task;
checking a first task corresponding to the first information;
identifying a first device that satisfies a plurality of conditions corresponding to the first task among a plurality of devices; and
and requesting the first device to perform the first task through the communication module.
12. The method of claim 11,
and storing device information collected from the plurality of devices in a memory of the electronic device.
The method of claim 11, wherein the checking of the first device comprises:
checking a plurality of conditions corresponding to the first task from among a plurality of conditions set for each task type; and
and identifying a first device that satisfies a plurality of conditions corresponding to the first task from among the plurality of devices, based on device information collected from the plurality of devices stored in the memory.
The method of claim 11, wherein the checking of the first device comprises:
identifying first candidate devices that satisfy a first condition indicating a constraint on configuration information of a device for performing the first task among the plurality of devices;
identifying second candidate devices that satisfy a second condition indicating a preference condition for state information of a device for performing the first task among the first candidate devices; and
and identifying the first device that satisfies a third condition for information on the number of devices for performing the first task among the second candidate devices.
12. The method of claim 11,
The method of claim 1, further comprising: collecting, as device information, state information for informing that the first task is performed, received from the first device, in a memory of the electronic device.
12. The method of claim 11,
identifying a second task for the first device;
checking a second device that satisfies a plurality of conditions corresponding to the second task among the plurality of devices; and
and requesting the second device to perform the second task through a communication module of the electronic device.
The method of claim 16, wherein the identifying a second task for the first device comprises:
and confirming the second task for performing an additional service for the first task performed on the first device or the second task for controlling a function of the first device.
The method of claim 16, wherein the checking of the second device comprises:
identifying a second device that satisfies a plurality of conditions corresponding to the second task among the plurality of devices based on device information collected from the plurality of devices stored in a memory of the electronic device; Way.
The method of claim 16, wherein the checking of the second device comprises:
identifying first candidate devices that satisfy a first condition for configuration information of a device for performing the second task and user activity information among the plurality of devices;
checking second candidate devices that satisfy a second condition for state information of a device for performing the second task among the first candidate devices; and
and identifying the second device that satisfies a third condition for information on the number of devices for performing the second task among the second candidate devices. 17. The method of claim 16,
The method of claim 1, further comprising: collecting, as device information, state information for informing that the second task is performed, received from the second device, in a memory of the electronic device.

Images