KR101818203B1 - Mobile Terminal And Method Of Controlling The Same - Google Patents

Abstract

The present invention relates to a mobile terminal and a control method of the mobile terminal. The present invention provides a user interface for efficiently accessing a plurality of displayed objects overlapping each other and providing various user interfaces for executing an application corresponding to at least one object among the plurality of objects, A control method of a mobile terminal is provided.

Description

TECHNICAL FIELD [0001] The present invention relates to a control method for a mobile terminal,

The present invention relates to a video display method of a mobile terminal (including a general electronic apparatus), and more particularly, to a video display method of a mobile terminal (including a general electronic apparatus) in which, when a plurality of objects overlap, And a video display method of the mobile terminal.

Recently, there has been a tendency to provide a stereoscopic image through an electronic device including a mobile terminal. To this end, improvement of the hardware and / or software of the mobile terminal is considered.

An object of the present invention is to provide a mobile terminal and a control method of the mobile terminal that provide a user interface for efficiently accessing a plurality of displayed objects that are overlapped with each other.

Another object of the present invention is to provide a mobile terminal and a control method of the mobile terminal that provide various user interfaces for executing an application corresponding to at least one object among the plurality of objects.

The technical objects to be achieved by the present invention are not limited to the technical problems mentioned above. In addition, other technical objects to be achieved by the present invention will become apparent to those skilled in the art from the following description.

A mobile terminal according to a first aspect of the present invention includes: a touch screen; And when a plurality of objects corresponding to different applications overlap each other and are displayed on the touch screen and the plurality of objects overlap to receive a touch operation on the displayed area, And controlling the display of the plurality of objects so as to enable access by touch to the plurality of objects.

A mobile terminal according to a second aspect of the present invention includes: a touch screen; When a plurality of objects corresponding to different applications are overlapped and displayed on the touch screen and the plurality of objects are overlapped and received a touch operation for the displayed area, And a control unit for performing a first operation of executing all of the plurality of applications corresponding to each other.

A method of controlling a mobile terminal according to a third aspect of the present invention is a method of controlling a mobile terminal in a mobile terminal having a touch screen, the method comprising: a plurality of objects, Receiving a touch operation on an area in which the plurality of objects are overlapped and displayed on the touch screen; And controlling the display of the plurality of objects so that the plurality of objects can be accessed by touching upon receipt of the touch operation.

A control method of a mobile terminal according to a fourth aspect of the present invention is a method of controlling a mobile terminal in a mobile terminal having a touch screen, the method comprising: a plurality of objects, Receiving a touch operation on an area in which the plurality of objects are overlapped and displayed on the touch screen; And performing a first operation of executing all of a plurality of applications respectively associated with the plurality of objects in response to the reception of the touch operation.

According to the control method of the mobile terminal and the mobile terminal according to the present invention, the following effects can be obtained.

According to the present invention, it is possible to efficiently access each of a plurality of displayed objects overlapping each other.

In addition, according to the present invention, a user can be provided with various user interfaces for executing an application corresponding to at least one object among the plurality of objects, so that the user can conveniently and efficiently control the mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a conceptual diagram for explaining the proximity depth of the proximity sensor.
3 and 4 are views for explaining a stereoscopic image displaying method using a binocular parallax according to embodiments of the present invention.
5 is a flowchart of a video display method of the mobile terminal according to the first embodiment of the present invention.
6 is a diagram illustrating an example in which the plurality of objects are overlapped with each other and displayed on the touch screen 151. FIG.
FIG. 7 shows an example of a widget to which the first to third objects 50, 51 and 52 correspond.
FIGS. 8 and 9 are views showing examples in which the step S110 is performed.
FIGS. 10 and 11 are views showing examples in which the step S120 is performed by the touch operation performed in FIG. 8 or FIG.
FIGS. 12 and 13 show another example in which the step S110 and the step S120 are performed by the stroke operation.
FIG. 14 is a diagram for explaining an example in which the degree of expansion of the plurality of objects varies according to at least one of the distance and the speed of the stroke operation.
15 and 16 are diagrams for explaining examples of a touch operation for executing an application corresponding to a specific object among the plurality of objects.
FIGS. 17 to 20 are diagrams for explaining examples in which the steps S110 and S120 are performed with respect to the rolling of the plurality of objects.
FIG. 21 is a view for explaining examples in which steps S110 and S120 are performed in connection with the pop-up window.
FIGS. 22 to 24 are diagrams for explaining examples in which the steps S110 and S120 are performed when the plurality of objects are composed of a polyhedron.
Fig. 25 shows an example in which a plurality of home screens are provided.
Figs. 26 and 27 are diagrams for explaining a function performance according to a stroke operation for a polyhedron when a plurality of home screens are provided. Fig.
28 is a flowchart of a method of controlling a mobile terminal according to a second embodiment of the present invention.

The foregoing objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Like reference numerals designate like elements throughout the specification. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory unit 160, An interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory unit 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. The location information module 115 may obtain location information using a global navigation satellite system (GNSS). Here, the Global Positioning System (GNSS) is a term used to describe the radionavigation satellite systems in which certain types of radionavigation receivers orbiting the Earth are transmitting reference signals that can determine their position near the surface or ground surface . The Global Positioning System (GNSS) includes Global Positioning System (GPS) in the United States, Galileo in Europe, GLONASS (Global Orbiting Navigational Satelite System) in Russia, COMPASS in China and Japan QZSS (Quasi-Zenith Satellite System), which is operated by the Ministry of Land, Infrastructure and Transport.

As a representative example of the GNSS, the location information module 115 may be a Global Position System (GPS) module. The GPS module calculates information on a distance (distance) from three or more satellites to a point (object), information on a time when the distance information is measured, and then applies a trigonometric method to the calculated distance information, Dimensional position information according to latitude, longitude, and altitude with respect to a point (object) in the three-dimensional space. Further, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module continuously calculates the current position in real time, and calculates velocity information using the current position.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory unit 160 or may be transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, it may be responsible for a sensing function related to whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor.

The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154, for example, for generating output related to visual, auditory, have.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display).

Some of these displays may be transparent or light transmissive so that they can be seen through. This may be referred to as a transparent display. A typical example of the transparent display is a transparent LCD or the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

The display unit 151 is connected to a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') having a mutual layer structure It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory unit 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to a function (e.g., a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like. Also, the sound output module 152 may output sound through the earphone jack 116. The user can connect the earphone to the earphone jack 116 to hear the sound output.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may also be output through the display unit 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may be configured to perform various functions such as an effect of stimulation by a pin arrangement vertically moving with respect to a contact skin surface, an effect of stimulation by air spraying force or suction force through a jet opening or a suction opening, A variety of tactile effects such as an effect of stimulation through contact of an electrode, an effect of stimulation by an electrostatic force, and an effect of reproducing a cold sensation using a heat absorbing or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to feel the tactile effect through the muscles of the user's finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The memory unit 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory unit 160 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory unit 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory unit 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. Also, the software codes may be stored in the memory unit 160 and executed by the control unit 180. [

2 is a conceptual diagram for explaining the proximity depth of the proximity sensor.

As shown in FIG. 2, when a pointer such as a finger of a user approaches the touch screen, the proximity sensor disposed in or near the touch screen senses the proximity sensor and outputs a proximity signal.

The proximity sensor may be configured to output different proximity signals according to a distance between the proximity-touched pointer and the touch screen (hereinafter referred to as "proximity depth").

A distance at which the proximity signal is output when the pointer approaches the touch screen is referred to as a detection distance. In short, by using a plurality of proximity sensors having different detection distances, the proximity signals output from the proximity sensors are compared, .

In FIG. 2, for example, a cross section of a touch screen having proximity sensors capable of sensing three proximity depths is illustrated. Of course, proximity sensors that detect less than three or more than four proximity depths are also possible.

Specifically, when the pointer is completely in contact with the touch screen (d0), it is recognized as a contact touch. If the pointer is located on the touch screen at a distance less than the distance d1, it is recognized as a proximity touch of the first proximity depth.

If the pointer is located on the touch screen at a distance d1 or less and less than the distance d2, the pointer is recognized as a proximity touch of the second proximity depth. If the pointer is located on the touch screen at a distance d2 or more and less than the distance d3, it is recognized as a proximity touch of the third proximity depth. If the pointer is located at a distance d3 or more on the touch screen, it is recognized that the proximity touch is released.

Accordingly, the controller 180 can recognize the proximity touch as various input signals according to the proximity and proximity positions of the pointer to the touch screen, and perform various operation controls according to the various input signals.

FIGS. 3 and 4 are views for explaining a stereoscopic image displaying method using a binocular parallax according to the embodiments of the present invention. FIG. 3 is a view illustrating a method using a lenticular lens array And Fig. 4 shows a method of using a parallax barrier.

Binocular parallax (stereo disparity) is the difference between the left and right eyes of a person. When synthesizing the image seen through the left eye and the image seen through the right eye in the human brain, the synthesized image makes a person feel stereoscopic. Hereinafter, a phenomenon in which a person perceives a stereoscopic effect according to a binocular disparity is referred to as 'stereoscopic vision', and an image causing stereoscopic vision is referred to as a 'stereoscopic image'. In addition, when a specific object included in an image causes stereoscopic vision, the object is referred to as a 'stereoscopic object'.

The stereoscopic image display method according to the binocular disparity can be classified into a spectacle type requiring special glasses and a non-eye type requiring no glasses. The spectacle type includes a method using a sunglass having wavelength selectivity, a polarized spectacle method using a shading effect according to a polarization difference, and a time-division spectacle method in which right and left images are alternately presented in a residual image time of the eye. In addition, there is a method of mounting a filter having a different transmittance in each of the right and left eyes to obtain a three-dimensional effect on the movement in the left and right direction in accordance with the time difference of the visual system from the difference in transmittance.

In addition, a parallax barrier system, a lenticular lens system, or a microlens array system is used for a non-eye-safety system in which a stereoscopic effect is generated on the side of the image display surface other than the observer.

Referring to FIG. 3, the display module 151 includes a lenticular lens array 81a to display a stereoscopic image. The lenticular lens array 81a includes a pixel L to be input to the left eye 82a and a pixel R to be input to the right eye 82b are alternately arranged along the horizontal direction and a display surface 83 and left and right eyes 82a, 82b and provides optical discrimination directivity for the pixel L to be input to the left eye 82a and the pixel R to be input to the right eye 82b. The image of the human eye is viewed through the left eye 82a and the image through the right eye 82b while the human eye is viewed through the left eye 82a and the right eye 82b. And the stereoscopic image is observed.

Referring to FIG. 4, the display module 151 includes a vertical grid-shaped parallax barrier 81b to display a stereoscopic image. The parallax barrier 81b includes a pixel L to be inputted to the left eye 82a and a pixel R to be inputted to the right eye 82b are alternately arranged along the horizontal direction and the display surface 83 and the left and right eyes 82a, 82b so that the images are separated and observed in the left eye 82a and the right eye 82b through a vertical grid aperture. Accordingly, the human brain combines the image viewed through the left eye 82a and the image viewed through the right eye 82b to observe the stereoscopic image. This parallax barrier 81b is turned on only when it is desired to display a stereoscopic image and separates the incident time. When the flat image is to be displayed, the parallax barrier 81b is turned off so that the incident time can be passed without being separated have.

Meanwhile, the stereoscopic image display methods described above are for illustrating embodiments of the present invention, and the present invention is not limited thereto. The present invention can display stereoscopic images using binocular parallax using various methods in addition to the above-described methods.

Hereinafter, specific embodiments of the present invention will be described.

Hereinafter, embodiments of the present invention will be described. In the present invention, the display unit 151 provided in the mobile terminal 100 is assumed to be the touch screen 151 for convenience of explanation. As described above, the touch screen 151 can perform both the information display function and the information input function. However, it should be clearly understood that the present invention is not limited thereto. Also, the touch mentioned in this document can include both touch and proximity touch.

5 is a flowchart of a video display method of the mobile terminal according to the first embodiment of the present invention. 6 to 27 are diagrams for explaining a control method of a mobile terminal according to the first embodiment of the present invention.

The control method of the mobile terminal according to the first embodiment of the present invention can be implemented in the mobile terminal 100 described with reference to Figs. Hereinafter, the control method of the mobile terminal according to the first embodiment of the present invention and the operation of the mobile terminal 100 for implementing the same will be described in detail with reference to the necessary drawings.

Referring to FIG. 5, the controller 180 may overlap the plurality of objects and display the objects on the touch screen 151 (S100).

Each of the plurality of objects may be any one of a 2D (two-dimensional) object, a 3D (three-dimensional) object using a stereo disparity, and a 3D object composed of a plurality of 2D layers have.

The plurality of objects may include all objects that can be displayed on the touch screen 151.

For example, the plurality of objects includes an icon and a widget, and may include an application, a still image, a moving image, an animation, a flash, and the like.

Also, for example, the plurality of objects may be objects included in specific contents such as still images, moving images, and the like.

For example, the plurality of objects may include a window for providing or receiving information such as a menu window, an input window, and a pop-up window.

6 is a diagram illustrating an example in which the plurality of objects are overlapped with each other and displayed on the touch screen 151. FIG.

For example, referring to FIG. 6, the controller 180 displays the first object 50, the second object 51, and the third object 52 on the touch screen 151 so as to overlap with each other .

The cause of overlapping of the first to third objects 50, 51, and 52 may be variously set by a user's operation, an application setting, a mutual overlapping of contents, or the like .

FIG. 7 shows an example of a widget to which the first to third objects 50, 51 and 52 correspond. In this document, it is assumed that the first to third objects 50, 51, and 52 correspond to a weather widget, a news widget, and a traffic widget, respectively.

The controller 180 may receive weather information from the outside through the weather application corresponding to the weather widget and provide the weather information to the user.

Also, the control unit 180 may receive the news information from the outside through the news application corresponding to the news widget and provide the news information to the user.

Also, the controller 180 may receive traffic information from outside through the traffic application corresponding to the traffic widget and provide the traffic information to the user.

Meanwhile, the control unit 180 may control the plurality of mutually overlapped objects to construct 3D.

For example, the plurality of objects are each a 2D object, and when the plurality of objects overlap each other, the control unit 180 controls the depth levels of the plurality of objects to be different from each other, It is possible to control so that a plurality of overlapped objects constitute 3D as a whole.

In addition, for example, the plurality of objects are each a 3D object using a binocular disparity, and the control unit 180 controls different depth level ranges of the plurality of objects when the plurality of objects overlap each other , It is possible to control so that the plurality of overlapped objects constitute 3D using the binocular parallax as a whole.

When the plurality of objects are overlapped and receive a touch operation for the displayed area (S110), the controller 180 controls the touch operation of the plurality of objects The display can be controlled (S120).

The touch operation in step S110 for performing step S120 may vary. In addition, the method of performing the step S120 by the specific touch operation performed in the step S110 may also be various.

Hereinafter, various embodiments in which S110 and S120 are performed will be described in detail.

<Expand unfolding )>

FIGS. 8 and 9 are views showing examples in which the step S110 is performed, and FIGS. 10 and 11 illustrate examples in which the step S120 is performed by the touch operation performed in FIG. 8 or FIG. to be.

For example, as shown in FIG. 8, the user inputs a single touch to the displayed area in which the plurality of objects are overlapped, or when the plurality of objects are overlapped and displayed as shown in FIG. 9 You can enter a stroke for the area. The stroke includes flicking and drag.

The control unit 180 may perform an operation of expanding at least a part of the overlapped plurality of objects so that the object can be accessed by touching the plurality of objects in accordance with the single-touch operation or the stroke operation.

For example, referring to FIG. 10, the controller 180 receives the single touch shown in FIG. 8 or receives the stroke shown in FIG. 9, and outputs the overlapped first through third objects 50, 51, 52) are all unfolded.

10 shows a state in which the second object 51 moves after moving from the third object 52 having the deepest depth level in the state of FIG. 6 and the first object 50 maintains its original position And the overlapped first to third objects (50, 51, 52) are unfolded.

On the other hand, FIG. 11 shows a state in which the second object 51 moves after moving from the first object 50 having the shallower depth level in the state of FIG. 6, and the third object 52 moves to the original position And the overlapped first, second, and third objects 50, 51, 52 are unfolded.

Meanwhile, when the touch operation in step S110 is the stroke operation, the controller may control the spreading operation in consideration of at least one of a direction, a distance, and a speed of the stroke operation.

For example, the control unit 180 may perform the unfolding operation in a direction corresponding to the direction of the stroke operation.

Referring to FIGS. 9 and 10, the controller 180 may expand the overlapped objects in the right direction as the user inputs the stroke operation in the right direction.

FIGS. 12 and 13 show another example in which the step S110 and the step S120 are performed by the stroke operation.

For example, when the user inputs a stroke operation in the left direction as shown in FIG. 12, the controller 180 can expand the overlapped plurality of objects in the left direction as shown in FIG.

In addition, when the user inputs the stroke operation in the downward direction or the upward direction, the controller 180 may expand the overlapped objects in the downward direction or the upward direction so as to correspond to the stroke direction (not shown).

In addition, for example, the controller 180 may determine the number of objects to be unfolded among the plurality of objects corresponding to at least one of the distance and the speed of the stroke operation.

FIG. 14 is a diagram for explaining an example in which the degree of expansion of the plurality of objects varies according to at least one of the distance and the speed of the stroke operation.

14, when the user inputs a stroke operation in which the distance and the speed are smaller than the stroke operation in FIG. 9, the controller 180 controls the overlapping first to third objects 50, 51 , 52, and the second and third objects 51, 52 may still maintain an overlap state to form a layer.

The controller may control the plurality of objects to return to mutually overlapping states after a predetermined time elapses after performing step S120 as in performing the unfolding operation [S130, S100].

If the specific object among the plurality of objects is selected before the preset time elapses after performing the step S120 as in the performing the unfolding operation, the controller may perform the steps of [S130, S140] The application can be executed [S150].

15 and 16 are diagrams for explaining examples of a touch operation for executing an application corresponding to a specific object among the plurality of objects.

For example, referring to FIG. 15, the user can select the third object by touching the third object among the first, second, and third objects 50, 51, and 52 with the finger.

The control unit 180 may execute a traffic widget corresponding to the selected third object.

If the touch operation performed in step S110 is the single-touch operation, if the single touch is touched at the point after moving to a certain point included in the displayed area of the plurality of objects, The application corresponding to the object displayed at the point can be executed.

For example, referring to FIG. 16, when a user touches a point A in a state in which the first to third objects 50, 51 and 52 overlap to form a layer, as described above, 3 objects 51 and 52 may be moved and unfolded.

When the user releases the touch by releasing the touch to the point A and moves the finger to the point B at the point B in a state in which the first to third objects 50, 51 and 52 are unfolded, The control unit 180 may execute a news widget corresponding to the second object 51, which is an object displayed at the point B.

If the touch operation in step S110 is a single touch operation, the control unit 180 performs the unfolding operation when the single touch is maintained below a predetermined time, and if the single touch is in the predetermined time An operation of executing at least one application among a plurality of applications corresponding to the plurality of objects may be performed.

Here, as will be described later, all of a plurality of applications corresponding to each of the plurality of overlapping objects may be executed.

<Rolling ( rolling ) Or roofing ( 로링 )>

Alternatively, when the plurality of objects overlap each other and receive a single touch for the displayed area, the controller 180 may perform the overlapping of the plurality of objects in step S110 and step S120, And can be displayed by rolling.

FIGS. 17 to 20 are diagrams for explaining examples in which the steps S110 and S120 are performed with respect to the rolling of the plurality of objects.

For example, when the user touches the overlapped first to third objects 50, 51, 52 with a finger as shown in FIG. 17, the controller 180, as shown in FIG. 18, The depth level of the first object 50 having the lowest depth level is controlled to be the highest level and the depth level of the second object 51 existing below the first object 50 is controlled to be the lowest , The second object 51 is brought to the uppermost position.

18, when the user touches the second object 51 in the state of FIG. 18, the second object 52 moves to the lowermost position and the third object 52 ) Will come to the top.

For example, when the user touches the third object 52 in the state of FIG. 19, the controller 180 controls the first to third objects 50 and 51 , 52 can be controlled.

Here, if the user touches the area in which the overlapped first, second, third, and fourth objects 50, 51, 52 are displayed and the touch is maintained over a predetermined time (long touch) The weather widget, the news widget, and the traffic widget corresponding to the first to third objects 50, 51 and 52, as described later, It can also be executed.

In addition, when the plurality of objects are overlapped and receive the stroke operation for the displayed area, the controller 180 may display the overlapped objects by rolling.

For example, referring to FIG. 20, when the user touches the point C in the state of FIG. 20A and then releases the touch, the controller 180 determines whether the weather corresponding to the first object 50 You can run the widget.

When the user moves the touch to the point D as shown in FIG. 20 (b) without releasing the touch with respect to the point C in the state of FIG. 20 (a), the control unit 180 controls the above- The display of the first, second, and third objects 50, 51, and 52 may be controlled so that the second object 51 is located at the top.

When the user releases the touch at the point D in the state of FIG. 20 (b), the control unit 180 can execute the news widget corresponding to the second object 51.

When the user moves the touch to the point E as shown in FIG. 20 (c) without releasing the touch with respect to the point D in the state of FIG. 20 (b) It is possible to control the display of the first to third objects 50, 51 and 52 such that the third object 52 is brought to the uppermost position.

When the user releases the touch at the point E in the state of FIG. 20 (c), the controller 180 can execute the news widget corresponding to the second object 51.

When the user moves the touch again in the direction of the point D and the point C in the state of Fig. 20C, the control unit 180 controls the display of the first to third objects 50, 51, 20 (b) and 20 (a).

In FIG. 20, it is assumed that the drag operation is performed on the right and left sides. However, the technical idea of the present invention is not limited thereto.

For example, even when the drag operation is performed up and down, the display of the first to third objects 50, 51, 52 and the execution of the corresponding application can be controlled in the same manner as shown in Fig.

< Pop-up window  Provided>

Meanwhile, the control unit 180 may perform a predetermined touch operation (for example, the single touch) on the displayed area in which the plurality of objects are overlapped with each other in step S110 and step S120 A pop-up window including a plurality of items representing a plurality of applications corresponding to each of the plurality of objects may be provided to the touch screen.

As the user selects any item among the plurality of items, the control unit 180 can execute the application corresponding to the selected item.

FIG. 21 is a view for explaining examples in which steps S110 and S120 are performed in connection with the pop-up window.

For example, referring to FIG. 21, when the user touches an area in which the overlapped first to third objects 50, 51, and 52 are displayed with a finger, the control unit 180 controls the first to third It is possible to provide the touch screen 151 with a pop-up window 60 including first to third items 61, 62 and 63 corresponding to the objects 50, 51 and 52, respectively.

Like the first to third objects 50, 51 and 52, the first to third items 61, 62 and 63 correspond to weather widgets, news widgets and traffic widgets, respectively.

21, the first to third items 61, 62, and 63 may be the same objects as the first to third objects 50, 51, and 52, (E.g., an image, an icon, and the like) corresponding to the first to third objects 50, 51, and 52.

Meanwhile, the pop-up window 60 may be set so that the user is provided only while the touch for the area in which the first to third objects 50, 51, and 52 are displayed is maintained.

In addition, the pop-up window 60 may be set to disappear automatically after a predetermined time has elapsed since being provided to the touch screen 151. [

The pop-up window 60 may be provided in 2D, in 3D using binocular parallax, or in 3D composed of a plurality of 2D layers.

When the user selects the specific item by touching a specific item among the first to third items 61, 62, 63 included in the pop-up window 60 by the finger, the controller 180 displays the selected specific item (Or application) corresponding to the widget.

<Rotation of polyhedron>

Meanwhile, when the step S110 and the step S120 are performed, the controller 180 displays the overlapped objects so as to form a polyhedron, and when receiving the stroke operation for the polyhedron, The polyhedron may be rotated in consideration of at least one of a direction, a distance, and a velocity of the stroke operation. The polyhedron can be provided in 3D using binocular parallax.

The user can select a specific face constituting the polyhedron, and the control unit 180 can execute an application corresponding to the object displayed on the selected face.

FIGS. 22 to 24 are diagrams for explaining examples in which the steps S110 and S120 are performed when the plurality of objects are composed of a polyhedron.

For example, on the screen shown in Fig. 22, 2D objects 65, 66, 67, 68 and 3D object groups 70, 71, 72 constituting the aforementioned polyhedron are displayed.

Each of the 3D object groups 70, 71, and 72 may include a plurality of objects.

For example, the first 3D object group 70 may be a polyhedron, and the first to sixth menus may correspond to the respective sides of the first 3D object group 70.

When the user drags the first 3D object group 70 leftward in the state of FIG. 22, the controller 180 rotates the first 3D object group 70 leftward to be in the state of FIG. 23 The display of the first 3D object group 71 can be controlled.

When the user drags the first 3D object group 70 downward in the state of FIG. 23, the controller 180 rotates the first 3D object group 70 downward, So that the display of the first 3D object group 71 can be controlled.

That is, the controller 180 may rotate the polyhedron (the first 3D object group 70 in FIGS. 22 to 24) in a direction corresponding to the direction of the drag operation (or flicking operation).

Also, the control unit 180 may control the degree of rotation of the polyhedron in accordance with at least one of the distance and the speed of the drag operation (or flicking operation).

For example, as the speed at which the user performs the drag operation is faster, the controller 180 can rotate the polyhedron more rapidly.

Also, for example, the control unit 180 can rotate the polyhedron more as the distance by which the user performs the drag operation is longer.

When the user touches the face corresponding to the desired menu in FIG. 22 to FIG. 24 with a finger, the control unit 180 can execute the application corresponding to the menu displayed on the touched face.

Meanwhile, the controller 180 may provide a plurality of home screens. The plurality of home screens may be referred to as a plurality of idle screens. The plurality of home screens may be switched to each other and any one of the plurality of home screens may be provided to the touch screen 151.

Fig. 25 shows an example in which a plurality of home screens are provided.

The screen shown in Fig. 25 may include an indicator area 75 for displaying a plurality of home screens.

The plurality of indicators 76a, 76b, 76c, 76d, and 76e included in the indicator area 75 correspond to a plurality of home screens, respectively. A home screen corresponding to a numeric indicator (the third indicator 76c in FIG. 25) among the plurality of indicators 76a, 76b, 76c, 76d and 76e is currently displayed on the touch screen 151 .

That is, in FIG. 25, the idle screen currently provided on the touch screen 151 is the third home screen among the five home screens.

The first indicator 76a, the second indicator 76b, the fourth indicator 76d and the fifth indicator 76e represent the home screen which is not currently displayed on the touch screen 151. [ That is, in FIG. 25, the number of home screens that are not currently displayed on the touch screen 151 is four.

If the screen displayed on the touch screen is a home screen of any one of the plurality of home screens, the controller 180 controls the operation of the polyhedron such that the stroke operation (for example, the drag operation or the flicking operation) Or if it is out of a preset area, the currently displayed home screen may be changed to another home screen.

The predetermined area may be an area where the polyhedron is displayed.

Figs. 26 and 27 are diagrams for explaining a function performance according to a stroke operation for a polyhedron when a plurality of home screens are provided. Fig.

For example, referring to FIG. 26, when a stroke is input to the first object group 70 in the screen shown in FIG. 25, the inputted stroke is input as a distance d2 larger than a predetermined distance d1 When the first object group 70 is out of the displayed area, the controller 180 does not perform the operation of rotating the first object group 70, To another home screen, which is the fourth home screen, as shown in FIG.

<Control of display of non-executable objects>

Meanwhile, in the above-described embodiments, there may be an object that can not be executed among the plurality of overlapped objects.

For example, if communication with the outside is impossible due to network instability or error, an application that requires communication with the outside may not be able to be executed. Here, an object corresponding to an application that requires communication with the outside may not be executable.

Also, for example, if a widget for providing status information on a subject, such as a clock widget or a widget that provides exchange rate information, is displayed overlapping with other objects, the widget for providing the status information may be Information may be transmitted, and execution may not be possible.

Also, a widget that can provide content by itself may also be impractical. The clock widget or the exchange rate widget may correspond to a widget that can provide the content by itself.

As described above, the control unit 180 displays an object that can not be executed among the plurality of overlapped objects at the deepest depth level, gives a predetermined graphic property, or displays the object at a smaller size than the original size , It can notify the user that this is an unexecutable object.

For example, the control unit 180 may display an unexecutable object in gray or transparently.

28 is a flowchart of a method of controlling a mobile terminal according to a second embodiment of the present invention.

The control method of the mobile terminal according to the second embodiment of the present invention can be implemented in the mobile terminal 100 described with reference to Figs. Hereinafter, the control method of the mobile terminal according to the first embodiment of the present invention and the operation of the mobile terminal 100 for implementing the same will be described in detail with reference to the necessary drawings.

Referring to FIG. 28, the controller 180 may overlap the plurality of objects and display the objects on the touch screen 151 (S200). The step S200 corresponds to the step S100 in the first embodiment of the present invention described above.

If the plurality of objects are overlapping and receive the touch operation for the displayed area (S210), the controller 180 controls the plurality of applications corresponding to the overlapped plurality of objects according to the type of the received touch operation In whole or in part [S220].

For example, the controller 180 may perform a first operation to execute all of a plurality of applications respectively associated with the plurality of overlapped objects in accordance with the type of the touch operation performed in step S210, And a second operation for executing only an application corresponding to a specific object among a plurality of objects.

The first touch operation, which is a condition for performing the first operation, and the second touch operation, which is a condition for performing the second operation, are performed when the touch input times for the areas where the overlapped objects are displayed are set to be different from each other , The number of touches to the area may be set to be different from each other.

For example, if the user touches the area where the first object 50 is displayed in the state of FIG. 6 once, the weather widget corresponding to the first object 50 is executed, The weather widget, the news widget, and the traffic widget corresponding to the first to third objects 50, 51, and 52 may be executed by touching or touching the area twice.

The first touch operation and the second touch operation may be any one of a single touch operation and a stroke operation for the area in which the overlapped plurality of objects are displayed.

For example, in FIG. 6, when the user inputs a single touch to the area in which the first object 50 is displayed, the controller 180 executes a weather widget corresponding to the first object 50, The controller 180 may input a weather widget, a news widget, and a traffic widget corresponding to the first, second, and third objects 50, 51, and 52, respectively, Both can be executed.

A specific example in which all of the plurality of objects displayed as mutually overlapped are executed will be described.

For example, the first to third objects 50, 51 and 52 may be a plurality of different web pages or a plurality of different web browsers or a plurality of different web search engines the control unit 180 receives a predetermined command (for example, a long touch signal input through the area in which the first to third objects 50 are displayed) Page or the plurality of web browsers or the plurality of web search engines.

For example, the first to third objects 50, 51, and 52 may correspond to different broadcast channels preferred by the user. At this time, when receiving the predetermined command, the control unit 180 can simultaneously access the plurality of broadcast channels.

For example, the first to third objects 50, 51 and 52 may correspond to different contact items included in a contact book (for example, a phone book) have.

The controller 180 can simultaneously transmit the set message to a plurality of contact items corresponding to the first to third objects 50, 51 and 52 when receiving the predetermined command.

Alternatively, when the predetermined command is received, the controller 180 may attempt to make a conference call with a plurality of parties corresponding to the plurality of contact items when receiving the predetermined command .

In addition, the first to third objects 50, 51, and 52 may correspond to a plurality of different location information, or may correspond to a plurality of different social network services (SNS) ). &Lt; / RTI &gt;

Also, for example, the first to third objects 50, 51, 52 may be a plurality of received messages or a plurality of missed calls.

When receiving the predetermined command, the controller 180 displays all of the plurality of received messages on the touch screen 151 or transmits information on all of the plurality of missed calls to the touch screen 151 ). &Lt; / RTI &gt;

On the other hand, in the above-described embodiments, the overlapped plurality of objects may correspond to a plurality of different web pages.

Here, the controller 180 may control the display of the overlapped objects so that the object corresponding to the set web page of the plurality of different web pages reaches the highest level. Examples of such tasks may be web search, data download, and the like.

In addition, the controller 180 may control display of the overlapped objects so that the object corresponding to the first web page connected to the first web page among the plurality of different web pages comes to the top.

The above-described method of controlling a mobile terminal according to the present invention can be provided by being recorded in a computer-readable recording medium as a program for execution in a computer.

The control method of the mobile terminal according to the present invention can be executed through software. When executed in software, the constituent means of the present invention are code segments that perform the necessary tasks. The program or code segments may be stored in a processor readable medium or transmitted by a computer data signal coupled with a carrier wave in a transmission medium or a communication network.

A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the computer-readable recording device include a ROM, a RAM, a CD-ROM, a DVD 占 ROM, a DVD-RAM, a magnetic tape, a floppy disk, a hard disk, The computer-readable recording medium may also be distributed to networked computer devices so that computer readable code can be stored and executed in a distributed manner.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings. In addition, the embodiments described in this document can be applied to not only the present invention, but also all or some of the embodiments may be selectively combined so that various modifications can be made.

100: mobile terminal 151: display unit (touch screen)
160: Memory

Claims (20)

touch screen; And
In a state where a plurality of objects corresponding to different applications overlap each other and are displayed at a specific position on the touch screen, the plurality of objects are overlapped to perform a single touch operation for the displayed area, At least one of the plurality of objects maintains the specific position and the display of the plurality of objects is performed so that the plurality of objects can be accessed by touching, And a controller
Wherein,
And displays the rolled plurality of objects when the single touch is not released and executes the application corresponding to the object displayed at the released time when the touch is released. . The touch screen of claim 1,
A panel for realizing stereoscopic vision is provided,
Wherein the plurality of objects are any one of a 2D (two-dimensional) object, a 3D (three-dimensional) object using a stereo disparity, and a 3D object composed of a plurality of 2D layers,
Wherein the control unit controls the plurality of mutually overlapped objects to construct 3D. delete delete The apparatus of claim 1,
Performing an operation of expanding at least a part of the overlapped plurality of objects,
Wherein when a predetermined time has elapsed after performing the unfolding operation, the plurality of objects are returned to mutually overlapping states,
And executes an application corresponding to a selected one of the objects unfolded by the unfolding operation. The apparatus of claim 1,
Performing an unfolding operation when the single touch is maintained for less than a predetermined time and executing at least one application among a plurality of applications respectively corresponding to the plurality of objects when the single touch is maintained over the predetermined time To the mobile terminal. [7] has been abandoned due to the registration fee. 6. The apparatus of claim 5,
Wherein the single touch executes the application corresponding to the object displayed at the point when the single touch is moved to a point included in the displayed area of the object expanded by the unfolding operation and then is touched at the point. [8] has been abandoned due to the registration fee. 6. The apparatus of claim 5,
And performs the unfolding operation in a direction corresponding to a direction of the stroke operation. [Claim 9 is abandoned upon payment of registration fee.] 9. The apparatus according to claim 8,
And determines the number of objects to be unfolded among the plurality of objects corresponding to at least one of a distance and a velocity of the stroke operation. delete The apparatus of claim 1,
Providing a touch screen with a pop-up window including a plurality of items representing a plurality of applications corresponding to each of the plurality of objects when receiving a single touch for the area, Is executed. The apparatus of claim 1,
Wherein the polyhedron rotates the polyhedron in consideration of at least one of a direction, a distance, and a velocity of the stroke operation when the plurality of overlapping objects constitute a polyhedron, and when a stroke operation is received on the polyhedron, . [13] has been abandoned due to the registration fee. 13. The apparatus according to claim 12,
If the current screen displayed on the touch screen is a home screen of any one of a plurality of home screens, if the stroke operation is performed over a predetermined distance or outside a preset area, Screen is changed to a screen. The apparatus of claim 1,
Wherein an object which can not be executed among the plurality of overlapped objects is displayed at the deepest depth level, a predetermined graphic property is given, or the object is displayed smaller than the original size. delete delete delete delete delete delete

Images