KR101768540B1 - Mobile device and method for providing UI - Google Patents

Abstract

A mobile device and a UI providing method applied thereto are provided. In this mobile device, when the pressure is detected in the pressure sensing part, the control part is activated. Accordingly, the user can use various types of UI by using various operation units other than the pressure.

Pressure, proximity, touch, UI

Description

[0001] The present invention relates to a mobile device, and more particularly,

The present invention relates to a mobile device and a UI providing method applied thereto, and more particularly, to a mobile device providing a UI using pressure sensing and a UI providing method applied thereto.

With the recent development of mobile device technology, mobile devices can provide a wide variety of functions. In order to utilize such various functions, the user controls the mobile device through a user interface provided in the mobile device.

There are various kinds of user interfaces. For example, the user interface may include various types of buttons, touch screens, and the like disposed on a mobile device. The user can input a command to the mobile device to perform a desired function through the user interface.

However, as the number of functions provided in mobile devices increases, more user interfaces are required. In addition, a method for easily using various user interfaces by users is actively researched.

Users want a user interface that is easier and more convenient to use. Accordingly, there is a need to search for a way to provide a user interface that the user can easily use without error.

SUMMARY OF THE INVENTION The present invention has been conceived to solve the above problems, and it is an object of the present invention to provide a mobile device in which a manipulation part is activated when a pressure is sensed by a pressure sensing part, and a method of providing a UI applied thereto.

According to an aspect of the present invention, there is provided a mobile device including: a pressure sensor for sensing a pressure; An operation unit for receiving a user's operation; And a control unit for controlling the operation unit to be activated when a pressure is detected by the pressure sensing unit.

The operation unit may include: a proximity sensor unit that detects proximity of a user and a proximity gesture; A touch detection unit for detecting a touch operation of a user; And a button unit for detecting a button operation of the user, wherein the controller may control at least one of the proximity sensor unit, the touch detection unit, and the button unit to be activated when the pressure is sensed by the pressure sensing unit.

The controller may further include a proximity sensor that detects proximity of the user and proximity gesture of the user, wherein the controller is configured to detect a pressure in the pressure sensing unit while the specific application is being executed, If a proximity gesture is detected, it may perform a function associated with the particular application.

When a pressure is sensed by the pressure sensing unit and the touch operation is detected by the touch sensing unit while a specific application is being executed, the control unit may include a touch detection unit that detects a touch operation of the user , And may perform functions related to the specific application.

When the pressure is sensed by the pressure sensing unit and a button operation is detected in the button unit while a specific application is being executed, the control unit may include: And may perform functions related to the specific application.

The control unit may determine a function to be performed on the operation input through the operation unit according to the intensity of the pressure sensed by the pressure sensing unit.

Also, the pressure sensing unit may include at least one pressure sensing area, and the control unit may perform at least one of the at least one pressure sensing area and the at least one pressure sensing area, It is also possible to determine the function.

The control unit may determine a function to be performed on the operation input through the operation unit according to the number of sensed pressures sensed by the pressure sensing unit.

According to another aspect of the present invention, there is provided a UI providing method including: sensing a pressure in a pressure sensing unit; And activating an operation unit that receives a user's operation when the pressure is sensed by the pressure sensing unit.

The operation unit may include: a proximity sensor unit that detects proximity of a user and a proximity gesture; A touch detection unit for detecting a touch operation of a user; And a button unit for detecting a button operation of a user, wherein the activation step may activate at least one of the proximity sensor unit, the touch detection unit, and the button unit when the pressure is sensed by the pressure sensing unit.

The method may further include performing a function related to the specific application when a pressure is sensed by the pressure sensing unit and a proximity sensor is sensed by the proximity sensor during execution of a specific application.

The method may further include performing a function related to the specific application when a pressure is sensed by the pressure sensing unit and a touch operation is detected by the touch detecting unit during execution of a specific application.

The method may further include performing a function related to the specific application when a pressure is detected in the pressure sensing part and a button operation is detected in a button part during execution of a specific application.

Receiving an operation of a user through the operation unit; And determining a function to be performed on the operation input through the operation unit according to the intensity of the pressure sensed by the pressure sensing unit.

The pressure sensing step may include sensing pressure in one of the at least one pressure sensing areas and receiving a user's operation through the control part; And determining a function to be performed on the operation input through the operation unit according to the pressure sensing area in which the pressure is sensed in the at least one pressure sensing area.

The pressure sensing step may include sensing at least one pressure and receiving a user's operation through the operation unit; And determining a function to be performed on the operation input through the operation unit according to the number of sensed pressures sensed by the pressure sensing unit.

According to various embodiments of the present invention, it is possible to provide a mobile device in which a control unit is activated when a pressure is sensed in a pressure sensing unit and a UI providing method applied thereto, , And various types of UIs are available.

In particular, since the user can display the intention of the operation input through the pressure detection, the user can prevent the unexpected input of the operation.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

1 is a block diagram illustrating a detailed structure of a mobile device 100 according to an embodiment of the present invention.

1, the mobile device 100 includes a display unit 110, a storage unit 120, a pressure sensing unit 130, an operation unit 140, and a control unit 150.

The display unit 110 displays an image for providing a function of the mobile device 100. Also, the display unit 110 displays an image of a running application on the screen. The display unit 110 displays GUIs (Graphic User Interfaces) for user's operation on the screen.

The storage unit 120 stores programs for performing various functions of the mobile device 100. In addition, the storage unit 120 stores an application program. The storage unit 120 may be a hard disk, a non-volatile memory, or the like.

The pressure sensing unit 130 senses a pressure applied to a specific area. The pressure sensing unit 130 senses whether the pressure is applied and the magnitude of the pressure. Various types of pressure sensing sensors can be used as the pressure sensing unit 130. Examples of the pressure sensing sensor include a piezo sensor.

The piezo sensor does not require a separate power source in the standby state, generates power when the pressure is applied, and recognizes the magnitude of the pressure according to the voltage of the generated power. Accordingly, when the mobile device 100 is in the standby state, if only the piezo sensor is activated, the standby power can be minimized and the power consumption can be reduced.

The operation unit 140 receives various user's operations and transmits the inputted user operation information to the control unit 150. [ The operation unit 140 includes various types of user interface devices. Specifically, as shown in Fig. 1, the operation unit 140 includes a proximity sensor unit 142, a touch detection unit 144, and a button unit 146. [

The proximity sensor unit 142 detects the proximity of the user and the proximity gesture. Here, the proximity gesture refers to a gesture performed when the user's hand or a part of the body other than the user's hand is close to the proximity sensor unit 142. [ For example, the proximity gesture may be a direction in which the user's hand moves in the vicinity of the proximity sensor unit 142. [

The proximity sensor section 142 includes at least one light emitting element. The proximity sensor unit 142 can detect proximity only when one light emitting device is included, and can detect a proximity gesture and proximity coordinates when two or more light emitting devices are included. Further, the proximity sensor unit 142 can more accurately detect the proximity gesture as the number of the light emitting elements increases.

The touch detection unit 144 detects the touch operation of the user. The touch detection unit 144 may be implemented as a touch screen.

The button unit 146 detects the operation of the user's button. The button unit 146 includes at least one button. For example, the button unit 146 includes number buttons, direction buttons, and the like.

The control unit 150 controls the overall operation of the mobile device 100 according to the user's operation inputted through the operation unit 140. [ The control unit 150 controls the operation unit 140 to be activated when the pressure sensing unit 130 detects the pressure. The control unit 150 controls at least one of the proximity sensor unit 142, the touch detection unit 144, and the button unit 146 to be activated when the pressure is sensed by the pressure sensing unit 130. [ Here, the activation state is a state in which the proximity sensor unit 142 can detect proximity and proximity gesture, a state in which the touch detection unit 144 can detect the touch operation, and a state in which the button unit 146 performs a button operation It means a state that can be detected.

Specifically, when a pressure is detected by the pressure sensing unit 130 and a proximity gesture is sensed by the proximity sensor unit 142 during execution of a specific application, the controller 150 performs a function related to a specific application. When a pressure is detected by the pressure sensing unit 130 and a touch operation is detected by the touch detection unit 144 during execution of a specific application, the control unit 150 performs a function related to a specific application. When the pressure is detected in the pressure sensing unit 130 and the button operation is detected in the button unit 146 during the execution of the specific application, the control unit 130 performs a function related to the specific application.

The control unit 150 determines a function to be performed on the operation input through the operation unit 140 according to the intensity of the pressure sensed by the pressure sensing unit 130.

If the pressure sensing unit 130 includes at least one pressure sensing area, the controller 150 may control the pressure sensing unit 130 based on the pressure sensing area of the at least one pressure sensing area, It may also determine the function to be performed on the operation.

The control unit 150 may determine a function to be performed on the operation input through the operation unit 140 according to the number of times the pressure sensed by the pressure sensing unit 130 is sensed.

The control unit 150 controls the UI providing methods and processes of FIGS. 2 to 20C to be described below.

2 is a block diagram of a mobile communication device according to an embodiment of the present invention that includes a pressure sensing unit 130, a proximity sensor unit 142, a touch detection unit 144, and a button unit 146 disposed on the outer surface of the mobile device 100 Fig.

As shown in FIG. 2, the mobile device 100 is disposed on both side surfaces of the pressure sensing part 130. The mobile device 100 is provided with a touch detection unit 144 on a display screen to provide a touch screen function. In the mobile device 100, the proximity sensor unit 142 and the button unit 146 are disposed at the lower end of the screen.

2 is merely an example. The pressure sensing unit 130, the proximity sensor unit 142, the touch detection unit 144, and the button unit 146 of the mobile device 100 But it is also possible to arrange them in different forms.

Hereinafter, a method of operating the user of the mobile device 100 will be described with reference to FIGS. 3A to 3C. FIG.

3A is a diagram illustrating a user operation mode using the pressure sensing unit 130 and the proximity sensor unit 142 of the mobile device 100 according to an embodiment of the present invention.

As shown in FIG. 3A, when the user grasps both sides of the mobile device 100, the mobile device 100 detects the pressure in the pressure sensing part 130 disposed on both sides. When the pressure is sensed by the pressure sensing unit 130, the mobile device 100 activates the proximity sensor unit 142, and the proximity sensor unit 142 recognizes the proximity of the user and the proximity gesture.

In this way, when the pressure is sensed by the pressure sensing unit 130, the proximity sensor unit 142 is activated, thereby preventing the user's unintended operation from being detected by the proximity sensor unit 142. [ In addition, since the proximity sensor unit 142 is deactivated in a state where no pressure is sensed by the pressure sensing unit 130 (i.e., standby state), the mobile device 100 can minimize power consumption in the standby state .

FIG. 3B is a diagram illustrating a user operation using the touch sensing unit 144 and the pressure sensing unit 130 of the mobile device 100, according to an embodiment of the present invention.

As shown in FIG. 3A, when the user grasps both sides of the mobile device 100, the mobile device 100 detects the pressure in the pressure sensing part 130 disposed on both sides. When the pressure is detected by the pressure sensing unit 130, the mobile device 100 activates the touch detection unit 144, and the touch detection unit 144 recognizes the touch operation of the user on the display screen.

As such, when the pressure is sensed by the pressure sensing unit 130, the touch detection unit 144 is activated to prevent the unintended touch of the user from being sensed by the touch sensing unit 144. [ In addition, since the touch detection unit 144 is deactivated in a state where no pressure is sensed by the pressure sensing unit 130 (i.e., in a standby state), the mobile device 100 can minimize power consumption in a standby state.

3C is a diagram illustrating a user operation mode using the pressure sensing unit 130 and the button unit 146 of the mobile device 100 according to an embodiment of the present invention.

3C, when the user grasps both side surfaces of the mobile device 100, the mobile device 100 detects the pressure in the pressure sensing part 130 disposed on both sides. When the pressure is detected by the pressure sensing unit 130, the mobile device 100 activates the button unit 146, and the button unit 146 recognizes the user's proximity and proximity gesture.

Thus, when the pressure is sensed by the pressure sensing unit 130, the button unit 146 is activated, thereby preventing the unintended operation of the user from being detected by the button unit 146. [ In addition, since the button unit 146 is deactivated in a state where no pressure is sensed by the pressure sensing unit 130 (i.e., in a standby state), the mobile device 100 can minimize power consumption in a standby state.

As described above, before the pressure is sensed by the pressure sensing unit 130, the proximity sensor unit 142, the touch sensing unit 144, and the button unit 146 are in the inactive state, At least one of the proximity sensor unit 142, the touch detection unit 144, and the button unit 146 is activated after the sensing unit 130 senses the pressure.

Accordingly, the mobile device 100 can minimize power consumption in the standby state. In addition, since the user can input an intention to input a desired operation through the pressure sensing unit 130, it is possible to input a desired operation without any error at a desired time.

FIG. 4 is a flowchart illustrating a UI (User Interface) providing method of the mobile device 100 according to an embodiment of the present invention.

First, the mobile device 100 places the operation unit 140 in the inactive state (S405). Then, the mobile device 100 checks whether the pressure is sensed by the pressure sensing unit 130 (S410). If the pressure is sensed by the pressure sensing unit 130 (S410-Y), the mobile device 100 activates the operation unit 140 (S420).

Thereafter, the mobile device 100 confirms whether a proximity gesture is detected in the proximity sensor 142 (S430). If the proximity sensor 142 detects a proximity gesture (S430-Y), the mobile device 100 performs a function corresponding to the proximity gesture detected by the proximity sensor 142 (S435).

In addition, the mobile device 100 determines whether the touch operation of the user is detected by the touch detection unit 144 (S440). If a touch operation of the user is detected by the touch detection unit 144 (S440-Y), the mobile device 100 performs a function corresponding to the touch operation detected by the touch detection unit 144 (S445).

Then, the mobile device 100 confirms whether the operation of the user's button is detected in the button unit 146 (S450). If the operation of the user's button is detected in the button unit 146 (S450-Y), the mobile device 100 performs a function corresponding to the button operation detected in the button unit 146 (S455).

Through the above process, the mobile device 100 can provide the user interface by using the pressure sensing unit 130 and the operation unit 140. According to the UI providing method, when the pressure is sensed by the pressure sensing unit 130, the button unit 146 is activated, thereby preventing the unintended operation of the user from being detected by the button unit 146. In addition, since the button unit 146 is deactivated in a state where no pressure is sensed by the pressure sensing unit 130 (i.e., in a standby state), the mobile device 100 can minimize power consumption in a standby state.

As described above, before the pressure is sensed by the pressure sensing unit 130, the proximity sensor unit 142, the touch sensing unit 144, and the button unit 146 are in the inactive state, At least one of the proximity sensor unit 142, the touch detection unit 144, and the button unit 146 is activated after the sensing unit 130 senses the pressure.

Accordingly, the mobile device 100 can minimize power consumption in the standby state. In addition, since the user can input an intention to input a desired operation through the pressure sensing unit 130, it is possible to input a desired operation without any error at a desired time.

Hereinafter, operation of the mobile device 100 will be described with reference to the drawings. 5A to 5C are views illustrating a process of changing the mobile device 100 from a hold state to a hold off state according to an embodiment of the present invention.

5A shows a lock screen 500 displayed on the screen of the mobile device 100. [ The pressure sensing unit 130 is disposed on both sides of the mobile device 100 and the proximity sensor unit 142 is disposed on the bottom of the screen. As shown in FIG. 5A, when the user holds the pressure sensing unit 130 by hand, the proximity sensor unit 142 is activated from the inactive state.

5B shows that the user inputs a proximity gesture to the proximity sensor portion 142 from right to left. 5B, when the user holds the pressure sensing unit 130 and inputs a proximity gesture to the proximity sensor unit 142 from the right to the left side, the mobile device 100 displays a function corresponding to the proximity sensor unit 142 Thereby performing unlocking.

5C, the mobile device 100 is changed to the unlocked state, and the unlocked screen 510 is displayed on the screen.

In this way, the mobile device 100 may perform an unlock function by an operation input to the pressure sensing unit 130 and the proximity sensor unit 142.

6A to 6C are views illustrating a process of changing the mobile device 100 from a hold off state to a hold on state according to an embodiment of the present invention.

6A shows a screen 600 of the mobile device 100 displayed on the unlocked screen. The pressure sensing unit 130 is disposed on both sides of the mobile device 100 and the proximity sensor unit 142 is disposed on the bottom of the screen. As shown in FIG. 5A, when the user presses the pressure sensing part 130 by hand two times in succession, the proximity sensor part 142 is activated from the inactive state, and the lock setting screen 610 ) Is displayed. In this case, the lock setting screen 610 corresponds to the screen for the intermediate process between the unlocked state and the locked state, which indicates that a certain operation is transferred to the locked state on the screen.

6B shows that the user inputs a proximity gesture to the proximity sensor unit 142 from right to left in a state where the lock setting screen 610 is displayed. 6B, if the user inputs a proximity gesture to the proximity sensor unit 142 from right to left while holding the pressure sensing unit 130 twice, the mobile device 100 may perform a function corresponding thereto Lock function.

Accordingly, as shown in FIG. 6C, the mobile device 100 is changed to the locked state, and the locked state 620 is displayed on the screen.

As described above, the mobile device 100 may perform a locking function by an operation input to the pressure sensing unit 130 and the proximity sensor unit 142. [

Meanwhile, the mobile device 100 may perform different functions for the same operation for each pressure sensing area of the pressure sensing unit 130. [ This will be described with reference to Figs. 7A to 8B.

7A and 7B show that the mobile device 100 performs different functions according to the pressure sensing area of the pressure sensing part 130 according to an embodiment of the present invention.

The pressure sensing part 130 includes a first pressure sensing area 130a and a second pressure sensing area 130b. 7A, the first pressure sensing area 130a is the upper area of the left side surface of the mobile device 100 and the second pressure sensing area 130b is the lower left area of the mobile device 100. As shown in FIG.

7A shows a mobile device 100 in which a proximity sensor 142 receives a right-to-left proximity gesture by a user in a state in which pressure is sensed in the first pressure sensing area 130a. 7A, when the user inputs a proximity gesture to the proximity sensor 142 in the right-to-left direction with the pressure applied to the first pressure sensing area 130a of the pressure sensing unit 130, The device 100 executes the application A with the function corresponding thereto.

On the other hand, FIG. 7B shows a state in which the proximity sensor 142 receives the right-side proximity gesture by the user in a state in which the pressure is sensed in the second pressure sensing area 130b, . 7B, when the user inputs a proximity gesture to the proximity sensor 142 from the right to the left in a state where the pressure is applied to the second pressure sensing area 130b of the pressure sensing unit 130, The device 100 executes the application B as a function corresponding thereto.

As such, the pressure sensing unit 130 may include at least two pressure sensing areas. In addition, the mobile device 100 may perform different functions for each of the sensed areas in the same proximity gesture operation.

8A and 8B illustrate that the mobile device 100 performs different functions according to the pressure sensing area of the pressure sensing part 130 according to an embodiment of the present invention.

The pressure sensing part 130 includes a first pressure sensing area 130a and a second pressure sensing area 130b. 8A, the first pressure sensing area 130a is the upper area of the left side surface of the mobile device 100 and the second pressure sensing area 130b is the lower left area of the mobile device 100. As shown in FIG.

8A illustrates a mobile device 100 to which an operation of a specific button 146a by a user is inputted in a state in which pressure is sensed in the first pressure sensing area 130a. 7A, when the user inputs the operation of the specific button 146 in a state where the pressure is applied to the first pressure sensing area 130a of the pressure sensing unit 130, the mobile device 100 responds thereto The application A is executed.

On the other hand, FIG. 8B shows the mobile device 100 to which the operation of the specific button 146a by the user is inputted in a state where the pressure is sensed in the second pressure sensing area 130b. 8B, when the user inputs the operation of the specific button 146a in a state where the pressure is applied to the second pressure sensing area 130b of the pressure sensing unit 130, the mobile device 100 responds thereto The application B is executed.

As such, the pressure sensing unit 130 may include at least two pressure sensing areas. Also, the mobile device 100 may perform different functions for the same button operation, for each pressure sensed area.

In addition, it is needless to say that the mobile device 100 may perform different functions for the same touch operation by each sensed area.

It should be noted that the mobile device 100 may provide different functions for the same operation according to the intensity of the pressure sensed by the pressure sensing unit 130. [ Hereinafter, a process of providing different functions for the same operation according to the intensity of the pressure sensed by the pressure sensing unit 130 will be described with reference to FIGS. 9 to 11E. FIG.

9 is a table summarizing the intensity of the pressure sensed by the pressure sensing unit 130 and the functions of the UI according to the proximity gesture sensed by the proximity sensor unit 142, according to an embodiment of the present invention.

As shown in FIG. 9, the intensity of the pressure can be divided into three levels of weak, medium, and strong. The proximity gesture can be classified into two types of proximity proximity and near proximity depending on the degree of proximity. Here, the close proximity means the operation in which the user's hand is very close to the proximity sensor unit 142, and the far proximity is the proximity sensor unit 142 in the range where the user's hand can be detected by the proximity sensor unit 142 142 < / RTI >

9, when the intensity of the pressure sensed by the pressure sensing unit 130 is "weak" and the proximity gesture detected by the proximity sensor unit 142 is a near-field gesture, It functions slowly. If the intensity of the pressure sensed by the pressure sensing unit 130 is "weak" and the proximity gesture sensed by the proximity sensor unit 142 is a distant gesture, the corresponding UI function is a function of quickly passing photographs several sheets at a time . If the intensity of the pressure sensed by the pressure sensing unit 130 is "medium" and the proximity gesture sensed by the proximity sensor unit 142 is a near-field gesture, the corresponding UI function is to transmit two or three photos at a time Function. If the intensity of the pressure sensed by the pressure sensing unit 130 is "strong" and the proximity gesture sensed by the proximity sensor unit 142 is a near-field gesture, the corresponding UI function is a function of quickly passing photographs several sheets at a time .

10A to 10C are views illustrating a process of displaying a next picture on a screen according to an embodiment of the present invention. 10A shows a mobile device 100 in which a proximity sensor 142 receives a right-to-left proximity gesture by a user in a state in which a pressure is sensed by the pressure sensing unit 130. As shown in FIG. 10A, when the user inputs a proximity gesture to the proximity sensor unit 142 from the right to the left with the pressure applied to the pressure sensing unit 130, the mobile device 100 displays the function corresponding thereto And a function of turning the picture on the screen.

10B shows the mobile device 100 in which a touch operation from the right to the left direction by the user is input to the touch detection unit 144 while the pressure is sensed by the pressure sensing unit 130. [ 10B, when the user inputs a touch operation to the touch detection unit 144 from the right to the left in a state in which the pressure is applied to the pressure sensing unit 130, the mobile device 100 performs a function corresponding to the touch operation And executes a function of turning the photograph.

10C shows the mobile device 100 to which the right button operation of the button unit 146 by the user is inputted in a state in which the pressure is sensed by the pressure sensing unit 130. FIG. 10C, when the user inputs a right button operation of the button unit 146 in a state in which the pressure is applied to the pressure sensing unit 130, the mobile device 100 transmits a photograph as a function corresponding thereto Function.

FIGS. 11A to 11E are diagrams illustrating the intensity of the pressure sensed by the pressure sensing unit 130 and the function of photographing according to the proximity gesture sensed by the proximity sensor unit 142, according to an embodiment of the present invention.

11A to 11D, the pictures stored in the mobile device 100 include a first picture 1110, a second picture 1120, a third picture 1130, and a fourth picture 1140 .

11A shows a case where the intensity of the pressure sensed by the pressure sensing unit 130 is "weak" and the proximity gesture sensed by the proximity sensor unit 142 is a near-field gesture. Fig. 11A, when the intensity of the pressure sensed by the pressure sensing unit 130 is "weak" and the proximity gesture sensed by the proximity sensor unit 142 is a right-to-left proximity gesture, 100 performs a function of passing a single picture by switching the state of the second picture 1120 displayed while the first picture 1110 is displayed.

FIG. 11B shows a function of quickly turning a photograph, which is a corresponding UI function, by several sheets when the intensity of the pressure sensed by the pressure sensing unit 130 is "weak" and the proximity gesture sensed by the proximity sensor unit 142 is a remote gesture FIG. 11B, when the intensity of the pressure sensed by the pressure sensing unit 130 is "weak" and the proximity gesture sensed by the proximity sensor unit 142 is a remote gesture, It is a function to turn each chapter at a time. 11B, when the intensity of the pressure sensed by the pressure sensing unit 130 is "weak" and the proximity gesture sensed by the proximity sensor unit 142 is a right-to-left distance gesture, 100 performs a function of passing a single picture by switching the state of the fourth picture 1140 displayed while the first picture 1110 is displayed.

FIG. 11C shows a function of quickly flipping a plurality of pictures, which are UI functions corresponding to the UI function, when the intensity of the pressure sensed by the pressure sensing unit 130 is "weak" and the proximity gesture sensed by the proximity sensor unit 142 is a remote gesture And FIG. 11C, when the intensity of the pressure sensed by the pressure sensing unit 130 is "weak" and the proximity gesture sensed by the proximity sensor unit 142 is a remote gesture, the corresponding UI function has a small screen It is a function to transfer three pictures at a time. The user can confirm the second picture 1120 and the third picture 1130 disposed between the first picture 1110 and the fourth picture 1140 in the process of passing the picture .

11C, when the intensity of the pressure sensed by the pressure sensing unit 130 is "weak" and the proximity gesture sensed by the proximity sensor unit 142 is a right-to-left distance gesture, 100 performs a function of turning over three pictures by reducing the screen in a state in which the fourth picture 1140 is displayed while the first picture 1110 is displayed.

FIG. 11D shows a function of rapidly rotating the photographs corresponding to the UI function by three when the intensity of the pressure sensed by the pressure sensing unit 130 is "medium" and the proximity gesture sensed by the proximity sensor unit 142 is a near-field gesture FIG. 11D, if the intensity of the pressure sensed by the pressure sensing unit 130 is "medium" and the proximity gesture detected by the proximity sensor unit 142 is a near-field gesture, It is a function to turn each chapter at a time. 11D, when the intensity of the pressure sensed by the pressure sensing unit 130 is "medium" and the proximity gesture sensed by the proximity sensor unit 142 is a right-to-left proximity gesture, 100 performs a function of passing three pictures at a time by switching the display state of the fourth picture 1140 in a state that the first picture 1110 is displayed.

11E, the pictures stored in the mobile device 100 may include a first picture 1110, a second picture 1120, a third picture 1130, a fourth picture 1140, a fifth picture 1150 ), The sixth photograph 1160, and the seventh photograph 1170. [

FIG. 11E shows a function of quickly turning the photographs corresponding to the UI function five by five when the intensity of the pressure sensed by the pressure sensing unit 130 is "strong" and the proximity gesture sensed by the proximity sensor unit 142 is a near- FIG. 11D, if the intensity of the pressure sensed by the pressure sensing unit 130 is "strong" and the proximity gesture detected by the proximity sensor unit 142 is a near-field gesture, It is a function to turn each chapter at a time. 11E, when the intensity of the pressure sensed by the pressure sensing unit 130 is "strong" and the proximity gesture sensed by the proximity sensor unit 142 is a right-to-left proximity gesture, 100 performs a function of passing five pictures at a time by switching the state of the sixth picture 1160 in a state that the first picture 1110 is displayed.

12 is a diagram illustrating a process of moving a widget screen according to an embodiment of the present invention. As shown in FIG. 12, the widget full screen 1200 is composed of an area corresponding to three times the screen of the mobile device 100. Accordingly, when the widget is displayed on the screen, the mobile device 100 displays a part of the widget full screen 1200.

When the user inputs a proximity gesture from right to left or a touch operation from right to left, the mobile device 100 displays the widget screen to be continuously moved from right to left.

On the other hand, in the state where the first widget screen 1210 is displayed, when the pressure is sensed by the pressure sensing unit 130, the mobile device 100 receives the proximity gesture from right to left in the proximity sensor 142 The second widget screen 1220 is displayed immediately. When the second widget screen 1220 is displayed on the mobile device 100, the proximity sensor 142 receives the proximity gesture from right to left in a state where the pressure is sensed by the pressure sensing unit 130 The third widget screen 1230 is displayed immediately. In this way, when the proximity sensor 142 receives the proximity gesture in the state where the pressure is sensed by the pressure sensing unit 130, the mobile device 100 passes the widget screen on a page basis.

Hereinafter, various methods of performing the zoom in function and the zoom out function using the pressure sensing unit 130 will be described with reference to FIGS. 13A to 13H. FIG. 13A to 13H are diagrams illustrating various methods of performing a zoom in function and a zoom out function using the pressure sensing unit 130 according to an embodiment of the present invention.

13A is a diagram illustrating a method of performing a zoom in function in a state that a photograph is displayed. 13A, when the photograph is displayed on the screen and the proximity gesture in the direction in which the pressure sensing unit 130 is sensed and the proximity sensor unit 142 is approached is input, the mobile device 100 Zoom in on the displayed picture.

13B is a diagram illustrating a method of performing a zoom-out function in a state in which a photograph is displayed. 13B, when a photograph is displayed on the screen, if a pressure is detected by the pressure sensing unit 130 and a proximity gesture in the direction of moving away from the proximity sensor unit 142 is inputted, the mobile device 100 displays And performs a function of zooming out the photograph.

13C is a view showing a method of performing a zoom-in function in a state in which a photograph is displayed. 13C, when the pressure is detected twice in succession (that is, when a gripping operation is performed twice) while the photograph is displayed on the screen, Zooms in the displayed picture at a specific magnification.

13D is a diagram illustrating a method of performing a zoom-out function in a state in which a photograph is displayed. 13D, if the pressure is detected for a predetermined time or longer (i.e., a long gripping operation) in the state that the photograph is displayed on the screen, the mobile device 100 And performs a function of zooming out the displayed picture during the time when the pressure is applied.

13E is a diagram illustrating a method of performing a zoom-in function in a state in which a photograph is displayed. 13E, if a pressure is sensed by the pressure sensing unit 130 and a proximity gesture that maintains a predetermined distance from the proximity sensor unit 142 is input while the photograph is displayed on the screen, Zooms in on a displayed picture while a proximity gesture maintaining a constant distance is input.

13F is a diagram illustrating a method of performing a zoom-out function in a state in which a photograph is displayed. 13F, when the photograph is displayed on the screen, the proximity gesture of the state where the pressure is sensed by the pressure sensing unit 130 and the proximity sensor unit 142 is touched (that is, the distance is 0) The mobile device 100 performs a function of zooming out the displayed picture while the proximity sensor unit 142 is touched.

13G and 13H are views showing a method of performing a zoom in function for a specific area in a state where a photograph is displayed. 13G, when a pressure is sensed by the pressure sensing unit 130 and a touch operation for touching a specific area 1300 is input through the touch detection unit 144 in a state that a photograph is displayed on the screen, The device 100 performs a function of zooming down a picture around the touched specific area 1300.

Therefore, as shown in FIG. 13G, when a user presses the pressure sensing unit 130 and inputs a touch operation for touching a specific area 1300 of the screen while a photograph is displayed on the screen, As described above, the mobile device 100 displays an enlarged image 1310 zoomed in on the touched area on the screen.

13G, when the pressure sensed by the pressure sensing unit 130 disappears in a state that the enlarged picture 1310 is displayed, the mobile device 100 displays the original picture as shown in FIG. 13G again do.

As described above, the mobile device 100 can provide a zoom in function and a zoom out function in various manners by using the pressure sensing unit 130.

Hereinafter, a notification function for notifying the current position of the pointer or the position of the currently selected icon using the pressure sensing unit 130 and the proximity sensor unit 142 will be described with reference to FIGS. 14 to 16C. FIG.

FIG. 14 is a diagram illustrating operations of the pressure sensing unit 130 and the proximity sensor unit 142 for executing a notification function according to an embodiment of the present invention. 14, when the main menu is displayed on the screen and the proximity gesture in the direction in which the pressure sensing unit 130 is detected and the proximity sensor unit 142 is approached is inputted, The notification function informs the current position of the pointer or the position of the currently selected icon.

15A to 15C are diagrams showing that the pointer 1500 of the main menu is gradually decreased as the user's hand approaches the proximity sensor unit 142, according to an embodiment of the present invention. 15A is a diagram showing a large pointer 1500 displayed when the user's hand is away from the proximity sensor unit 142. FIG. 15B is a diagram showing the pointer 1500 being displayed at a medium size when the hand is at a medium distance from the proximity sensor unit 142. Fig. 15C is a diagram showing that the pointer 1500 is displayed small when the user's hand is close to the proximity sensor unit 142. FIG.

As the user's hand approaches the proximity sensor unit 142, the pointer 1500 of the main menu is displayed so as to be gradually smaller. As a result, the user can see that the pointer moves closer to the screen from the farther You can feel the feeling.

16A to 16C are diagrams showing that the selected icon 1600 of the main menu gradually increases as the user's hand approaches the proximity sensor unit 142, according to an embodiment of the present invention. 16A is a diagram showing that the selected icon 1600 is displayed at the original size when the user's hand is far from the proximity sensor unit 142. FIG. 16B is a diagram showing a selected icon 1600 displayed slightly larger when the hand is at a medium distance from the proximity sensor unit 142. Fig. 16C is a diagram showing a large icon 1600 selected when the user's hand is close to the proximity sensor unit 142. FIG.

As the user's hand approaches the proximity sensor unit 142, the selected icon 1600 of the main menu is displayed so as to be gradually increased, so that the user can see that the selected icon 1600 comes closer to the user It is possible to feel the same feeling.

Hereinafter, a zoom-in process and a sub-menu display process of the main menu will be described with reference to FIGS. 17A to 17E. 17A to 17E are diagrams illustrating a zoom-in process and a submenu display process of a main menu according to an embodiment of the present invention.

17A shows a screen on which the main menu 1700 of the mobile device 100 is displayed. 17B, when a proximity gesture in a direction in which a pressure is sensed by the pressure sensing unit 130 and approaches the proximity sensor unit 142 is inputted, the mobile device 100 displays the main menu 1700 ) To zoom in.

Thus, as shown in FIG. 17C, the zoomed-in main menu 1710 is displayed on the screen. In this state, when the panning touch operation for the specific point 1720 is input by the user, the screen of the zoomed-in main menu 1710 is moved. The panning touch operation refers to a touch operation that moves in a predetermined direction with the screen being touched.

17D is a view showing the zoomed-in main menu 1710 after being moved by the panning touch operation of the user. 17D, when the specific icon 1740 is displayed in the specific area 1730 of the screen for a predetermined period of time, the mobile device 100 displays the submenu 1750 for the specific icon 1740 on the screen .

17E shows a state in which a submenu 1750 for a specific icon 1740 is displayed on the screen.

In this manner, the user can zoom in on the main menu using the pressure sensing unit 130 and the proximity sensor unit 142, and display the submenu for the specific icon on the screen.

Hereinafter, a process of displaying a hidden menu using the pressure sensing unit 130 and the proximity sensor unit 142 will be described with reference to FIGS. 18A to 18C. 18A to 18C are views illustrating a process of displaying a hidden menu using the pressure sensing unit 130 and the proximity sensor unit 142 according to an embodiment of the present invention.

18A is a view showing a screen in which a moving picture is being played back in the mobile device 100. [ 18A, the mobile device 100 activates the proximity sensor unit 142 when a pressure is sensed by the pressure sensing unit 130. As shown in FIG.

18B, when a pressure is detected in the pressure sensing unit 130 and a proximity gesture toward the proximity sensor unit 142 is input, the mobile device 100 displays the hidden menu 1800, Is displayed on the screen in a translucent manner.

And, as shown in FIG. 18C, as the proximity gesture of the user gets closer to the proximity sensor unit 142, the mobile device 100 gradually displays the hidden menu 1800 in a dark state.

In this way, the user can display the hidden menu on the screen by using the pressure sensing unit 130 of the mobile device 100 and the proximity sensor unit 142.

Hereinafter, a process of changing a running application using the pressure sensing unit 130 and the proximity sensor unit 142 will be described with reference to FIGS. 19A to 19D. 19A to 19D are diagrams illustrating a process in which the mobile device 100 changes an application being executed using the pressure sensing unit 130 and the proximity sensor unit 142 according to an embodiment of the present invention.

19A is a diagram showing a screen on which the application A (1900) is executed. As shown in FIG. 19A, when a pressure is sensed by the pressure sensing unit 130 while the application A 1900 is being executed, an application list is displayed on the screen as shown in FIG. 19B.

In this state, as shown in FIG. 19C, when the proximity sensor unit 142 detects the proximity gesture in the top-down direction, the application list is scrolled downward. Thus, as shown in FIG. 19C, the application currently selected in the application list becomes application B 1910.

Thereafter, when the pressure sensing unit 130 finishes sensing the pressure, the mobile device 100 displays a screen on which the application B 1910 is executed as shown in FIG. 19D.

In this way, the user may change the application being executed in the mobile device 100 using the pressure sensing part 130 and the proximity sensor part 142.

Hereinafter, a process of displaying a quick menu using the pressure sensing unit 130, the proximity sensor unit 142, and the button unit 146 will be described with reference to FIGS. 20A to 20C. 20A to 20C illustrate a process in which the mobile device 100 displays a quick menu using the pressure sensing unit 130, the proximity sensor unit 142, and the button unit 146 according to an embodiment of the present invention. Fig.

20A shows that a user inputs a proximity gesture in a direction of approaching the proximity sensor unit 142 while applying pressure to the pressure sensing unit 130. [ 20C, when the proximity sensor 142 detects a pressure in the pressure sensing unit 130, the mobile device 100 displays the proximity gesture in the quick menu 2000, On the screen. Here, the quick menu represents a menu in which functions frequently used by users are separately stored. The items of the quick menu may be set by the user or already set in the mobile device 100. [

20B shows that the user inputs a specific button operation of the button unit 146 while applying pressure to the pressure sensing unit 130. [ 20C, when the pressure is detected by the pressure sensing unit 130 and an operation for a specific button of the button unit 146 is input, the mobile device 100 displays the quick menu 2000 on the screen .

In this way, the user may display the quick menu on the screen of the mobile device 100 using the pressure sensing part 130, the proximity sensor part 142 and the button part 146. [

Meanwhile, in the present embodiment, the mobile device 100 can be any device capable of sensing pressure and receiving input of a user's operation. For example, the mobile device 100 may be a mobile phone, a TV, an MP3, a PMP, a PDA, a notebook computer, or the like capable of sensing a pressure.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

1 is a block diagram showing a detailed structure of a mobile device according to an embodiment of the present invention;

FIG. 2 illustrates a pressure sensing unit, a proximity sensor, a touch detector, and a button unit disposed on an outer surface of a mobile device according to an exemplary embodiment of the present invention.

3A is a diagram illustrating a user operation using a pressure sensor and a proximity sensor of a mobile device according to an embodiment of the present invention;

FIG. 3B is a diagram illustrating a user operation mode using a pressure detection unit and a touch detection unit of a mobile device according to an embodiment of the present invention;

FIG. 3C is a diagram illustrating a user operation using a button unit and a pressure sensing unit of a mobile device according to an exemplary embodiment of the present invention; FIG.

4 is a flowchart illustrating a UI (User Interface) providing method of a mobile device according to an embodiment of the present invention;

5A to 5C are diagrams illustrating a process of changing a mobile device from a hold state to a hold off state according to an embodiment of the present invention;

6A to 6C illustrate a process of changing a mobile device from a hold off state to a hold on state according to an embodiment of the present invention;

7A and 7B illustrate that the mobile device performs different functions according to the pressure sensing areas of the pressure sensing part, according to an embodiment of the present invention;

8A and 8B illustrate that the mobile device performs different functions according to the pressure sensing areas of the pressure sensing unit according to an embodiment of the present invention;

9 is a table summarizing the intensity of the pressure sensed by the pressure sensing unit and the function of the UI according to the proximity gesture sensed by the proximity sensor unit, according to an embodiment of the present invention;

FIGS. 10A through 10C illustrate a process of displaying a next picture on a screen according to an embodiment of the present invention; FIG.

FIGS. 11A to 11E illustrate the intensity of the pressure sensed by the pressure sensing unit and the function of photographing according to the proximity gesture sensed by the proximity sensor unit, according to an embodiment of the present invention;

12 is a diagram illustrating a process of moving a widget screen according to an embodiment of the present invention;

13A through 13H illustrate various methods of performing a zoom in function and a zoom out function using a pressure sensing unit according to an embodiment of the present invention.

FIG. 14 illustrates operations of a pressure sensor and a proximity sensor for executing a notification function according to an embodiment of the present invention; FIG.

FIGS. 15A through 15C illustrate that the pointer of the main menu decreases as the user's hand approaches the proximity sensor, according to an embodiment of the present invention; FIGS.

16A to 16C illustrate that the selected icon of the main menu gradually increases as the user's hand approaches the proximity sensor unit, according to an embodiment of the present invention;

FIGS. 17A through 17E illustrate a zoom-in process and a sub-menu display process of a main menu according to an embodiment of the present invention;

18A to 18C are diagrams illustrating a process of displaying a hidden menu using a pressure sensor and a proximity sensor according to an embodiment of the present invention;

19A to 19D illustrate a process of changing a running application using a pressure sensor and a proximity sensor according to an embodiment of the present invention;

20A to 20C are views illustrating a process of displaying a quick menu using a pressure sensor, a proximity sensor, and a button unit according to an embodiment of the present invention.

Claims (16)

A pressure sensing part for sensing a pressure; An operation unit for receiving a user's operation; And And a control unit for controlling the operation unit in the deactivated state to be activated when a pressure is detected in the pressure sensing unit in a state in which the operation unit is deactivated, Wherein, A proximity sensor for detecting proximity of a user and proximity gesture; A touch detection unit for detecting a touch operation of a user; And A button unit for detecting a button operation of the user; , ≪ / RTI > Wherein, Wherein the control unit controls the at least one of the proximity sensor, the touch detection unit, and the button unit to be activated when the pressure is sensed by the pressure sensing unit, Wherein, And performs a different function on the same operation input through the operation unit according to the intensity of the pressure sensed by the pressure sensing unit. delete The method according to claim 1, Wherein, And a proximity sensor section for detecting proximity of the user and proximity gesture, Wherein, Wherein when a pressure is detected by the pressure sensing unit and the proximity sensor detects the proximity gesture during execution of a specific application, the mobile device performs a function related to the specific application. The method according to claim 1, Wherein, And a touch detection unit for detecting a touch operation of the user, Wherein, Wherein when a pressure is detected by the pressure sensing unit and the touch operation is detected by the touch detecting unit during execution of a specific application, the mobile device performs a function related to the specific application. The method according to claim 1, Wherein, And a button unit for detecting a button operation of the user, Wherein, Wherein when a pressure is detected in the pressure sensing part and a button operation is detected in the button part during execution of a specific application, the mobile device performs a function related to the specific application. delete The method according to claim 1, The pressure sensing unit may include: At least one pressure sensing area, Wherein, Wherein the determining unit determines a function to be performed on the operation input through the operation unit according to the pressure sensing area in which the pressure is sensed in the at least one pressure sensing area. The method according to claim 1, Wherein, Wherein the function determining unit determines a function to be performed on the operation input through the operation unit according to the number of sensed pressures sensed by the pressure sensing unit. Sensing a pressure in the pressure sensing unit; Activating the operation unit when pressure is sensed by the pressure sensing unit in a state in which the operation unit for receiving a user's operation is inactivated; And And performing a function corresponding to an operation of a user input through the operation unit, Wherein, A proximity sensor for detecting proximity of a user and proximity gesture; A touch detection unit for detecting a touch operation of a user; And A button unit for detecting a button operation of the user; , ≪ / RTI > Wherein, Wherein when the pressure is sensed by the pressure sensing unit, at least one of the proximity sensor, the touch sensing unit, and the button unit is activated, Wherein the performing comprises: And performs a different function on the same operation input through the operation unit according to the intensity of the pressure sensed by the pressure sensing unit. delete 10. The method of claim 9, And performing a function related to the specific application when a pressure is sensed by the pressure sensing unit and a proximity gesture is sensed by the proximity sensor during execution of a specific application. 10. The method of claim 9, And performing a function related to the specific application when a pressure is detected by the pressure sensing unit and a touch operation is detected by the touch detecting unit during execution of a specific application. 10. The method of claim 9, And performing a function related to the specific application when a pressure is detected in the pressure sensing part and a button operation is detected in a button part while a specific application is being executed. delete 10. The method of claim 9, Wherein the pressure sensing step comprises: Sensing a pressure in one of the at least one pressure sensing areas, Receiving an operation of a user through the operation unit; And Determining a function to be performed on the operation input through the operation unit according to the pressure sensing area in which the pressure is sensed in the at least one pressure sensing area. 10. The method of claim 9, Wherein the pressure sensing step comprises: Sensing at least one pressure, Receiving an operation of a user through the operation unit; And And determining a function to be performed on the operation input through the operation unit according to the number of sensed pressures sensed by the pressure sensing unit.

Images