WO2023168621A1 - Tactile and visual feedback synchronization method and device - Google Patents

Abstract

Provided in the present disclosure are a tactile and visual feedback synchronization method and device, which are used for controlling tactile feedback and visual feedback that accompany a touch-control operation of a user to stay synchronous, so as to reduce the delay of the visual feedback, thereby avoiding the visual experience of lagging. The method comprises: acquiring tangential velocities of touch points during rotation, wherein the touch points are generated by means of a user executing a rotation touch operation within the coverage range of a virtual knob displayed on a touch-control screen, and the touch operation is accompanied by tactile feedback; and according to the tangential velocities, controlling response labels displayed on the touch-control screen to move in sequence, so as to make the tactile feedback stay synchronized with visual feedback produced by the movement of the response labels, wherein the step length of each instance of movement of each response label corresponds to a preset unit angle, and the number of times each response label is moved is determined according to the number of preset unit angles included in a rotation angle of the virtual knob.

Description

A method and device for synchronizing tactile and visual feedback Technical field

The present disclosure relates to the technical field of human-computer interaction, and in particular to a method and device for synchronizing tactile and visual feedback.

Background technique

In the field of human-computer interaction technology, users realize human-computer interaction with electronic devices through touch operations performed on the touch screen. After the user performs a touch operation on the touch screen of the electronic device, the electronic device provides the user with visual feedback corresponding to the touch operation by displaying an interface corresponding to the touch operation. Usually, after a user performs a touch operation, a certain amount of feedback time is required to complete the display of the corresponding interface. In scenarios where the user performs a touch operation quickly, it is easy to cause an out-of-sync problem between the touch operation and visual feedback.

For example, in a certain scenario, the user needs to control the rotation of a virtual knob on the touch screen to switch the current state of the controlled quantity on the virtual knob. However, when the user quickly turns the virtual knob to switch states, since the feedback time of the state switch is usually fixed, when the user has completed turning the virtual knob, the state switch cannot be completed simultaneously, resulting in a delay in visual feedback to the user. , out of sync and stuck visual experience.

Contents of the invention

The present disclosure provides a method and device for synchronizing tactile and visual feedback, which is used to control the tactile feedback and visual feedback accompanying the user's touch operation to be synchronized, reduce the delay of visual feedback, and avoid a stuck visual experience.

In a first aspect, an embodiment of the present disclosure provides a method for synchronizing tactile and visual feedback, including:

Obtain the tangential velocity of the rotation of the contact point generated by the user performing a rotational touch operation within the coverage of the virtual knob displayed on the touch screen, the touch operation being accompanied by tactile feedback;

According to the tangential speed, each response label displayed on the touch screen is controlled to move sequentially to synchronize the tactile feedback and the visual feedback formed by the movement of each response label, wherein each response label moves in steps The length corresponds to the preset unit angle, and the number of times each response label moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob.

As an optional implementation, it also includes:

According to the tangential speed, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is based on the response labels displayed at the reference position before each response label moves in sequence and the number of times each response label moves. definite;

When the visual feedback time is less than or equal to the time threshold, the content of each response tag displayed on the touch screen is updated.

As an optional implementation manner, controlling each response label displayed on the touch screen to move sequentially according to the tangential speed includes:

When the visual feedback time is greater than the time threshold, each response label displayed on the touch screen is controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

As an optional implementation, determining the visual feedback time for the target response tag to move to the reference position according to the tangential speed includes:

Determine the rotation angle of the virtual knob according to the tangential velocity and the size of the virtual knob;

According to the distance between the target response label and the reference position and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

As an optional implementation manner, controlling each response label displayed on the touch screen to move sequentially according to the tangential speed includes:

Determine the movement trajectory of each response label based on the step length and number of times each response label moves;

Perform the following steps for the movement trajectory of each response label:

An interpolation operation is performed on the movement trajectory of the response tag to obtain each point that the response tag passes during its movement; the response tag is controlled to move to each point in sequence according to the tangential speed.

As an optional implementation manner, controlling each response label displayed on the touch screen to move sequentially according to the tangential speed includes:

Using the tangential speed as the moving speed, each response label displayed on the touch screen is controlled to move at a constant speed in sequence.

As an optional implementation manner, controlling each response label displayed on the touch screen to move sequentially according to the tangential speed includes:

Obtain the rotation direction of the contact rotation, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction;

According to the tangential speed and the moving direction, each response label displayed on the touch screen is controlled to move sequentially.

As an optional implementation,

The respective response tags are displayed in sequence along the vertical direction; or,

The respective response tags are arranged and displayed in order along the horizontal direction; or,

The respective response labels are arranged and displayed around the virtual knob.

In a second aspect, an embodiment of the present disclosure provides a device for synchronizing tactile and visual feedback, including:

A speed acquisition unit configured to acquire the tangential speed of the rotation of a contact point generated by a user performing a touch operation of rotation within the coverage of a virtual knob displayed on the touch screen, the touch operation being accompanied by tactile feedback;

A control movement unit configured to control each response label displayed on the touch screen to move sequentially according to the tangential speed, so as to synchronize the tactile feedback and the visual feedback formed by the movement of each response label, wherein each response The step size of each movement of the label corresponds to the preset unit angle, and the number of times each response label moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob.

As an optional implementation method, the update content unit is also included for:

According to the tangential speed, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is based on the response labels displayed at the reference position before each response label moves in sequence and the number of times each response label moves. definite;

When the visual feedback time is less than or equal to the time threshold, the content of each response tag displayed on the touch screen is updated.

As an optional implementation, the control mobile unit is specifically used to:

When the visual feedback time is greater than the time threshold, each response label displayed on the touch screen is controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

As an optional implementation, the updated content unit is used for:

Determine the rotation angle of the virtual knob according to the tangential velocity and the size of the virtual knob;

According to the distance between the target response label and the reference position and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

As an optional implementation, the control mobile unit is specifically used to:

Determine the movement trajectory of each response label based on the step length and number of times each response label moves;

Perform the following steps for the movement trajectory of each response label:

An interpolation operation is performed on the movement trajectory of the response tag to obtain each point that the response tag passes during its movement; the response tag is controlled to move to each point in sequence according to the tangential speed.

As an optional implementation, the control mobile unit is specifically used to:

Using the tangential speed as the moving speed, each response label displayed on the touch screen is controlled to move at a constant speed in sequence.

As an optional implementation, the control mobile unit is specifically used to:

Obtain the rotation direction of the contact rotation, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction;

According to the tangential speed and the moving direction, each response label displayed on the touch screen is controlled to move sequentially.

As an optional implementation,

The respective response tags are displayed in sequence along the vertical direction; or,

The respective response tags are arranged and displayed in order along the horizontal direction; or,

The respective response labels are arranged and displayed around the virtual knob.

In a third aspect, embodiments of the present disclosure also provide a device for synchronizing tactile and visual feedback. The device includes a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read program in the memory and perform the following steps:

Obtain the tangential velocity of the rotation of the contact point generated by the user performing a rotational touch operation within the coverage of the virtual knob displayed on the touch screen, the touch operation being accompanied by tactile feedback;

According to the tangential speed, each response label displayed on the touch screen is controlled to move sequentially to synchronize the tactile feedback and the visual feedback formed by the movement of each response label, wherein each response label moves in steps The length corresponds to the preset unit angle, and the number of times each response label moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob.

As an optional implementation, the processor is specifically configured to execute:

According to the tangential speed, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is based on the response labels displayed at the reference position before each response label moves in sequence and the number of times each response label moves. definite;

When the visual feedback time is less than or equal to the time threshold, the content of each response tag displayed on the touch screen is updated.

As an optional implementation, the processor is specifically configured to execute:

When the visual feedback time is greater than the time threshold, each response label displayed on the touch screen is controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

As an optional implementation, the processor is specifically configured to execute:

Determine the rotation angle of the virtual knob according to the tangential velocity and the size of the virtual knob;

According to the distance between the target response label and the reference position and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

As an optional implementation, the processor is specifically configured to execute:

Determine the movement trajectory of each response label based on the step length and number of times each response label moves;

Perform the following steps for the movement trajectory of each response label:

An interpolation operation is performed on the movement trajectory of the response tag to obtain each point that the response tag passes during its movement; the response tag is controlled to move to each point in sequence according to the tangential speed.

As an optional implementation, the processor is specifically configured to execute:

Using the tangential speed as the moving speed, each response label displayed on the touch screen is controlled to move at a constant speed in sequence.

As an optional implementation, the processor is specifically configured to execute:

Obtain the rotation direction of the contact rotation, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction;

According to the tangential speed and the moving direction, each response label displayed on the touch screen is controlled to move sequentially.

As an optional implementation,

The respective response tags are displayed in sequence along the vertical direction; or,

The respective response tags are arranged and displayed in order along the horizontal direction; or,

The respective response labels are arranged and displayed around the virtual knob.

In a fourth aspect, embodiments of the present disclosure also provide a computer storage medium on which a computer program is stored, and when the program is executed by a processor, it is used to implement the steps of the method described in the first aspect.

These and other aspects of the present disclosure will be more clearly understood in the following description of the embodiments.

Description of the drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, a brief introduction will be given below to the drawings needed to be used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present disclosure. Those of ordinary skill in the art can also obtain other drawings based on these drawings without exerting any creative effort.

Figure 1 is an implementation flow chart of a method for synchronizing tactile and visual feedback provided by an embodiment of the present disclosure;

Figure 2 is a schematic diagram of a virtual knob provided by an embodiment of the present disclosure;

Figure 3 is a specific implementation flow chart of synchronization of tactile and visual feedback provided by an embodiment of the present disclosure;

Figure 4A is a schematic diagram of a display interface of the first touch screen provided by an embodiment of the present disclosure;

Figure 4B is a first human-computer interaction flow chart provided by an embodiment of the present disclosure;

Figure 5A is a schematic diagram of the display interface of the second touch screen provided by an embodiment of the present disclosure;

Figure 5B is a second human-computer interaction flow chart provided by an embodiment of the present disclosure;

Figure 6A is a schematic diagram of a display interface of a third touch screen provided by an embodiment of the present disclosure;

Figure 6B is a third human-computer interaction flow chart provided by an embodiment of the present disclosure;

Figure 7 is a schematic diagram of a device for synchronizing tactile and visual feedback provided by an embodiment of the present disclosure;

Figure 8 is a schematic diagram of a device for synchronizing tactile and visual feedback provided by an embodiment of the present disclosure.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the present disclosure will be described in further detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present disclosure. Based on the embodiments in this disclosure, all other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the scope of protection of this disclosure.

In the embodiment of the present disclosure, the term "and/or" describes the association relationship of associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone. these three situations. The character "/" generally indicates that the related objects are in an "or" relationship.

The application scenarios described in the embodiments of the present disclosure are to more clearly illustrate the technical solutions of the embodiments of the present disclosure, and do not constitute a limitation on the technical solutions provided by the embodiments of the present disclosure. Those of ordinary skill in the art will know that with the emergence of new application scenarios It appears that the technical solutions provided by the embodiments of the present disclosure are equally applicable to similar technical problems. Among them, in the description of the present disclosure, unless otherwise specified, "plurality" means two or more.

Embodiment 1. In the field of human-computer interaction technology, users implement human-computer interaction with electronic devices through touch operations performed on the touch screen. After the user performs a touch operation on the touch screen of the electronic device, the electronic device provides the user with visual feedback corresponding to the touch operation by displaying an interface corresponding to the touch operation. Usually, after a user performs a touch operation, a certain amount of feedback time is required to complete the display of the corresponding interface. In scenarios where the user performs a touch operation quickly, it is easy to cause an out-of-sync problem between the touch operation and visual feedback. For example, in a certain scenario, the user needs to control the rotation of a virtual knob on the touch screen to switch the current state of the controlled quantity on the virtual knob. However, when the user quickly turns the virtual knob to switch states, since the feedback time of the state switch is usually fixed, when the user has completed turning the virtual knob, the state switch cannot be completed simultaneously, resulting in a delay in visual feedback to the user. , out of sync and stuck visual experience.

In order to solve the above technical problems, embodiments of the present disclosure provide a method for synchronizing tactile and visual feedback. The core idea is to use the detection of the contact speed to obtain the tangential speed of the contact rotation, thereby controlling the virtual machine according to the tangential speed. Each response label corresponding to the knob moves in sequence. As the contact speed changes, the moving speed of each response label also changes accordingly. It solves the problem of slow and fast control of the virtual knob rotation speed for different users, tactile feedback and dynamic visual feedback. Out of sync or lag issues. This embodiment uses the method of detecting the moving speed of touch screen contacts to perform variable speed adjustment of visual dynamic feedback, reducing visual feedback delay and avoiding stuck, so that the tactile feedback accompanying the user's touch operation and the dynamic response generated in response to the touch operation are Visual feedback remains synchronized, effectively improving the user experience.

As shown in Figure 1, the implementation process of a method for synchronizing tactile and visual feedback provided by this embodiment is as follows:

Step 100: Obtain the tangential speed of the rotation of the contact point, which is generated by the user's touch operation of rotating within the coverage of the virtual knob displayed on the touch screen, and the touch operation is accompanied by tactile feedback;

In the implementation, the user can perform touch operations along the virtual knob, simulating the user's rotation operation of the physical knob in a real scene. As shown in Figure 2, this embodiment provides a schematic diagram of a virtual knob. Among them, when the user performs a rotating touch operation on the virtual knob displayed on the touch screen, it is also accompanied by tactile feedback, such as through vibration, jitter and other tactile feedback methods, allowing the user to have tactile perception while rotating the virtual knob, and can be more Really simulates the touch feeling of users operating physical knobs in real scenes.

In some embodiments, when it is detected that the angle of the contact point changes within the coverage range of the virtual knob, the rotation of the contact point is determined, and the tangential speed generated by the rotation of the contact point along the virtual knob is detected. Among them, the tangential speed in this embodiment refers to the instantaneous speed of the contact when it makes a curved motion (including circular motion). At the same time, the movement direction of the contact is along the tangential direction of the motion track (such as the outline of a virtual knob) .

In some embodiments, a sensor may be used to detect whether the contact is rotating and the tangential speed of the contact rotation. In the implementation, the contact rotation generated by the user's touch operation does not need to strictly rotate along the circumference of the virtual knob. As long as it is within the coverage of the virtual knob and the angle change of the contact is greater than or equal to the angle threshold, the touch point is determined to be The point is when the virtual knob is rotated. This contact is used as an effective contact and the tangential speed of the contact rotation can be detected. Similarly, if the contact exceeds the coverage range of the virtual knob or the angle change of the contact is less than the angle threshold, the contact is determined to be an invalid contact and the above steps are not performed.

Step 101: Control each response label displayed on the touch screen to move sequentially according to the tangential speed, so as to synchronize the tactile feedback and the visual feedback formed by the movement of each response label, wherein each response label each time The step length of movement corresponds to the preset unit angle, and the number of times each response tag moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob.

In this embodiment, the tactile feedback perceived by the user while turning the virtual knob is almost synchronized with the user's rotation process. In order to synchronize the movement of the response label visually perceived by the user with the tactile feedback, this embodiment is based on the user's touch The tangential speed of the contact rotation generated by the operation controls the movement of each response tag, so that the movement process of the contact point and the movement process of the response label are synchronized, and the contact point is accompanied by tactile feedback during the movement process, so it can make tactile feedback Synchronize with visual feedback to improve user experience.

During implementation, the virtual knob in this embodiment is marked with various rotation angles. Optionally, each rotation angle can be evenly distributed or unevenly distributed. This embodiment does not overdo the distribution of each rotation angle on the virtual knob. Too limited. Since the default unit angle does not change, the step size of each response label movement is fixed, and the number of moves is determined based on the number of preset unit angles included in the rotation angle. For example, the default unit angle is 10 degree, the rotation angle is 50 degrees, then each response label moves 5 steps. In some embodiments, after detecting the rotation angle of the virtual knob, first determine the number of preset unit angles included in the rotation angle, and then determine the number of preset unit angles included in the rotation angle. Set the number of unit angles to determine the number of times the response label moves, and then determine the movement step of the response label corresponding to the preset unit angle. Finally, according to the movement step and the number of movements, control each response label to be arranged in the preset order. Move in turn. It should be noted that the preset unit angle in this embodiment is obtained by dividing the maximum angle value of the virtual knob equally. Specifically, the size of the preset unit angle can be defined according to the actual situation. This embodiment does not make too much about this. limited.

Optionally, the preset unit angle is used to characterize the detection accuracy when detecting the rotation angle of the virtual knob. When the user rotates the virtual knob and the rotation angle is lower than the preset unit angle, it is determined that the rotation angle is invalid and the movement of the response label will not be controlled.

In some embodiments, the tangential speed can be used as the moving speed of each response label, and each response label displayed is controlled to move to the corresponding position according to the tangential speed. Visually, with the speed of the user's touch point, changes, the moving speed of each response label also changes accordingly, that is, if the speed of the user's contact point is fast, then the speed of each response label will move fast, and if the speed of the user's contact point is slow, then the speed of each response label will move slowly, thus achieving Visual feedback synchronization.

In some embodiments, this embodiment also provides a response label switching method. The specific implementation steps are as follows:

Step 1) According to the tangential velocity, determine the visual feedback time for the target response tag to move to the reference position;

The target response label is determined based on the response labels displayed at the reference position before each response label moves in sequence and the number of times each response label moves. Optionally, the order in which each response label is displayed is predefined. Each response label moves one or more times according to a fixed step size. Each time it moves, the position of the response label changes once. In some embodiments, All response labels move in the same step size, and all response labels move at the same time in the same step size and number of times. Among them, when any response label moves by one step, the any response label moves to the adjacent position (such as the adjacent next position, or the adjacent previous position, or the adjacent left position) in a predefined order. one position, or the adjacent one to the right, and so on).

In some embodiments, the target response tag is determined based on the arrangement order of each response tag, the response tag displayed at the reference position before each response tag moves in sequence, and the number of times each response tag moves. In the implementation, the order of each response tag is predefined, then after determining the number of moves, based on the response tag displayed at the reference position and the number of moves, it is determined which response tag will move to the reference position, thereby moving the response tag to the reference position. The response label is determined as the target response label, that is, the response label selected by the user by turning the virtual knob is determined.

In some embodiments, the reference position is used to display the target response label; in some embodiments, the reference position is a fixed position on the touch screen, used to display the response label currently selected by the user, that is, the target response Label.

Optionally, the target response label is the response label corresponding to the rotated virtual knob selected by the user after turning the virtual knob, wherein the target response label is determined based on the reference position displayed before each response label is moved sequentially. The response tags, as well as the number and direction of movement of each response tag are determined. The arrangement order of each response tag is predefined. During the movement process, it moves sequentially according to the step length, number of times, direction of movement, and the arrangement order.

Optionally, the target response label in this embodiment can be regarded as the current response label. If the user has not turned the virtual knob at the current moment, the target response label can be regarded as the response label that has been displayed on the reference position. If the user has already turned the virtual knob at the current moment, When the virtual knob is rotated, the target response label is the response label corresponding to the rotation angle of the virtual knob after rotation.

In some embodiments, this embodiment determines the visual feedback time for the target response tag to move to the reference position through the following steps:

1a) Determine the rotation angle of the virtual knob according to the tangential velocity and the size of the virtual knob;

In some embodiments, the rotation angle is determined based on the tangential velocity and the radius of the virtual knob, and the formula is as follows:

w＝v/R Formula (1);

Among them, w represents the rotation angle, v represents the tangential velocity, and R represents the radius.

1b) Determine the visual feedback time for the target response label to move to the reference position based on the distance between the target response label and the reference position and the rotation angle.

In some embodiments, the visual feedback time is determined by the following formula, which is as follows:

t＝L/μw Formula (2);

Among them, t represents the visual feedback time, L represents the distance between the target response label and the reference position, w represents the rotation angle, and μ represents the correction coefficient greater than 0.

Step 2) When the visual feedback time is less than or equal to the time threshold, update the content of each response tag displayed on the touch screen.

The above formula shows that when L is constant, the larger w is, the smaller t is. As w increases to a certain extent, that is, when the user turns the virtual knob very fast, t tends to 0. At this time, due to computer processing Due to capacity limitations, if you continue to use dynamic visual feedback in response to label movement, it will cause out-of-sync phenomena such as screen freezes. At this time, the dynamic visual feedback is adjusted to static visual feedback, that is, there is no dynamic movement effect visually, but the content of each response tag is directly modified, visually producing the feeling that the response tag is in place in one step, avoiding lag, and satisfying users The experience of human-computer interaction.

In the implementation, when the user turns the virtual knob to a certain angle, the target response label corresponding to the angle is displayed at the reference position. At the same time, during the period when the user turns the virtual knob, due to the small calculated visual feedback time, there is almost no time for the response label to move to simulate the physical displacement in the real world. Therefore, the response label does not change its position, and only the content of the response label changes, thus It creates a visual experience that responds to the label in one step, synchronizing visual feedback and tactile feedback, so that the user's tactile and visual perceptions are synchronized.

In some embodiments, when the visual feedback time is greater than a time threshold, each response label displayed on the touch screen is controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference Location.

During the implementation, during the period when the user turns the virtual knob, due to the long feedback time, there is sufficient time for the response label to move to simulate the physical displacement in the real world. The target response label moves to the reference position. During the movement of the target response label , other response tags are also moved to the corresponding positions in sequence. The responsive tag visually gives the user a process of responding to the physical changes of the tag in the real world through displacement.

In some embodiments, as the contact is rotated, the virtual knob is also rotated.

In some embodiments, this embodiment provides two visual feedback methods, including dynamic visual feedback and static visual feedback. The two visual feedback methods provided by this embodiment are explained below:

Static visual feedback means that when the user turns the virtual knob on the touch screen, there is no displacement change in response to label switching, but only changes in the content of the response label. In implementation, when the visual feedback time is less than or equal to the time threshold, the content of each response tag displayed on the touch screen is updated.

Dynamic visual feedback means that when the user turns the virtual knob on the touch screen, the switching of the response label will change in displacement. Visually, the content of the response label is like the process of physical changes in the real world. In implementation, when the visual feedback time is greater than the time threshold, each response label displayed on the touch screen is controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

In some embodiments, embodiments of the present disclosure can also decide to use dynamic visual feedback or static visual feedback based on the judgment of tangential speed. The specific implementation process is as follows:

When the tangential speed is greater than the speed threshold, static visual feedback is used to switch the response tags, that is, the content of each response tag displayed on the touch screen is updated.

When the tangential speed is less than or equal to the speed threshold, dynamic visual feedback is used to switch the response tags, that is, each response tag displayed on the touch screen is controlled to move sequentially according to the tangential speed, wherein the target response tag is controlled to move to the reference position.

In some embodiments, the reference position in this embodiment is a fixed display position on the touch screen, which is used to display the response label corresponding to the rotation angle of the current virtual knob. This embodiment does not place too many restrictions on the setting of the reference position.

In some embodiments, this embodiment provides an interpolation method so that the response tag can simulate a more realistic physical movement scene during movement. The specific implementation is as follows:

Determine the movement trajectory of each response label based on the step length and number of times each response label moves;

Perform the following steps for the movement trajectory of each response label:

An interpolation operation is performed on the movement trajectory of the response tag to obtain each point that the response tag passes during its movement; the response tag is controlled to move to each point in sequence according to the tangential speed.

In some embodiments, this embodiment can also use the tangential speed as a moving speed to control each response label displayed on the touch screen to move at a constant speed in sequence.

In implementation, for each response tag, the response tag is controlled to move to each point in sequence at a constant speed according to the tangential speed.

In some embodiments, this embodiment can also control the movement direction of each response tag according to the rotation direction of the contact. The specific implementation is as follows:

Obtain the rotation direction of the contact rotation, determine the movement direction of each response label displayed on the touch screen according to the rotation direction; control the movement direction of each response label displayed on the touch screen based on the tangential speed and the movement direction. Each response tag moves in sequence.

In implementation, the tangential speed is used as the moving speed of each response tag, and each response tag is controlled to move to the corresponding position (each point) according to the moving direction of the response tag corresponding to the moving direction. Optionally, the user controls the rotation of the virtual knob through the touch screen, and the response label will move up and down to switch positions. When the virtual knob rotates clockwise, all response labels move to the switching position from top to bottom; when the virtual knob rotates counterclockwise, all response labels move to the switching position from bottom to top. Alternatively, the user controls the rotation of the virtual knob through the touch screen, and the response label will move left and right. When the virtual knob rotates clockwise, all response labels move to the switching position from left to right; when the virtual knob rotates counterclockwise, all response labels move to the switching position from right to left. Alternatively, the user controls the rotation of the virtual knob through the touch screen, and the response label will move diagonally. When the virtual knob rotates clockwise, all response labels move from diagonally downward to diagonally upward. When the virtual knob rotates counterclockwise, all response labels move from diagonally upward to diagonally downward.

In some embodiments, each response label displayed on the touch screen of this embodiment is displayed in any of the following ways:

(1) The respective response tags are arranged and displayed in sequence along the longitudinal direction;

(2) The respective response tags are arranged and displayed in order along the horizontal direction;

(3) The respective response labels are arranged and displayed around the virtual knob. Each response label can surround one side of the virtual knob, or the virtual knob can be entirely surrounded, for example, the response labels are evenly distributed around the virtual knob. This embodiment does not limit this too much.

In some embodiments, the virtual knob and the response label are displayed on the touch screen at the same time, and the virtual knob and the response label do not block each other. This embodiment does not place too many restrictions on the relative positional relationship between the virtual knob and the response label.

In some embodiments, the shape of the virtual knob in this embodiment includes but is not limited to at least one of a circle, an ellipse, and a figure composed of a curve. This embodiment does not impose too many restrictions on the shape of the virtual knob.

In some embodiments, the response tag includes but is not limited to icons, pictures, and text, and the content of the response tag includes but is not limited to specified information, such as contacts in the address book, playlists in the song library, product models, etc. This embodiment does not place too many restrictions on the size, shape, content, color, etc. of the response tag.

In some embodiments, all response labels may not be displayed on the touch screen at the same time. Only part of the response labels may be displayed, and the target response label corresponding to the rotation angle of the current virtual knob is displayed at the reference position. When the user rotates the virtual knob, During the process of turning the knob, the response labels can also be displayed sequentially by scrolling.

As shown in Figure 3, the embodiment of the present disclosure also provides a specific implementation process for synchronizing tactile and visual feedback, as follows:

Step 300: Receive contacts generated by the user performing a rotating touch operation within the coverage of the virtual knob displayed on the touch screen;

Step 301: Calculate the tangential speed of contact rotation;

Step 302: Determine the rotation angle of the virtual knob based on the tangential velocity and the radius of the virtual knob;

Step 303: Determine the corresponding target response label according to the rotation angle of the virtual knob;

Step 304: Determine the visual feedback time for the target response label to move to the reference position based on the distance between the target response label and the reference position and the rotation angle;

Step 305: Determine whether the visual feedback time is greater than the time threshold. If so, execute step 306; otherwise, execute step 307;

Step 306: On the movement trajectory of each response tag, calculate each point that each response tag passes during its movement through interpolation operations, and control each response tag to move to the corresponding points at a constant speed according to the tangential speed;

Step 307: Calculate the position to which each response label needs to be moved, and update the content of each response label according to the response label that needs to be displayed at each position.

As shown in Figure 4A, an embodiment of the present disclosure provides a touch screen display interface. Taking the virtual knob on the left side and the response label on the right side arranged vertically as an example, the circle with scales on the left represents the virtual knob, and the square on the right The area represents the response tag, and the response tag can store information specified by the developer, such as contacts in the address book, playlists in the song library, product models, etc. The user controls the rotation of the virtual knob on the left through the touch screen, and the response label on the right will move up and down to switch positions. For example, when the virtual knob rotates clockwise, all response labels move to the switching position from top to bottom; when the virtual knob rotates counterclockwise, all response labels move to the switching position from bottom to top.

As shown in Figure 4B, a human-computer interaction process provided by this embodiment is explained. The specific implementation process is as follows:

Step 400: The touch screen receives a touch operation in which the user touches the virtual knob with his finger to perform rotation;

Step 401: Obtain the tangential speed of the contact generated by the touch operation as it rotates along the virtual knob;

Step 402: Determine the target response label corresponding to the rotation angle obtained after the virtual knob is rotated;

Step 403: Calculate the distance between the target response tag and the reference position, and determine the visual feedback time based on the distance and rotation angle;

The reference position can be set at the position directly facing the virtual knob.

Step 404: Determine whether the visual feedback time is greater than the time threshold. If so, execute step 405; otherwise, execute step 406;

Step 405: Control each response tag to move up and down in sequence according to the tangential speed, and the target response tag moves to the reference position.

Step 406: Determine the position where each response label needs to be moved, and modify the content of each response label according to the response label that needs to be displayed at the position.

As shown in Figure 5A, an embodiment of the present disclosure provides a touch screen display interface. As an example, the virtual knob is located on the lower side and the response labels are located on the upper side and arranged horizontally. The circle with scales on the lower side represents the virtual knob, and the square on the upper side represents the virtual knob. The area represents the response tag, and the response tag can store information specified by the developer, such as contacts in the address book, playlists in the song library, product models, etc. The user controls the rotation of the virtual knob on the lower side through the touch screen, and the response label on the upper side will move left and right to switch positions. For example, when the virtual knob rotates clockwise, all response labels move to the switching position from left to right; when the virtual knob rotates counterclockwise, all response labels move to the switching position from right to left.

As shown in Figure 5B, a human-computer interaction process provided by this embodiment is explained. The specific implementation process is as follows:

Step 500: The touch screen receives the user's touch operation of rotating the virtual knob by touching it with his finger;

Step 501: Obtain the tangential speed of the contact generated by the touch operation as it rotates along the virtual knob;

Step 502: Determine the target response label corresponding to the rotation angle obtained after the virtual knob is rotated;

Step 503: Calculate the distance between the target response tag and the reference position, and determine the visual feedback time based on the distance and rotation angle;

The reference position can be set at the position directly facing the virtual knob.

Step 504: Determine whether the visual feedback time is greater than the time threshold. If so, execute step 505; otherwise, execute step 506;

Step 505: Control each response tag to move left and right in sequence according to the tangential speed, with the target response tag moving to the reference position.

Step 506: Determine the position where each response label needs to be moved, and modify the content of each response label according to the response label that needs to be displayed at the position.

As shown in Figure 6A, an embodiment of the present disclosure provides a touch screen display interface. Taking the virtual knob on the left side and response labels arranged around the virtual knob as an example, the circle with a scale on the right side represents the virtual knob, and the square area on the left side Represents a response tag, which can store information specified by the developer, such as contacts in the address book, playlists in the song library, product models, etc. The user controls the rotation of the virtual knob on the right through the touch screen, and the response label on the left will move up and down to switch positions. For example, when the virtual knob rotates clockwise, all response labels move from diagonally upward to diagonally downward. When the virtual knob rotates counterclockwise, all response labels move from diagonally downward to diagonally upward.

As shown in Figure 6B, a human-computer interaction process provided by this embodiment is explained. The specific implementation process is as follows:

Step 600: The touch screen receives the user's touch operation of rotating the virtual knob by touching it with his finger;

Step 601: Obtain the tangential speed of the contact generated by the touch operation as it rotates along the virtual knob;

Step 602: Determine the target response label corresponding to the rotation angle obtained after the virtual knob is rotated;

Step 603: Calculate the distance between the target response tag and the reference position, and determine the visual feedback time based on the distance and rotation angle;

Step 604: Determine whether the visual feedback time is greater than the time threshold. If so, execute step 605; otherwise, execute step 606;

Step 605: Control each response tag to move obliquely upward or downward in sequence according to the tangential speed, wherein the target response tag moves to the reference position.

Step 606: Determine the position where each response label needs to be moved, and modify the content of each response label according to the response label that needs to be displayed at the position.

In implementation, when the distance between the target response label and the reference position is small (for example, the response label that the user wants to select is adjacent to the response label currently displayed at the reference position), the user's rotation speed is not fast, and the calculated visual feedback time is usually relatively long. There is enough time for the response tag to move to simulate the physical displacement of the real world. The response tag on the right can choose dynamic visual feedback, that is, the displacement will change when the response tag is switched. Visually, the content of the response tag is like the physical changes in the real world. The process is the same; on the contrary, when the distance is large (for example, the response label the user wants to select and the response label currently displayed at the reference position are separated by more than 3 response labels), the user rotates quickly and the calculated visual feedback time is usually relatively small. , even close to 0, there is no time for the response label to move to simulate the physical displacement of the real world. The response label on the right selects static visual feedback, that is, the response label does not actually change its position, but only changes in the content of the response label to generate a response. The visual experience of labeling is in place in one step.

Embodiment 2. Based on the same inventive concept, the embodiment of the present disclosure also provides a device for synchronizing tactile and visual feedback, because this device is the device in the method in the embodiment of the present disclosure, and the principle of this device to solve the problem is It is similar to the method, so the implementation of the device can be referred to the implementation of the method, and repeated details will not be repeated.

As shown in Figure 7, the device includes:

Acquisition speed unit 700 is used to acquire the tangential velocity of the rotation of a contact point generated by a user performing a rotational touch operation within the coverage area of a virtual knob displayed on the touch screen, and the touch operation is accompanied by tactile feedback ;

Control movement unit 701, configured to control each response label displayed on the touch screen to move sequentially according to the tangential speed, so as to synchronize the tactile feedback and the visual feedback formed by the movement of each response label, wherein each The step size of each movement of the response label corresponds to the preset unit angle, and the number of times each response label moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob.

As an optional implementation method, the update content unit is also included for:

According to the tangential speed, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is based on the response labels displayed at the reference position before each response label moves in sequence and the number of times each response label moves. definite;

When the visual feedback time is less than or equal to the time threshold, the content of each response tag displayed on the touch screen is updated.

As an optional implementation, the control mobile unit 701 is specifically used to:

When the visual feedback time is greater than the time threshold, each response label displayed on the touch screen is controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

As an optional implementation, the updated content unit is used for:

Determine the rotation angle of the virtual knob according to the tangential velocity and the size of the virtual knob;

According to the distance between the target response label and the reference position and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

As an optional implementation, the control mobile unit 701 is specifically used to:

Determine the movement trajectory of each response label based on the step length and number of times each response label moves;

Perform the following steps for the movement trajectory of each response label:

An interpolation operation is performed on the movement trajectory of the response tag to obtain each point that the response tag passes during its movement; the response tag is controlled to move to each point in sequence according to the tangential speed.

As an optional implementation, the control mobile unit 701 is specifically used to:

Using the tangential speed as the moving speed, each response label displayed on the touch screen is controlled to move at a constant speed in sequence.

As an optional implementation, the control mobile unit 701 is specifically used to:

Obtain the rotation direction of the contact rotation, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction;

According to the tangential speed and the moving direction, each response label displayed on the touch screen is controlled to move sequentially.

As an optional implementation,

The respective response tags are displayed in sequence along the vertical direction; or,

The respective response tags are arranged and displayed in order along the horizontal direction; or,

The respective response labels are arranged and displayed around the virtual knob.

Embodiment 3. Based on the same inventive concept, the embodiment of the present disclosure also provides a device for synchronizing tactile and visual feedback, because this device is the device in the method in the embodiment of the present disclosure, and the principle of this device to solve the problem is It is similar to this method, so the implementation of the device can be referred to the implementation of the method, and repeated details will not be repeated.

As shown in Figure 8, the device includes a processor 800 and a memory 801. The memory 801 is used to store programs executable by the processor 800. The processor 800 is used to read the programs in the memory 801 and Perform the following steps:

Obtain the tangential velocity of the rotation of the contact point generated by the user performing a rotational touch operation within the coverage of the virtual knob displayed on the touch screen, the touch operation being accompanied by tactile feedback;

According to the tangential speed, each response label displayed on the touch screen is controlled to move sequentially to synchronize the tactile feedback and the visual feedback formed by the movement of each response label, wherein each response label moves in steps The length corresponds to the preset unit angle, and the number of times each response label moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob.

As an optional implementation, the processor 800 is specifically configured to execute:

According to the tangential speed, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is based on the response labels displayed at the reference position before each response label moves in sequence and the number of times each response label moves. definite;

When the visual feedback time is less than or equal to the time threshold, the content of each response tag displayed on the touch screen is updated.

As an optional implementation, the processor 800 is specifically configured to execute:

When the visual feedback time is greater than the time threshold, each response label displayed on the touch screen is controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position.

As an optional implementation, the processor 800 is specifically configured to execute:

Determine the rotation angle of the virtual knob according to the tangential velocity and the size of the virtual knob;

According to the distance between the target response label and the reference position and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined.

As an optional implementation, the processor 800 is specifically configured to execute:

Determine the movement trajectory of each response label based on the step length and number of times each response label moves;

Perform the following steps for the movement trajectory of each response label:

An interpolation operation is performed on the movement trajectory of the response tag to obtain each point that the response tag passes during its movement; the response tag is controlled to move to each point in sequence according to the tangential speed.

As an optional implementation, the processor 800 is specifically configured to execute:

Using the tangential speed as the moving speed, each response label displayed on the touch screen is controlled to move at a constant speed in sequence.

As an optional implementation, the processor 800 is specifically configured to execute:

Obtain the rotation direction of the contact rotation, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction;

According to the tangential speed and the moving direction, each response label displayed on the touch screen is controlled to move sequentially.

As an optional implementation,

The respective response tags are displayed in sequence along the vertical direction; or,

The respective response tags are arranged and displayed in order along the horizontal direction; or,

The respective response labels are arranged and displayed around the virtual knob.

Based on the same inventive concept, embodiments of the present disclosure also provide a computer storage medium on which a computer program is stored. When the program is executed by a processor, the following steps are implemented:

Obtain the tangential velocity of the rotation of the contact point generated by the user performing a rotational touch operation within the coverage of the virtual knob displayed on the touch screen, the touch operation being accompanied by tactile feedback;

According to the tangential speed, each response label displayed on the touch screen is controlled to move sequentially to synchronize the tactile feedback and the visual feedback formed by the movement of each response label, wherein each response label moves in steps The length corresponds to the preset unit angle, and the number of times each response label moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob.

Those skilled in the art will appreciate that embodiments of the present disclosure may be provided as methods, systems, or computer program products. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment that combines software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) embodying computer-usable program code therein.

The disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a use Equipment used to implement the functions specified in a process or processes in a flow diagram and/or a block or blocks in a block diagram.

These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instructed device, the instructions The equipment implements the functions specified in a process or processes in the flow diagram and/or in a block or blocks in the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device. Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.

Obviously, those skilled in the art can make various changes and modifications to the present disclosure without departing from the spirit and scope of the disclosure. In this way, if these modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and equivalent technologies, the present disclosure is also intended to include these modifications and variations.

Claims (11)

A method for synchronizing tactile and visual feedback, wherein the method includes: Obtain the tangential velocity of the rotation of the contact point generated by the user performing a rotational touch operation within the coverage of the virtual knob displayed on the touch screen, the touch operation being accompanied by tactile feedback; According to the tangential speed, each response label displayed on the touch screen is controlled to move sequentially to synchronize the tactile feedback and the visual feedback formed by the movement of each response label, wherein each response label moves in steps The length corresponds to the preset unit angle, and the number of times each response label moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob. The method of claim 1, further comprising: According to the tangential speed, the visual feedback time for the target response label to move to the reference position is determined, wherein the target response label is based on the response labels displayed at the reference position before each response label moves in sequence and the number of times each response label moves. definite; When the visual feedback time is less than or equal to the time threshold, the content of each response tag displayed on the touch screen is updated. The method according to claim 2, wherein controlling each response label displayed on the touch screen to move sequentially according to the tangential speed includes: When the visual feedback time is greater than the time threshold, each response label displayed on the touch screen is controlled to move sequentially according to the tangential speed, wherein the target response label is controlled to move to the reference position. The method according to claim 2, wherein determining the visual feedback time for the target response tag to move to the reference position according to the tangential velocity includes: Determine the rotation angle of the virtual knob according to the tangential velocity and the size of the virtual knob; According to the distance between the target response label and the reference position and the rotation angle, the visual feedback time for the target response label to move to the reference position is determined. The method according to claim 1 or 3, wherein the controlling each response label displayed on the touch screen to move sequentially according to the tangential speed includes: Determine the movement trajectory of each response label based on the step length and number of times each response label moves; Perform the following steps for the movement trajectory of each response label: An interpolation operation is performed on the movement trajectory of the response tag to obtain each point that the response tag passes during its movement; the response tag is controlled to move to each point in sequence according to the tangential speed. The method according to claim 1 or 3, wherein controlling each response label displayed on the touch screen to move sequentially according to the tangential speed includes: Using the tangential speed as the moving speed, each response label displayed on the touch screen is controlled to move at a constant speed in sequence. The method according to claim 1 or 3, wherein controlling each response label displayed on the touch screen to move sequentially according to the tangential speed includes: Obtain the rotation direction of the contact rotation, and determine the movement direction of each response label displayed on the touch screen based on the rotation direction; According to the tangential speed and the moving direction, each response label displayed on the touch screen is controlled to move sequentially. The method according to any one of claims 1 to 3, wherein, The respective response tags are displayed in sequence along the vertical direction; or, The respective response tags are arranged and displayed in order along the horizontal direction; or, The respective response labels are arranged and displayed around the virtual knob. A device that synchronizes tactile and visual feedback, including: A speed acquisition unit configured to acquire the tangential speed of the rotation of a contact point generated by a user performing a touch operation of rotation within the coverage of a virtual knob displayed on the touch screen, the touch operation being accompanied by tactile feedback; A control movement unit configured to control each response label displayed on the touch screen to move sequentially according to the tangential speed, so as to synchronize the tactile feedback and the visual feedback formed by the movement of each response label, wherein each response The step size of each movement of the label corresponds to the preset unit angle, and the number of times each response label moves is determined based on the number of preset unit angles included in the rotation angle of the virtual knob. A device for synchronizing tactile and visual feedback, wherein the device includes a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and execute them. The steps of the method according to any one of claims 1 to 8. A computer storage medium on which a computer program is stored, wherein when the program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

Images