WO2021103981A1 - Split-screen display processing method and apparatus, and electronic device - Google Patents

Abstract

A split-screen display processing method and apparatus, and an electronic device. The split-screen display processing method is applied to the electronic device with a foldable touch screen, the touch screen being in an unfolded state. The method comprises: the electronic device receiving a touch operation input by a user on the touch screen for a first application (S102); in response to the touch operation, determining whether the touch operation is a preset operation capable of triggering split-screen display (S104); and when the touch operation is determined to be the preset operation, the electronic device instructing a full-screen display region of the touch screen to be divided into a first display region and a second display region according to a preset folding line, wherein the first display region displays a first interface of the first application, and the second display region displays a second interface of the first application (S106). According to the method, a split-screen display mode can be quickly entered according to a usage scenario of the user, thus improving the user experience.

Description

Processing method, device and electronic equipment for split screen display

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on November 29, 2019, the application number is 2019112074403, and the application name is "Processing Method, Apparatus and Electronic Equipment for Split Screen Display", the entire content of which is incorporated by reference In this application.

Technical field

This application relates to the technical field of electronic equipment, in particular to a processing method, device and electronic equipment for split-screen display.

Background technique

At present, more and more users like large screens, but they are not convenient to carry. Therefore, folding screens have emerged as the times require, and they also expect the functions of folding screens to be applied to electronic devices. In the prior art, split-screen display is mainly used to display two different applications on one screen, and the user is required to input split-screen instructions in the display interface of one application (for example, two fingers move upward from the bottom of the screen). In response to the split screen instruction, the smart terminal displays two windows, one window displays the one application, and the other window displays the other application. However, in some scenarios of the same application, when split-screen display is required, the electronic device cannot automatically recognize the usage scenario and actively perform split-screen display, requiring multiple operations by the user, resulting in poor user experience.

Application content

The embodiments of the present application provide a processing method, device, electronic device, computer readable storage medium, and computer program product for split-screen display. The electronic device can quickly enter the split-screen display mode according to the user's usage scenario, thereby improving user experience.

In the first aspect, an embodiment of the present application provides a method for processing split-screen display, which is applied to an electronic device including a foldable touch screen, the touch screen being in an unfolded state, and the method includes:

The electronic device receives a touch operation for the first application input by the user on the touch screen; in response to the touch operation, it is determined whether the touch operation is a preset operation that can trigger a split-screen display; when the touch operation When determined to be the preset operation, the electronic device instructs the full-screen display area of the touch screen to be divided into a first display area and a second display area according to a preset folding line, and the first display area displays the first display area. The first interface of the application, and the second display area displays the second interface of the first application.

In this way, the electronic device can quickly enter the split-screen display mode according to the user's usage scenario, which solves the problem of the current split-screen display mode being relatively rigid, resulting in poor user experience.

In a second aspect, the present application provides a processing device for split-screen display, the device including:

A receiving module, configured to receive a touch operation for the first application input by the user on the touch screen;

The determining module is configured to determine whether the touch operation is a preset operation that can trigger a split-screen display in response to the touch operation;

The processing module is configured to, when the touch operation is determined to be the preset operation, instruct the full-screen display area of the touch screen to be divided into a first display area and a second display area according to a preset folding line, and the first display The area displays the first interface of the first application, and the second display area displays the second interface of the first application.

In a third aspect, the present application provides an electronic device, the electronic device includes a memory, at least one processor and a touch screen, the display screen is a foldable display screen; the memory is coupled with the one or more processors The memory is used to store computer program code, the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the electronic device is caused to perform the following operations:

The electronic device receives a user's touch operation on the touch screen that acts on the first application; in response to the touch operation, it is determined whether the touch operation is a preset operation that can trigger a split-screen display; when the touch operation For the preset operation, the electronic device instructs the display interface of the touch screen to be divided into a first display area and a second display area according to a preset folding line, and the first display area displays the information of the first application The first interface, the second display area displays the second interface of the first application.

In a fourth aspect, the present application provides a computer-readable storage medium, including instructions, which when run on an electronic device, cause the electronic device to perform the above-mentioned first aspect and any of the possibilities of the first aspect The processing method of split-screen display in the implementation mode.

In the fifth aspect, the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the above-mentioned first aspect and the split-screen display in any one of the possible implementations of the first aspect的处理方法。 Treatment methods.

In the embodiment of the present application, the electronic device determines whether the touch operation on the first application is a preset operation that can trigger the split screen display, and when the touch operation is the preset operation, it directly instructs the touch screen to turn on the split screen display , So that the first interface of the first application is displayed in the first display area, and the second interface of the first application is displayed in the second display area. In this way, the electronic device can quickly enter the split-screen display mode according to the user's usage scenario, which solves the problem of the current split-screen display mode being relatively rigid, resulting in poor user experience.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained from these drawings without creative labor.

FIG. 1A is a schematic structural diagram of an electronic device provided by an embodiment of the application;

FIG. 1B is a block diagram of the software structure of an electronic device provided by an embodiment of the application;

2 is a schematic diagram of an interface in an expanded state of an electronic device according to an embodiment of the application;

FIG. 3 is a schematic diagram of an electronic device in a folded state according to an embodiment of the application;

4 is a schematic flowchart of a processing method for split-screen display provided by an embodiment of the application;

FIG. 5A is a schematic diagram of another interface in an expanded state of an electronic device according to an embodiment of the application; FIG.

FIG. 5B is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application; FIG.

FIG. 5C is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application; FIG.

FIG. 6A is a schematic diagram of another interface in an expanded state of an electronic device according to an embodiment of the application; FIG.

6B is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application;

6C is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application;

FIG. 7A is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application; FIG.

FIG. 7B is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application; FIG.

FIG. 8A is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application; FIG.

FIG. 8B is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application; FIG.

FIG. 9A is a schematic diagram of another interface in an expanded state of an electronic device according to an embodiment of the application; FIG.

FIG. 9B is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application; FIG.

FIG. 10A is a schematic diagram of another interface in an expanded state of an electronic device according to an embodiment of the application; FIG.

10B is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application;

FIG. 11A is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application; FIG.

FIG. 11B is a schematic diagram of another interface in an expanded state of the electronic device according to an embodiment of the application; FIG.

FIG. 12 is a schematic structural diagram of a processing device for split-screen display provided by an embodiment of the application.

Detailed ways

In order to better understand the technical solutions of the present application, the following describes the embodiments of the present application in detail with reference to the accompanying drawings.

It should be clear that the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

In this application, "at least one" refers to one or more, and "multiple" refers to two or more. "And/or" describes the association relationship of the associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, and B exists alone, where A, B can be singular or plural. The character "/" generally indicates that the associated objects before and after are in an "or" relationship. "The following at least one item (a)" or similar expressions refers to any combination of these items, including any combination of a single item (a) or a plurality of items (a). For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple .

For ease of understanding, some illustrations of concepts related to the embodiments of the present application are given as examples for reference. As follows:

A foldable display is a display that can be bent.

Capacitive touch screen technology uses the current induction of the human body to work. When a finger touches the metal layer, due to the electric field of the human body, a coupling capacitor is formed between the user and the surface of the touch screen. For high-frequency current, the capacitor is a direct conductor, so the finger draws a small current from the contact point. This current flows from the electrodes on the four corners of the touch screen, and the current flowing through these four electrodes is proportional to the distance from the finger to the four corners. The processor can calculate the ratio of these four currents accurately to get the touch point. position.

The term user interface (UI) in the specification, claims and drawings of this application is a medium interface for interaction and information exchange between applications or operating systems and users. It realizes the internal form of information and the user interface. Can accept the conversion between forms. The user interface of the application program is the source code written in a specific computer language such as java, extensible markup language (XML), etc. The interface source code is parsed and rendered on the electronic device 100, and finally presented as content that can be recognized by the user , Such as pictures, text, buttons and other controls. Controls are the basic elements of the user interface. Typical controls include buttons, widgets, toolbars, menu bars, text boxes, and scroll bars. scrollbar), pictures and text. The attributes and content of the controls in the interface are defined by tags or nodes. For example, XML specifies the controls contained in the interface through nodes such as <Textview>, <ImgView>, and <VideoView>.

The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device.

The method for processing split-screen display provided in the embodiments of the present application may be applied to the electronic device 100 shown in FIG. 1A, and the electronic device 100 shown in FIG. 1A may also include other functions such as personal digital assistants and/or music player functions. Of portable electronic devices, such as mobile phones, tablet computers, wearable devices with wireless communication functions (such as smart watches), etc. The above-mentioned portable electronic devices are, for example, laptop computers with touch panels.

As shown in FIG. 1A, the following specifically describes the embodiment by taking the electronic device 100 as an example.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2. , Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc. Among them, the different processing units may be independent devices or integrated in one or more processors.

The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.

A memory may also be provided in the processor 110 for storing computer programs and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter/receiver (universal asynchronous) interface. receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / Or Universal Serial Bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively through different I2C bus interfaces. For example, the processor 110 may couple the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to implement the touch function of the electronic device 100.

The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled with the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit audio signals to the wireless communication module 160 through an I2S interface, so as to realize the function of answering calls through a Bluetooth headset.

The PCM interface can also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both I2S interface and PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 may transmit audio signals to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a Bluetooth headset.

The MIPI interface can be used to connect the processor 110 with the display screen 194, the camera 193 and other peripheral devices. The MIPI interface includes a camera serial interface (camera serial interface, CSI), a display serial interface (display serial interface, DSI), and so on. In some embodiments, the processor 110 and the camera 193 communicate through a CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through a DSI interface to realize the display function of the electronic device 100.

The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and so on. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 130 is an interface that complies with the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect earphones and play audio through earphones. This interface can also be used to connect other electronic devices, such as AR devices.

It can be understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is merely a schematic description, and does not constitute a structural limitation of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.

The charging management module 140 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive the charging input of the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 may receive the wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device 100 through the power management module 141.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may also be provided in the same device.

The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering, amplifying and transmitting the received electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites. System (global navigation satellite system, GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be sent from the processor 110, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna 2.

In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. Wireless communication technologies can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), and broadband code division. Multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM , And/or IR technology, etc. GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).

The electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. The GPU is an image processing microprocessor, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and is used for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, and N is a positive integer greater than one. In this embodiment, the display screen 194 is a curved display screen or a foldable display screen.

The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

The ISP is used to process the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transfers the electrical signal to the ISP for processing and is converted into an image visible to the naked eye. ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and is projected to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some embodiments, the electronic device 100 may include one or N cameras 193, and N is a positive integer greater than one.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects the frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.

NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, for example, the transfer mode between human brain neurons, it can quickly process input information, and it can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, and so on.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.

The internal memory 121 may be used to store computer executable program code, and the executable program code includes instructions. The internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like. The data storage area can store data (such as audio data, phone book, etc.) created during the use of the electronic device 100. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110, or part of the functional modules of the audio module 170 may be provided in the processor 110.

The speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.

The receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or voice message, it can receive the voice by bringing the receiver 170B close to the human ear.

The microphone 170C, also called "microphone", "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C through the human mouth, and input the sound signal into the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, which can implement noise reduction functions in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.

The earphone interface 170D is used to connect wired earphones. The earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, and a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be provided on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors and so on. The capacitive pressure sensor may include at least two parallel plates with conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch position but have different touch operation strengths may correspond to different operation instructions. For example: when a touch operation whose intensity is less than the first pressure threshold is applied to the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

The gyro sensor 180B may be used to determine the movement posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (ie, x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to counteract the shake of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

The magnetic sensor 180D includes a Hall sensor. The electronic device 100 may use the magnetic sensor 180D to detect the opening and closing of the flip holster. In some embodiments, when the electronic device 100 is a flip machine, the electronic device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Furthermore, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, features such as automatic unlocking of the flip cover are set.

The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device 100, and be used in applications such as horizontal and vertical screen switching, pedometers and the like.

Distance sensor 180F, used to measure distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F to measure the distance to achieve fast focusing.

The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light to the outside through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode, and the pocket mode will automatically unlock and lock the screen.

The ambient light sensor 180L is used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket to prevent accidental touch.

The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photographs, fingerprint answering calls, and so on.

The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In some other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also called a “touch screen”. The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. The visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.

The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can obtain the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the human pulse and receive the blood pressure pulse signal. In some embodiments, the bone conduction sensor 180M may also be provided in the earphone, combined with the bone conduction earphone. The audio module 170 can parse the voice signal based on the vibration signal of the vibrating bone block of the voice obtained by the bone conduction sensor 180M, and realize the voice function. The application processor can analyze the heart rate information based on the blood pressure beating signal obtained by the bone conduction sensor 180M, and realize the heart rate detection function.

The button 190 includes a power button, a volume button, and so on. The button 190 may be a mechanical button. It can also be a touch button. The electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the electronic device 100.

The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration notification, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as photographing, audio playback, etc.) can correspond to different vibration feedback effects. Acting on touch operations in different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminding, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.

The SIM card interface 195 is used to connect to the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, and N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. The same SIM card interface 195 can insert multiple cards at the same time. The types of multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as call and data communication. In some embodiments, the electronic device 100 adopts an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

The electronic device 100 exemplarily shown in FIG. 1A may display various user interfaces described in the following embodiments through a display screen 194. The electronic device 100 can detect touch operations in each user interface through the touch sensor 180K, such as a click operation in each user interface (such as a touch operation on an icon, a double-click operation), and for example, up or up in each user interface. Swipe down, or perform circle-drawing gestures, and so on. In some embodiments, the electronic device 100 may detect the motion gesture performed by the user holding the electronic device 10, such as shaking the electronic device, through the gyroscope sensor 180B, the acceleration sensor 180E, and the like. In some embodiments, the electronic device 100 can detect non-touch gesture operations through the 3D camera module 193 (eg, 3D camera, depth camera).

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present application takes a layered Android system as an example to illustrate the software structure of the electronic device 100 by way of example.

FIG. 1B is a software structure block diagram of an electronic device 100 according to an embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

The application layer can include a series of application packages.

As shown in Figure 1B, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. The application is responsible for direct interaction with the user.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 1B, the application framework layer can include Window Manager, Content Providers, View System, Telephony Manager, Resource Manager , Notification Manager, Activity Manager, Package Manager, etc.

The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, take a screenshot, etc.

The content provider is used to store and retrieve data and make these data accessible to applications. Data can include videos, images, audios, phone calls made and received, browsing history and bookmarks, phone book, etc.

The view system includes visual controls, such as controls that display text, controls that display pictures, and so on. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures.

The phone manager is used to provide the communication function of the electronic device 100. For example, the management of the call status (including connecting, hanging up, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of the download, message reminders and so on. The notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or a scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, text messages are prompted in the status bar, prompt sounds, electronic devices vibrate, and indicator lights flash.

The package manager is used to manage the properties of the parsing package to determine whether the application supports multiple windows and split-screen display. Package Manager is an API that actually manages the installation, uninstallation and upgrade of applications.

The activity manager is used to manage the life cycle of each application and provides the management functions of Activity, Task, and Stack.

The package manager is used to manage the parsing packages of all applications installed in the Android system. It can be judged whether the application supports multiple windows, that is, split-screen display, through the parsing package properties of the application in the package manager. Optionally, a multi-window application whitelist mechanism can be added to the package manager to force applications in the whitelist to support multiple windows.

Understandably, when the application starts or exits the split screen, the activity manager judges that the application supports multiple windows according to the properties of the parsing package in the package manager. If so, the activity manager sends the split screen instruction to the window manager , The window manager controls the display to open the split-screen display function.

Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of Android.

The application layer and application framework layer run in a virtual machine. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), three-dimensional graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.

The surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

In the following, the workflow of the software and hardware of the electronic device 100 will be exemplified in conjunction with capturing a photo scene.

When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes touch operations into original input events (including touch coordinates, time stamps of touch operations, etc.). The original input events are stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation, and the control corresponding to the click operation is the control of the camera application icon as an example, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer. The camera 193 captures still images or videos.

The following describes an exemplary user interface for application menus on the electronic device 100.

FIG. 2 exemplarily shows a schematic diagram of the interface of the application menu in the expanded state of the electronic device 100.

As shown in FIG. 2, the user interface may include: a status bar 201, a tray 202 with icons of commonly used applications, a calendar widget 207, a weather widget 208, and other application icons. among them:

The status bar 201 may include: one or more signal strength indicators 203 for mobile communication signals (also called cellular signals), and one or more signal strength indicators 204 for wireless fidelity (Wi-Fi) signals , Battery status indicator 205, time indicator 206.

The calendar widget 207 can be used to indicate the current time, such as date, day of the week, hour and minute information, and so on.

The weather widget 208 can be used to indicate the type of weather, such as cloudy to clear, light rain, etc., and can also be used to indicate information such as temperature.

The tray 202 with icons of commonly used applications may display: a call icon 209, an address book icon 210, and a camera icon 211.

Other application icons may be, for example, an icon 212 of a file editing application, an icon 213 of a file management application, an icon 214 of a video application, an icon 215 of a social communication application, an icon 216 of an email application, and an icon 217 of a gallery application. Among them, the social communication application can be, for example, WeChat, QQ, Twitter, Facebook, etc.

The user interface may also include interface indicators 218. Other application icons can be distributed on other interfaces. The interface indicator 218 can be used to indicate the number of interfaces and which interface the user is currently viewing. For example, the interface indicator 218 displays 3 small dots, and the second dot is black, and the other dot is white , Indicating that the current mobile phone includes 3 interfaces, and the user is browsing the second interface. In addition, users can swipe left and right on the current interface to browse application icons in other pages.

It can be understood that FIG. 2 only exemplarily shows the user interface on the electronic device 100, and should not constitute a limitation to the embodiment of the present application.

FIG. 3 exemplarily shows a schematic diagram of an electronic device 100 in a folded state. As shown in FIG. 3, the display screen 194 of the electronic device 100 is a folding screen. By folding the electronic device, the display screen 194 can be divided into two parts, a first display area and a second display area, along the folding line. Can be bent here means that the display screen can be bent at any position to any angle, and can be maintained at that angle. For example, the display screen 194 can be folded in half from the middle, left and right, and in other embodiments, it can also be folded in half from the middle.

The foldable display screen 194 may include at least two physical states: an expanded state and a folded state.

Generally, when the electronic device is in a folded state, the full-screen display area of the electronic device is automatically divided into a first display area and a second display area. When the electronic device is in an unfolded state, the electronic device generally presents a full-screen display. However, when some applications are in use, even if the electronic device is in an expanded state, it needs to be displayed on a split screen to improve user operation convenience and improve user experience.

FIG. 4 is a schematic flowchart of a method for processing split screen display provided by an embodiment of the application. As shown in FIG. 4, this application provides a method for processing split screen display, which is applied to an electronic device including a foldable touch screen. In an expanded state, the methods include:

Step S102, the electronic device receives a touch operation on the first application input by the user on the touch screen;

Step S104, in response to the touch operation, it is determined whether the touch operation is a preset operation that can trigger a split-screen display;

Step S106: When the touch operation is determined to be a preset operation, the electronic device instructs the full-screen display area of the touch screen to be divided into a first display area and a second display area according to a preset folding line, and the first display area displays the first display area of the first application. Interface, the second display area displays the second interface of the first application.

In the embodiment of the present application, the electronic device determines whether the touch operation on the first application is a preset operation that can trigger the split screen display. When the touch operation is the preset operation, it directly instructs the touch screen to turn on the split screen display, so that the first application The first interface of the application is displayed in the first display area, and the second interface of the first application is displayed in the second display area. In this way, the electronic device can quickly enter the split-screen display mode according to the user's usage scenario, which solves the problem of the current split-screen display mode being relatively rigid, resulting in poor user experience.

In some implementations, developers and designers need to set which usage scenarios need to be displayed in split screens during application development, for example, save the operation that triggers split screen display in the parse package properties of the application through tags or other definitions. . This application does not limit the definition of the operation here.

In an embodiment, after step S102, the method further includes:

The electronic device determines whether the first application supports split-screen display;

If yes, step S104 is executed, and in response to the touch operation, it is determined whether the touch operation is a preset operation that can trigger the split screen display.

In one embodiment, by creating a multi-window application whitelist mechanism, when an opened application is in the whitelist, it means that the application supports multiple windows, that is, it can support split-screen display. The whitelist mechanism can be defined in the parsing package of the application.

If the opened application is not in the whitelist, the user can also be provided with a UI interactive entry to ask the user whether to add it to the whitelist, and then update the whitelist of the application according to the user's operation.

Optionally, when the touch screen of the electronic device is in the folded state, the electronic device will automatically hide a certain interface of the application in the second display area, and only retain the interface displayed in the first display area.

When the electronic device is in the split-screen display state, when the user closes one of the display interfaces through a touch instruction, the other display area will automatically switch to the full-screen display state.

The solution will be explained below in conjunction with some scenarios applicable to this application.

5A-5C exemplarily show some schematic diagrams of user interfaces for split-screen display.

As shown in FIG. 5A, the first application is a desktop application. The electronic device receives a touch operation input by the user for the desktop application. The touch parameter of the touch operation (for example, the pressing duration exceeds 2s), the electronic device determines that the touch operation is used to indicate movement. During the preset operation of the application icon on the desktop (for example, the icon for document editing), the electronic device instructs the touch screen to display the first interface of the desktop application in the first display area, and the first interface is the display interface of multiple interfaces of the desktop; The device instructs the touch screen to display the second interface of the desktop management application in the second display area, and the second interface is the interface where the application icon to be moved is located.

As shown in Figure 5B, after the user presses the document editing icon for 2 seconds, the screen is automatically split into a first display area and a second display area. The "document editing" icon in the second interface can be dragged, and the user can drag the icon Drag to interface 2, and then release the icon of the document editing application to realize the rapid movement of the document editing application. Of course, it can also be dragged to interface 1, interface 3, interface 4, and so on. Understandably, the split-screen display improves the efficiency of application movement.

It should be noted that the touch operation is not limited to the gestures and operations in the example shown in FIG. 5B, and may also be other operations used to trigger the split-screen display of the electronic device, which is not specifically limited in this embodiment.

In this embodiment, during split-screen display, the user can perform a corresponding operation in the display area divided by the electronic device to trigger the electronic device to execute a corresponding event for the application displayed on the display area.

Optionally, the type of touch operation is a long-press operation, a sliding operation, or a touch operation. It should be noted that the above-mentioned touch operation may also be other operations used to trigger the electronic device to perform a return event for the application displayed on the corresponding display area, such as a double-click operation in the first display area, etc. This embodiment will not specifically describe it here. limit. In addition, the number of fingers performing the touch operation may be one or multiple, which is not specifically limited in this embodiment.

In one embodiment, the user can close any one of the first interface or the second interface through a preset second touch operation, and when one of the interfaces is closed, the other interface will automatically enter the full-screen display mode. Exemplarily, the second touch operation is a sliding operation, the starting point of the sliding operation is the bottom edge of the first display area or the second display area, the sliding direction is away from the bottom edge, and the duration is greater than the preset duration.

6A-6C exemplarily show some schematic diagrams of user interfaces for split-screen display.

As shown in the figure, the first application is a camera application. The electronic device receives a touch operation for the camera application input by the user. When the electronic device determines that the touch operation is a preset operation for instructing to start or complete a photo, the electronic device instructs the touch screen to be The first display area displays the first interface of the camera application, the first interface is a photo interface; the electronic device instructs the touch screen to display the second interface of the camera application in the second display area, and the second interface is a photo interface.

In one embodiment, as shown in FIG. 6A, the user touches the icon of the camera application. When the camera is turned on, the electronic device will automatically display on the screen, and the display area of the touch screen is switched to the first display area as shown in FIG. 6C And the second display area.

In another embodiment, as shown in FIG. 6B, after the user opens the camera application and taps the camera button, the electronic device will automatically split the screen display when the camera is finished taking pictures.

Understandably, the user does not need to enter other split-screen instructions. The electronic device can quickly switch to split-screen display according to the user's use scene. The second display area displays the photos that have just been taken. The user can continue to take pictures while viewing the taken photos. The effect of improving user experience.

When the user does not need to display in a split screen, one of the interfaces can be closed by sliding operation.

Figures 7A-7B exemplarily show some schematic diagrams of user interfaces for split-screen display.

As shown in FIG. 7A, the first application is a gallery application, and the electronic device receives a touch operation on the gallery application input by the user. When the electronic device determines that the touch operation is a preset operation for instructing to edit a picture in the gallery, the electronic device instructs the touch screen The first interface of the gallery application is displayed in the first display area, the first interface is the original state display interface of the picture; the electronic device instructs the touch screen to display the second interface of the gallery application in the second display area, and the second interface is the picture editing state display interface.

Understandably, when the user opens the gallery application and swipes the touch screen left and right to browse the pictures in the gallery, when a photo needs to be edited, the touch operation of clicking the edit button is the preset operation, and the electronic device will automatically divide it. Screen display, the first display area displays the original picture for reference when editing, and the second display area is used for editing pictures. The user does not need to enter other split-screen instructions, and quickly switches to the split-screen display according to the user's usage scenario, which is convenient for the user to intuitively View the editing effect in a timely manner to improve the user experience.

Optionally, as shown in FIG. 7B, after the user edits the picture in the second display area, the user can directly perform operations such as saving, deleting, and sharing.

8A-8B exemplarily show some schematic diagrams of user interfaces for split-screen display.

As shown in FIG. 8A, the first application is a social application, and the electronic device receives a touch operation on a social application (for example, WeChat) input by the user. When the electronic device determines that the touch operation is a preset operation for instructing to start chatting, the electronic device Instruct the touch screen to display the first interface of the social application in the first display area, the first interface is a message prompt interface; the electronic device instructs the touch screen to display the second interface of the camera application in the second display area, and the second interface is a chat interface.

Understandably, when the user uses the social application in the full screen, when the user selects a chat object through touch operation, the electronic device will automatically display on the split screen, without inputting other split screen instructions, and quickly switch to split screen according to the user's usage scenario Display, improve user experience.

Figures 9A-9B exemplarily show some schematic diagrams of user interfaces for split-screen display.

As shown in FIG. 9A, the first application is a video application. The electronic device receives a user input for a touch operation on a video application (for example, iQiyi, Tencent Video, Huawei Video and other multimedia video broadcasting software), and the electronic device determines that the touch operation is When used to instruct the preset operation of taking screenshots, the electronic device instructs the touch screen to display the first interface of the video application in the first display area, and the first interface is the video playback interface; the electronic device instructs the touch screen to display the second interface of the video application in the second display area Interface, the second interface is the screenshot picture display interface.

Understandably, when the user is watching a video in full screen, the user wants to keep a certain frame of the video, and when the user touches the "screen capture" button in the video playback interface, the electronic device will automatically display in split screens, as shown in Figure 9B It shows that there is no need to enter other split-screen instructions, and quickly switch to split-screen display according to the user's usage scenario. Users can watch the video while editing the screenshot of the video, which improves the user experience.

10A-10B exemplarily show some schematic diagrams of user interfaces for split-screen display.

As shown in FIG. 10A, the first application includes a document editing application. The electronic device receives a user input for a touch operation on a document editing application (for example, a document editing application such as WPS, memo, notepad, etc.), and the preset operation is used to instruct to start Editing operation; the electronic device instructs the full-screen display area of the touch screen to be divided into a first display area and a second display area according to a preset folding line, including:

The electronic device instructs the touch screen to display the first interface of the document editing application in the first display area, the first interface is the document display interface; the electronic device instructs the touch screen to display the second interface of the document editing application in the second display area, and the second interface is keyboard input interface.

Understandably, when the user needs to edit a document, when the user touches the "Edit" button in the document display interface, the electronic device will automatically split the screen display, as shown in Figure 10B. There is no need to enter other split screen instructions. The user's use scene is switched to split-screen display to improve user experience. Convenient for users to quickly edit operations.

11A-11B exemplarily show some schematic diagrams of user interfaces for split-screen display.

As shown in FIG. 11A, the first application includes a file management application. The electronic device receives a touch operation on the file management application input by the user. File types include folders, files, compressed files, pictures, videos, music, and so on. The preset operation is an operation for instructing to copy or move a file; the full-screen display area of the touch screen in the electronic device is divided into a first display area and a second display area according to a preset folding line, including:

The electronic device instructs the touch screen to display the first interface of the file management application in the first display area, the first interface is the file storage path interface; the electronic device instructs the touch screen to display the second interface of the file management application in the second display area, and the second interface is selected File display interface.

Understandably, when the user needs to move or copy a file, the user presses a file icon in the file storage path interface, and the electronic device will automatically split the screen display, as shown in Figure 11B, without inputting other split screen instructions, quickly Switch to split-screen display according to the user's usage scenario. Through split-screen, the user can find the path that he wants to save in the first display area, which improves the efficiency of copying or moving and improves user experience.

Optionally, after determining whether the touch operation is a preset operation capable of triggering the split-screen display in response to the touch operation, the method further includes:

If not, the electronic device maintains the current full-screen display of the touch screen.

Understandably, when the touch operation is determined to be a preset operation, the split screen can be triggered, otherwise it cannot, and the full screen display will remain.

FIG. 12 is a schematic structural diagram of a processing device for split-screen display provided by this application. As shown in FIG. 12, the processing device 10 for split-screen display includes: a receiving module 11, a determining module 12, and a processing module 13.

The receiving module 11 is configured to receive a touch operation for the first application input by the user on the touch screen;

The determining module 12 is configured to determine whether the touch operation is a preset operation that can trigger a split-screen display in response to a touch operation;

The processing module 13 is used to indicate that the full-screen display area of the touch screen is divided into a first display area and a second display area according to a preset folding line when the touch operation is determined to be a preset operation. The first display area displays the first display area of the first application. An interface, and the second display area displays the second interface of the first application.

In the embodiment of the present application, the electronic device determines whether the touch operation on the first application is a preset operation that can trigger the split screen display. When the touch operation is the preset operation, it directly instructs the touch screen to turn on the split screen display, so that the first application The first interface of the application is displayed in the first display area, and the second interface of the first application is displayed in the second display area. In this way, the electronic device can quickly enter the split-screen display mode according to the user's usage scenario, which solves the problem of the current split-screen display mode being relatively rigid, resulting in poor user experience.

The split-screen display processing method provided in this embodiment is used to implement the technical solutions in the foregoing method embodiments, and its implementation principles and technical effects are similar, and will not be repeated here.

The electronic device provided by the present application, as shown in FIG. 1A, the electronic device 100 includes a memory 121, at least one processor 110 and a touch screen. The touch screen is a foldable touch screen 194; the memory is coupled with one or more processors, and the memory 121 It is used to store computer program code. The computer program code includes computer instructions. When one or more processors 110 execute the computer instructions, the electronic device 100 executes the aforementioned split-screen display processing method.

The present application also provides a computer-readable storage medium, including instructions, which, when the instructions run on the electronic device, cause the electronic device to execute the processing method for split-screen display as described above.

This application also provides a computer program product, which when the computer program product runs on a computer, causes the computer to execute the above-mentioned split-screen display processing method.

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the above-described system, device, and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed device and method may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be It can be combined or integrated into another device, or some features can be omitted or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and the parts displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. . Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product, and the software product is stored in a storage medium. It includes several instructions to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disks or optical disks and other media that can store program codes. .

The above are only specific implementations of this application. Any person skilled in the art can easily conceive of changes or substitutions within the technical scope disclosed in this application, and they should be covered by the protection scope of this application. The protection scope of this application shall be subject to the protection scope of the claims.

Claims (20)

1. A processing method for split-screen display, characterized in that it is applied to an electronic device including a foldable touch screen, the touch screen being in an unfolded state, and the method includes:

   Receiving, by the electronic device, a touch operation on the first application input by the user on the touch screen;

   In response to the touch operation, determining whether the touch operation is a preset operation that can trigger a split-screen display;

   When the touch operation is determined to be the preset operation, the electronic device instructs the full-screen display area of the touch screen to be divided into a first display area and a second display area according to a preset folding line, and the first display area The first interface of the first application is displayed, and the second display area displays the second interface of the first application.
2. The method according to claim 1, wherein the first application comprises a desktop application, and the preset operation is used to instruct an operation of an application program on a mobile desktop; the electronic device instructs the full screen of the touch screen The display area is divided into a first display area and a second display area according to a preset folding line, including:

   The electronic device instructs the touch screen to display a first interface of the desktop application in the first display area, where the first interface is a display interface of multiple interfaces of the desktop;

   The electronic device instructs the touch screen to display a second interface of the desktop application in the second display area, where the second interface is an interface where the application to be moved is located.
3. The method according to claim 1, wherein the first application includes a camera application, and the preset operation is an operation for instructing to start or complete a photo; the electronic device instructs the full-screen display of the touch screen The area is divided into a first display area and a second display area according to a preset folding line, including:

   The electronic device instructs the touch screen to display a first interface of the camera application in the first display area, and the first interface is a camera interface;

   The electronic device instructs the touch screen to display a second interface of the camera application in the second display area, and the second interface is a photo interface.
4. The method according to claim 1, wherein the first application comprises a gallery application, and the preset operation is an operation for instructing to edit pictures in the gallery; the electronic device instructs the full-screen display of the touch screen The area is divided into a first display area and a second display area according to a preset folding line, including:

   The electronic device instructs the touch screen to display a first interface of the gallery application in the first display area, where the first interface is a display interface of the original state of the picture;

   The electronic device instructs the touch screen to display a second interface of the gallery application in the second display area, and the second interface is a picture editing state display interface.
5. The method according to claim 1, wherein the first application comprises a social application, the preset operation is an operation for instructing to start chatting; the electronic device instructs the full-screen display area of the touch screen to be based on the preset operation. The folding line is divided into a first display area and a second display area, including:

   The electronic device instructs the touch screen to display a first interface of the social application in the first display area, and the first interface is a message prompt interface;

   The electronic device instructs the touch screen to display a second interface of the social application in the second display area, and the second interface is a chat interface.
6. The method according to claim 1, wherein the first application comprises a video application, and the preset operation is an operation for instructing a screen capture; the electronic device instructs the full-screen display area of the touch screen according to a preset The fold line is divided into a first display area and a second display area, including:

   The electronic device instructs the touch screen to display a first interface of the video application in the first display area, and the first interface is a video playback interface;

   The electronic device instructs the touch screen to display a second interface of the video application in the second display area, and the second interface is a screenshot display interface.
7. The method according to claim 1, wherein the first application comprises a document editing application, and the preset operation is an operation for instructing to start editing; the electronic device instructs the full-screen display area of the touch screen according to The preset folding line is divided into a first display area and a second display area, including:

   The electronic device instructs the touch screen to display a first interface of the document editing application in the first display area, and the first interface is a document display interface;

   The electronic device instructs the touch screen to display a second interface of the document editing application in the second display area, and the second interface is a keyboard input interface.
8. The method according to claim 1, wherein the first application comprises a file management application, and the preset operation is an operation for instructing copying or moving a file; the electronic device instructs the full-screen display of the touch screen The area is divided into a first display area and a second display area according to a preset folding line, including:

   The electronic device instructs the touch screen to display a first interface of the file management application in the first display area, where the first interface is a file storage path interface;

   The electronic device instructs the touch screen to display a second interface of the file management application in the second display area, and the second interface is a selected file display interface.
9. The method according to claim 1, wherein after the receiving a touch operation input by the user on the touch screen for the first application, the method further comprises:

   The electronic device determines whether the first application supports split-screen display;

   If so, in response to the touch operation, it is determined whether the touch operation is a preset operation that can trigger a split screen display.
10. The method according to claim 1, wherein the type of the touch operation is a long-press operation, a sliding operation, or a touch operation.
11. A processing device for split-screen display, characterized in that the device comprises:

    A receiving module, configured to receive a touch operation for the first application input by the user on the touch screen;

    The determining module is configured to determine whether the touch operation is a preset operation that can trigger a split-screen display in response to the touch operation;

    The processing module is configured to, when the touch operation is determined to be the preset operation, instruct the full-screen display area of the touch screen to be divided into a first display area and a second display area according to a preset folding line, and the first display The area displays the first interface of the first application, and the second display area displays the second interface of the first application.
12. An electronic device, wherein the electronic device includes a memory, at least one processor, and a touch screen, the touch screen is a foldable touch screen; the memory is coupled with the one or more processors, and the memory Used to store computer program code, the computer program code including computer instructions, when the one or more processors execute the computer instructions, cause the electronic device to perform the following operations:

    Receiving, by the electronic device, a touch operation on the first application input by the user on the touch screen;

    In response to the touch operation, determining whether the touch operation is a preset operation that can trigger a split-screen display;

    When the touch operation is determined to be the preset operation, the electronic device instructs the full-screen display area of the touch screen to be divided into a first display area and a second display area according to a preset folding line, and the first display area The first interface of the first application is displayed, and the second display area displays the second interface of the first application.
13. The electronic device according to claim 12, wherein the first application comprises a desktop application, and the preset operation is used to instruct an operation of an application program on a mobile desktop; when the one or more processors When the computer instruction is executed, the electronic device is caused to also perform the following operations:

    The electronic device instructs the touch screen to display a first interface of the desktop application in the first display area, where the first interface is a display interface of multiple interfaces of the desktop;

    The electronic device instructs the touch screen to display a second interface of the desktop application in the second display area, where the second interface is an interface where the application to be moved is located.
14. The electronic device according to claim 12, wherein the first application comprises a camera application, and the preset operation is an operation for instructing to start taking a photo or to complete a photo; when the one or more processors execute The computer instruction causes the electronic device to also perform the following operations:

    The electronic device instructs the touch screen to display a first interface of the camera application in the first display area, and the first interface is a camera interface;

    The electronic device instructs the touch screen to display a second interface of the camera application in the second display area, and the second interface is a photo interface.
15. The electronic device according to claim 12, wherein the first application comprises a gallery application, and the preset operation is an operation for instructing to edit a picture in the gallery; when the one or more processors execute The computer instruction causes the electronic device to also perform the following operations:

    The electronic device instructs the touch screen to display a first interface of the gallery application in the first display area, where the first interface is a display interface of the original state of the picture;

    The electronic device instructs the touch screen to display a second interface of the gallery application in the second display area, and the second interface is a picture editing state display interface.
16. The electronic device according to claim 12, wherein the first application comprises a social application, and the preset operation is an operation for instructing to start a chat; when the one or more processors execute the computer When instructed, the electronic device is caused to also perform the following operations:

    The electronic device instructs the touch screen to display a first interface of the social application in the first display area, and the first interface is a message prompt interface;

    The electronic device instructs the touch screen to display a second interface of the social application in the second display area, and the second interface is a chat interface.
17. The electronic device according to claim 12, wherein the first application comprises a video application, and the preset operation is an operation for instructing a screenshot; when the one or more processors execute the computer instruction When the time, the electronic device is caused to also perform the following operations:

    The electronic device instructs the touch screen to display a first interface of the video application in the first display area, and the first interface is a video playback interface;

    The electronic device instructs the touch screen to display a second interface of the video application in the second display area, and the second interface is a screenshot display interface.
18. The electronic device according to claim 12, wherein the first application comprises a document editing application, and the preset operation is an operation for instructing to start editing; when the one or more processors execute the When the computer is instructed to cause the electronic device to also perform the following operations:

    The electronic device instructs the touch screen to display a first interface of the document editing application in the first display area, and the first interface is a document display interface;

    The electronic device instructs the touch screen to display a second interface of the document editing application in the second display area, and the second interface is a keyboard input interface.
19. The electronic device according to claim 12, wherein the first application comprises a file management application, and the preset operation is an operation for instructing copying or moving a file; when the one or more processors When the computer instruction is executed, the electronic device is caused to also perform the following operations:

    The electronic device instructs the touch screen to display a first interface of the file management application in the first display area, and the first interface is a file storage path interface;

    The electronic device instructs the touch screen to display a second interface of the file management application in the second display area, and the second interface is a selected file display interface.
20. A computer-readable storage medium, comprising instructions, characterized in that, when the instructions run on an electronic device, the electronic device is caused to execute the split-screen display processing according to any one of claims 1-10 method.

Images