CN114691067A - Screen projection method and electronic equipment - Google Patents

Abstract

The application provides a screen projection method and electronic equipment, and relates to the technical field of terminals, wherein the method comprises the steps that first equipment obtains first display content corresponding to a first process of a first application program, the first equipment determines second equipment based on a first user identification corresponding to the first process, and the first equipment projects the first display content onto a display screen of the second equipment for display. The technical scheme that this application provided can improve the security of throwing the screen display.

Description

Screen projection method and electronic device

technical field

The present application relates to the field of terminal technologies, and in particular, to a screen projection method and an electronic device.

Background technique

At present, an electronic device can install and run an application program, and the electronic device can acquire the displayed content of the application program and display it on the display of the local end. However, gradually, this single display mode has been unable to meet the needs of users, and various more diversified display modes have emerged as the times require, among which screen projection is an important display mode.

In the prior art, the first device can obtain the display content corresponding to the process of a certain application, and the first device can display the display content, and can also project the display content to the second device, so that the second device can display the display content. the display shows the display.

However, since the user of the first device may not be the same as the user viewing the display screen of the second device, for example, the first device may be a user's mobile phone, and the second device may be the public display screen of the company conference room. The user of one device usually does not want the user of the second device to see some private content through the second device, and in the existing screen projection method, the first device and the second device can display the same content, which may As a result, the privacy of the user of the first device is leaked, and the security is low.

SUMMARY OF THE INVENTION

In view of this, the present application provides a screen projection method and electronic device, so as to improve the security of screen projection display.

In order to achieve the above purpose, in the first aspect, an embodiment of the present application provides a screen projection method, including:

The first device acquires the first display content corresponding to the first process of the first application;

The first device determines the second device based on the first user identifier corresponding to the first process;

The first device projects the first display content to a display screen of the second device for display.

The first application may be any application in the first device. In some embodiments, the first application may include a system application for providing a software environment necessary for the electronic device to operate or interact with a user, such as desktop applications and system user interface applications. In other embodiments, the first application may include a user application, which may be installed by the user and provide the user with value-added services, such as communication applications and games.

It should be noted that, the user identifier in this embodiment may refer to the user identifier in the operating system of the electronic device.

In this embodiment of the present application, the first device may acquire the first display content corresponding to the first process of the first application, and determine the second device based on the first user identifier corresponding to the first process. Since the first process corresponds to the first user ID, and the second device is determined based on the first user ID, the first display content of the first process can be projected to the second device for display, that is, the first One device can control the content displayed on the second device through the first user identification, which reduces the problem of indiscriminately projecting all the displayed content of the first application to the second device, and improves the display quality. safety.

Optionally, the method further includes:

acquiring, by the first device, second display content corresponding to a second process of the first application, the second process corresponding to a second user identifier, and the second user identifier corresponding to the first device;

The first device displays the second display content on a display screen of the first device.

For example, the first user identifier may be represented as userid=10, that is, user 10; the second user identifier may be represented as userid=0, that is, user 0.

The user can control the display content displayed on multiple different devices through multiple user IDs, which improves the flexibility and security of the display. In addition, when the first device runs the first application, the first display content corresponding to the first process of the first application is displayed on the second device, and the first display content corresponding to the second process of the first application is displayed on the second device. The second display content is displayed on the first device or the third device, and the two processes are independent, then the first device can assign the first display content and the second display content to the second device and the first device respectively. (or the third device) the display screen is adapted to display the first display content and the second display content on the second device and the first device (or the third device) respectively. The first application program is simultaneously displayed in the middle, which improves the display performance and user experience.

Optionally, the first user identifier is the same as the second user identifier, the first process and the second process are the same process, and the first display content is the same as the second display content.

The first device may compare the first user identification with the second identification. When the first user identification is different from the second user identification, it may be determined that the current screen projection is a heterogeneous screen projection. When the first user ID and the second user ID are the same, the current screen projection is the same source screen projection, the first process and the second process are the same process, then the first display content and the second display content are the same.

Optionally, the first device determines the second device based on the first user identifier corresponding to the first process, including:

Based on the first user identifier, the first device determines the device identifier of the second device from the stored correspondence between at least one user identifier and at least one device identifier, and the at least one user identifier includes all the user identifiers. the first user identifier, the at least one device identifier includes the device identifier of the second device;

The first device determines the second device according to the device identification of the second device.

It should be noted that, the correspondence between the user identifier and the device identifier may be determined in advance by the first device. In some embodiments, the first device may first determine the second device displayed on the screen, and then determine the first user identifier corresponding to the second device, and then store the device identifier of the second device corresponding to the first user identifier, thereby Therefore, when the first display content of the first process corresponding to the first user identifier is acquired, the corresponding second device can be determined based on the first user identifier.

In some embodiments, the first device may search for the second device when receiving the user's screen casting operation. If the first device finds a plurality of electronic devices, it may present a device list to the user, where the device list includes the device identifiers of the plurality of electronic devices, and when the device identifiers are received based on at least one of the plurality of electronic device identifiers During the user's determination operation, the electronic device corresponding to the at least one device identifier is determined as the second device.

In some embodiments, the first device may determine the first user identity from the stored correspondence between the at least one device identity and the at least one user identity based on the device identity of the second device. In some embodiments, the first device may provide a user list to the user, the user list includes at least one user identification, and when receiving a user's determination operation based on any user identification, determine the user identification as the first user identification . In some embodiments, the first device may also receive the first user identification submitted by the user.

Optionally, obtaining, by the first device, first display content corresponding to the first process, including:

obtaining, by the first device, third display content corresponding to the first process of the first application;

The first device acquires display style data corresponding to the second device from the application body of the first application;

The first device performs adaptation processing on the third display content based on display style data corresponding to the second device to obtain the first display content.

The first device can obtain the display style data corresponding to the second device from the application body of the first application program, without the need to preset display style data for various devices in advance, which reduces the cost of screen projection display.

Optionally, before the first device acquires the first display content corresponding to the first process of the first application, the method further includes:

The first device creates the first process based on the first user identification.

Optionally, the first device creates the first process based on the first user identifier, including:

If the first device determines that the user corresponding to the first user identifier exists, obtain the user data of the first application from the user space corresponding to the first user identifier;

The first process is created based on the user data of the first application.

The first device may determine whether the stored user identification list includes the first user identification, and if so, may determine that the user corresponding to the first user identification exists; otherwise, may determine that the user corresponding to the first user identification does not exist. And if the user corresponding to the first user identifier does not exist, the first device may create the user based on the first user identifier, and then create the first process based on the first user identifier.

It should be noted that the first device may include multiple user spaces, and the user spaces are isolated from each other. Application data can be included in user space. In some embodiments, the application data may include user data, and the user data may be data generated for the user when the first device runs the application program, such as chat records of the instant messaging application, pictures taken by the camera, and the like. The application body storage may be in a designated storage space other than the multiple user spaces, and the instruction storage space may be shared by users corresponding to the multiple user spaces. Alternatively, in some embodiments, the application data may further include an application program body, and the first device may install the application program in the user space corresponding to each user identification based on different user identifications. The user data of the same application in different user spaces may be different, so that the first device can independently run multiple processes of the same application at the same time. For example, the address of the instruction storage space for installing the application program in the first device is "/data/app", and the first device includes two user spaces, and the addresses of the two user spaces are "/data/user/ 0" and "/data/user/10", where "/data/user/0" is the user space of user 0, and "/data/user/10" is the user space of user 10. Each user space includes user data of a communication application, so the first device can run two processes of the communication application independently at the same time. For the user, two communication applications can be run on the first device, each Different app accounts can be logged into the messaging app.

In some embodiments, the first device may create a second process of the application based on the second user identification in a similar manner to creating the first process based on the first user identification.

Optionally, the first device includes a first mobile phone, and the second device includes a computer, a vehicle-mounted device, a smart TV, or a second mobile phone. Of course, in practical applications, the second device may also include other electronic devices provided with a display.

In a second aspect, an embodiment of the present application provides a screen projection device, the screen projection device can be applied to an electronic device, and the screen projection device can use any of the methods described in the first aspect above.

In a third aspect, an embodiment of the present application provides an electronic device, including: a memory and a processor, where the memory is used to store a computer program; the processor is used to execute the method described in any one of the first aspects when the computer program is invoked.

In a fourth aspect, an embodiment of the present application provides a chip system, the chip system includes a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory, so as to implement any one of the above first aspects. one of the methods described.

Wherein, the chip system may be a single chip or a chip module composed of multiple chips.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the method described in any one of the foregoing first aspects.

In a sixth aspect, an embodiment of the present application provides a computer program product that, when the computer program product runs on an electronic device, causes the electronic device to execute the method described in any one of the first aspects above.

It can be understood that, for the beneficial effects of the foregoing second aspect to the sixth aspect, reference may be made to the relevant descriptions in the foregoing first aspect, and details are not described herein again.

Description of drawings

1 is a schematic structural diagram of an electronic device provided by an embodiment of the application;

FIG. 2 is a schematic structural diagram of a screen projection system provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of a screen projection scene provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of another screen projection scenario provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of another screen projection system provided by an embodiment of the present application;

6 is a schematic diagram of a software architecture of an application program provided by an embodiment of the present application;

FIG. 7 is a flowchart of a screen projection method provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of another screen projection scenario provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of another screen projection scenario provided by an embodiment of the present application;

FIG. 10 is a schematic structural diagram of another electronic device provided by an embodiment of the present application.

Detailed ways

The screen projection method provided by the embodiments of the present application can be applied to mobile phones, tablet computers, wearable devices, in-vehicle devices, notebook computers, ultra-mobile personal computers (UMPC), netbooks, and personal digital assistants (personal digital assistants). , PDA) and other electronic devices, the embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

Please refer to FIG. 1 , which is a schematic structural diagram of an electronic device 100 provided by the present application. The electronic device 100 may be the following first device, second device, third device, fourth device or fifth device, and the electronic device 100 may include a processor 110, a memory 120, a communication module 130, and the like.

The processor 110 may include one or more processing units, and the memory 120 is used for storing program codes and data. In this embodiment of the present application, the processor 110 can execute the computer-executed instructions stored in the memory 120 to control and manage the actions of the electronic device 100 .

The communication module 130 may be used for communication between various internal modules of the electronic device 100, or communication between the electronic device 100 and other external electronic devices, and the like. Exemplarily, if the electronic device 100 communicates with other electronic devices through a wired connection, the communication module 130 may include an interface, such as a USB interface. USB interface, USB Type C interface, etc. The USB interface can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices.

Alternatively, the communication module 130 may include an audio device, a radio frequency circuit, a Bluetooth chip, a wireless fidelity (Wi-Fi) chip, a near-field communication (NFC) module, etc. In this way, the interaction between the electronic device 100 and other electronic devices is realized.

Optionally, the electronic device 100 may further include a display device (display device) 140, and the display device 140 may display images or videos in the human-computer interaction interface. Alternatively, the display screen 140 may include a physical display screen, a virtual display screen, a wi-fi display, and the like.

Optionally, the electronic device 100 may further include peripheral devices 150, such as a mouse, a keyboard, a speaker, a microphone, and the like.

It should be understood that, except for the various components or modules listed in FIG. 1 , the embodiment of the present application does not specifically limit the structure of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may further include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Please refer to FIG. 2 , which is a schematic structural diagram of a screen projection system provided by an embodiment of the present application. The screen projection system may include a fourth device 200 and a fifth device 300 .

The fourth device 300 may include a first application layer 210, a first application management service layer 220, a first window manager service (WMS) layer 230, a first display management service (display manager service, DMS) layer 240, The first display layer 250 and the first coding layer 260.

The first application layer 210 may include local display style data 211 , at least one screen projection display style data 212 and first application data 213 . The local display style data 211 and the screen projection display style data 212 may be preset by the fourth device 200 in advance according to the physical characteristics of the display screens of the fourth device 200 and the fifth device 300, so that the same display content can be displayed separately. The local end and the fifth device 200 display normally and present different display styles, wherein the physical characteristics may include at least one of resolution and dots per inch (dots per inch, DPI). The local display style data 211 may include a first desktop (launcher) 214 and a first system user interface (system UI) 215 . Cast display style data 212 may include a second desktop (which may be referred to as cast_launcher) 216 and a second system user interface (which may be referred to as cast_system UI) 217 . The first desktop 214 and the second desktop 216 may be the same application or different applications for providing different desktop styles for different devices, such as landscape screen, portrait screen, screen size, screen ratio, and the like. The first system user interface 215 and the second system user interface 217 may be the same application or different applications for providing different UI styles for different devices, such as status bar, notification bar, navigation bar and volume UI Wait. Among them, the first desktop 214 and the second desktop 216 are. The first application data 213 may include the application ontology of the application (such as camera, gallery, instant messaging application, and audio and video applications, etc.) and user data of the application (such as documents, photos, music, videos, and chat records, etc.) ).

The first application management service layer 220 may include a first application management service module 221 . The first application management service module 221 may be used to manage the running state of the application. In some embodiments, the first application management service module 221 may manage the life cycle of components such as activity components of the application program through an activity manager service (activity manager service, AMS), such as starting, ending and scheduling the activity components. The active component is an important component of the application, and the active components of the application may all run in the process of the application.

The first window management service layer 230 may include a first logical display (display content) 231 and a second logical display 232 . The first logical display screen 231 and the second logical display screen 232 may correspond to the display screen of the fourth device 200 and the display screen of the fifth device 300, respectively. Taking the first logical display screen 231 as an example, the first logical display screen 231 can determine the display content to be displayed on the display screen of the fourth device 200 according to the information included in the windows and sub-windows of each active component.

The first display management service layer 240 may be used to manage the life cycle of the display screen (including the display screen at the local end of the fourth device 200 and the display screen of the fifth device 300 ). The display adapter can be coupled with the first display management service layer 240, the display adapter can be used to discover the display screen and determine the physical characteristics of the display screen, and can also process the display content according to the physical characteristics of the display screen, so that the display screen can be displayed. The content is adapted to the physical characteristics, that is, the display adapter can provide an adaptation function to the display screen. The first display management service layer 240 may provide the detected physical characteristics of the display screen to other layers (eg, the first window management service layer 230 ), so that other layers can perform display-related operations based on the physical characteristics. In some embodiments, the display adapter may include at least one of a local display adapter (local display adapter) 241, a virtual display adapter (overlay display adapter or virtual display adapter) 242, and a wireless display adapter (wifi display adapter) 243, wherein , the local display adapter 241 can be used to provide the adaptation function for the physical display screen (or the main display screen), the virtual display adapter 242 can be used to provide the adaptation function for the virtual display screen, and the virtual display adapter 242 can be used by the fourth Created when the device 300 detects a screen-casting device (eg, the fifth device 300 ), the wireless display can be used to provide an adaptation function for the wireless display. In this embodiment of the present application, the local display adapter 241 may provide an adaptation function for the display screen of the fourth device 200 at the local end, and the wireless display adapter 243 may provide an adaptation function for the display screen of the fifth device 300 .

The first display layer 250 can synthesize and render the data to be displayed corresponding to a certain display screen through an image synthesis service (such as surface flinger), and send the obtained display content (such as an image) to the display screen for display.

The first encoding layer 260 may be used to encode the display content to be sent to the fifth device 300 .

The fifth device 300 may include a second display layer 310 and a first decoding layer 320 . The first decoding layer 320 can decode the display content encoded by the first encoding layer 260, and send the decoded display content to the second display layer 310, and the second display layer 310 can perform the same operation as the first display layer according to the implementation. 250 similar or identical steps to display the display.

In some embodiments, the fourth device 200 may simultaneously display one interface on the local end through heterogeneous screen projection, and display another interface on its device. Specifically, it is taken as an example that the fourth device 200 performs screen projection on the fifth device 300 by means of heterogeneous screen projection. The fourth device 200 discovers the physical characteristics of the display screen of the third device 300 through the first display management service layer 240, and searches the local end for the screen projection display style data 212 corresponding to the fifth device 300 according to the physical characteristics of the display screen. The fourth device 200 displays one desktop on the local end through the local end display style data 211 , and displays another desktop on the fifth device 300 through the screen projection display style data 212 . When an application is running, the fourth device 200 can manage the process of the application through the first application management service layer 220, where one application corresponds to one process. The fourth device 200 may also determine, through the first window management service layer 230, on which display screen the display content corresponding to the process is displayed. If the display content corresponding to the process is displayed on the display screen of the fifth device 300 , the display content is processed by the first wireless display adapter 243 so that the display content is suitable for display on the display screen of the fifth device 300 . After that, the fourth device 200 may encode the adapted display content through the first encoding layer 260, and send the encoded display content to the fifth device 300. The fifth device 300 may decode the received display content through the first decoding layer 320 , and display the decoded display content on the display screen through the second display layer 310 .

Among them, heterologous screen projection is a screen projection method. Heterogeneous screen projection means that one electronic device projects a part of the display content on another electronic device, and the display content displayed on the other electronic device is different from the display content displayed on the local end of the electronic device. Another screen projection method is homologous screen projection, which means that one electronic device directly projects the display content of the electronic device to another electronic device for display, that is, the display content displayed by the two electronic devices is the same.

Please refer to FIG. 3 , which is a schematic diagram of a scene of a homologous screen projection display provided by an embodiment of the present application. In this scenario, the fourth device 200 is a mobile phone, and the fifth device 300 includes at least one of a smart TV and a notebook computer. The mobile phone currently displays a video playback picture, and the mobile phone projects the video playback picture to at least one of the smart TV and the notebook computer, so that at least one of the smart TV and the notebook computer also displays the video playback picture.

Please refer to FIG. 4 , which is a schematic diagram of a scenario of a heterogeneous screen projection display provided by an embodiment of the present application. In this scenario, the fourth device 200 is a mobile phone, and the fifth device 300 includes one of a laptop computer and a vehicle-mounted device. The mobile phone currently displays the video playback screen, and the mobile phone also displays a chat interface on the laptop screen. Similarly, the mobile phone can also display the music playback screen on the vehicle device.

It can be seen that there are at least the following problems in the above-mentioned embodiment: First, since the same application corresponds to one process, and one process corresponds to one user, the fourth device 200 can display the content of the process on the fourth device 200 Or display on the display screen of the fifth device 300, that is, the display content displayed by the fourth device 200 through screen projection and the display content displayed on the local end are the same, and because the user of the first device and the user viewing the display screen of the second device may not For example, the first device may be a mobile phone of a certain user, and the second device may be the public display screen of the company conference room, so the user of the first device may not want the user of the second device to see some The content of privacy may lead to leakage of user privacy and lower security. Secondly, due to the different physical characteristics (such as resolution and DPI) of the display screens of different devices, different display styles are required, and it is difficult for the fourth device 200 to simultaneously adapt the display content of the same process to different display screens. Therefore, when performing heterogeneous screen projection, it is difficult for the fourth device 200 and the fifth device 300 to display the same application program at the same time, and when the display content of the application program is switched from the fourth device 200 to the fifth device 300 or from the fifth device 300 When the device 300 switches to the fourth device 200 for display, the application may be reloaded, and the display performance and user experience may be poor. In addition, the fourth device 200 needs to set different screen projection display style data for different electronic devices in advance, which increases the cost of screen projection.

To solve at least some of the above technical problems, embodiments of the present application provide another screen projection system. Please refer to FIG. 5 , which is a schematic structural diagram of another screen projection system provided by an embodiment of the application. The screen projection system may include a first device 400 and at least one screen projection device (a second device 500 is shown in FIG. 5 ). and the third device 600), the screen projection device may be provided with a display.

The first device 400 may include a second application layer 410, a second application management service layer 420, a user controller module 422, a user manager service module 423, a device management module 424, and a data storage (setting provider) module 425, the second window management service layer 430, the second display management service layer 440, the third display layer 450, and the encoding layer (FIG. 5 shows the second encoding layer 460 and the third encoding layer 470).

The second application layer 410 may include a plurality of user spaces, and each user space may include application data and display style data. Each user space may correspond to a user respectively, as shown in FIG. 5 , the first user space 411 , the second user space 413 and the third user space 415 , wherein the user ID (userid) corresponding to the first user space 411 is 0 (ie userid=0), the first user space 411 includes the second application data 412C, the user ID corresponding to the second user space 413 is 10 (ie userid=10), the first user space 413 includes the third application data 414C, The user ID corresponding to the third user space 415 is 11 (userid=11), and the first user space 415 includes fourth application data 416C. Each application data may be similar to the first application data 213 in FIG. 2 . Each display style data may be similar to the local display style data 211 or the screen projection display style data 212 of the fourth device 200 in FIG. 2 , and each display style data may correspond to a screen projection display device, as shown in FIG. 5 . The first display style data 412, the second display style data 414 and the third display style data 416 are shown, wherein the first display style data 412 corresponds to the local end of the first device 400, and the first display style data 412 includes the third desktop 412A and the third system user interface 412B, the second display style data 414 corresponds to the second device 500, the second display style data 414 includes the fourth desktop 414A and the fourth system user interface 414B, and the third display style data 416 corresponds to the third device 600 , the third display style data 416 includes a third desktop 416A and a third system user interface 416B. Since each user space can correspond to one user, the first device 400 can run multiple processes to correspond to multiple users when running a certain application. Correspondingly, when the screen is displayed, it can be displayed on different devices. The screen displays the display contents corresponding to different processes (ie, different users).

It should be noted that, the user identifier in the embodiment of the present application may refer to the user identifier in the operating system of the electronic device. For example, userid=0 may represent the main user (ie, user 0) in the operating system, and userid=10 and userid=11 may represent sub-users (ie, user 10 and user 11) in the operating system.

It should also be noted that the first device 400 may include multiple user spaces, and the user spaces are isolated from each other. Application data can be included in user space. In some embodiments, the application data may include user data (as shown in the second application data 412C in FIG. 5 ), and the user data may be data generated for the user by the first device 400 when running an application program, such as instant messaging Chat history of the app, pictures taken by the camera, etc. In some embodiments, the application data may further include the application program body, and the first device may install the application program in the user space corresponding to each user ID based on different user IDs; or, in other embodiments, the application data does not Including an application program body, the application program body is stored in a designated storage space outside the multiple user spaces, and the instruction storage space can be shared by users corresponding to the multiple user spaces. Wherein, the user data of the same application in different user spaces may be different, so that the first device 400 can independently run multiple processes of the same application at the same time. For example, the address of the instruction storage space for installing the application program in the first device 400 is "/data/app", and the first device includes two user spaces, and the addresses of the two user spaces are "/data/user" respectively /0" and "/data/user/10", where "/data/user/0" is the user space of user 0, and "/data/user/10" is the user space of user 10. Each user space includes user data of a communication application, so the first device 400 can run two processes of the communication application independently at the same time. For the user, two communication applications can be run on the first device 400. Different app accounts can be logged into each messaging app.

In some embodiments, each user space may not include display style data, but as shown in FIG. 6 , the application body 700 may include various types of display style data such as application desktop style 710 and application system user interface style 720, Each display style data may include styles adapted to different devices. As shown in FIG. 6 , the application desktop style 710 includes a mobile phone desktop style 710A, a computer desktop style 710B and a vehicle desktop style 710C, so that the desktop of the application 700 can be displayed normally on the display screens of the mobile phone, computer and vehicle equipment. Similarly, the application system user interface style 720 may include the mobile phone system user interface style 720A, the computer system user interface style 720B and the vehicle desktop style 720C, so that the system user interface of the application program 700 can be displayed on the mobile phone, computer and vehicle equipment. The screen displays normally. That is, the first device 400 may no longer preset different display style data for different devices, but may acquire display styles for different devices from each application program, thereby reducing the display cost.

The user setting module 422 can be used to configure the user or the device, including responding to the relevant operation of the user, so as to store the corresponding relationship between a certain user identification and a certain device identification in the data module 425, that is, to bind the user identification and the device identification. Certainly.

The user management module 423 may be used to manage users, for example, may include logging in, logging out, and changing a certain user ID.

The device management module 424 can be used to manage the electronic device that performs screen projection, for example, it can include acquiring and deleting the device identification and the like.

The data storage module 425 may be used to store the correspondence between the user ID and the device ID. Of course, in practical applications, the data storage module 425 may also store other information related to users or devices.

The second application management service layer 420 may include a second application management service module 421, and the second application management service module 421 may be similar to the first application management service module 221 in FIG. 2 . In some embodiments, the second application management service module 421 may be configured to search for a user ID corresponding to a certain device ID or an electronic device ID corresponding to a certain user ID from the data storage module 425 .

The second window management service layer 430 may include multiple logical display screens, each logical display screen may correspond to a real or virtual display screen, and each logical display screen may be the same as the first logical display screen 231 or the second logical display screen in FIG. 2 . Logic display 232 is similar. For example, in FIG. 3 , the second window management service layer 430 includes a third logical display screen 431 and a fourth logical display screen, wherein the first logical display screen 431 corresponds to the display screen on the local end of the first device 400 , and the second logical display screen The screen 432 may correspond to the display screen of the second device 500 , and the third logical display screen 433 may correspond to the display screen of the third device 600 .

The second display management service layer 440 may be similar to the first display management service layer 240 in FIG. 2 .

The second local display adapter 441 may be similar to the first local display adapter 241 , the second virtual display adapter 442 may be similar to the first virtual display adapter 242 , and the second wireless display adapter 443 may be similar to the first wireless display adapter 243 .

The third display layer 450 , the fourth display layer 510 and the fifth display layer 610 in the third device 600 may be similar to the first display layer 241 in FIG. 2 .

The second coding layer 460 and the third coding layer 470 may be similar to the first coding layer 260 in FIG. 2 .

The second decoding layer 520 and the third decoding layer 620 may be similar to the first decoding layer 320 in FIG. 2 .

In some embodiments, the first device 400 may include a first mobile phone, and the second device 500 or the third device 600 may include a second mobile phone, a computer, a vehicle-mounted device, or a smart TV.

In this embodiment of the present application, the first device may acquire the first display content corresponding to the first process of the first application, and determine the second device based on the first user identifier corresponding to the first process. Since the first process corresponds to the first user ID, and the second device is determined based on the first user ID, the first display content of the first process can be projected to the second device for display, that is, the first One device can control the content displayed on the second device through the first user identification, which reduces the problem of indiscriminately projecting all the displayed content of the first application to the second device, and improves the display quality. safety.

The technical solutions of the present application will be described in detail below with specific examples. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

Please refer to FIG. 7 , which is a flowchart of a screen projection method provided by an embodiment of the present application. It should be noted that the method is not limited to the specific sequence shown in FIG. 7 and the following. It should be understood that, in other embodiments, the sequence of some steps of the method may be exchanged according to actual needs, or some of the steps may be exchanged. It can also be omitted or deleted. The method includes the following steps:

S701, the first device determines the second device to be displayed on the screen.

The first device may establish a communication connection with the second device in a wireless or wired manner, so as to use the second device as another device for screen projection.

In some embodiments, the first device may search for the second device when receiving the user's screen casting operation. If the first device finds a plurality of electronic devices, it may present a device list to the user, where the device list includes the device identifiers of the plurality of electronic devices, and when the device identifiers are received based on at least one of the plurality of electronic device identifiers During the user's determination operation, the electronic device corresponding to the at least one device identifier is determined as the second device.

Of course, in practical applications, the first device may also determine the second device in other manners, and the embodiments of the present application do not specifically limit the manner in which the first device determines the second device to be displayed on the screen.

In some embodiments, if the first device determines the second device, the first device may obtain the physical characteristics of the display screen of the second device through the second display management service layer, so as to facilitate subsequent screen projection display on the second device.

S702, the first device determines a first user identifier corresponding to the second device.

In some embodiments, the first device may determine the first user identity from the stored correspondence between the at least one device identity and the at least one user identity based on the device identity of the second device. In some embodiments, the first device may provide a user list to the user, the user list includes at least one user identification, and when receiving a user's determination operation based on any user identification, determine the user identification as the first user identification . In some embodiments, the first device may also receive the first user identification submitted by the user.

The first device may obtain the first user identifier corresponding to the second device from the data storage module in the first device through the second application management service layer.

Of course, in practical applications, the first device may also determine the first user identifier corresponding to the second device in other ways. This embodiment of the present application does not specifically limit the manner in which the first device determines the first user identifier corresponding to the second device.

It should be noted that, in practical applications, it is not necessary to limit the execution order of S701 and S702, that is, the first device may determine the second device and the first user ID successively, or may simultaneously determine the second device and the first user ID.

S703: The first device determines whether the first user identifier is the same as the second user identifier corresponding to the first device. If it is different, otherwise it is determined that it is a heterogeneous screen projection, and S704 is performed; if it is the same, it is determined that it is a same-source screen projection, and S710 is performed.

It can be seen from the foregoing that different users have different user data, and the display content obtained by the first device when running applications in different user data will also be different, so the first device can associate the first user ID with the first user ID. Two user IDs are compared. If the second user ID corresponding to the first device is the same as the first user ID corresponding to the second device, it may be that the user needs to display the same display content synchronously on the display screens of the first device and the second device, so homologous casting can be performed. Screen. If the second user ID corresponding to the first device is different from the first user ID corresponding to the second device, it may be that the user needs to display different display contents on the display screens of different devices, so hetero-source screen projection can be performed.

S704, the first device determines whether a user corresponding to the first user identifier exists. If otherwise, execute S505, and if so, execute S706.

It can be seen from the foregoing that the first user ID may not be obtained by the first device from the stored user list, for example, it may be obtained by the first device after receiving the user's submission after the screen projection is started. Therefore, the first device can determine the first user ID. Whether a user ID exists in the user list. If yes, it can be determined that the user corresponding to the first user identifier is an existing user; otherwise, it can be determined that the user corresponding to the first user identifier does not exist.

In some embodiments, if the first device determines that the user corresponding to the first user identification does not exist, it may not execute S705, but prompt the user to resubmit a user identification.

S705, the first device creates a user based on the first user identifier.

The first device may store the first user identifier in the user list, and may also store the first user identifier and the device identifier of the second device in the correspondence between the user identifier and the device identifier.

In some embodiments, the first device may create a user space corresponding to the first user identification.

The first device may create a user through the user management module, and bind the created user to the second device through the user setting module, that is, store the first user ID and the device ID of the second device in the data storage module.

In some embodiments, S704 and S705 may be omitted, that is, the first device may directly execute S706 when it is determined that the second device corresponds to the first user identifier.

In some embodiments, the first device may also first execute S704 to determine whether a user corresponding to the first user identifier exists. If the user corresponding to the first user identifier exists, then execute S703 to determine whether the first user identifier is the same as the second user identifier corresponding to the first device. If the user corresponding to the first user identifier does not exist, perform S705 to create a user based on the first user identifier, and then perform S703.

Through the foregoing steps, the first device determines the second device and the first user identifier corresponding to the second device, and the first device also determines the second user identifier corresponding to the local end of the first device, that is, the first device can determine different User IDs and electronic devices corresponding to different user IDs, then in subsequent steps, the first device can determine which user ID a certain display content corresponds to, and then determine which electronic device display screen to display the display content on.

S706, the first device creates a first process of the first application based on the first user identifier.

Wherein, the first application program may be any application program. In some embodiments, the first application may include a system application, and the system application is used to provide a software environment necessary for the electronic device to operate or interact with the user. For example, the first application may include a desktop application and a system user interface application. at least one of the. In other embodiments, the first application may include a user application, which may be installed by the user and provide the user with value-added services, such as communication applications and games. The first device may manage each application program according to a preset application management policy, such as creating or closing the first application program.

In some embodiments, the first device may acquire user data of the first application from the user space corresponding to the first user identifier, and create the first process based on the user data of the first application. The first device may obtain the application body of the application from the specified storage space or the user space corresponding to the first user ID, obtain the user data of the first application from the user space corresponding to the first user ID, and then obtain the user data of the first application from the user space corresponding to the first user ID. To the application ontology and user data, create the first process.

In some embodiments, the first device may store the process identifier of the first process and the first user identifier in the corresponding relationship between the process identifier and the user identifier.

In some embodiments, the first device may also create a second process of the first application based on the second user identifier in a second manner similar to creating the first process, and the second user identifier may correspond to the first device.

For example, the first device may create process 1 and process 2 for application A, where process 1 corresponds to user 1, and process 2 corresponds to user 10. For the user, the first device runs two identical applications A, and You can log in to different application accounts in each application A.

S707: The first device acquires the first display content corresponding to the first process of the first application program.

The first device may obtain the first display content from the windows and sub-windows corresponding to each active component included in the first process through the second window management service layer. In some embodiments, the first device may acquire the third display contents in the windows and sub-windows, and then combine and render the acquired third contents based on the positions and sizes of the windows and sub-windows, so as to obtain the third display contents. A display content.

It should be noted that, in practical applications, the first device may also obtain the first display content corresponding to the first process in other ways. In this embodiment of the present application, the first device obtains the first display content corresponding to the first process of the first application program. - The manner of displaying the content is not specifically limited.

In some embodiments, the first device may acquire the second display content corresponding to the second process of the first application in a manner similar to S707.

S708, the first device determines the second device based on the first user identifier corresponding to the first process.

Since the first device may run different processes based on different user IDs when running the first application, if there are multiple user IDs, multiple processes may be run, and different user IDs will also correspond to different Therefore, in order to determine whether to display the first display content of the first application program on the local end or perform screen projection display, it can reduce the user privacy caused by indiscriminately projecting the display content of the first application program to an external device. In order to improve the security of the display, the first device can determine the device identification of the second device based on the first user identification corresponding to the first process, and determine the second device based on the device identification of the second device.

In some embodiments, the first device may obtain the electronic device identification corresponding to the electronic device identification corresponding to the first user identification from the stored correspondence between the at least one user identification and the at least one device identification, and the device identification corresponds to The device is determined to be the second device. Wherein, at least one user identification may include a first user identification, and at least one device identification may include a device identification of a second device.

It should be noted that this embodiment of the present application does not specifically limit the order in which the first device obtains the first display content corresponding to the first process and the first device determines the second device based on the first user identifier corresponding to the first process. For example, in some embodiments, the first device may first determine the second device based on the first user identifier, and then first obtain the first display content corresponding to the first process.

In some embodiments, the first device may acquire the third display content corresponding to the first process of the first application, and acquire the display style corresponding to the second device from the application body (or user data) of the first application The data, based on the display style data corresponding to the second device, perform adaptation processing on the third display content to obtain the first display content. That is, the first device does not need to set different screen projection display style data for different electronic devices in advance, which reduces the cost of screen projection.

Wherein, the first device can obtain the physical features of the display screen of the second device from the second display management service layer, and then the physical features can obtain the display style data corresponding to the second device, through the second virtual device corresponding to the second device. The display adapter adapts the display style data to the third display content to obtain the first display content. Of course, in practical applications, the first device can also obtain the display style data corresponding to the second device in other ways. For example, the first device can also obtain the display style data corresponding to the second device based on the device identifier of the second device. Display style data.

In some embodiments, the first device may determine the electronic device corresponding to the second user identification based on the second user identification corresponding to the second process in a manner similar to S708. And in some embodiments, the electronic device corresponding to the second user identification may be the first device.

S709, the first device projects the first display content to a display screen of the second device for display.

Since the first display content corresponds to the first process of the first application, and the second device is determined based on the first user ID corresponding to the first process, when the first device runs the first application, if it determines the first When a process corresponds to the first user ID, the first display content corresponding to the first process can be projected to the second device determined based on the first user ID for display, that is, the first device can use the first user ID to control Projecting the content displayed on the screen on the second device reduces the problem of indiscriminately projecting all the displayed content of the first application to the second device, and improves the security of the display.

The first device can encode the first display content through the second encoding layer, and send the encoded first display content to the second device, and the second device can decode the received data through the second decoding layer , obtain the first display content, and then control the display to display the first display content through the fourth display layer.

S710, the first device projects the second display content currently displayed by the first device to a display screen of the second device for display.

When the first user ID is the same as the second user ID, the current screencasting can be the same source screencasting, the first process and the second process are the same process, then the first device can display the second display currently displayed by the first device The content is projected to the display screen of the second device for display.

In some embodiments, the first device may display the second display content on the local end of the first device. Of course, if the second user identifier does not correspond to the first device but corresponds to another third device, then the first device may project the second display content to the third device for display in a manner similar to S708. That is, the user can control the display content displayed on multiple different devices through multiple user IDs, which improves the flexibility and security of the display. In addition, when the first device runs the first application, the first display content corresponding to the first process of the first application is displayed on the second device, and the first display content corresponding to the second process of the first application is displayed on the second device. The second display content is displayed on the first device or the third device, and the two processes are independent, then the first device can assign the first display content and the second display content to the second device and the first device respectively. (or the third device) the display screen is adapted to display the first display content and the second display content on the second device and the first device (or the third device) respectively. The first application program is simultaneously displayed in the middle, which improves the display performance and user experience.

In some embodiments, the first device may not adapt the style of the first display content according to the physical characteristics of the display screen of the second device, so that the style of the first device and the second device when the first application is displayed be consistent.

For example, referring to FIG. 8 , the first device 400 is a mobile phone, and the second device 500 is a computer. A communication application is currently displayed on the mobile phone, and the displayed content is the user setting interface 1 . The displayed content comes from the process 1 of the communication application, and the process 1 corresponds to the user 0 . The mobile phone also projects another display content of the communication application to the display screen of the computer for display. The other display content is the user setting interface 2 , and the other display content originates from the process 2 of the communication application, and the process 2 corresponds to the user 10 . Wherein, the application account logged in by the communication application in the mobile phone is asd1, and the application account logged in by the communication application in the notebook computer is qwe1, and the display interface of the mobile phone is consistent with the display interface style of the mobile phone screen projected on the laptop computer. Please refer to FIG. 9 , the contents displayed by the mobile phone in FIG. 9 and FIG. 8 are the same. Based on the user setting interface displayed by the laptop, the user clicks the chat icon in the lower left corner, so the mobile phone switches to the chat interface, generates display content 1 based on the chat interface, and uses the device identification of the laptop to extract the application ontology from the communication application. , the display style data corresponding to the notebook computer is obtained, the display content 1 is adapted according to the display style data, and the display content 2 is obtained, and the mobile phone projects the display content 2 to the notebook computer, so that the display content of The chat interface is displayed on the screen, and the size of the chat interface matches the screen size of the display screen of the notebook computer, which is more conducive to the interaction between the notebook computer and the user.

It should be noted that the developer of each application can generate display style data corresponding to various devices in advance, and encapsulate the display style data of the various devices in the application body or user data of the application.

In this embodiment of the present application, the first device may acquire the first display content corresponding to the first process of the first application, and determine the second device based on the first user identifier corresponding to the first process. Since the first process corresponds to the first user ID, and the second device is determined based on the first user ID, the first display content of the first process can be projected to the second device for display, that is, the first One device can control the content displayed on the second device through the first user identification, which reduces the problem of indiscriminately projecting all the displayed content of the first application to the second device, and improves the display quality. safety.

Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned functions can be allocated to different functional units, Module completion, that is, dividing the internal structure of the device into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated in one processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit, and the above-mentioned integrated units may adopt hardware. It can also be realized in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present application. For the specific working processes of the units and modules in the above-mentioned system, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

Based on the same inventive concept, an embodiment of the present application further provides an electronic device, and the electronic device may be the aforementioned first device, second device or third device. FIG. 10 is a schematic structural diagram of an electronic device 1000 provided by an embodiment of the present application. As shown in FIG. 10 , the electronic device provided by this embodiment includes: a memory 1010 and a processor 1020. The memory 1010 is used to store computer programs; The methods described in the above method embodiments are executed when the computer program is invoked.

The electronic device provided in this embodiment can execute the foregoing method embodiments, and the implementation principles and technical effects thereof are similar, and details are not described herein again.

Based on the same inventive concept, an embodiment of the present application also provides a chip system. The chip system includes a processor coupled with a memory, and the processor executes a computer program stored in the memory, so as to implement the method described in the above method embodiments.

Wherein, the chip system may be a single chip, or a chip module composed of multiple chips.

Embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method described in the foregoing method embodiment is implemented.

The embodiments of the present application further provide a computer program product, when the computer program product runs on the electronic device, the terminal executes the method described in the above method embodiments.

If the above-mentioned integrated units are implemented in the form of software functional units and sold or used as independent products, they may be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can be implemented by a computer program to instruct the relevant hardware. The computer program can be stored in a computer-readable storage medium, and the computer program When executed by a processor, the steps of each of the above method embodiments can be implemented. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form, and the like. The computer-readable storage medium may include at least: any entity or device capable of carrying computer program codes to the photographing device/electronic device, recording medium, computer memory, read-only memory (ROM), random access Memory (random access memory, RAM), electrical carrier signals, telecommunication signals, and software distribution media. For example, U disk, mobile hard disk, disk or CD, etc. In some jurisdictions, under legislation and patent practice, computer readable media may not be electrical carrier signals and telecommunications signals.

In the foregoing embodiments, the description of each embodiment has its own emphasis. For parts that are not described or described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed apparatus/device and method may be implemented in other manners. For example, the apparatus/equipment embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or Components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

It is to be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described feature, integer, step, operation, element and/or component, but does not exclude one or more other The presence or addition of features, integers, steps, operations, elements, components and/or sets thereof.

It will also be understood that, as used in this specification and the appended claims, the term "and/or" refers to and including any and all possible combinations of one or more of the associated listed items.

As used in the specification of this application and the appended claims, the term "if" may be contextually interpreted as "when" or "once" or "in response to determining" or "in response to detecting ". Similarly, the phrases "if it is determined" or "if the [described condition or event] is detected" may be interpreted, depending on the context, to mean "once it is determined" or "in response to the determination" or "once the [described condition or event] is detected. ]" or "in response to detection of the [described condition or event]".

In addition, in the description of the specification of the present application and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and should not be construed as indicating or implying relative importance.

References in this specification to "one embodiment" or "some embodiments" and the like mean that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically emphasized otherwise. The terms "including", "including", "having" and their variants mean "including but not limited to" unless specifically emphasized otherwise.

The above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the above-mentioned embodiments, those of ordinary skill in the art should understand that: it is still possible to implement the above-mentioned implementations. The technical solutions described in the examples are modified, or some or all of the technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims (10)

1. A screen projection method, comprising:

the method comprises the steps that first equipment obtains first display content corresponding to a first process of a first application program;

the first equipment determines second equipment based on a first user identification corresponding to the first process;

and the first equipment projects the first display content to the display screen of the second equipment for display.

2. The method of claim 1, further comprising:

the first device acquires second display content corresponding to a second process of the first application program, wherein the second process corresponds to a second user identifier, and the second user identifier corresponds to the first device;

the first device displays the second display content on a display screen of the first device.

3. The method of claim 2, wherein the first user identifier is the same as the second user identifier, wherein the first process is the same as the second process, and wherein the first display content is the same as the second display content.

4. The method according to any of claims 1-3, wherein the determining, by the first device, the second device based on the first user identifier corresponding to the first process comprises:

the first device determines a device identifier of the second device from a stored correspondence between at least one user identifier and at least one device identifier based on the first user identifier, wherein the at least one user identifier comprises the first user identifier, and the at least one device identifier comprises the device identifier of the second device;

and the first equipment determines the second equipment according to the equipment identification of the second equipment.

5. The method according to any one of claims 1-4, wherein the obtaining, by the first device, first display content corresponding to a first process of a first application program comprises:

the first equipment acquires third display content corresponding to the first process;

the first device acquires display style data corresponding to the second device from an application body of the first application;

and the first equipment performs adaptation processing on the third display content based on the display style data corresponding to the second equipment to obtain the first display content.

6. The method according to any one of claims 1-5, wherein before the first device obtains the first display content corresponding to the first process of the first application, the method further comprises:

the first device creates the first process based on the first user identification.

7. The method of claim 6, wherein the first device creates the first process based on the first user identification, comprising:

if the first device determines that the user corresponding to the first user identifier exists, acquiring user data of the first application program from a user space corresponding to the first user identifier;

creating the first process based on the user data of the first application.

8. The method of any one of claims 1-7, wherein the first device comprises a first cell phone and the second device comprises a computer, a vehicle mounted device, a smart television, or a second cell phone.

9. An electronic device, comprising: a memory for storing a computer program and a processor; the processor is adapted to perform the method of any of claims 1-8 when the computer program is invoked.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-8.

Images