EP3716036B1 - Display apparatus and control method thereof - Google Patents
Display apparatus and control method thereof Download PDFInfo
- Publication number
- EP3716036B1 EP3716036B1 EP19200576.7A EP19200576A EP3716036B1 EP 3716036 B1 EP3716036 B1 EP 3716036B1 EP 19200576 A EP19200576 A EP 19200576A EP 3716036 B1 EP3716036 B1 EP 3716036B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- display
- electronic apparatus
- received
- regions
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 16
- 238000003708 edge detection Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 5
- 230000005236 sound signal Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000001939 inductive effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 229910021417 amorphous silicon Inorganic materials 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 229910021420 polycrystalline silicon Inorganic materials 0.000 description 1
- 229920005591 polysilicon Polymers 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
- G06F3/1462—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay with means for detecting differences between the image stored in the host and the images displayed on the remote displays
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G5/005—Adapting incoming signals to the display format of the display terminal
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/12—Synchronisation between the display unit and other units, e.g. other display units, video-disc players
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/38—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
- H04N21/440272—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0442—Handling or displaying different aspect ratios, or changing the aspect ratio
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0492—Change of orientation of the displayed image, e.g. upside-down, mirrored
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
- G09G2340/125—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels wherein one of the images is motion video
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/14—Solving problems related to the presentation of information to be displayed
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/14—Solving problems related to the presentation of information to be displayed
- G09G2340/145—Solving problems related to the presentation of information to be displayed related to small screens
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
Definitions
- the disclosure relates to a display apparatus and a control method thereof, and more particularly, to a display apparatus capable of mirroring and displaying an image that is being displayed on an electronic apparatus, and a control method thereof.
- the mirroring service refers to a service for displaying (or sharing) an image that is being displayed on a display of the electronic apparatus, on a display of another electronic apparatus.
- the mirroring service allows a user to watch an image that is being displayed on a display of an electronic apparatus such as a laptop computer, a tablet personal computer (PC), or a smartphone, through a display of a display apparatus such as a television or a monitor.
- the mirroring service has been provided according to a Miracast standard.
- a resolution or a ratio of a display for each manufacturer may vary.
- the electronic apparatus transmits an image for mirroring to the display apparatus, resolution of the image that is being displayed on the electronic apparatus is converted according to the Miracast standard, and the image of which resolution is converted is transmitted to the display apparatus.
- the electronic apparatus inserts blank regions into the top and bottom or the left and right of the image to convert the resolution of the image to correspond to the Miracast standard, and transmits the image of which resolution is converted to the display apparatus.
- the blank regions may be included in the image displayed on the display apparatus.
- such blank regions may be a factor that hinders the user from watching the image comfortably.
- US 2018/0261185 discloses a wireless device.
- US 2014/0333671 discloses a display apparatus and control method thereof.
- a display apparatus capable of displaying an image of a remaining region excluding blank regions in an image for mirroring, and a control method thereof.
- FIG. 1 is a block diagram for describing a display apparatus 100 according to an embodiment.
- a display apparatus 100 may be a smart television (TV).
- TV smart television
- the display apparatus 100 may be various electronic apparatuses including a display, such as a computer, a laptop computer, a tablet personal computer (PC), a digital camera, a camcorder, a personal digital assistant (PDA), a smartphone, and the like.
- a display such as a computer, a laptop computer, a tablet personal computer (PC), a digital camera, a camcorder, a personal digital assistant (PDA), a smartphone, and the like.
- PDA personal digital assistant
- the display apparatus 100 includes a display 110, a communicator 120, and a processor 130.
- the display 110 may display various screens (e.g., simultaneously display various screens on different areas of the display 110).
- the display 110 may mirror and display an image that is being displayed on an electronic apparatus.
- the display 110 displays an image of a remaining region excluding blank regions in an image for mirroring.
- the display 110 may display various images such as broadcasting contents, multimedia contents and the like, as well as various user interfaces (UIs) and icons.
- UIs user interfaces
- the display 110 can be rotated.
- the display 110 may be disposed in a horizontal form or a vertical form according to a user command for rotation.
- the display apparatus 100 further includes a driver for rotating the display 110.
- the display 110 may be implemented in various manners, such as a liquid crystal display (LCD) panel, a light emitting diode (LED) display or backlit display, an organic light emitting diode (OLED) display, a liquid crystal on silicon (LCoS) display, a digital light processing (DLP) display, and the like.
- the display 110 may also include a driving circuit, a backlight unit, and the like, and may be implemented in a form such as an a-Si thin film transistor (TFT), a low temperature poly silicon (LTPS) TFT, an organic TFT (OTFT), and the like.
- TFT a-Si thin film transistor
- LTPS low temperature poly silicon
- OFT organic TFT
- the display 110 may be implemented by a touch screen by combining with a touch sensor.
- the communicator 120 communicates with the electronic apparatus to transmit and receive various data.
- the communicator 120 may not only perform communication with the electronic apparatus through a local area network (LAN), an Internet network, and a mobile communication network, but may also perform communication with the electronic apparatus through various communication manners such as Bluetooth, Bluetooth Low Energy (BLE), Wireless Fidelity (WI-FI), Zigbee, Near Field Communication (NFC), and the like.
- LAN local area network
- Internet network Internet network
- NFC Near Field Communication
- the communicator 120 may include various communication modules for performing network communication.
- the communicator 120 may include at least one of a Bluetooth chip, a WI-FI chip, a wireless communication chip, and the like.
- the communicator 120 may perform the communication with the electronic apparatus to receive the image for mirroring from the electronic apparatus.
- the electronic apparatus may be a smartphone, a computer, a laptop computer, or the like, but is not limited thereto.
- the electronic apparatus may be various electronic apparatuses that may transmit the image that is being displayed on or by the electronic apparatus to the display apparatus 100.
- the communicator 120 may perform communication with an external apparatus to receive broadcasting contents (or broadcasting signals).
- the broadcasting contents may include at least one of an image, an audio, or additional data (for example, an electronic program guide (EPG)).
- EPG electronic program guide
- the communicator 120 may include a tuner, a demodulator, an equalizer, and the like.
- the processor 130 controls a general operation of the display apparatus 100.
- the processor 130 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP).
- CPU central processing unit
- AP application processor
- CP communication processor
- the processor 130 may drive an operating system and/or an application program to control hardware and/or software components connected to the processor 130, and may perform various types of data processing and calculation.
- the processor 130 may load and process commands or data received from at least one of other components in a volatile memory, and store various data in a non-volatile memory.
- the processor 130 controls the communicator 120 to perform communication connection with the electronic apparatus.
- the processor 130 may search for a peripheral electronic apparatus through the communicator 120 and control the communicator 120 to perform communication connection with the searched for electronic apparatus.
- the processor 130 may control the communicator 120 to perform the communication connection.
- the processor 130 receives the image for mirroring from the electronic apparatus.
- the processor 130 may transmit a signal for requesting image transmission to the electronic apparatus when a user command for mirroring is received, and display the received image on the display 110 when the image for mirroring is received from the electronic apparatus.
- the processor 130 may control the communicator 120 to receive the image for mirroring and display the image received from the electronic apparatus on the display 110, when a signal for requesting image reception (or when the image itself and/or a control signal instructing image reception for mirroring) is received from the electronic apparatus in a state where the display apparatus is communication-connected to the electronic apparatus through the communicator 120.
- the image for mirroring which is an image including contents displayed on a display of the electronic apparatus, may be an image having a resolution according to a Miracast standard.
- the processor 130 may receive an image for mirroring of which resolution is 1920 ⁇ 1080 from the electronic apparatus.
- blank regions are included in the image for mirroring.
- blank regions added in a process of converting the resolution of the image according to the Miracast standard may be included in the image for mirroring.
- blank regions can be included in a left area and a right area of the image for mirroring.
- the electronic apparatus adds the blank regions to the left area and the right area of the image to convert the resolution of the image that is being displayed into the resolution according to the Miracast standard and transmits the image to which the blank regions are added as the image for mirroring to the display apparatus 100.
- the processor 130 displays (i.e., control to display) the image received from the electronic apparatus on the display 110.
- the processor 130 may display the received image or an image in which the blank regions are excluded from the received image on the display 110 on the basis of a disposition state of the display 110 and whether or not the blank regions for mirroring are included in the image.
- the processor 130 may display the images 210 and 310 for mirroring received from the electronic apparatus 200 on the display 110 regardless of whether the disposition state of the display 100 is horizontal or vertical, as illustrated in FIGS. 2 and 3 .
- the image 210 in which the blank regions are not included is received in a state where the display 110 is horizontally disposed as illustrated in FIG. 2 , a content that is being displayed on the electronic apparatus 200 is displayed over an entire region of the display 110 and thus, the image need not be displayed in a state where resolution of the image is converted.
- the image 310 in which the blank regions are not included is received in a state where the display 110 is vertically disposed as illustrated in FIG. 3
- the image is displayed in a state in which resolution of the image is converted to correspond to resolution or a size of the display 110 (that is, when the image is displayed in a state where it is extended in a vertical direction)
- the image is unnaturally displayed.
- the processor 130 may perform different operations depending on the disposition state of the display 110.
- the processor 130 may display the image 410 for mirroring on the display 110.
- the image 410 for mirroring in which the blank regions are included is received in the state where the display 110 is horizontally disposed as illustrated in FIG. 4
- the image is displayed in a state in which resolution of the image is converted to correspond to resolution or a size of the display 110 (that is, the image is displayed in a state where it is extended in a horizontal direction)
- the image is unnaturally displayed.
- the processor 130 may display an image of a remaining region excluding the blank regions on the display 110, as illustrated in FIG. 6 .
- the processor 130 may display the image in which the blank regions are included on the display 110 and then display an image of a remaining region excluding the blank regions on the display 110 automatically or on the basis of a user command.
- the image 510 in which the blank regions are included is received in the state where the display 110 is vertically disposed as illustrated in FIG. 5 , it is natural to display the image in a state in which resolution of the image is converted to correspond to the resolution or the size of the display 110.
- the image is displayed in this manner, a case where viewing of a user is hindered by the blank regions is prevented.
- FIGS. 7 to 9 are views for describing an operation of the display apparatus 100 when an image in which blank regions are included is received in a state where a display according to an embodiment is vertically disposed.
- the processor 130 identifies whether or not the blank regions for mirroring are included in the received image.
- the blank regions for mirroring may refer to blank regions added to the image for the image to have the resolution according to, by way of example, the Miracast standard.
- the processor 130 identifies black regions 710 and 720 in an image displayed through the display 110, as illustrated in FIG. 7 , and identifies that regions corresponding to the black regions are blank regions.
- the black regions 710 and 720 may be identified by analyzing a color value of the image displayed through the display 110.
- the processor 130 may identify the blank regions included in the image displayed (or to be displayed) through the display 110 via other methods, such as an edge detection algorithm.
- the processor 130 crops the image of the remaining region excluding the blank regions in the image for mirroring. In this case, the processor 130 crops an image 730 of a remaining region excluding the blank regions in further consideration of information on a pre-stored image ratio for each electronic apparatus.
- the processor 130 receives recognition information (e.g., identification information) of the electronic apparatus 200 from the electronic apparatus 200 through the communicator 120.
- the processor 130 identifies an image ratio corresponding to the recognition information on the basis of information on a pre-stored image ratio for each electronic apparatus.
- the processor 130 may identify 9:18.5, which is an image ratio corresponding to the third electronic apparatus on the basis of the information on the pre-stored image ratio for each electronic apparatus.
- the processor 130 may crop an image of a region having an aspect ratio of 9:18.5 on the basis of a central region from the image for mirroring received from the electronic apparatus 200.
- the display apparatus 100 may more accurately crop a region in which a content is included by cropping the image in further consideration of the information on the pre-stored image ratio.
- the processor 130 scales resolution of a cropped image 910 to correspond to the resolution of the display 110, as illustrated in FIG. 9 .
- the processor 130 displays an image 920 of which resolution is scaled on the display 110. Therefore, the disclosure can display the image of the remaining region excluding the blank regions over the entire region of the display 110 and prevent a case where watching of the image by the user is hindered due to the blank regions.
- the processor 130 may not only identify the disposition state of the display 110 on the basis of a ratio of the image that is being displayed on the display 110, but may also identify the disposition state of the display 110 on the basis of state information received for the display 110.
- the display apparatus 100 according to the disclosure may further include a sensor sensing rotation, such as a gyro sensor or the like, and the processor 130 may identify the disposition state of the display 110 on the basis of a state of the display 110 sensed by the sensor.
- FIG. 10 is a view for describing a user interface (UI) for scaling of an image useful for understanding the present invention.
- UI user interface
- the processor 130 may display an image of a remaining region excluding the blank regions on the display 110 disposed in the vertical direction.
- Such an operation may not only be performed automatically when it is identified that the image in which the blank regions are included is received, but may also be performed on the assumption that a user command selecting a UI for displaying the image of the remaining region excluding the blank regions is received.
- the processor 130 may display a user interface (UI) 1010 (e.g., graphical user interface item, icon, etc.) for displaying the image of the remaining region excluding the blank regions.
- UI user interface
- the processor 130 may display the image of the remaining region excluding the blank regions on the display 110 disposed in the vertical direction.
- FIG. 11A is a view for describing an operation of the display apparatus 100 when an image in which blank regions are included is received in a state where a display is horizontally disposed
- FIG. 11B is a view for describing a UI for rotation of a display.
- the processor 130 may display the image for mirroring received from the electronic apparatus 200 on the display 110.
- the processor 130 may control the display 110 disposed in the horizontal direction (i.e., in which width is greater than height) to rotate to the vertical direction (i.e., in which height is greater than width) and display the image of the remaining region excluding the blank regions through the display 110 disposed in the vertical direction, as illustrated in FIG. 11A .
- the processor 130 may identify the blank regions in the image received from the electronic apparatus 200, crop the image of the remaining region excluding the blank regions, scale resolution of the cropped image to correspond to the resolution of the display disposed in the vertical direction, and then display the cropped image of which resolution is scaled.
- the processor 130 may display a UI 1110 for rotation of the display 110 on one region of the display 110 disposed in the horizontal direction, rotate the display 110 in the vertical direction based on a user command for selecting the UI 1110 being received, and display the image of the remaining region excluding the blank regions from the image received from the electronic apparatus 200 on the display 110 disposed in the vertical direction, as illustrated in FIG. 11B .
- the processor 130 may further display a message for inducing, inquiring, or requesting feedback from the user to rotate the display, such as "rotate the display in the vertical direction.” Therefore, the user may watch the image from which the blank regions are excluded.
- FIG. 12A is a view for describing an operation of the display apparatus 100 when an image in which blank regions are not included is received in a state where a display is vertically disposed
- FIG. 12B is a view for describing a UI for rotation of a display.
- the processor 130 may display the images 210 and 310 for mirroring received from the electronic apparatus 200 regardless of whether or not the disposition state of the display 110 is horizontal or vertical.
- the processor 130 may control the display 110 disposed in the vertical direction to rotate in the horizontal direction, and display the image received from the electronic apparatus 200 through the display 110 disposed in the horizontal direction.
- the processor 130 may display a UI 1210 for rotation of the display 110 on one region of the display 110 disposed in the vertical direction, rotate the display 110 in the horizontal direction based on a user command for selecting the UI 1210 being received, and display the image received from the electronic apparatus 200 on the display 110 disposed in the horizontal direction, as illustrated in FIG. 12B .
- the processor 130 may further display a message for inducing, inquiring, or requesting feedback from the user to rotate the display, such as "rotate the display in the horizontal direction.” Accordingly, the user may watch the image through an entire screen of the display 110.
- FIG. 13 is a detailed block diagram for describing a display apparatus 100 useful for understanding the present invention.
- the display apparatus 100 may include the display 110, the communicator 120, a storage 140, a microphone 150, a speaker 160, an input 170 (e.g., input unit or inputter), a signal processor 180, and the processor 130.
- a description of portions overlapping or redundant with those described above will be omitted or abbreviated below.
- the storage 140 may store an operating system (OS) for controlling a general operation of components of the display apparatus 100 and commands, instructions, or data related to the components of the display apparatus 100.
- OS operating system
- the processor 130 may control a plurality of hardware and/or software components of the display apparatus 100 using various commands, instructions, data or the like stored in the storage 140, load and process a command, an instruction, or data received from at least one of other components to a volatile memory, and store various data in a non-volatile memory.
- the storage 140 may store information on the image ratio and/or the resolution for each of plural electronic apparatuses.
- the microphone 150 receives a user speech.
- the user speech may be a speech for executing a specific function of the display apparatus 100.
- the processor 130 may analyze the user speech through a speech to text (STT) algorithm, and perform a function corresponding to the user speech.
- STT speech to text
- the speaker 160 may output various audio signals.
- the speaker 160 may output an audio signal in a case of displaying the image of the remaining region excluding the blank regions in the image for mirroring or in a case of rotating the display 110.
- the input 170 may receive various user commands.
- the processor 130 may execute a function corresponding to a user command input through the input 170.
- the input 170 may receive a user command for displaying the image of the remaining region excluding the blank regions in the image for mirroring, and the processor 130 may display the image of the remaining region excluding the blank regions on the display 110 according to a user input.
- the input 170 may receive a user command for performing turn-on, channel change, volume adjustment, or the like, and the processor 130 may turn on the display apparatus 100 or perform the channel change, the volume adjustment, or the like depending on the received user command.
- the input 170 may be implemented by an input panel.
- the input panel may be implemented by a touch pad or a key pad including various functional keys, numeric keys, special keys, character keys, and the like, or in a touch screen manner.
- the signal processor 180 may perform signal processing on a content received through the communicator 120.
- the signal processor 180 may perform operations such as decoding, scaling, frame rate conversion, and the like, on an image configuring the content to make, render, or reproduce the image a form in which the image may be output from the display apparatus 100.
- the signal processor 180 may perform signal processing such as decoding or the like on an audio signal configuring the content to make the audio signal in a form in which the audio signal may be output from the speaker 160.
- the display 110 may display the image or the like output from the signal processor 180, and the speaker 160 may output the audio output from the signal processor 180.
- the display apparatus 100 may further include a motor for rotating the display 110.
- the processor 130 may transmit a control signal to the motor to rotate the display 110.
- FIG. 14 is a flowchart for describing a control method of a display apparatus useful for understanding the present invention.
- the display apparatus 100 may receive the image for mirroring from the electronic apparatus (S1410).
- the content that is being displayed on the electronic apparatus 200 and the blank regions may be included in the image for mirroring.
- the electronic apparatus 200 may transmit an image in which the blank regions are inserted into the left and right of a region corresponding to the content that is being displayed on the electronic apparatus 200 on the basis of the Miracast standard to the display apparatus 100.
- the display apparatus 100 may identify whether or not the blank regions for mirroring are included in the image received from the electronic apparatus 200 (S1420). For example, the display apparatus 100 may confirm the black regions on the basis of pixel values of the display apparatus and identify that the regions corresponding to the black regions are the blank regions.
- the display apparatus 100 may display the image of the remaining region excluding the blank region in the received image on the display 110 disposed in the predetermined direction (S1430).
- the display apparatus 100 may display the content that is being displayed on the electronic apparatus 200 over the entire region of the display 100 to increase an immersion level of the watching of the image by the user.
- methods according to one or more embodiments described above may be implemented in a form of software and/or an application that may be installed in a display apparatus.
- methods according to one or more embodiments described above may be implemented by software upgrade or hardware upgrade for a display apparatus.
- one or more embodiments described above may also be performed through an embedded server provided in the display apparatus or a server disposed outside the display apparatus.
- a non-transitory computer readable medium storing a program or instructions sequentially or at least partially simultaneously performing a control method of a display apparatus according to one or more embodiments may be provided.
- the non-transitory computer readable medium may be a medium that semi-permanently stores data and is readable by an apparatus.
- various applications, programs, and/or processor-executable instructions described above may be stored and provided in the non-transitory computer readable medium such as a compact disk (CD), a digital versatile disk (DVD), a hard disk, a Blu-ray disk, a universal serial bus (USB), a memory card, a read only memory (ROM), or the like.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Description
- The disclosure relates to a display apparatus and a control method thereof, and more particularly, to a display apparatus capable of mirroring and displaying an image that is being displayed on an electronic apparatus, and a control method thereof.
- With the evolution of electronic technology, various electronic apparatuses have recently been developed. In particular, an electronic apparatus supporting a mirroring service has recently been developed.
- The mirroring service refers to a service for displaying (or sharing) an image that is being displayed on a display of the electronic apparatus, on a display of another electronic apparatus. Thus, the mirroring service allows a user to watch an image that is being displayed on a display of an electronic apparatus such as a laptop computer, a tablet personal computer (PC), or a smartphone, through a display of a display apparatus such as a television or a monitor.
- Meanwhile, the mirroring service has been provided according to a Miracast standard. In particular, a resolution or a ratio of a display for each manufacturer may vary. Thus, when the electronic apparatus transmits an image for mirroring to the display apparatus, resolution of the image that is being displayed on the electronic apparatus is converted according to the Miracast standard, and the image of which resolution is converted is transmitted to the display apparatus. For example, the electronic apparatus inserts blank regions into the top and bottom or the left and right of the image to convert the resolution of the image to correspond to the Miracast standard, and transmits the image of which resolution is converted to the display apparatus.
- As a result, the blank regions may be included in the image displayed on the display apparatus. However, such blank regions may be a factor that hinders the user from watching the image comfortably.
-
US 2018/0261185 discloses a wireless device. -
US 2014/0333671 discloses a display apparatus and control method thereof. - Provided are a display apparatus capable of displaying an image of a remaining region excluding blank regions in an image for mirroring, and a control method thereof.
- Features of the present invention are set out in the appended claims.
- The above and other aspects, features, and advantages of certain embodiments of the present disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
-
FIG. 1 is a block diagram for describing a display apparatus according to an embodiment; -
FIG. 2 is a view for describing a mirrored image of the display apparatus useful for understanding the present invention; -
FIG. 3 is a view for describing a mirrored image of the display apparatus useful for understanding the present invention; -
FIG. 4 is a view for describing a mirrored image of the display apparatus useful for understanding the present invention; -
FIG. 5 is a view for describing a mirrored image of the display apparatus useful for understanding the present invention; -
FIG. 6 is a view for describing an example in which an image of a remaining region excluding blank regions is displayed on the display apparatus useful for understanding the present invention; -
FIG. 7 is a view for describing an operation of the display apparatus in a case where an image in which blank regions are included is received in a state where a display according to an embodiment is vertically disposed; -
FIG. 8 is a view for describing an operation of the display apparatus in a case where an image in which blank regions are included is received in a state where a display according to an embodiment is vertically disposed; -
FIG. 9 is a view for describing an operation of the display apparatus in a case where an image in which blank regions are included is received in a state where a display according to an embodiment is vertically disposed; -
FIG. 10 is a view for describing a user interface (UI) for scaling of an image useful for understanding the present invention; -
FIG. 11A is a view for describing an operation of the display apparatus in a case where an image in which blank regions are included is received in a state where a display is horizontally disposed; -
FIG. 11B is a view for describing a UI for rotation of a display useful for understanding the present invention; -
FIG. 12A is a view for describing an operation of the display apparatus in a case where an image in which blank regions are not included is received in a state where a display is vertically disposed; -
FIG. 12B is a view for describing a UI for rotation of a display useful for understanding the present invention; -
FIG. 13 is a detailed block diagram for describing the display apparatus useful for understanding the present invention; and -
FIG. 14 is a flowchart for describing a control method of a display apparatus useful for understanding the present invention. - First, general terms in this specification and claims are used in consideration of functions, operations, and structures described in the disclosure. However, these terms may vary depending on an intention of those skilled in the art, legal or technical interpretation, the emergence of a new technology, and the like. In addition, some terms are terms arbitrarily selected by an applicant. These terms may be interpreted by the meanings defined herein, and/or may be interpreted based on a general content of the specification and usual technical knowledge in the art as long as they are not specifically defined.
- It is understood that, hereinafter, expressions such as "at least one of," when preceding a list of elements (e.g., "at least one of A and B" or "at least one of A or B"), modify the entire list of elements (i.e., only A, only B, or both A and B) and do not modify the individual elements of the list.
- Also, in describing embodiments, when a detailed description for known functions or configurations related to the disclosure may unnecessarily obscure the gist of the disclosure, the detailed description therefor will be abbreviated or omitted.
- Furthermore, one or more embodiments will hereinafter be described in detail with reference to the accompanying drawings and contents described in the accompanying drawings, but the disclosure is not limited or restricted by these embodiments.
- Hereinafter, one or more embodiments will be described in detail with reference to the accompanying drawings.
-
FIG. 1 is a block diagram for describing adisplay apparatus 100 according to an embodiment. - A
display apparatus 100 according to an embodiment may be a smart television (TV). However, this is only an example, and thedisplay apparatus 100 may be various electronic apparatuses including a display, such as a computer, a laptop computer, a tablet personal computer (PC), a digital camera, a camcorder, a personal digital assistant (PDA), a smartphone, and the like. - Referring to
FIG. 1 , thedisplay apparatus 100 according to an embodiment includes adisplay 110, acommunicator 120, and aprocessor 130. - The
display 110 may display various screens (e.g., simultaneously display various screens on different areas of the display 110). As an example, thedisplay 110 may mirror and display an image that is being displayed on an electronic apparatus. Thedisplay 110 displays an image of a remaining region excluding blank regions in an image for mirroring. - In addition, the
display 110 may display various images such as broadcasting contents, multimedia contents and the like, as well as various user interfaces (UIs) and icons. - The
display 110 can be rotated. In detail, thedisplay 110 may be disposed in a horizontal form or a vertical form according to a user command for rotation. To this end, thedisplay apparatus 100 further includes a driver for rotating thedisplay 110. - The
display 110 may be implemented in various manners, such as a liquid crystal display (LCD) panel, a light emitting diode (LED) display or backlit display, an organic light emitting diode (OLED) display, a liquid crystal on silicon (LCoS) display, a digital light processing (DLP) display, and the like. In addition, thedisplay 110 may also include a driving circuit, a backlight unit, and the like, and may be implemented in a form such as an a-Si thin film transistor (TFT), a low temperature poly silicon (LTPS) TFT, an organic TFT (OTFT), and the like. - In addition, the
display 110 may be implemented by a touch screen by combining with a touch sensor. - The
communicator 120 communicates with the electronic apparatus to transmit and receive various data. For example, thecommunicator 120 may not only perform communication with the electronic apparatus through a local area network (LAN), an Internet network, and a mobile communication network, but may also perform communication with the electronic apparatus through various communication manners such as Bluetooth, Bluetooth Low Energy (BLE), Wireless Fidelity (WI-FI), Zigbee, Near Field Communication (NFC), and the like. - To this end, the
communicator 120 may include various communication modules for performing network communication. For example, thecommunicator 120 may include at least one of a Bluetooth chip, a WI-FI chip, a wireless communication chip, and the like. - Particularly, the
communicator 120 may perform the communication with the electronic apparatus to receive the image for mirroring from the electronic apparatus. Here, the electronic apparatus may be a smartphone, a computer, a laptop computer, or the like, but is not limited thereto. The electronic apparatus may be various electronic apparatuses that may transmit the image that is being displayed on or by the electronic apparatus to thedisplay apparatus 100. - Meanwhile, the
communicator 120 may perform communication with an external apparatus to receive broadcasting contents (or broadcasting signals). Here, the broadcasting contents may include at least one of an image, an audio, or additional data (for example, an electronic program guide (EPG)). To this end, thecommunicator 120 may include a tuner, a demodulator, an equalizer, and the like. - The processor 130 (e.g., at least one processor) controls a general operation of the
display apparatus 100. To this end, theprocessor 130 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). - The
processor 130 may drive an operating system and/or an application program to control hardware and/or software components connected to theprocessor 130, and may perform various types of data processing and calculation. In addition, theprocessor 130 may load and process commands or data received from at least one of other components in a volatile memory, and store various data in a non-volatile memory. - The
processor 130 controls thecommunicator 120 to perform communication connection with the electronic apparatus. In detail, when a user command for the communication connection with the electronic apparatus is received, theprocessor 130 may search for a peripheral electronic apparatus through thecommunicator 120 and control thecommunicator 120 to perform communication connection with the searched for electronic apparatus. Alternatively, when a signal for requesting communication connection from the electronic apparatus is received in a state where thecommunicator 120 is activated, theprocessor 130 may control thecommunicator 120 to perform the communication connection. - In addition, the
processor 130 receives the image for mirroring from the electronic apparatus. In detail, theprocessor 130 may transmit a signal for requesting image transmission to the electronic apparatus when a user command for mirroring is received, and display the received image on thedisplay 110 when the image for mirroring is received from the electronic apparatus. Alternatively, theprocessor 130 may control thecommunicator 120 to receive the image for mirroring and display the image received from the electronic apparatus on thedisplay 110, when a signal for requesting image reception (or when the image itself and/or a control signal instructing image reception for mirroring) is received from the electronic apparatus in a state where the display apparatus is communication-connected to the electronic apparatus through thecommunicator 120. - Here, the image for mirroring, which is an image including contents displayed on a display of the electronic apparatus, may be an image having a resolution according to a Miracast standard.
- For example, in a case where the resolution according to the Miracast standard is 1920 × 1080, the
processor 130 may receive an image for mirroring of which resolution is 1920 × 1080 from the electronic apparatus. - Meanwhile, blank regions are included in the image for mirroring. In detail, blank regions added in a process of converting the resolution of the image according to the Miracast standard may be included in the image for mirroring.
- In a case where an image having resolution of 1080 × 1920 is being displayed on the display of the electronic apparatus, blank regions can be included in a left area and a right area of the image for mirroring. The reason is that in this case, the electronic apparatus adds the blank regions to the left area and the right area of the image to convert the resolution of the image that is being displayed into the resolution according to the Miracast standard and transmits the image to which the blank regions are added as the image for mirroring to the
display apparatus 100. - Then, the
processor 130 displays (i.e., control to display) the image received from the electronic apparatus on thedisplay 110. - In detail, the
processor 130 may display the received image or an image in which the blank regions are excluded from the received image on thedisplay 110 on the basis of a disposition state of thedisplay 110 and whether or not the blank regions for mirroring are included in the image. - For example, in a case where the blank regions for mirroring are not included in the image received from the electronic apparatus, the
processor 130 may display theimages electronic apparatus 200 on thedisplay 110 regardless of whether the disposition state of thedisplay 100 is horizontal or vertical, as illustrated inFIGS. 2 and3 . - The reason is that in a case where the
image 210 in which the blank regions are not included is received in a state where thedisplay 110 is horizontally disposed as illustrated inFIG. 2 , a content that is being displayed on theelectronic apparatus 200 is displayed over an entire region of thedisplay 110 and thus, the image need not be displayed in a state where resolution of the image is converted. Further, in a case where theimage 310 in which the blank regions are not included is received in a state where thedisplay 110 is vertically disposed as illustrated inFIG. 3 , when the image is displayed in a state in which resolution of the image is converted to correspond to resolution or a size of the display 110 (that is, when the image is displayed in a state where it is extended in a vertical direction), the image is unnaturally displayed. - Meanwhile, in a case where the blank regions for mirroring are included in the image received from the
electronic apparatus 200, theprocessor 130 may perform different operations depending on the disposition state of thedisplay 110. - In detail, when an
image 410 for mirroring in which blank regions are included is received from theelectronic apparatus 200 in a state where thedisplay 110 is horizontally disposed as illustrated inFIG. 4 , theprocessor 130 may display theimage 410 for mirroring on thedisplay 110. - The reason is that in a case where the
image 410 for mirroring in which the blank regions are included is received in the state where thedisplay 110 is horizontally disposed as illustrated inFIG. 4 , when the image is displayed in a state in which resolution of the image is converted to correspond to resolution or a size of the display 110 (that is, the image is displayed in a state where it is extended in a horizontal direction), the image is unnaturally displayed. - In addition, when an
image 510 for mirroring in which blank regions are included is received from theelectronic apparatus 200 in a state where thedisplay 110 is vertically disposed as illustrated inFIG. 5 , theprocessor 130 may display an image of a remaining region excluding the blank regions on thedisplay 110, as illustrated inFIG. 6 . Alternatively, theprocessor 130 may display the image in which the blank regions are included on thedisplay 110 and then display an image of a remaining region excluding the blank regions on thedisplay 110 automatically or on the basis of a user command. - In a case where the
image 510 in which the blank regions are included is received in the state where thedisplay 110 is vertically disposed as illustrated inFIG. 5 , it is natural to display the image in a state in which resolution of the image is converted to correspond to the resolution or the size of thedisplay 110. When the image is displayed in this manner, a case where viewing of a user is hindered by the blank regions is prevented. - Hereinafter, an operation of the
processor 130 in the case where theimage 510 in which the blank regions are included is received in the state where thedisplay 110 is vertically disposed as illustrated inFIG. 5 will be described. -
FIGS. 7 to 9 are views for describing an operation of thedisplay apparatus 100 when an image in which blank regions are included is received in a state where a display according to an embodiment is vertically disposed. - When the image for mirroring is received from the
electronic apparatus 200 through thecommunicator 120, theprocessor 130 identifies whether or not the blank regions for mirroring are included in the received image. Here, the blank regions for mirroring may refer to blank regions added to the image for the image to have the resolution according to, by way of example, the Miracast standard. - For example, the
processor 130 identifiesblack regions display 110, as illustrated inFIG. 7 , and identifies that regions corresponding to the black regions are blank regions. Here, theblack regions display 110. However, this is only an example, and theprocessor 130 may identify the blank regions included in the image displayed (or to be displayed) through thedisplay 110 via other methods, such as an edge detection algorithm. - In addition, the
processor 130 crops the image of the remaining region excluding the blank regions in the image for mirroring. In this case, theprocessor 130 crops animage 730 of a remaining region excluding the blank regions in further consideration of information on a pre-stored image ratio for each electronic apparatus. - To this end, the
processor 130 receives recognition information (e.g., identification information) of theelectronic apparatus 200 from theelectronic apparatus 200 through thecommunicator 120. In addition, theprocessor 130 identifies an image ratio corresponding to the recognition information on the basis of information on a pre-stored image ratio for each electronic apparatus. - For example, referring to
FIG. 8 , when it is identified that theelectronic apparatus 200 is a third electronic apparatus on the basis of the recognition information of theelectronic apparatus 200, theprocessor 130 may identify 9:18.5, which is an image ratio corresponding to the third electronic apparatus on the basis of the information on the pre-stored image ratio for each electronic apparatus. In addition, theprocessor 130 may crop an image of a region having an aspect ratio of 9:18.5 on the basis of a central region from the image for mirroring received from theelectronic apparatus 200. - As described above, the
display apparatus 100 according to an embodiment may more accurately crop a region in which a content is included by cropping the image in further consideration of the information on the pre-stored image ratio. - Then, the
processor 130 scales resolution of a croppedimage 910 to correspond to the resolution of thedisplay 110, as illustrated inFIG. 9 . In addition, theprocessor 130 displays animage 920 of which resolution is scaled on thedisplay 110. Therefore, the disclosure can display the image of the remaining region excluding the blank regions over the entire region of thedisplay 110 and prevent a case where watching of the image by the user is hindered due to the blank regions. - Meanwhile, the
processor 130 may not only identify the disposition state of thedisplay 110 on the basis of a ratio of the image that is being displayed on thedisplay 110, but may also identify the disposition state of thedisplay 110 on the basis of state information received for thedisplay 110. Alternatively, thedisplay apparatus 100 according to the disclosure may further include a sensor sensing rotation, such as a gyro sensor or the like, and theprocessor 130 may identify the disposition state of thedisplay 110 on the basis of a state of thedisplay 110 sensed by the sensor. -
FIG. 10 is a view for describing a user interface (UI) for scaling of an image useful for understanding the present invention. - When it is identified that the image in which the blank regions are included is received in a state where the
display 110 is disposed in the vertical direction, theprocessor 130 may display an image of a remaining region excluding the blank regions on thedisplay 110 disposed in the vertical direction. - Meanwhile, such an operation may not only be performed automatically when it is identified that the image in which the blank regions are included is received, but may also be performed on the assumption that a user command selecting a UI for displaying the image of the remaining region excluding the blank regions is received.
- For example, referring to
FIG. 10 , when it is identified that the image in which the blank regions are included is received in the state where thedisplay 110 is disposed in the vertical direction, theprocessor 130 may display a user interface (UI) 1010 (e.g., graphical user interface item, icon, etc.) for displaying the image of the remaining region excluding the blank regions. When a user command for selecting theUI 1010 through a button or the like provided in a remote control apparatus, theelectronic apparatus 200, or thedisplay apparatus 100 is received, theprocessor 130 may display the image of the remaining region excluding the blank regions on thedisplay 110 disposed in the vertical direction. -
FIG. 11A is a view for describing an operation of thedisplay apparatus 100 when an image in which blank regions are included is received in a state where a display is horizontally disposed, andFIG. 11B is a view for describing a UI for rotation of a display. - As described above, in a case where the image in which the blank regions are included is received in a state where the
display 110 is horizontally disposed, theprocessor 130 may display the image for mirroring received from theelectronic apparatus 200 on thedisplay 110. - In this case, the
processor 130 may control thedisplay 110 disposed in the horizontal direction (i.e., in which width is greater than height) to rotate to the vertical direction (i.e., in which height is greater than width) and display the image of the remaining region excluding the blank regions through thedisplay 110 disposed in the vertical direction, as illustrated inFIG. 11A . - In detail, the
processor 130 may identify the blank regions in the image received from theelectronic apparatus 200, crop the image of the remaining region excluding the blank regions, scale resolution of the cropped image to correspond to the resolution of the display disposed in the vertical direction, and then display the cropped image of which resolution is scaled. - Alternatively, the
processor 130 may display aUI 1110 for rotation of thedisplay 110 on one region of thedisplay 110 disposed in the horizontal direction, rotate thedisplay 110 in the vertical direction based on a user command for selecting theUI 1110 being received, and display the image of the remaining region excluding the blank regions from the image received from theelectronic apparatus 200 on thedisplay 110 disposed in the vertical direction, as illustrated inFIG. 11B . - Meanwhile, only the
UI 1110 for rotation is illustrated inFIG. 11B , but theprocessor 130 may further display a message for inducing, inquiring, or requesting feedback from the user to rotate the display, such as "rotate the display in the vertical direction." Therefore, the user may watch the image from which the blank regions are excluded. -
FIG. 12A is a view for describing an operation of thedisplay apparatus 100 when an image in which blank regions are not included is received in a state where a display is vertically disposed, andFIG. 12B is a view for describing a UI for rotation of a display. - As described above, in a case where the blank regions for mirroring are not included in the image received from the
electronic apparatus 200, theprocessor 130 may display theimages electronic apparatus 200 regardless of whether or not the disposition state of thedisplay 110 is horizontal or vertical. - Meanwhile, in a case where the image in which the blank regions are not included is received from the
electronic apparatus 200 in a state where thedisplay 110 is disposed in the vertical direction, as illustrated inFIG. 12A , theprocessor 130 may control thedisplay 110 disposed in the vertical direction to rotate in the horizontal direction, and display the image received from theelectronic apparatus 200 through thedisplay 110 disposed in the horizontal direction. - Alternatively, the
processor 130 may display aUI 1210 for rotation of thedisplay 110 on one region of thedisplay 110 disposed in the vertical direction, rotate thedisplay 110 in the horizontal direction based on a user command for selecting theUI 1210 being received, and display the image received from theelectronic apparatus 200 on thedisplay 110 disposed in the horizontal direction, as illustrated inFIG. 12B . - Meanwhile, only the
UI 1210 for rotation is illustrated inFIG. 12B , but theprocessor 130 may further display a message for inducing, inquiring, or requesting feedback from the user to rotate the display, such as "rotate the display in the horizontal direction." Accordingly, the user may watch the image through an entire screen of thedisplay 110. -
FIG. 13 is a detailed block diagram for describing adisplay apparatus 100 useful for understanding the present invention. - Referring to
FIG. 13 , thedisplay apparatus 100 may include thedisplay 110, thecommunicator 120, astorage 140, amicrophone 150, aspeaker 160, an input 170 (e.g., input unit or inputter), asignal processor 180, and theprocessor 130. A description of portions overlapping or redundant with those described above will be omitted or abbreviated below. - The
storage 140 may store an operating system (OS) for controlling a general operation of components of thedisplay apparatus 100 and commands, instructions, or data related to the components of thedisplay apparatus 100. - Accordingly, the
processor 130 may control a plurality of hardware and/or software components of thedisplay apparatus 100 using various commands, instructions, data or the like stored in thestorage 140, load and process a command, an instruction, or data received from at least one of other components to a volatile memory, and store various data in a non-volatile memory. - Particularly, the
storage 140 may store information on the image ratio and/or the resolution for each of plural electronic apparatuses. - The
microphone 150 receives a user speech. Here, the user speech may be a speech for executing a specific function of thedisplay apparatus 100. When the user speech is received through themicrophone 150, theprocessor 130 may analyze the user speech through a speech to text (STT) algorithm, and perform a function corresponding to the user speech. - The
speaker 160 may output various audio signals. For example, thespeaker 160 may output an audio signal in a case of displaying the image of the remaining region excluding the blank regions in the image for mirroring or in a case of rotating thedisplay 110. - The
input 170 may receive various user commands. Theprocessor 130 may execute a function corresponding to a user command input through theinput 170. - For example, the
input 170 may receive a user command for displaying the image of the remaining region excluding the blank regions in the image for mirroring, and theprocessor 130 may display the image of the remaining region excluding the blank regions on thedisplay 110 according to a user input. In addition, theinput 170 may receive a user command for performing turn-on, channel change, volume adjustment, or the like, and theprocessor 130 may turn on thedisplay apparatus 100 or perform the channel change, the volume adjustment, or the like depending on the received user command. - To this end, the
input 170 may be implemented by an input panel. The input panel may be implemented by a touch pad or a key pad including various functional keys, numeric keys, special keys, character keys, and the like, or in a touch screen manner. - The
signal processor 180 may perform signal processing on a content received through thecommunicator 120. In detail, thesignal processor 180 may perform operations such as decoding, scaling, frame rate conversion, and the like, on an image configuring the content to make, render, or reproduce the image a form in which the image may be output from thedisplay apparatus 100. In addition, thesignal processor 180 may perform signal processing such as decoding or the like on an audio signal configuring the content to make the audio signal in a form in which the audio signal may be output from thespeaker 160. - Accordingly, the
display 110 may display the image or the like output from thesignal processor 180, and thespeaker 160 may output the audio output from thesignal processor 180. - Meanwhile, the
display apparatus 100 may further include a motor for rotating thedisplay 110. When (e.g., based on) a user command for rotation of thedisplay 110 is received, theprocessor 130 may transmit a control signal to the motor to rotate thedisplay 110. -
FIG. 14 is a flowchart for describing a control method of a display apparatus useful for understanding the present invention. - The
display apparatus 100 may receive the image for mirroring from the electronic apparatus (S1410). Here, the content that is being displayed on theelectronic apparatus 200 and the blank regions may be included in the image for mirroring. In detail, theelectronic apparatus 200 may transmit an image in which the blank regions are inserted into the left and right of a region corresponding to the content that is being displayed on theelectronic apparatus 200 on the basis of the Miracast standard to thedisplay apparatus 100. - In addition, the
display apparatus 100 may identify whether or not the blank regions for mirroring are included in the image received from the electronic apparatus 200 (S1420). For example, thedisplay apparatus 100 may confirm the black regions on the basis of pixel values of the display apparatus and identify that the regions corresponding to the black regions are the blank regions. - Furthermore, when it is identified that the image in which the blank regions are included is received in a state where the
display 110 is disposed in a predetermined direction, thedisplay apparatus 100 may display the image of the remaining region excluding the blank region in the received image on thedisplay 110 disposed in the predetermined direction (S1430). - Therefore, the
display apparatus 100 may display the content that is being displayed on theelectronic apparatus 200 over the entire region of thedisplay 100 to increase an immersion level of the watching of the image by the user. - Meanwhile, an example of a case where the blank regions are inserted into the left and right of the region corresponding to the content that is being displayed on the
electronic apparatus 200 has been described hereinabove. It is understood, however, that one or more other embodiments are not limited thereto, and the technical spirit described above may also be applied to a case where the blank regions are inserted into the top and bottom or the top and bottom and the left and right of the region corresponding to the content that is being displayed on theelectronic apparatus 200. - Also, methods according to one or more embodiments described above may be implemented in a form of software and/or an application that may be installed in a display apparatus.
- Furthermore, methods according to one or more embodiments described above may be implemented by software upgrade or hardware upgrade for a display apparatus.
- In addition, one or more embodiments described above may also be performed through an embedded server provided in the display apparatus or a server disposed outside the display apparatus.
- Meanwhile, a non-transitory computer readable medium storing a program or instructions sequentially or at least partially simultaneously performing a control method of a display apparatus according to one or more embodiments may be provided.
- The non-transitory computer readable medium may be a medium that semi-permanently stores data and is readable by an apparatus. In detail, various applications, programs, and/or processor-executable instructions described above may be stored and provided in the non-transitory computer readable medium such as a compact disk (CD), a digital versatile disk (DVD), a hard disk, a Blu-ray disk, a universal serial bus (USB), a memory card, a read only memory (ROM), or the like.
- Although certain embodiments have been illustrated and described hereinabove, the disclosure is not limited to these embodiments, but may be variously modified by those skilled in the art to which the disclosure pertains without departing from the scope of the disclosure as claimed in the claims. These modifications should also be understood to fall within the technical scope of the disclosure.
Claims (2)
- A display apparatus (100) configured to rotate a display (110) between a horizontal landscape direction and a vertical portrait direction, the display apparatus comprises:the display (110);a driver for rotating the display (110) of the display apparatus (100) between the horizontal landscape direction and the vertical portrait direction;a communicator (120) comprising circuitry connectable with an electronic apparatus (200);a processor (130) configured to, when the electronic apparatus is connected to the display apparatus:receive an image from the connected electronic apparatus, which received image includes blank regions;identify black regions in the received image and determine that regions corresponding to the black regions are blank regions by analyzing a color value of the image or using an edge detection algorithm;obtain, from the electronic apparatus (200), identification information of the electronic apparatus and identify an image ratio corresponding to the identification information based on pre-stored information on image ratios for each of plural external electronic apparatuses,crop, based on the identified image ratio, a remaining region obtained from the received image by excluding the blank regions from the received image, andscale a resolution of the cropped image to correspond to a resolution of the display.
- A control method of the display apparatus (100) of claim 1, the control method comprising, by the display apparatus, when connected to an electronic apparatus:receiving an image for mirroring from the electronic apparatus (200);identifying black regions in the received image and determine that regions corresponding to the black regions are blank regions by analyzing a color value of the image or using an edge detection algorithm;receiving, from the electronic apparatus (200), identification information of the electronic apparatus;identifying an image ratio corresponding to the identification information based on pre-stored information on image ratios for each plural external electronic apparatuses;cropping, based on the identified image ratio, a remaining region obtained from the received image by excluding the blank regions from the received image;scaling a resolution of the cropped image to correspond to a resolution of the display.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020190033825A KR102607214B1 (en) | 2019-03-25 | 2019-03-25 | Display apparatus and the control method thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3716036A1 EP3716036A1 (en) | 2020-09-30 |
EP3716036B1 true EP3716036B1 (en) | 2024-10-30 |
Family
ID=68158891
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19200576.7A Active EP3716036B1 (en) | 2019-03-25 | 2019-09-30 | Display apparatus and control method thereof |
Country Status (5)
Country | Link |
---|---|
US (1) | US10949160B2 (en) |
EP (1) | EP3716036B1 (en) |
KR (1) | KR102607214B1 (en) |
CN (1) | CN111741357B (en) |
WO (1) | WO2020197012A1 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114489529A (en) * | 2020-10-23 | 2022-05-13 | 华为技术有限公司 | Screen projection method of electronic device, medium thereof and electronic device |
WO2022108110A1 (en) * | 2020-11-17 | 2022-05-27 | 삼성전자 주식회사 | Electronic device comprising flexible display and operating method thereof |
CN112565839B (en) * | 2020-11-23 | 2022-11-29 | 青岛海信传媒网络技术有限公司 | Display method and display device of screen projection image |
CN112565861A (en) * | 2020-11-23 | 2021-03-26 | 青岛海信传媒网络技术有限公司 | Display device |
JP2022098948A (en) * | 2020-12-22 | 2022-07-04 | 富士フイルムビジネスイノベーション株式会社 | Information processing device and program |
KR102694587B1 (en) * | 2021-11-24 | 2024-08-12 | (주)유브릿지 | Terminal device that supports optimal control of app screen resolution and a method for controlling the same |
US11893303B2 (en) | 2021-11-30 | 2024-02-06 | Samsung Electronics Co., Ltd. | Device and method for performing mirroring |
US20250014537A1 (en) * | 2023-07-06 | 2025-01-09 | Baker Hughes Holdings Llc | Automated scaling and display parameters |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140333671A1 (en) * | 2013-05-10 | 2014-11-13 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
EP3190786A2 (en) * | 2016-01-11 | 2017-07-12 | Lg Electronics Inc. | Image display apparatus |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2612044B2 (en) | 1988-07-21 | 1997-05-21 | 株式会社日立製作所 | Electronic file device |
KR100867131B1 (en) | 2006-11-10 | 2008-11-06 | 삼성전자주식회사 | Image output device and method of portable terminal |
CN103003869B (en) * | 2010-07-05 | 2015-04-15 | 富士通株式会社 | Display control device and method |
CN102377960B (en) * | 2010-08-24 | 2014-11-05 | 腾讯科技(深圳)有限公司 | Video picture displaying method and device |
JP2012054682A (en) * | 2010-08-31 | 2012-03-15 | Sony Corp | Image processing system and image processing method |
US8963799B2 (en) | 2011-01-11 | 2015-02-24 | Apple Inc. | Mirroring graphics content to an external display |
WO2013085546A1 (en) | 2011-12-09 | 2013-06-13 | Hewlett-Packard Development Company, Lp | Modification of images based on orientation |
US9632648B2 (en) | 2012-07-06 | 2017-04-25 | Lg Electronics Inc. | Mobile terminal, image display device and user interface provision method using the same |
JP5929719B2 (en) * | 2012-11-12 | 2016-06-08 | ソニー株式会社 | Information processing apparatus, communication system, and information processing method |
JP2014232228A (en) | 2013-05-29 | 2014-12-11 | ソニー株式会社 | Information processing unit and information processing system |
KR102345610B1 (en) | 2015-02-27 | 2021-12-30 | 삼성전자주식회사 | Apparatus and method for providing of screen mirroring service |
KR20170000714A (en) | 2015-06-24 | 2017-01-03 | 엘지전자 주식회사 | Video display device and operating method thereof |
US20170237986A1 (en) | 2016-02-11 | 2017-08-17 | Samsung Electronics Co., Ltd. | Video encoding method and electronic device adapted thereto |
KR102496225B1 (en) | 2016-02-11 | 2023-02-07 | 삼성전자 주식회사 | Method for video encoding and electronic device supporting the same |
KR102442527B1 (en) * | 2016-02-26 | 2022-09-13 | 엘지전자 주식회사 | wireless device |
KR102614044B1 (en) * | 2016-09-01 | 2023-12-15 | 삼성전자 주식회사 | Method and apparatus for providing miracast |
KR20180035434A (en) * | 2016-09-29 | 2018-04-06 | 삼성전자주식회사 | Display apparatus and controlling method thereof |
KR102623181B1 (en) * | 2016-10-05 | 2024-01-11 | 엘지전자 주식회사 | Wireless device and wireless system |
KR102379066B1 (en) * | 2016-11-21 | 2022-03-25 | 삼성전자주식회사 | Rotatable display apparatus and method of displaying contents |
KR102341301B1 (en) * | 2017-03-27 | 2021-12-20 | 삼성전자 주식회사 | electronic device and method for sharing screen |
CN109192113B (en) * | 2018-06-29 | 2021-12-03 | 努比亚技术有限公司 | Terminal display method, terminal and computer readable storage medium |
-
2019
- 2019-03-25 KR KR1020190033825A patent/KR102607214B1/en active Active
- 2019-09-30 EP EP19200576.7A patent/EP3716036B1/en active Active
- 2019-09-30 US US16/588,128 patent/US10949160B2/en active Active
- 2019-09-30 WO PCT/KR2019/012695 patent/WO2020197012A1/en active Application Filing
- 2019-09-30 CN CN201910940248.9A patent/CN111741357B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140333671A1 (en) * | 2013-05-10 | 2014-11-13 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
EP3190786A2 (en) * | 2016-01-11 | 2017-07-12 | Lg Electronics Inc. | Image display apparatus |
Also Published As
Publication number | Publication date |
---|---|
KR20200113521A (en) | 2020-10-07 |
WO2020197012A1 (en) | 2020-10-01 |
EP3716036A1 (en) | 2020-09-30 |
US10949160B2 (en) | 2021-03-16 |
CN111741357B (en) | 2025-04-25 |
CN111741357A (en) | 2020-10-02 |
US20200310738A1 (en) | 2020-10-01 |
KR102607214B1 (en) | 2023-11-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3716036B1 (en) | Display apparatus and control method thereof | |
US8953099B2 (en) | Display apparatus, remote control apparatus, and method for providing user interface using the same | |
EP3745729B1 (en) | Electronic device and method for controlling the same | |
KR102242407B1 (en) | Display apparatus and the control method thereof | |
US20070008338A1 (en) | Display system, display apparatus, and method of controlling video source and display apparatus | |
US11189184B2 (en) | Display apparatus and controlling method thereof | |
US20150088669A1 (en) | Apparatus and method for providing responsive user interface and electronic device-readable recording medium therefor | |
US10191712B2 (en) | Display apparatus and recording medium | |
US20230350627A1 (en) | Display device and control method for same | |
EP3038374A1 (en) | Display device and display method | |
KR20170117843A (en) | Multi screen providing method and apparatus thereof | |
US20140160305A1 (en) | Information processing apparatus, information processing method, output apparatus, output method, program, and information processing system | |
KR20170092790A (en) | Display apparatus, user terminal apparatus, system and the controlling method | |
KR101609280B1 (en) | Dispaly apparatus and controlling method thereof | |
CN104423834A (en) | User terminal and control method thereof | |
US20140189600A1 (en) | Display apparatus and method for controlling display apparatus thereof | |
WO2022193475A1 (en) | Display device, method for receiving screen projection content, and screen projection method | |
EP3691308B1 (en) | Electronic apparatus and control method for initial setup of setup language | |
TWI493443B (en) | Electronic device and method for displaying the same | |
US11930237B2 (en) | Display apparatus, method for UI display thereof and computer-readable recording medium | |
US20200413150A1 (en) | Display apparatus and the controlling method thereof | |
EP2887331B1 (en) | Content reproduction control device, content reproducing system, content reproducing method, and content reproducing program | |
CN103838514A (en) | Electronic device and method for displaying application program thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200820 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20211008 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20240513 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602019061060 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20241030 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250228 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20241030 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20241030 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20241030 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1737554 Country of ref document: AT Kind code of ref document: T Effective date: 20241030 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20241030 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20241030 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250130 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20241030 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20241030 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250131 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20241030 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20250130 |