US9026034B2

US9026034B2 - Automatic detection of broadcast programming

Info

Publication number: US9026034B2
Application number: US13/100,900
Authority: US
Inventors: Kai Buehler; Frederik Juergen Fleck
Original assignee: PROJECT ODA Inc
Current assignee: Perk com US Inc
Priority date: 2010-05-04
Filing date: 2011-05-04
Publication date: 2015-05-05
Also published as: US20110275311A1; US20110275312A1; US9020415B2; US20110276882A1

Abstract

According to one aspect, embodiments of the invention provide a method for the detection of broadcast programming, the method comprising acts of receiving audio signals from a user over a communication network, receiving audio signals from a plurality of broadcast channels over the communication network, comparing, by a processor, the audio signals from the user with the audio signals from the plurality of broadcast channels, determining by the processor, in response to the act of comparing, that the audio signals from the user match the audio signals from at least one of the plurality of broadcast channels, identifying by the processor, in response to the act of determining, the at least one of the plurality of broadcast channels, and transmitting by the processor, in response to the act of identifying, information related to the at least one of the plurality of broadcast channels to the user.

Description

RELATED APPLICATIONS

This application claims priority under 35 U.S.C. §119(e) to U.S. Provisional Application No. 61/331,195 entitled “BONUS AND EXPERIENCE ENHANCEMENT SYSTEM FOR RECEIVERS OF BROADCAST MEDIA”, filed on May 4, 2010, U.S. Provisional Application No. 61/332,587 entitled “AUTOMATIC DETECTION OF BROADCAST PROGRAMMING”, filed on May 7, 2010, U.S. Provisional Application No. 61/347,737 entitled “AUTOMATIC GROUPING FOR USERS EXPERIENCING A SPECIFIC BROADCAST MEDIA”, filed on May 24, 2010, and U.S. Provisional Application No. 61/360,840 entitled “SYSTEM FOR PROVIDING SERVICES TO A USER ASSOCIATED WITH A BROADCAST TELEVISION OR RADIO SHOW BEING EXPERIENCED BY THE USER”, filed on Jul. 1, 2010, each of which is incorporated by reference herein in its entirety.

BACKGROUND OF THE DISCLOSURE

1. Field of the Invention

Aspects of the present invention relate to a system and method for interacting with broadcast media.

2. Discussion of Related Art

Consumers of broadcast media (e.g., radio and television broadcasts) typically receive broadcast media passively through a receiver (e.g., a radio or television). For example, an individual listening to a radio or watching a television may listen to and/or watch broadcast media signals passively received by the radio or television over a selected channel. Despite various advancements in broadcasting equipment, current systems are generally not interactive with respect to the media being broadcast.

SUMMARY

According to one aspect of the present invention, it is appreciated that in traditional broadcasting systems, individuals are unable to interact with the received broadcast media. Alternatively, with internet enabled devices (e.g., computers, cell phones, laptops, etc.), a user may be able to specifically select desired media content which the user wishes to view (rather than merely a desired channel) and may also directly interact with selected media content via the internet enabled device. However, a problem exists whereby even though both broadcast media receivers and internet enabled devices are commonly utilized today, individual broadcast media receivers and internet enabled devices are not directly linked to allow for interaction between the receivers and devices to provide the user with benefits of both types of systems.

Also, in addition to users not being able to directly interact with the broadcast media, television and radio broadcast providers are also typically unable to directly interact with the users. For example, in conventional broadcast media reward-based systems, a user is typically rewarded for taking a specific defined action (e.g., logging in or “checking in”). However, in such systems, there is no way for the broadcast provider to confirm that the user is actually viewing or listening to the required program. The broadcast provider must take the word of the user. In addition, in such systems, the user must take an additional intermediary step (e.g., “checking-in”) to be rewarded. In this way, merely viewing or listening to a program is not typically enough to receive rewards.

In another example, in conventional broadcast media related chat groups, it is a common problem that a chat group may become overcrowded because of the large number of people who view broadcast programming and wish to discuss it with others. For instance, too many users who are viewing the same program may be in the same chat room, making meaningful discussion difficult. For example, due to a large number of posters, a post of a single user may not remain visible long enough for it to be read in detail.

According to one aspect the present invention features a method for awarding incentives, the method comprising receiving, via a first interface of a server, audio signals from a user over a communication network, receiving, via a second interface of the server, audio signals from a plurality of broadcast channels over the communication network, comparing, by a processor in the server, the audio signals received from the user and the audio signals received from the plurality of broadcast channels, determining, by the processor, based on the act of comparing, that the audio signals from the user correspond to a program currently being broadcast on one of the plurality of broadcast channels, and in response to the act of determining, automatically awarding, by the processor, the user at least one incentive.

According to one embodiment, the method further comprises tracking, based on the act of determining, a program history of the user. In one embodiment, the method further comprises generating, based on the act of tracking, a program history profile corresponding to the user. In another embodiment, the act of awarding further comprises awarding incentives to the user based on the user's program history profile.

According to another embodiment, the method further comprises awarding, by the processor, bonus incentives to the user in response to the user interacting with the program currently being broadcast. In one embodiment, the act of awarding bonus incentives includes awarding bonus incentives to the user in response to the user participating in a chat related to the program currently being broadcast. In another embodiment, the act of awarding bonus incentives includes awarding bonus incentives to the user in response to the user making a comment in a social media network related to the program currently being broadcast. In one embodiment, the act of awarding bonus incentives includes awarding bonus incentives to the user in response to the user participating in a poll related to the program currently being broadcast.

According to another aspect, the present invention features a system for awarding incentives, the system comprising a server comprising, a first interface configured to be coupled to a communication network and to receive audio signals from a user over the communication network, a second interface configured to be coupled to the communication network and to receive audio signals from a plurality of broadcast channels over the communication network, and a processor coupled to the first interface and the second interface, wherein the processor is configured to associate the audio signals from the user with a program currently being broadcast on one of the plurality of broadcast channels and in response, automatically award at least one incentive to the user.

According to one embodiment, the at least one incentive is at least one reward point capable of being redeemed by the user towards an award. In another embodiment, the processor is further configured to automatically track an amount of time that the first interface is receiving audio signals from the user associated with the program currently being broadcast and to automatically award a corresponding incentive to the user in response to the amount of time. In one embodiment, the processor is further configured to award at least one incentive to the user in response to the user interacting with the program currently being broadcast.

According to one embodiment, the system further comprises a data storage coupled to the processor, the data storage configured to maintain a database including a profile associated with the user, wherein the profile includes a program history associated with the user. In one embodiment, the profile also includes incentive information related to the user.

According to one aspect, the present invention features a computer readable medium comprising computer-executable instructions that when executed on a processor performs a method for awarding incentives, the method comprising acts of receiving, via a first interface of a server, audio signals from a user over a communication network, receiving, via a second interface of the server, audio signals from a plurality of broadcast channels over the communication network, comparing, by a processor in the server, the audio signals received from the user and the audio signals received from the plurality of broadcast channels, determining, by the processor, based on the act of comparing, that the audio signals from the user correspond to a program currently being broadcast on one of the plurality of broadcast channels, and in response to the act of determining, automatically awarding, by the processor, the user at least one incentive.

According to one embodiment, the method further comprises tracking, based on the act of determining, a program history of the user. In another embodiment, the method further comprises generating, based on the act of tracking, a program history profile corresponding to the user. In one embodiment, the act of awarding further comprises awarding incentives to the user based on the user's program history profile.

According to another embodiment, the method further comprises awarding bonus incentives to the user in response to the user interacting with the program currently being broadcast. In one embodiment, the act of awarding bonus incentives includes awarding bonus incentives to the user in response to an amount time that the first interface is receiving audio signals from the user corresponding to the program currently being broadcast.

According to another aspect, the present invention features a method for the detection of broadcast programming, the method comprising acts of receiving, via a first interface of a server, audio signals from a user over a communication network, receiving, via a second interface of the server, audio signals from a plurality of broadcast channels over the communication network, comparing, by a processor in the server, the audio signals from the user with the audio signals from the plurality of broadcast channels, determining by the processor, in response to the act of comparing, that the audio signals from the user match the audio signals from at least one of the plurality of broadcast channels, identifying by the processor, in response to the act of determining, the at least one of the plurality of broadcast channels, and transmitting by the processor, in response to the act of identifying, information related to the at least one of the plurality of broadcast channels to the user.

According to one embodiment, the act of receiving audio signals from the user includes an act of receiving audio signals from a computer system associated with the user, the computer system being located proximate a receiver of the at least one of the plurality of broadcast channels.

According to another embodiment, the act of comparing includes an act of comparing the audio signals from the user with the audio signals from the plurality of broadcast channels using a comparison technique selected from a group comprising signal cross-correlation, fingerprinting, thumbprinting, and hashing.

According to one embodiment, the acts of comparing, determining and identifying are performed automatically in response to the act of receiving audio signals from the user. In one embodiment, the acts of comparing, determining and identifying are performed absent an intermediary action by the user.

According to another embodiment, the method further comprises acts of receiving, by the processor, schedule information related to the at least one of the plurality of broadcast channels, and identifying by the processor, in response to the act of receiving schedule information, a program corresponding to the audio signals received from the user.

According to one embodiment, the method further comprises an act of providing, by the processor, program specific content to the user in response to the act of identifying. In one embodiment, the act of providing program specific content includes providing an interface that includes information corresponding to the program, the information selected from a group comprising a poll, a chat group, and incentive information.

According to another embodiment, the method further comprises acts of tracking by the processor, based on the act of identifying a program, a program history of the user, and generating by the processor, based on the act of tracking, a program history profile corresponding to the user. In one embodiment, the method further comprises an act of providing, by the processor, program specific content to the user based on the program history profile.

According to another aspect, the present invention features a system for the detection of broadcast programming, the system comprising a server comprising a first interface configured to be coupled to a communication network and to receive audio signals from a user over the communication network, a second interface configured to be coupled to the communication network and to receive audio signals from a plurality of broadcast channels over the communication network, and a processor coupled to the first interface and the second interface, wherein the processor is configured to match the audio signals received from the user with the audio signals received from at least one of the plurality of broadcast channels, identify the at least one of the plurality of broadcast channels, and transmit identification information related to the at least one of the plurality of broadcast channels to the user.

According to one embodiment, the processor is further configured to automatically match the audio signals received from the user with the audio signals received from the at least one of the plurality of broadcast channels in response to receiving audio signals from the user. In one embodiment, the processor is further configured to automatically identify the at least one of the plurality of broadcast channels absent an intermediary action by the user.

According to another embodiment, the processor is further configured to be coupled to a schedule module and to receive schedule information from the schedule module related to the at least one of the plurality of broadcast channels and in response, identify a program corresponding to the audio signals received from the user. In one embodiment, the processor is further configured to provide program specific content to the user in response to identifying the program.

According to one embodiment, the processor is further configured to provide a chat interface to the user that corresponds to the program. In one embodiment, the processor is further configured to be coupled to a reward engine and to provide an incentive to the user that corresponds to the program. In another embodiment, the processor is further configured to be coupled to a recommendation engine and to provide recommended content to the user that corresponds to the program.

According to one aspect, the present invention features a computer readable medium comprising computer-executable instructions that when executed on a processor performs a method for the detection of broadcast programming, the method comprising acts of receiving, via a first interface of a server, audio signals from a user over a communication network, receiving, via a second interface of the server, audio signals from a plurality of broadcast channels over the communication network, comparing, by a processor in the server, the audio signals from the user with the audio signals from the plurality of broadcast channels, determining by the processor, in response to the act of comparing, that the audio signals from the user match the audio signals from at least one of the plurality of broadcast channels, identifying by the processor, in response to the act of determining, the at least one of the plurality of broadcast channels, and transmitting by the processor, in response to the act of identifying, information related to the at least one of the plurality of broadcast channels to the user.

According to one embodiment, the acts of comparing, determining and identifying are performed automatically in response to the act of receiving audio signals from the user. In one embodiment, the method further comprises acts of, receiving, by the processor, schedule information related to the at least one of the plurality of broadcast channels, and identifying by the processor, in response to the act of receiving schedule information, a program corresponding to the audio signals received from the user. In another embodiment, the method further comprises an act of providing, by the processor, program specific content to the user in response to the act of identifying a program.

According to another aspect, the present invention features a method for grouping chat users, the method comprising acts of receiving, via a first interface of a server, audio signals from a user over a communication network, receiving, via a second interface of the server, audio signals from a plurality of broadcast channels over the communication network, comparing, by a processor in the server, the audio signals received from the user and the audio signals received from the plurality of broadcast channels, determining, by the processor, based on the act of comparing, that the audio signals from the user correspond to a program currently being broadcast on one of the plurality of broadcast channels, and grouping, by the processor, the user into a chat group based on at least one grouping criteria, the at least one grouping criteria including the program currently being broadcast.

According to one embodiment, the method further comprises an act of determining, by the processor, a location of the user, wherein the at least one grouping criteria includes the location of the user. In another embodiment, the method further comprises an act of extracting social media information from a social media network account of the user, wherein the at least one grouping criteria includes the social media information. In one embodiment, the act of grouping is performed automatically in response to the act of receiving audio signals from the user.

According to another embodiment, the method further comprises an act of tracking by the processor, based on the act of determining, a program history of the user. In one embodiment, the method further comprises an act of generating by the processor, based on the act of tracking, a program history profile corresponding to the user. In another embodiment, the at least one grouping criteria includes information extracted from the program history profile.

According to one embodiment, the at least one grouping criteria includes size of the chat group. In one embodiment, the method further comprises an act of determining the size of the chat group to maintain a desired time limit between comments within the chat group.

According to one aspect, the present invention features a system for grouping chat users, the system comprising a server comprising a first interface coupled to a communication network and configured to receive audio signals from a user over the communication network, a second interface coupled to the communication network and configured to receive audio signals from a plurality of broadcast channels over the communication network, and a processor coupled to the first interface and the second interface, wherein the processor is configured to associate the audio signals from the user with a program currently being broadcast on one of the plurality of broadcast channels, and group the user into a chat group based on a grouping framework stored in the processor, the grouping framework including the program currently being broadcast.

According to one embodiment, the processor is configured to be coupled to an internet enabled device having an IP address, and to determine a location of the user based on the IP address, and wherein the grouping framework includes the location of the user. In one embodiment, the processor is configured to be coupled to a social media network, and to extract a friend network from a social media network account of the user, and wherein the grouping framework includes the social media information. In another embodiment, the processor is configured to group the user into the chat group automatically in response to receiving audio signals from the user.

According to another embodiment, the processor is further configured to track a program history of the user. In one embodiment, the processor is further configured to generate a program history profile corresponding to the user.

According to one embodiment, the grouping framework includes information extracted from the program history profile. In one embodiment, the grouping framework includes size of the chat group.

According to another aspect, the present invention features a computer readable medium comprising computer-executable instructions that when executed on a processor performs a method for grouping chat users, the method comprising acts of receiving, via a first interface of a server, audio signals from a user over a communication network, receiving, via a second interface of the server, audio signals from a plurality of broadcast channels over the communication network, comparing, by a processor, the audio signals received from the user and the audio signals received from the plurality of broadcast channels, determining, by the processor, based on the act of comparing, that the audio signals from the user correspond to a program currently being broadcast on one of the plurality of broadcast channels, and grouping, by the processor, the user into a chat group based on at least one grouping criteria, the at least one grouping criteria including the program currently being broadcast.

According to one embodiment, the act of grouping includes an act of grouping the user into a chat group based on at least one grouping criteria selected from a group comprising a location of the user, social media information related to the user, a viewing history of the user and size of the chat group. In another embodiment, the act of grouping is performed automatically in response to the act of receiving audio signals from the user.

BRIEF DESCRIPTION OF DRAWINGS

The accompanying drawings are not intended to be drawn to scale. In the drawings, each identical or nearly identical component that is illustrated in various FIGS. is represented by a like numeral. For purposes of clarity, not every component may be labeled in every drawing. In the drawings:

FIG. 1 is a block diagram of a television audio synchronization system in accordance with one embodiment of the present invention;

FIG. 2 is a block diagram illustrating an Application Programming Interface (API) in accordance with one embodiment of the present invention;

FIG. 3 is a graph illustrating signal cross-correlation in accordance with one embodiment of the present invention;

FIG. 4 is a flow chart of a process for the automatic detection of broadcast programming in accordance with one embodiment of the present invention;

FIG. 5 is a block diagram of a system architecture in accordance with one embodiment of the present invention;

FIG. 6A is a block diagram of a first scenario in which specific content or functionality is provided to a user in accordance with one embodiment of the present invention;

FIG. 6B is a block diagram of a second scenario in which specific content or functionality is provided to a user in accordance with one embodiment of the present invention;

FIG. 6C is a block diagram of a third scenario in which specific content or functionality is provided to a user in accordance with one embodiment of the present invention;

FIG. 6D is a block diagram of a fourth scenario in which specific content or functionality is provided to a user in accordance with one embodiment of the present invention;

FIG. 6E is a block diagram of a fifth scenario in which specific content or functionality is provided to a user in accordance with one embodiment of the present invention;

FIG. 6F is a block diagram of a sixth scenario in which specific content or functionality is provided to a user in accordance with one embodiment of the present invention;

FIG. 7 is a flow chart of an auto-grouping process in accordance with one embodiment of the present invention.

FIG. 8 is a block diagram of a general-purpose computer system upon which various embodiments of the invention may be implemented; and

FIG. 9 is a block diagram of a computer data storage system with which various embodiments of the invention may be practiced

DETAILED DESCRIPTION

Embodiments of the invention are not limited to the details of construction and the arrangement of components set forth in the following description or illustrated in the drawings. Embodiments of the invention are capable of being practiced or of being carried out in various ways. Also, the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having,” “containing”, “involving”, and variations thereof herein, is meant to encompass the items listed thereafter and equivalents thereof as well as additional items.

As described above, individual broadcast media receivers and internet enabled devices are not directly linked. As a result, users are unable to directly interact with received broadcast media. Common applications may allow for a user to indirectly interact with received broadcast media; however, such applications require an intermediary action by a user of the broadcast media receiver and internet enabled device. For example, while viewing or listening to broadcast media via a broadcast media receiver, a typical application on an internet enabled device (e.g., a cell phone or computer) may allow a user to log in and identify (i.e. “checking-in”) what broadcast media they are currently viewing or listening to. In response to the identification provided by the user, the application may provide additional options, such as allowing the user to chat with other people viewing or listening to the same broadcast media, providing the user an opportunity to vote in a poll related to the broadcast media, or allowing the user to gain bonus, experience or reward points for “checking in” and/or participating in a poll.

However, in requiring the user of the broadcast media receiver and internet enabled device to take the extra intermediary step of “checking in”, the broadcast media receiver and the internet enabled device are not directly linked. Thus, the information provided by the user to the internet enabled device may not be entirely accurate. For example, after a user has already “checked in” in relation to a certain program; a user may begin viewing or listening to a different program (e.g., by turning the channel of the broadcast media receiver). If the user fails to update the application on the internet enabled device to reflect the new program, the application on the internet enabled device will still think the user is watching or listening to the old program and will continue to provide information related to that program. Also, if reward points are being offered by the application for viewing a specific program, a dishonest user may “check-in” to a program they are not actually viewing or listening to in an effort to gain the reward points. Because of the indirect nature of the connection between the broadcast media receiver and the internet enabled device, there is no way for the application on the internet enabled device to confirm that the user is actually watching or listening to the reward giving program.

Also, in addition to users not being able to directly interact with the broadcast media, television and radio broadcasters are unable to directly interact with the users. Traditionally, television and radio broadcasters have a uni-directional relationship with their viewers. For example, while broadcasting television or radio signals to a user, television and radio broadcasters are unable to directly track how many people are watching/listening to their broadcast media. As such, television and radio broadcasters typically rely on diaries and surveys to determine how many people are watching/listening to their programming. However, diaries and surveys suffer from a number of problems. For example, diaries and surveys are not able to offer real time feedback and are only as reliable as a consumer's memory. An alternative may be the use of a set meter for measuring viewer or listener behavior. However, despite being more accurate than the diaries and surveys, the set meters still do not offer real-time feedback and typically report overall viewing for a period of time (e.g., a 24 hour period of time).

As such, the current invention provides a system and method for automatically detecting and identifying, with an internet enabled device, broadcast media being viewed or listened to by a user and for allowing the user to directly interact with the received broadcast media via the internet enabled device.

One example of a system 100 for automatically detecting and identifying broadcast media in accordance with aspects of the current invention is shown in FIG. 1. The system 100 includes a broadcast media receiver 102. The broadcast media receiver 102 is coupled to a broadcast media network through a wired or wireless connection and is configured to receive broadcast media signals from the broadcast media network. As shown in FIG. 1, the broadcast media receiver 102 is a television. However, according to other embodiments, the broadcast media receiver 102 may be any device capable of receiving broadcast media signals (e.g., a radio, a digital cable television receiver, an analog cable television receiver, a satellite television receiver etc.).

The system 100 also includes an internet enabled device 104. As shown in FIG. 1, an internet enabled device 104 may include a mobile phone (e.g., a smart phone) or a computer (e.g., a laptop computer, personal computer or tablet computer). According to other embodiments, the internet enabled device 104 may be any internet capable device that includes a microphone. The internet enabled device 104 is located proximate the broadcast media receiver 102 to receive audio signals 103 projected by the broadcast media receiver 102 in response to broadcast media signals received over the broadcast media network. The internet enabled device 104 is also coupled to an external network 105 (e.g., the internet) via a wired or wireless connection.

The system 100 also includes a matching server 106. The matching server 106 is also coupled to the external network 105, via a wired or wired connection, and is configured to communicate with an internet enabled device 104 over the external network. From the external network 105, the matching server 106 receives audio streams of the audio signals received by the internet enabled device 104, via a first interface, and also audio streams 108 of broadcast media from one or more known broadcast channels (e.g., known radio or television stations), via a second interface.

The matching server 106 compares the audio stream from the internet enabled device 104 with audio streams from the known broadcast channels, matches the audio stream from the internet enabled device 104 with audio streams 108 from the known broadcast channels and automatically identifies the broadcast media that the user is viewing or listening too. Based on this matching, the server 106 provides to the user, via the internet enabled device 104, one or more features and/or functionality that correspond to the detected broadcast, allowing the user to directly interact with the detected broadcast. The interaction between the internet enabled device 104 and the matching server 106 will now be described in greater detail with relation to FIG. 2.

FIG. 2 illustrates a block diagram of an Application Programming Interface (API) 200 between an internet enabled device 104 and the matching server 106. As discussed above, the internet enabled device 104 and the matching server 106 are coupled via an external network 105. Upon receiving audio signals from the broadcast media receiver 102 via its microphone, the internet enabled device 104

transmits matching requests

202, including the audio signals, via the external network 105, to the matching server 106. According to one embodiment, the matching requests 202 are sent in four to five second bursts, every fifteen seconds. However, according to other embodiments, the duration of matching requests and time between matching requests may be defined as any amount of time.

According to one embodiment, communication between the internet enabled device 104 and the matching server 106 (e.g., a matching request 202) may include a variety of parameters. Certain parameters may be defined as optional or required. Such parameters may include:

- auth_token—An authorization token that is issued by the matching server 106 to identify the client application on the internet enabled device 104. Matching requests 202 without valid auth_token may be refused.
- action—Contains action requested by the client via the internet enabled device. For example, actions may include:
  - MATCH—Begins a new matching request for audio stream received by internet enabled device 104
  - INFO—Returns information on status of matching server 106
  - CONFIG—Returns information on client parameters required to perform matching action
- session_id—A session parameter identifying the client user of the internet enabled device 104.
- client_version—A version string to identify the version of the application operated by the client.

In addition to the parameters discussed above, matching requests 202 sent by the internet enabled device 104 also include audio signals received by the internet enabled device 104 from the broadcast media receiver 102. According to one embodiment, the audio signals are sent with the MATCH action; however, the transfer of audio data between the internet enabled device 104 and the matching server 106 may be configured differently. According to one embodiment, the format and encoding of the audio signals sent by the internet enabled device 104 to the matching server 106 is determined based on at least one of the parameters discussed above. For example, according to one embodiment, the format and encoding of the audio signals is based on the client_version identifier. According to one embodiment, the audio signals are formatted and encoded as 16 Bit, 22 KHz, mono, Speex signals. However, according to other embodiments, the audio signals may be formatted and encoded in any way.

The matching server 106 also constantly receives audio channel feeds 108 from known broadcast media channels. According to one embodiment, the matching server 106 captures information from the known broadcast media channels every two seconds. However, according to other embodiments, the matching server 106 may be configured to capture information from the known broadcast media channels at any desired interval. According to one embodiment, in addition to receiving broadcast media feeds from known channels, the matching server 106 also receives schedule information related to the received broadcast media from the known channels.

According to one embodiment, the matching server 106 is configured to capture information from location specific broadcast media channels. For example, broadcast media networks typically have separate feeds for western and eastern time zones (customers in the eastern and central time zones receive the east coast feed and customers in the pacific and mountain time zones receive the west coast feed). According to one embodiment, a matching server 106 may be configured to receive the east coast feed, the west coast feed, or both feeds.

According to one embodiment, an internet enabled device 104 determines the location (e.g., the time zone) of a user based on the IP address of the internet enabled device 104. Based on the determined location of the user, the internet enabled device 104 will communicate with an appropriate location specific matching server 106. For example, according to one embodiment, based on a determination by the internet enabled device 104 that a user is in the eastern or central time zone, the internet enabled device 104 will send a matching request to a matching server 106 receiving east coast feeds. Alternatively, based on a determination by the internet enabled device 104 that a user is in the western or mountain time zone, the internet enabled device 104 will send a matching request to a matching server 106 receiving west coast feeds.

Based on the received audio feeds from the internet enable devices 104 and the known broadcast media channels, the matching server 106 calculates signal cross-correlation (X-Correlation) between the audio signals 202 received from the internet enabled device 104 and the audio signals 108 received from the known broadcast channels to determine whether any matching exists between the signals. An example of X-Correlation 300 between signals is illustrated in FIG. 3. Audio signals 108 from the known broadcast channels are compared to the audio signals 202 received from the internet enabled device. As shown in FIG. 3, signals 302 that do no match will result in low signal X-Correlation. However, if an audio signal 304 from a known broadcast channel does match audio signals 202 from the internet enabled device 104, then a high signal X-Correlation will result. Upon detecting a high signal X-Correlation with a known broadcast channel, the matching server 106 determines that the audio signals being received by the internet enabled device 104 match the program being broadcast by the known broadcast channel.

According to one embodiment, the matching server 106 compares audio signals 202 from the internet enabled device 104 to the audio signals 108 from the known broadcast channels over a sliding period of time or window. According to one embodiment, the window is a thirty second window. However, in other embodiments, the window may be defined as having any length. By comparing signals over a sliding window, the matching server 106 is able to account for signal delays between the

audio signals

202, 108. For example, if broadcast signals received by an internet enabled device 104 are transmitted via a satellite system, there will likely be a delay between when the signals are actually broadcast over the known channel to when they are received by the internet enabled device 104. Therefore, by matching signals within a window, the matching server 106 accounts for the potential delay.

Upon performing matching, the matching server 106 responds to the matching request 202 of the internet enabled device 104. According to one embodiment, a response 204 to the matching request by the matching server 106 is sent within ten seconds of receiving the matching request. However, according to other embodiments, a response 204 to a matching request may be configured to be sent at any time upon receiving a matching request 202.

According to one embodiment, a response 204 to a matching request 202 may include a variety of parameters. Certain parameters may be defined as optional or required. Such parameters may include:

- result_status—The outcome of the matching operation includes one of the following identifiers:
  - SUCCESS—Successful matching operation
  - NOMATCH—Matching operation did not yield successful result
  - ERROR—An error (e.g., invalid audio format provided) prevented a successful operation. Check status_msg for details.
- status_code—Status code capable of indicating status of matching operation (e.g., an error).
- status_msg—Status message capable of displaying reason for error
- channel_id—The unique identifier of the recognized (matched) channel
- channel_shortname—Official short name of the recognized channel
- channel_longname—Official long name of the recognized channel.

According to one embodiment, using at least one of the parameters identified above, the matching server 106 may also retrieve information about the specific matched program being viewed or listened to on the matched channel. For example, in one embodiment, the channel_id parameter may be used by the matching server 106 to retrieve schedule and/or program information from an Electronic Program Guide (EPG) about the matched program currently being broadcast on the matched channel. According to one embodiment, the matching server 106 retrieves information from the EPG such as the name and synopsis of the matched program. According to other embodiments, the matching server 106 also retrieves meta-information from the EPG including the cast, producer, genre, rating, etc. of the matched program. According to other embodiments, any type of information related to the matched program may be retrieved by the matching server 106.

Upon completing the matching operation and retrieving information related to the matched channel and matched program, the matching server 106 transmits the matching program and matching channel information back to the user via the internet enabled device 104. According to one embodiment, the internet enabled device 104 includes a reference client application to illustrate the information provided by the matching server 106. In one embodiment, the reference client application is implemented in ActionScript; however, in other embodiments, the reference client application may be implemented in any other appropriate programming language.

According to one embodiment, the reference client displays information related to the matched channel and/or program. For example, in one embodiment, the reference client displays at least one of the network name of the matched channel, the name of the matched program, or a synopsis of the matched program. In other embodiments, the reference client displays other information related to the matched program such as the cast, producer, genre, rating etc. In one embodiment, the reference client displays other information related to the matched channel and/or program, such as related advertising or social media functionality. Additional functionality displayed by the reference client in response to a matched channel or program will be discussed in greater detail below.

The operation of the system 100 will now be described in greater detail in relation to FIG. 4. FIG. 4 is a flow chart 400 of a process for the automatic detection of broadcast programming in accordance with one embodiment of the present invention. At block 402, a user of an internet enabled device 104 situates himself near a broadcast media receiver 102 (e.g., an audio source such as a television or radio receiving broadcast media signals).

At block 404, the user operates the internet enabled device 104 to open an application and/or website configured to communicate with a matching server 106. At block 406, the internet enabled device 104 receives audio signals from the broadcast media receiver 102 via a microphone.

At block 408, the internet enabled device 104 transmits the audio signals received from the broadcast media receiver 102 to the matching server 106. According to one embodiment, the audio signals may be transmitted by the internet enabled device 104 to the matching server 106 in sequences of a few seconds via real time streaming. For example, as discussed above, matching requests 202 including the audio signals may be sent in four to five second bursts, every fifteen seconds. However, according to other embodiments, the duration of matching requests and time between matching requests may be defined as any amount of time.

At block 410, the matching server 106 receives the audio signals transmitted by the internet enabled device 104 and stores the audio signals at least temporarily for processing. At block 412, at the same time as the matching server 106 is receiving audio signals from the internet enabled device 104, the matching server 106 is also receiving and storing live audio signals from a plurality of known broadcast channels (e.g., a plurality of known television and/or radio channels).

According to one embodiment, the matching server 106 only stores, at any given moment, a small portion of the audio signals from the internet enabled device 104 and the audio signals from the known broadcast channels. For example, according to one embodiment, the matching server 106 receives a few seconds of audio data, processes the audio data and deletes the few seconds of audio data, before repeating the process again and again over time as the matching process is performed. However, in other embodiments, the matching server 106 may store received audio data for longer periods of time.

At block 414, the matching server 106 compares the audio signals received from the internet enabled device 104 with the audio signals received from the known broadcast channels. According to one embodiment, as described above, matching is performed using signal cross-correlation. However, in other embodiments, matching may be performed using any comparison technique including other types of correlation, fingerprinting, thumb printing, hashing or any other appropriate matching technique.

At block 416, the matching server 106 makes a determination (e.g., based on the matching process results), whether the audio signals received from the internet enabled device 104 match any one of the audio streams from the known broadcast channels. At block 418 in response to a determination that there was no successful match; the user of the internet enabled device 104 is informed of the matching process failure. At block 420, the user is queried whether they would like to attempt the matching process again. In response to a determination by the user that the matching process should be performed again, the process begins again at block 406.

At block 422, in response to a determination by the user that the matching process should not be performed again, the user is able to manually select the program that they are currently viewing or listening to. According to one embodiment, a list of programs currently broadcasting on known broadcast channels may be retrieved by the internet enabled device 104 from the EPG via the matching server 106.

At block 424, in response to a successful matching operation where a matching channel is identified by the matching server 106, the matching server 106 retrieves information about the currently being viewed matched program, via the EPG. For example, as discussed above, the matching server 106 may retrieve schedule information, the program title, the program synopsis, the cast, the producer, the genre, the rating etc. . . . of the matched program.

At block 426, the matching server 106 transmits the information related to the matched channel and program to the user via the internet enabled device 104. As discussed above, according to one embodiment, such information may be displayed via a reference client.

At block 428, in response to the currently viewed or listened to program being automatically matched or manually selected, the matching server may provide additional functionality related to the current program to the user via the internet enabled device. Such additional functionality may include advertisements, targeted programming, chat, games, EPG, links, software etc. The additional functionality provided in response to identifying a currently being viewed program will be discussed in greater detail below.

According to one embodiment, at block 430 the matching server 106 determines whether the user has changed the currently being viewed/listened to program. According to one embodiment, the matching server 106 determines whether the program has changed by continuing to receive audio signals from the internet enabled device 104 and comparing the audio signals to the currently matched channel. According one embodiment, the matching server 106 is configured to check, at defined intervals, whether the current program has changed. In one embodiment, the defined intervals are predefined. In another embodiment, the defined intervals are variable at the election of the user or an administrator of the matching server 106.

If no change in program is detected, the matching server 106 continues to monitor the audio signals from the internet enabled device 104 for a change in programming. If a change in program is detected, the audio matching process is started again from block 406.

As described above, upon the automatic identification of a channel and a program currently being viewed by a user, functionality related to the identified channel and/or program is provided to the user via the internet enabled device 104. According to one embodiment, specific functionality related to the identified channel and/or program is automatically presented to the user via the internet enabled device 104. According to another embodiment, specific functionality related to the identified channel and/or program may be presented to the user, via the internet enabled device 104, as available options.

FIG. 5 is a block diagram illustrating the architecture 500 of a system configured to provide a user with specific functionality related to an automatically identified channel and/or program currently being viewed by the user. As discussed above, a matching server 106 receives live TV or Radio audio feeds 502 from known broadcast channels 501. The matching server 106 includes an encoder module 504 which is configured to encode the received audio feeds 502. According to one embodiment, the audio feed 502 is formatted and encoded as 16 Bit, 22 KHz, mono, Speex signals. However, according to other embodiments, the audio feed may be formatted and encoded in any way.

The matching server 106 also receives an audio feed 506 from an internet enabled device 508. As discussed above, the audio feed 506 includes signals received by the internet enabled device 508 from a broadcast media receiver (e.g., a television or radio) via a microphone.

According to one embodiment, the matching server 106 includes an audio matching services module 510. The audio matching services module 510 receives the audio feed 506 from the internet enabled device 508 and the audio feeds 502 from the known broadcast channels 501. The audio matching services module 510 performs a matching operation between the audio feeds 502, 506, as described above, and identifies the currently being viewed/listened to channel.

According to one embodiment, the audio matching services module 510 also receives schedule information related to the known broadcast channels 501 from a TV/Radio source schedule module 512 (e.g., an EPG). As discussed above, based on the matched channel and the received schedule information, the matching services module 510 identifies a matched program.

According to one embodiment, the audio matching services module 510 also receives schedule information related to the known broadcast channels 501 from a TV/Radio source schedule module 511 (e.g., an EPG). As discussed above, based on the matched channel and the received schedule information, the matching services module 510 identifies a matched program.

For example, according to one embodiment, in response to the identification of the viewed/listened to channel, the core services module 512 also receives editorial feed data, related to the matched channel or program, from an editorial feed data module 514. For instance, in response to a specific identified matched program, the editorial feed data module 514 can push program specific content or functionality (e.g., polls, sweepstakes, blogs, social media networks, additional program feeds etc) to the user via the internet enabled device 508. Providing program specific content or functionality to a user in response to a matched channel and/or program will be described in greater detail below.

In addition, according to one embodiment, the matching server 106 includes a pattern identifier module 516. The pattern identifier module 516 monitors and keeps track of the matched channels and/or programs viewed by a user. According to one embodiment, the pattern identifier module 516 creates a program history profile (i.e. a viewing or listening history profile) for a specific user. In one embodiment, the program history profile may include such information as the channels viewed or listened to by a user and the programs viewed or listened to by a user over time. In one embodiment, program history profiles related to different users are stored in a database within data storage of the matching server 106. However, in other embodiments, user profiles may be stored in different locations (e.g., external the matching server 106).

According to one embodiment, based on a viewing or listening history profile of a user, the pattern identifier module 516 may provide information to the user which is specifically related to the channel and/or program being viewed/listened to. For example, in one embodiment, based on the profile of a user, the pattern identifier may provide program feeds and/or data 518 which is targeted at users viewing a specific program. For instance, if the pattern identifier module 516 realizes that a user consistently watches a certain program, the pattern identifier module 516 may provide targeted advertisements to the user which are specifically related to the program. In other embodiments, any type of content may be provided to a user based on a user profile.

In another embodiment, based on the profile of a user, the pattern identifier module 516 may provide filtered program metadata 520 to the user via the internet enabled device 508. According to one embodiment, based on the viewing or listening history profile of a user, the pattern identifier module 516 may provide the user with additional program feeds and/or data which the pattern identifier module 516 identifies as potentially of interest to the user.

As discussed above, based on the matching servers 106 identification of the channel and/or program currently being viewed/listened to by a user, specific content or functionality related to the identified channel or program can be provided to the user. FIGS. 6A-6F illustrate different situation in which the matching server 106 may provide content or functionality to a user based on a currently viewed/listened to channel or program. According to one embodiment, the content or functionality provided to a user in response to an automatically identified channel and/or program may be intended to provide incentive for the user to revisit the channel/program, create brand loyalty in the channel/program, provide the user with related information, and/or create a connection between a user and a channel/program in an effort to build a relationship.

FIG. 6A is a block diagram of a first scenario 600 in which specific content or functionality is provided to a user based on a currently being viewed/listened to channel or program. The audio matching services module 604 matches audio signals received by an internet enabled device with audio signals from a known broadcast channel currently being broadcast in order to identify the channel and/or program currently being viewed or listened to. As discussed above, in response to the channel and/or program identification, a user may be provided information related to the channel and/or program (e.g., name, synopsis, cast, crew, or any other information retrieved from a TV/Radio Metadata Service 606). In addition, according to one embodiment, in response to the channel and/or program identification, a user may also gain access to specific program and data feeds 608 related to the identified channel and/or program. For example, the specific program and data feeds 608 may provide specific content or functionality related to the identified program or channel. According to some embodiments, this content or functionality may include chats with other users watching or listening to the same program and/or channel, the ability to vote in a poll related to the identified program or the ability to vote/comment on comments by other users, and games related to the identified channel and/or program. However, the channel/program specific content or functionality provided in response to matching may be configured as any appropriate information.

FIG. 6B is a block diagram of a second scenario 601 in which incentives or rewards are provided to a user based on a currently being viewed/listened to channel or program. The audio matching services module 604 matches audio signals received by an internet enabled device with audio signals from a known broadcast channel currently being broadcast in order to identify the channel and/or program currently being viewed or listened to. As discussed above, in response to the channel and/or program identification, a user may be provided information related to the channel and/or program (e.g., name, synopsis, cast, crew, or any other information retrieved from a TV/Radio Metadata Service 606). In addition, according to one embodiment, in response to the channel and/or program being automatically identified, a user may be automatically rewarded by a bonus/reward system 610 for viewing the identified program and/or channel. For example, once the matching server 106 identifies the program currently being viewed/listened to, the user may be awarded points (e.g., via bonus points, reward points, loyalty points) automatically for their participation. According to one embodiment, the user may be able to trade in awarded points for rewards such as cash, prizes, merchandise, tickets, etc.

In conventional reward-based systems, a user is typically rewarded for taking a specific defined action. For example, a viewer of a television program may receive rewards for logging into an application and manually identifying (i.e., “checking in”) which program they are viewing. In another example, a viewer of a television program may receive rewards for responding to a poll via text message. However, in such systems, there is no way for the broadcast provider to confirm that the user is actually viewing or listening to the required program. The broadcast provider must take the word of the user. In addition, in such systems, the user must take an additional step (e.g., “checking-in, texting a response etc.) to be rewarded. In this way, merely viewing or listening to a program is not typically enough to receive rewards.

By automatically identifying the program currently being viewed, without requiring intermediary steps by a user, the user of the current system is able to be rewarded automatically for merely watching or listening to the required program. In addition, by automatically identifying the program being viewed and synching an internet enabled device 104 with the currently being viewed/or listened to broadcast media, the broadcast provider is able to confirm that that the user is actually viewing or listening to the required program, before awarding any incentives.

According to some embodiments, in addition to being rewarded for watching or listening to a specific matched program, a user may also be rewarded for interacting with content or functionality provided to the user in response to the matching server 106 identifying the currently being viewed/listened to channel or program.

In one embodiment, additional rewards can be awarded to the user for actively participating in program specific content or functionality. For example, in response to the currently being viewed/listened channel or program being automatically identified, the user may be provided with content or functionality (e.g., program related chat, game, poll etc.) related to the identified program or channel. In addition to being rewarded for watching/listening to the identified program; a user may be awarded additional or bonus rewards/points for interacting with such content or functionality. For instance, one example of a bonus-point-system bonus point structure is shown in Table 1.

TABLE 1

1 Minute of watching regular shows:	1	point
1 Minute of watching pilot shows:	3	points
Vote, sweepstakes entry, answer poll questions,	5	points
like/dislike:
Register:	10	points

Invite friends:	25 points per
	registration

Post in chat:	2	points
Comment on post in chat:	1	point
Share post on social network (e.g., Twitter/Facebook:	5	points
Post activities on Facebook-wall or Twitter:	5	points
Purchase affiliate offers:	500	points
Send SMS out of application:	50	points
Sign up for newsletter:	10	points

In other embodiments, reward/bonus points may be defined in any way to be issued to a user for any type of interaction with program/channel related activity. As discussed above, a viewing or listening history profile may be generated for a user. In one embodiment, the viewing or listening history profile may track a user's watching/listening habits. In addition, according to one embodiment, the viewing or listening history profile of a user may be provided to the bonus/reward system 610 to be associated with appropriate reward/bonus points. A viewing or listening history profile with associated bonus points may be stored for a user in order to incentivize the user to continue to watch/follow certain channels or programs.

FIG. 6C is a block diagram of a third scenario 603 in which a user is automatically provided the opportunity to chat with other users having similar interests (e.g., watching or listening to the same program), based on a currently being viewed/listened to channel or program. The audio matching services module 604 matches audio signals received by an internet enabled device with audio signals from a known broadcast channel currently being broadcast in order to identify the channel and/or program currently being viewed or listened to. As discussed above, in response to the channel and/or program identification, a user may be provided information related to the channel and/or program (e.g., name, synopsis, cast, crew, or any other information retrieved from a TV/Radio Metadata Service 606). In addition, according to one embodiment, in response to the channel and/or program being automatically identified, a user may automatically be provided an interface to interact with other users who are also watching/viewing the same channel or program.

For example, according to one embodiment, in response to the channel and/or program identification, a user is automatically provided a social media network interface 614 to interact with other users, watching or listening to the same program, via a social media network (e.g., Facebook, Twitter, Myspace, blogs, etc.) According to some embodiments, using a social media network, a user may indicate which channel or show they are currently watching or listening to, post comments related to the commonly viewed channel or program, vote in polls on the social media network related to the commonly viewed channel or program, comment on other users comments related to the commonly viewed channel or program, and/or indicate whether they like or dislike a comment by another user related to the commonly viewed channel or program.

According to another embodiment, in response to the channel and/or program identification a user is automatically provided a chat interface 612 to interact with other users watching or listening to the same program. According to one embodiment, users are directed into chat groups matching the program and/or channel that they are currently watching or listening to. Using the chat interface 612, users who are watching the same program or channel can actively exchange information about the program or channel with each other in real time.

According to one embodiment, users in a chat group have the option to agree or disagree (like or dislike) with statements/actions other users wrote/took. In this way, a user can share his opinion about certain topics or believes of other users. According to one embodiment, whether a user agrees of disagrees (likes or dislikes) with another user's statements or actions is displayed adjacent to the other user's statements or actions in the form of a short sentence. For example, if user X agrees with a comment posted by another user in relation to the program currently being watched, “X agrees with this” or “X likes this” will be displayed. In one embodiment, the chat interface 612 keeps track of how many people agree or disagree with each comment or action. According to one embodiment, the number of agrees/disagrees triggers a certain action. For example, in one embodiment, as soon as a comment made by a user in a chat receives a pre-defined number of agrees, it is automatically posted to a social network.

In conventional chat groups, it is a common problem that a chat group may become overcrowded. For instance, too many users may be in the same chat room, making meaningful discussion difficult. For example, due to a large number of posters, a post of a single user may not remain visible long enough for it to be read in detail. Therefore, according to one embodiment of the current invention, the chat interface 612 may include an auto-grouping system.

According to one embodiment, an auto-grouping system includes a mechanism to place a user into an appropriately sized chat group that allows for meaningful discussion. Placement of the user into a group is dependent on criteria enabling groups of appropriate size and relevant discussion. For example, the auto-grouping system may be based on an auto-grouping framework. According to one embodiment, this framework comprises three components: 1. Television/Radio Show, 2. Relationship (friend-status), 3. Geographical data. However, in other embodiments, an auto-grouping framework may include any number or type of components.

According to one embodiment, the Television/Radio show component is the television or radio show identified by the matching server 106, as described above. By matching people together who are viewing or listening to the same program, discussion related to the common subject matter of the television or radio show may be fostered.

According to another embodiment, the Relationship component includes friends of the user. In one embodiment, friends of the user are extracted from social media networks (e.g., Facebook, Twitter, Myspace, or other social networking groups). According to one embodiment, in addition to direct friends, indirect friends (i.e. friends of friends) are also extracted. By matching users together who are friends, discussion may be more comfortable in that oftentimes, people are more at east talking to their friends, rather than strangers.

According to one embodiment, the Geographical data component includes the location of the user. In one embodiment, the location of the user may be determined by analyzing the IP address of the internet enabled device 104. According to one embodiment, the chat interface calculates a “distance” between potential chat partners based on the geographical data. By matching users together who are in a similar geographic location, discussion may be more meaningful as generally, people who live in the same geographic area have more in common.

In one embodiment, the chat interface 612 may automatically provide a chat group to a user based on at least one of the above mentioned components. In one embodiment, the chat interface 612 automatically groups a user based on all three components. For example, the chat interface 612 may group the user into a chat room that includes users who are watching the same program, are friends in a social media network and who live in the same area. In other embodiments, the three components may be used in any combination. For example, in one embodiment, component one may be utilized while components two and three are optional. In another embodiment, components two and three may be utilized while component three is optional.

According to one embodiment, in addition to the three components identified above, the chat interface 612 may also analyze additional information when grouping users into chat rooms. For example, in one embodiment, additional information such as the interests, hobbies, favorite shows, and desired topics of conversation etc. of the user may be used when making groping decisions.

FIG. 7 illustrates an auto-grouping process 700 according to aspects of the present invention. At block 702, a user initiates the audio matching/synchronization process described above. In one embodiment, initiating the audio matching/synchronization process requires the user to log in using a username and password. At block 704, in response to the user logging in, associated information, related to the user, is retrieved from a user profile stored in a database of the data storage of the matching server 106. As described above, a user profile may include viewing/listening history information (e.g., commonly viewed or listened to channels or shows). In one embodiment, a user profile may also include such information as geographic information (i.e. an address), relationship information (i.e. friends from social media networks), interests of the user, hobbies of the user, or any other appropriate information.

At block 706, the audio matching process, as described above, is performed to automatically identify the currently viewed or listened to channel and/or program. At block 708, after identifying the viewed channel or program, a user is queried whether they would like to participate in a chat related to the identified channel and/or program. In response to a determination that the user would not like to participate in a chat, other content/functionality related to the identified channel or program may be provided to the user. In response to a determination that the user would like to participate in a chat, at block 710, an auto-grouping function is performed to automatically assign the user to an appropriate chat room based on the user profile. According to another embodiment, the auto-grouping function is performed automatically in response to the identification of the currently viewed or listened to channel and/or program and a user is automatically assigned to an appropriate chat room.

According to one embodiment, the auto-grouping function may be performed in any number of ways and may utilize any number of information combinations. For example, according to one embodiment, users who are watching/listening to the same program or channel may be grouped first by friends, then by friends of friends and finally by neighbors. In another embodiment, users who are watching/listening to the same program or channel may be grouped first with other users with similar interests, then with friends, then with neighbors. In another embodiment, users who are watching/listening to the same program or channel may be grouped first with users with similar genre interests (e.g., action, romance, comedy, sports, etc.), then with friends, then with neighbors.

According to one embodiment, users who are watching/listening to the same program or channel may be grouped with other users based, at least partially, on the user's activity time. For example, in the event that a user typically views the identified program at a certain time, the user may be grouped with people also viewing the program at the same time.

According to another embodiment, users who are watching/listening to the same program or channel may be grouped first by their demographics (e.g., age, household, education, income, etc.), second with friends and third by neighbors. In another embodiment, users who are watching/listening to the same program or channel may be grouped based on interests identified in their user profiles (e.g., same social media network groups, agree (like) the same comments, similar hobbies etc.).

According to one embodiment, users who are watching/listening to the same program or channel may be grouped based on their activity within the chat interface 612. For example, users who are very active in chat rooms are grouped with less active users, creating homogeneous groups.

In addition to the different components and parameters identified above, the chat interface 612 may also perform auto-grouping to reach a pre-defined optimal target group size. In one embodiment, the group size is selected so that there are enough users to generate a comment at least every fifteen seconds, but not so many users as to generate a comment more often than every five seconds. However, in other embodiments, the minimum and maximum time limits between comments may be configured differently.

According to one embodiment, the group size is limited to a certain number of users. For example, in one embodiment, the number of users is static and not dependent on the activity within the group. In such an embodiment, when the maximum number of users is reached, no additional users will be allowed to enter the group. In one embodiment, despite being at maximum capacity, a special rule may allow special members (e.g., close friends of users already participating in the group, group administrators, group ambassadors, etc.) to join the group and enlarge the group despite the size limitation.

According to other embodiments, the group size is not automatically limited to a certain number of users. For example, in some embodiments, the group size may be limited by the lengths of comments made by users within the group. For instance, if user comments consist of a certain number of characters which imply the conversation to be a high quality conversation, the number of group members may be limited to a small number to allow the conversation to remain at a high quality.

Upon performing auto-grouping, including determining which chat groups a user should be a member of and how large each group should be, at block 712 the user enters the identified chat room corresponding to the currently being viewed/listened to program and the appropriate criteria.

FIG. 6D is a block diagram of a fourth scenario 605 in which a user is automatically delivered advertiser content based on an automatically identified channel or program. The audio matching services module 604 matches audio signals received by an internet enabled device with audio signals from a known broadcast channel currently being broadcast in order to identify the channel and/or program currently being viewed or listened to. As discussed above, in response to the channel and/or program identification, a user may be provided information related to the channel and/or program (e.g., name, synopsis, cast, crew, or any other information retrieved from a TV/Radio Metadata Service 606). In addition, according to one embodiment, in response to the channel and/or program being automatically identified, a user may automatically be provided an advertisement feed and/or data 618 via an advertisement service module 616.

According to one embodiment, the advertisement service module 616 provides the user with advertisement content specifically related to the identified channel or program. For example, in one embodiment, the advertisement service module 616 provides to the user an advertisement for a product featured in an identified program (e.g., a shirt worn by an actor, shoes worn by an actress etc.) In another embodiment, the advertisement service module 616 provides to the user an advertisement for products related to the identified program (e.g., an advertisement for athletic equipment while watching a sporting event). In another embodiment, the advertisement service module 616 provides to the user an advertisement related to the identified program (e.g., an advertisement for upcoming show times or an advertisement from the producer of the identified program to introduce another program). According to other embodiments, any type of advertisement related to the identified channel or program may be presented to the user.

FIG. 6E is a block diagram of a fifth scenario 607 in which a user is automatically delivered premium content 620 based on an automatically identified channel or program. The audio matching services module 604 matches audio signals received by an internet enabled device with audio signals from a known broadcast channel currently being broadcast in order to identify the channel and/or program currently being viewed or listened to. As discussed above, in response to the channel and/or program identification, a user may be provided information related to the channel and/or program (e.g., name, synopsis, cast, crew, or any other information retrieved from a TV/Radio Metadata Service 606). In addition, according to one embodiment, in response to the channel and/or program being automatically identified, user may automatically be provided premium content 620 related to the identified channel and/or program.

According to one embodiment, premium content 620 includes games, play-along videos or polls related to the identified channel and/or program. For example, such games, play-along videos or polls may allow a user to play along with quiz shows or game shows, to bet on the outcome of sports events, to vote on members of a casting show, to respond to a show related poll, to play a video based game etc. By automatically identifying the channel or program that the user is watching or listening to and automatically providing the user with game, video or poll information, the game, video or poll is provided to the user in real time. In this way, the user is capable of being provided options at substantially the same time as a related event is occurring in the broadcast program. For example, if a user is currently watching a game show in which a contestant on the game show is presented with a multiple choice question and a matching server 106 has automatically identified, via audio signals from an internet enabled device 104, that the user is currently watching the game show, the user may be presented the same multiple choice question as the contestant. According to one embodiment, the user may be provided an incentive (e.g., bonus points, reward points, promotional gifts, discounts, monetary prizes, etc.) for playing along with a game and/or winning the game.

FIG. 6F is a block diagram of a sixth scenario 609 in which a user is automatically delivered integrated content from an integrator service module 621 based on an automatically identified channel or program. The audio matching services module 604 matches audio signals received by an internet enabled device with audio signals from a known broadcast channel currently being broadcast in order to identify the channel and/or program currently being viewed or listened to. As discussed above, in response to the channel and/or program identification, a user may be provided information related to the channel and/or program (e.g., name, synopsis, cast, crew, or any other information retrieved from a TV/Radio Metadata Service 606). In addition, according to one embodiment, the integrator service module 621 may combine content or functionality, related to the identified channel or program, from any number of sources and provide the content or functionality to the user. For example, in one embodiment, the integrator service module 621 may provide the user with reward/bonus information from a reward engine 610 (as discussed above) in addition to premium content 620 (as discussed above).

In another embodiment, the integrator service module 621 also provides information from a content management system 626, such as an advertisement service module 616 as described above, in response to the identified channel or program. In one embodiment, in addition to providing advertisement information to the user, the integrator service module 621 also communicates with an e-commerce integration module 624. The e-commerce integration module 624 may allow a user to actually make online purchases of products which are featured in the advertisement information. For example, an advertisement for a product featured in a television show may be displayed to the user in response to an automatic identification of the television show. In response, the user may be able to directly purchase the product via the e-commerce integration module 624.

According to one embodiment, the integrator service module 621 also provides information to the user from a recommendation engine 622. In one embodiment, the recommendation engine 622 provides content/functionality/program information (e.g., recommend programs, chat rooms, informational pages, games, polls, etc.) to a user based on the automatically identified channel or program currently being viewed/listened to by the user and/or additional information about the user. In one embodiment, recommendations by the recommendation engine 622 may be based on user data extracted from a social media network, user data extracted from a registration form, user behavior extracted from a user profile, comments made by a user, posts designated as being agreed on/liked, pages visited, or any other information related to the user.

Various embodiments according to the present invention may be implemented on one or more computer systems or other devices capable of automatically identifying a channel and/or program as described herein. A computer system may be a single computer that may include a minicomputer, a mainframe, a server, a personal computer, or combination thereof. The computer system may include any type of system capable of performing remote computing operations (e.g., cell phone, PDA, set-top box, or other system). A computer system used to run the operation may also include any combination of computer system types that cooperate to accomplish system-level tasks. Multiple computer systems may also be used to run the operation. The computer system also may include input or output devices, displays, or storage units. It should be appreciated that any computer system or systems may be used, and the invention is not limited to any number, type, or configuration of computer systems.

These computer systems may be, for example, general-purpose computers such as those based on Intel PENTIUM-type processor, Motorola PowerPC, Sun UltraSPARC, Hewlett-Packard PA-RISC processors, or any other type of processor. It should be appreciated that one or more of any type computer system may be used to partially or fully automate play of the described game according to various embodiments of the invention. Further, the software design system may be located on a single computer or may be distributed among a plurality of computers attached by a communications network.

For example, various aspects of the invention may be implemented as specialized software executing in a general-purpose computer system 800 such as that shown in FIG. 8. The computer system 800 may include a processor 802 connected to one or more memory devices 804, such as a disk drive, memory, or other device for storing data. Memory 804 is typically used for storing programs and data during operation of the computer system 800. Components of computer system 800 may be coupled by an interconnection mechanism 806, which may include one or more busses (e.g., between components that are integrated within a same machine) and/or a network (e.g., between components that reside on separate discrete machines). The interconnection mechanism 806 enables communications (e.g., data, instructions) to be exchanged between system components of system 800. Computer system 800 also includes one or more input devices 808, for example, a keyboard, mouse, trackball, microphone, touch screen, and one or more output devices 810, for example, a printing device, display screen, and/or speaker. In addition, computer system 800 may contain one or more interfaces (not shown) that connect computer system 800 to a communication network (in addition or as an alternative to the interconnection mechanism 806.

The storage system 812, shown in greater detail in FIG. 9, typically includes a computer readable and writeable nonvolatile recording medium 902 in which signals are stored that define a program to be executed by the processor or information stored on or in the medium 902 to be processed by the program. The medium may, for example, be a disk or flash memory. Typically, in operation, the processor causes data to be read from the nonvolatile recording medium 902 into another memory 904 that allows for faster access to the information by the processor than does the medium 902. This memory 904 is typically a volatile, random access memory such as a dynamic random access memory (DRAM) or static memory (SRAM). It may be located in storage system 812, as shown, or in memory system 804. The processor 802 generally manipulates the data within the integrated

circuit memory

804, 904 and then copies the data to the medium 902 after processing is completed. A variety of mechanisms are known for managing data movement between the medium 902 and the integrated

circuit memory element

804, 904, and the invention is not limited thereto. The invention is not limited to a particular memory system 804 or storage system 812.

The computer system may include specially-programmed, special-purpose hardware, for example, an application-specific integrated circuit (ASIC). Aspects of the invention may be implemented in software, hardware or firmware, or any combination thereof. Further, such methods, acts, systems, system elements and components thereof may be implemented as part of the computer system described above or as an independent component.

Although computer system 800 is shown by way of example as one type of computer system upon which various aspects of the invention may be practiced, it should be appreciated that aspects of the invention are not limited to being implemented on the computer system as shown in FIG. 8. Various aspects of the invention may be practiced on one or more computers having a different architecture or components that that shown in FIG. 8.

Computer system

800 may be a general-purpose computer system that is programmable using a high-level computer programming language. Computer system 800 may be also implemented using specially programmed, special purpose hardware. In computer system 800, processor 802 is typically a commercially available processor such as the well-known Pentium class processor available from the Intel Corporation. Many other processors are available. Such a processor usually executes an operating system which may be, for example, the Windows 95, Windows 98, Windows NT, Windows 2000 (Windows ME), Windows XP, or Windows Visa operating systems available from the Microsoft Corporation, MAC OS System X available from Apple Computer, the Solaris Operating System available from Sun Microsystems, or UNIX available from various sources. Many other operating systems may be used.

The processor and operating system together define a computer platform for which application programs in high-level programming languages are written. It should be understood that the invention is not limited to a particular computer system platform, processor, operating system, or network. Also, it should be apparent to those skilled in the art that the present invention is not limited to a specific programming language or computer system. Further, it should be appreciated that other appropriate programming languages and other appropriate computer systems could also be used.

One or more portions of the computer system may be distributed across one or more computer systems (not shown) coupled to a communications network. These computer systems also may be general-purpose computer systems. For example, various aspects of the invention may be distributed among one or more computer systems configured to provide a service (e.g., servers) to one or more client computers, or to perform an overall task as part of a distributed system. For example, various aspects of the invention may be performed on a client-server system that includes components distributed among one or more server systems that perform various functions according to various embodiments of the invention. These components may be executable, intermediate (e.g., IL) or interpreted (e.g., Java) code which communicate over a communication network (e.g., the Internet) using a communication protocol (e.g., TCP/IP).

It should be appreciated that the invention is not limited to executing on any particular system or group of systems. Also, it should be appreciated that the invention is not limited to any particular distributed architecture, network, or communication protocol. Various embodiments of the present invention may be programmed using an object-oriented programming language, such as SmallTalk, Java, C++, Ada, or C# (C-Sharp). Other object-oriented programming languages may also be used. Alternatively, functional, scripting, and/or logical programming languages may be used. Various aspects of the invention may be implemented in a non-programmed environment (e.g., documents created in HTML, XML or other format that, when viewed in a window of a browser program, render aspects of a graphical-user interface (GUI) or perform other functions). Various aspects of the invention may be implemented as programmed or non-programmed elements, or any combination thereof.

As described above, the matching server 106 is configured to receive live audio feeds from the internet enabled device 104 and the known broadcast channels. However, in other embodiments, the matching server 106 may also operate on time shifted feeds. For instance, in conventional television or radio systems, a user may be able to record programs for later viewing (i.e. time shift the program). When the user later selects the program for viewing; comparing the time shifted audio feed received by the internet enabled device 104 to live audio feeds received from known broadcast channels may not yield an accurate matching process.

Therefore, according to one embodiment, the matching server 106 archives audio feeds received from the known broadcast channels. In this way, when a user views/listens to a time shifted program, the audio signals received by the internet enabled device 104 may be compared to the archived audio feeds to determine the currently being viewed program. In one embodiment, in order to ensure accurate synchronization between the internet enabled device 104 and the matching server 106, the archived audio feeds may be tagged with program metadata (e.g., information about the program, advertisement information, time/date information etc.). By comparing the received audio signals from the internet enabled device 104 with the archived audio feeds and the tagged metadata related to the archived feeds, the matching server 106 is able to accurately synchronize the internet enabled device 104 to the correct program and provide appropriate content and functionality as described above.

As described above, an internet enabled device 104 is described as communicating with a single matching server 106. However, in other embodiments, the internet enabled device 104 may be configured to communicate with a plurality of matching servers 106. In this way, the workload of receiving audio feeds from known broadcast channels may be distributed amongst multiple matching servers 106.

As described above, a matching server 106 is configured to automatically identify a currently being viewed/listened to channel or program by a user and provide content/functionality related to the identified channel/program. However, in other embodiments, a user may be able to manually identify the program/channel he is watching or listening to. In response to the manual identification, related content or functionality may be provided to the user as discussed above.

As described herein, by automatically identifying a currently being viewed/listened to channel or program via audio matching, an intermediary step required by a user (e.g., a checking in or logging in step) is eliminated. In addition, by not requiring an intermediary action be taken by a user, the user is able to be directly linked to the received broadcast media and to directly interact with the broadcast media. For example, upon automatically identifying the program or channel currently being viewed or listened to by a user, the user may immediately be provided with program/channel specific content or functionality, allowing the user to directly interact with the program or channel. By automatically providing the user with specific content related to what the user is currently viewing or listening to, the content or functionality provided to the user is able to be automatically directed specifically at the interests of the user, potentially creating a deeper relationship between the user and the program.

In addition, it is to be appreciated that by providing a dual device system (i.e. a “two-screen system”) instead of a fully integrated system, the current invention may be mobile. For example, according to some embodiments, the internet enable device 104 is not physically coupled to the matching server 106 and instead, may be located adjacent any broadcast receiving device 102 which is currently receiving broadcast media signals and which is providing audio signals, as long as the internet enabled device is able to communicate with the matching server 106 (e.g., via the internet). Therefore, a user may move from broadcast receiving device to broadcast receiving device (e.g., from TV to TV) and the matching server 106 will perform the matching process accordingly.

Having thus described several aspects of at least one embodiment of this invention, it is to be appreciated that various alterations, modifications and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure, and are intended to be within the spirit and scope of the invention. Accordingly, the foregoing description is by way of example only.

Claims

What is claimed is:

1. A method for detection of broadcast programming, the method comprising acts of:

receiving, by a server, first audio signals recorded by a user device over a communication network;

receiving, by the server, audio signals from a plurality of broadcast channels over the communication network;

comparing, by a processor in the server, the first audio signals with the audio signals from the plurality of broadcast channels;

determining by the processor, in response to the act of comparing, that the first audio signals match audio signals broadcast on a particular one of the plurality of broadcast channels;

processing by the processor, in response to the act of determining, schedule information to determine a program currently being broadcast on the particular broadcast channel; and

transmitting by the processor, in response to the act of processing, information related to the program to the user device.

2. The method of claim 1, wherein the user device is a computer system associated with a user of the user device, the computer system being located proximate a receiver of the at least one of the plurality of broadcast channels, and wherein the first audio signals are included in a match request.

3. The method of claim 1, wherein the act of comparing includes an act of comparing the first audio signals with the audio signals from the plurality of broadcast channels using a comparison technique selected from a group consisting of signal cross-correlation, fingerprinting, thumbprinting, and hashing.

4. The method of claim 1, wherein the acts of comparing, determining and processing are performed automatically in response to the act of receiving the first audio signals.

5. The method of claim 4, wherein the acts of comparing, determining and processing are performed absent an intermediary action by a user of the user device.

6. The method of claim 1, further comprising an act of providing, by the processor, program specific content to the user device corresponding to the program currently being broadcast.

7. The method of claim 6, wherein the act of providing program specific content includes providing an interface that includes information corresponding to the program, the information selected from a group consisting of a poll, a chat group, and incentive information.

8. The method of claim 1, further comprising acts of:

tracking by the processor a program history of a user of the user device; and

generating by the processor, based on the act of tracking, a program history profile corresponding to the user.

9. The method of claim 8, further comprising an act of providing, by the processor, program specific content to the user device based on the program history profile.

10. A system for detection of broadcast programming, the system comprising:

a server comprising:

a first interface configured to be coupled to a communication network and to receive first audio signals recorded by a user device over the communication network;

a second interface configured to be coupled to the communication network and to receive audio signals from a plurality of broadcast channels over the communication network; and

a processor coupled to the first interface and the second interface, wherein the processor is configured to match the first audio signals with audio signals received from a particular one of the plurality of broadcast channels, process schedule information to determine a program currently being broadcast on the particular broadcast channel, and transmit identification information related to the program to the user device.

11. The system of claim 10, wherein the processor is further configured to automatically match the first audio signals with the audio signals received from the at least one of the plurality of broadcast channels in response to receiving the first audio signals from the user device.

12. The system of claim 11, wherein the processor is further configured to automatically identify the at least one of the plurality of broadcast channels absent an intermediary action by a user of the user device.

13. The system of claim 11, wherein the processor is further configured to be coupled to a schedule module and to receive the schedule information from the schedule module and in response, identify the program corresponding to the first audio signals received from the user device.

14. The system of claim 13, wherein the processor is further configured to provide program specific content to the user device in response to identifying the program.

15. The system of claim 14, wherein the processor is further configured to provide a chat interface to the user device that corresponds to the program.

16. The system of claim 14, wherein the processor is further configured to be coupled to a reward engine that provides an incentive corresponding to the program.

17. The system of claim 14, wherein the processor is further configured to be coupled to a recommendation engine that provides recommended content corresponding to the program.

18. A non-transitory computer readable medium comprising computer-executable instructions that when executed on a processor cause an apparatus at least to perform:

receiving first audio signals recorded by a user device over a communication network;

receiving audio signals from a plurality of broadcast channels over the communication network;

comparing the first audio signals with the audio signals from the plurality of broadcast channels;

determining, in response to the act of comparing, that the first audio signals match audio signals broadcast on a particular one of the plurality of broadcast channels;

processing, in response to the act of determining, schedule information to determine a program currently being broadcast on the particular broadcast channel; and

19. The computer readable medium of claim 18, wherein the acts of comparing, determining and processing are performed automatically in response to the act of receiving the first audio signals from the user device.

20. The computer readable medium of claim 19, wherein the instructions when executed on the processor further cause the apparatus to perform an act of providing program specific content to the user device corresponding to the program.