Prosecution Insights
Last updated: October 02, 2026
Application No. 18/920,422

AUTOMATICALLY DETERMINING OPTIMAL SUPPLEMENTAL CONTENT FOR A MEDIA STREAM MENU INTERFACE

Non-Final OA §103
Filed
Oct 18, 2024
Examiner
CASTRO, ALFONSO
Art Unit
2421
Tech Center
2400 — Computer Networks
Assignee
Roku Inc.
OA Round
3 (Non-Final)
51%
Grant Probability
Moderate
3-4
OA Rounds
1y 8m
Est. Remaining
70%
With Interview

Examiner Intelligence

Grants 51% of resolved cases
51%
Career Allowance Rate
230 granted / 451 resolved
-7.0% vs TC avg
Strong +19% interview lift
Without
With
+19.4%
Interview Lift
resolved cases with interview
Typical timeline
3y 8m
Avg Prosecution
27 currently pending
Career history
490
Total Applications
across all art units

Statute-Specific Performance

§101
5.8%
-34.2% vs TC avg
§103
72.1%
+32.1% vs TC avg
§102
4.5%
-35.5% vs TC avg
§112
10.1%
-29.9% vs TC avg
Black line = Tech Center average estimate • Based on career data from 451 resolved cases

Office Action

§103
DETAILED ACTION Continued Examination Under 37 CFR 1.114 A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 9/3/2026 has been entered. Notice of Pre-AIA or AIA Status The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA . Response to Arguments Applicant’s arguments, see Remarks pg. 8, filed 9/3/2026, with respect to the status of the claims is hereby acknowledged. Applicant’s arguments, see Remarks pg. 8-9, filed 9/3/2026, with respect to the rejection(s) of claim(s) 1-20 on obviousness grounds under 35 U.S.C. 103 have been fully considered. The examiner notes that the applicant’s arguments are directed to the newly amended limitations. Therefore, examiner will set forth a new grounds of rejection in order to address the newly added limitations. With respect to the applicant’s arguments regarding the deficiencies of the prior art, The examiner respectfully disagrees. In response to applicant’s argument, the test for obviousness is not whether the features of a secondary reference may be bodily incorporated into the structure of the primary reference; nor is it that the claimed invention must be expressly suggested in any one or all of the references. Rather, the test is what the combined teachings of the references would have suggested to those of ordinary skill in the art. See In re Keller, 642 F.2d 413, 208 USPQ 871 (CCPA 1981). Additionally, on the issue of obviousness, the Supreme Court stated the analysis of a rejection on obviousness grounds need not seek out precise teachings directed to the specific subject matter of the challenged claim, for a court can take account of the inferences and creative steps that a person of ordinary skill in the art would employ. See KSR International Co. v. Teleflex Inc., 550 U.S. 398, 418, 82 USPQ2d 1385 (2007). The obvious analysis cannot be confined by a formalistic conception of the words teaching, suggestion, and motivation. Id. at 419. Further, the Court stated that common sense teaches, however, that familiar items may have obvious uses beyond their primary purposes, and in many cases a person of ordinary skill will be able to fit the teachings of multiple patents together like pieces of a puzzle. Id. at 420. The examiner will rely, in part, on the prior art of record and further cite newly found prior art in order to address the newly amended limitations. For example, Lax discloses a motivation of for utilizing content recognition when determining conversion rate (para 33, 95) wherein a user interface comprises an option menu and an advertisement display portion (para 56). With respect to automatic content recognition on the media stream content to extract potential optimal supplemental content items from the media stream content Lax teaches para 32-37 using extracted content to target one or more objects associated with the video content wherein Fig. 4 and para 52-64 teachings targeting content to viewers associated with the viewed program. All things considered, the examiner will set forth a new grounds of rejection in order to address the new limitations. Claim Rejections - 35 USC § 103 The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action: A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made. The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows: 1. Determining the scope and contents of the prior art. 2. Ascertaining the differences between the prior art and the claims at issue. 3. Resolving the level of ordinary skill in the pertinent art. 4. Considering objective evidence present in the application indicating obviousness or nonobviousness. Claim(s) 1-3, 5-6, 8-11 and 13-18, 20 are rejected under 35 U.S.C. 103 as being unpatentable over Burstein; Jonathan Lee et al. US10565622B1 (hereafter Burstein) and in further view of and in further view of Kennedy; Oliver et al. US 20100114689 A1 (hereafter Kennedy) and in further view of Gilmore; Rudy C. et al. US 20240364950 A1 (hereafter Gilmore) and in further view of Lax; Reuven et al. US 20090006375 A1 (herein after Lax) and in further view of Neumeier; Zeev et al. US 20210084369 A1 (hereafter Neumeier). Regarding claim 1, “a computer-implemented method for generating an optimal supplemental content item in a media stream menu interface, comprising: calculating, by at least one computer processor, a relative conversion rate for a potential optimal supplemental content item, wherein the relative conversion rate for the potential optimal supplemental content item represents how often content is consumed based on supplemental content in the menu interface; calculating, by the at least one computer processor, a relative conversion rate threshold value based on the calculated relative conversion rate, wherein the relative conversion rate threshold value comprises a value less than a maximum relative conversion rate value; performing, by the at least one computer processor, automatic content recognition on the media stream content to extract potential optimal supplemental content items from the media stream content;” Burstein col. 12:42-67 to col. 13:1-14 and col. 16:46-67 to col. 17:1-42 teaches cached user information may include a set of eligible ads selected from the set of candidate ads or available advertising inventory that are pre-matched or otherwise identified as being potentially servable to a particular users and identifying ads as preset supplemental content items to be included as part of digital streaming digital content and further teaches periodically determining conversion events after a predetermined threshold number of monitored responses and utilizing the conversion events to identify ad values using dynamic data related to conversion events to enable an ad exchange server to update a new set of advertisements contents comprising new ads for underperforming ads and previous effective ads that resulted in conversion events; Burstein col. 12:42-67 to col. 13:1-14 and col. 16:46-67 to col. 17:1-42 teaches periodically determining conversion events after a predetermined threshold number of monitored responses and utilizing the conversion events to identify ad values using dynamic data related to conversion events to enable an ad exchange server to update a new set of advertisements contents comprising new ads for underperforming ads and previous effective ads that resulted in conversion events, Burstein’s teachings read on the terms “dynamic supplemental content” and “dynamic supplemental content values.” Whereas Burstein discloses impressions with respect to conversion rates (col. 8:12-47, col. 10:48-67 to col. 11:1-39) but does not reference automatic content recognition. With respect to calculating, by the at least one computer processor, a relative conversion rate threshold value based on the calculated relative conversion rate, wherein the relative conversion rate threshold value comprises a value less than a maximum relative conversion rate value, Burnstein Col. 13:4-14 teaches “the cached user information may include a pre-ordered ranking of eligible ads for a user. The pre-ordered ranking may be based at least in part on respective ad scores for the eligible ads, historical data indicative of a presentation history of respective ads, such that a user is not repeatedly presented with the same ad impression, or other factors, such as ad campaign performance information. In one example of ad campaign performance information, an ad may be ranked higher than normal if the ad is behind a desired rate of ad impression delivery.” Stated differently, Burnstein continuously tracks the campaign goals of an advertiser to determine what the status of the desired rate of ad impression delivery is and the success of ad viewing. Burnstein is silent with respect to “extract” in relation to potential optimal content as claimed (i.e., performing, by the at least one computer processor, automatic content recognition on the media stream content to extract potential optimal supplemental content items from the media stream content). All things considered, a person of ordinary skill in the art would have been able to draw particular inferences relating to the claimed limitation (i.e., a relative conversion rate threshold value based on the calculated relative conversion rate, wherein the relative conversion rate threshold value comprises a value less than a maximum relative conversion rate value) and also (a subset of potential optimal supplemental content items from the potential optimal supplemental content items based on a characteristic associated with the potential optional supplemental items and a relative conversion rate value of the subset of potential optimal supplemental content items being greater than the relative conversion rate threshold value. For example, Burstein col. 12:42-67 to col. 13:1-14 and col. 16:46-67 to col. 17:1-42 teaches periodically determining conversion events after a predetermined threshold number of monitored responses and utilizing the conversion events to identify ad values using dynamic data related to conversion events to enable an ad exchange server to update a new set of advertisements contents comprising new ads for underperforming ads and previous effective ads that resulted in conversion events. In an analogous art, Kennedy further teaches elements relating to advertisement opportunities and tracking conversion rates that are cited for supporting the inferences that a person of ordinary skill in the art would draw from the teachings of Burstein. See Kennedy teaching predetermined delivery commitment corresponds to guaranteed ad delivery teaches that particular slots are allocated before being made available to non-guaranteed contracts for ad placement and once the contract has been satisfied the available slots are made available to dynamic content advertisement (see para 15, 35-36, 55-58 disclosing “…allocation of increments of a supply of advertisements to meet demand may be optimized in a market for use of advertising opportunities (ad impressions) by establishing a proportion of revenue and/or quantity to be shared between distinct categories of demand with potentially different marginal values. A programmable technique divides all allocations that are projected and later the allocations that actually arise, between a category of pre-committed increments, typically contractually committed ad insertion opportunities with predetermined characteristics (e.g., guaranteed delivery (GD) of ads contracts), and a category of spot sales, such as via ad exchange auctions (e.g., non-guaranteed delivery (NGD) delivery of ads). Click through rates are considered in supplying the advertisements, such that the user that views the advertisement clicks on the advertisement, which may bring the user to a website of the advertiser. The embodiments also consider conversion to a sale from the advertisement, without the user actively clicking on the served ad.” Kennedy does not disclose elements with respect to content recognition (i.e., is silent with respect to “extract” in relation to potential optimal content as claimed (i.e., performing, by the at least one computer processor, automatic content recognition on the media stream content to extract potential optimal supplemental content items from the media stream content). In an analogous art, Gilmore teaches conversion rate in the context of automatic content recognition in order to establish impressions (para 35-40, 49). Gilmore is silent with respect to clustering as recited in “performing, by the at least one computer processor, automatic content recognition on the media stream content to extract potential optimal supplemental content items from the media stream content; clustering, by the at least one computer processor a subset of potential optimal supplemental content items from the potential optimal supplemental content items based on a characteristic assocait3ed with the potential optimal supplemental content items and a relative conversion rate value of the subset of potential optimal supplemental content items being greater than the relative conversion rate threshold value; and transmitting the subset of potential optimal supplemental content items and a display instruction to a subset of media devices, wherein the display instruction is configured to cause display of a supplemental content item adjacent to the media stream content in the menu interface, and wherein the supplemental content item is selected from the subset of potential supplemental content items.” Burstein teaches “the set of eligible ads may for the user of user device 202 may include a first ad and a second ad, where the set of eligible ads is indicative of ads with targeting criteria for which the user meets a threshold level of the targeting criteria. The threshold level may be represented by meeting some, a majority of, substantially all of, or all targeting criteria, such as over half of Boolean true/false queries, or by another metric. Additional examples of thresholds may include a relative comparison of target criteria matching amongst available users. For instance, while no users meet each targeting criteria, a user that meets most targeting criteria relative to other users may meet the threshold” Burstein col. 12:42-67 to col. 13:1-3 and col. 14:1-17; see also col. 2:49-67 to col. 3:1-4 advertisements selected for potential presentation to specific users based on user attributes. The prior art to Lax discloses a motivation of for utilizing content recognition when determining conversion rate (para 33, 95) wherein a user interface comprises an option menu and an advertisement display portion (para 56). With respect to automatic content recognition on the media stream content to extract potential optimal supplemental content items from the media stream content Lax teaches para 32-37 using extracted content to target one or more objects associated with the video content wherein Fig. 4 and para 52-64 teachings targeting content to viewers associated with the viewed program. See also prior art to Loheide; Donald Jude et al. US 20180343484 A1 (hereafter Loheide) made of record in the rejection of claim 4 and not recited in the rejection of the independent claim to avoid duplicative references. Loheide para 23-24 disclosing a menu of options. See also prior art made of record but not relied upon to Ramer; Jorey et al. US 20180025010 A1. In an analogous art, Neumeier recognizes using extracted video content for presenting supplemental content that is optimized in relation to the viewed content. See para 27, 34 and Fig. 1 teaches displaying supplemental content on a graphical user interface. Therefore, it would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the teachings of Burstein’s invention for determining one or more dynamic optimal supplemental content based on content characteristics to determine conversion rates that takes into consideration data reflecting the one or more digital supplemental content opportunities based on viewer characteristics to a supplemental content exchange because Gilmore teaches conversion rate in the context of automatic content recognition in order to establish impressions because the modification of utilizing known elements according to their known benefits as discussed Kennedy for monitoring ad performance and campaign goal and periodically determining conversion events after a predetermined threshold number of monitored responses and utilizing the conversion events to identify ad values using dynamic data related to conversion events to enable an ad exchange server to update a new set of advertisements contents comprising new ads for underperforming ads and previous effective ads that resulted in conversion events and Lax recognizes the benefit of utilizing content recognition when determining conversion rates which is likely to lead to predictable results for enabling an advertiser and content delivery exchange to improve the conversion rate of provided advertisements and efficiently display supplemental content as recognized in Neumeier for using extracted video content for presenting supplemental content that is optimized in relation to the viewed content and displaying supplemental content on a graphical user interface. Regarding claim 2, “wherein the potential supplemental content items comprise one or more of an image or a content clip from the media stream content” is further rejected on obviousness grounds as discussed in the rejection of claim 1 wherein Burstein col. 3:14-35 teaches a movie advertised in an ad impression is interpreted as an image or content clip from a media stream. Regarding claim 3, “further comprising: building, by the at least one computer processor, a random sample of potential optimal supplemental content items from the media stream content having a predicted relative conversion rate greater than a predetermined value; storing the random sample of potential optimal supplemental content items in a memory connected to the at least one computer processor; and selecting, by the at least one computer processor, the subset of media devices from a plurality of media devices based on one or more characteristics of the plurality of media devices and a relation between one or more characteristics of the subset of media devices and the relative conversion rate of the potential optimal supplemental content” is further rejected on obviousness grounds as discussed in the rejection of claims 1-2 wherein Burstein col. 3:14-67 disclosing probabilistic models and select an advertisement for which an expected value and/or probability of action may be highest, resulting in improved ad campaign effectiveness. Probability of action may be indicative of the chance that the potential consumer to which the ad impression was served will act or react in a certain manner intended by the advertiser. See also col. 13:14-67 disclosing pool of advertisements comprises random advertisements. Regarding claim 5, “wherein the selecting comprises selecting the subset of media devices based on historical playback information” is further rejected on obviousness grounds as discussed in the rejection of claims 1-3 wherein Burstein col. 7:39-64 and col. 10:48-67 to col. 11:1-18 and col. 13:4-13 disclosing historical playback for each viewer. Regarding claim 6, “further comprising receiving an indication from each media device of the subset of media devices confirming that the potential optimal supplemental content was displayed in the menu interface” is further rejected on obviousness grounds as discussed in the rejection of claims 1-3, 5 wherein Burstein col. 7:39-64 and col. 10:48-67 to col. 11:1-18 and col. 13:4-13 disclosing historical playback for each viewer suggests the supplemental content was presented to the viewer. Regarding the system claims 8-11 and the method claims 13-18, 20 the claims are grouped and rejected with the method claims 1-3, 5-6 because the steps of the method claims are met by the disclosure of the apparatus and methods of the reference(s) as discussed in the rejection of claims 1-3, 5-6 and because the steps of the method are easily converted into elements of computer implemented methods and systems by one of ordinary skill in the art. With respect to claims 13-14, the claim recites a limitation relating to closed-caption and live media stream not discussed in the rejection of claims 1-3, 5-6, however, the prior art to Lax discussed in the rejection of claims Lax further renders obvious the limitation regarding closed-caption data and live media stream used to detect automatic content recognition. See Lax para 16-20, 33. Regarding the rejection of claims 16-17 and the element regarding large language model not discussed in the rejection of claims 1-3, 5-6, the prior art to Lax para 34 discloses content recognition comprising neural networks understood to comprise large language models and thus renders the limitations of claims 16-17 obvious. Claims 4 and 19 are rejected under 35 U.S.C. 103 as being unpatentable over Burstein; Jonathan Lee et al. US10565622B1 (hereafter Burstein) and in further view of and in further view of Kennedy; Oliver et al. US 20100114689 A1 (hereafter Kennedy) and in further view of Gilmore; Rudy C. et al. US 20240364950 A1 (hereafter Gilmore) and in further view of Lax; Reuven et al. US 20090006375 A1 (herein after Lax) and in further view of Neumeier; Zeev et al. US 20210084369 A1 (hereafter Neumeier) and in further view of Loheide; Donald Jude et al. US 20180343484 A1 (hereafter Loheide). Regarding claim 4, Burstein and Gilmore are silent with respect to “wherein the characteristic comprises content genre, content personality, content director, content subject matter, content time length, content country of origin, or any combination thereof. Lax para 18 does disclose utilizing genre information. In an analogous art, Loheide teaches the deficiency with respect to genre (para 100-103 presenting optimal advertisements to improve conversion rate and take viewer genre preference into consideration when presenting advertisements. Therefore, it would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the teachings of Burstein, Gilmore, Neumeier and Lax delivering dynamic optimal supplemental content by further incorporating known elements of Loheide for presenting optimal advertisements to improve conversion rate and take viewer genre preference into consideration when presenting advertisements in order to optimize the advertiser’s return on investment for providing advertisement content. Regarding the system claim 19 the claim is grouped and rejected with the method claims 1-6 because the steps of the method claims are met by the disclosure of the apparatus and methods of the reference(s) as discussed in the rejection of claims 1-6 and because the steps of the method are easily converted into elements of computer implemented methods and systems by one of ordinary skill in the art. Claims 7 and 12 are rejected under 35 U.S.C. 103 as being unpatentable over Burstein; Jonathan Lee et al. US10565622B1 (hereafter Burstein) and in further view of and in further view of Kennedy; Oliver et al. US 20100114689 A1 (hereafter Kennedy) and in further view of Gilmore; Rudy C. et al. US 20240364950 A1 (hereafter Gilmore) and in further view of Lax; Reuven et al. US 20090006375 A1 (herein after Lax) and in further view of Neumeier; Zeev et al. US 20210084369 A1 (hereafter Neumeier) and in further view of Ciabarra, JR.; Mario Luciano US 20210176294 A1 (hereafter Ciabarra). Regarding claim 7, Burstein, Gilmore, and Lax and Neumeier are silent with respect to “wherein the calculating the relative conversion rate comprises dividing an existing conversion rate by an average conversion rate based on the existing supplemental content, wherein the average conversion rate based on the existing supplemental content comprises an average across all tracked existing supplemental content. In an analogous art, Ciabarra teaches the deficiency (para 31, 46, 86). Therefore, it would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the teachings of Burstein, Gilmore, Lax, and Neumeier for delivering dynamic optimal supplemental content by further incorporating known elements of Ciabarra for establishing a relative conversion rate based on a ration of an existing conversion rate and average conversion rate in order to calculate an optimal advertiser’s return on investment for providing advertisement content. Regarding the system claim 12 the claim is grouped and rejected with the method claims 1-6 because the steps of the method claims are met by the disclosure of the apparatus and methods of the reference(s) as discussed in the rejection of claims 1-6 and because the steps of the method are easily converted into elements of computer implemented methods and systems by one of ordinary skill in the art. CONCLUSION Any inquiry concerning this communication or earlier communications from the examiner should be directed to ALFONSO CASTRO whose telephone number is (571)270-3950. The examiner can normally be reached on Monday to Friday from 10am to 6pm. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Nathan Flynn can be reached. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of an application may be obtained from the Patent Application Information Retrieval (PAIR) system. Status information for published applications may be obtained from either Private PAIR or Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative or access to the automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /ALFONSO CASTRO/Primary Examiner, Art Unit 2421
Read full office action

Prosecution Timeline

Oct 18, 2024
Application Filed
Dec 17, 2025
Non-Final Rejection mailed — §103
Mar 17, 2026
Response Filed
Jun 03, 2026
Final Rejection mailed — §103
Sep 03, 2026
Request for Continued Examination
Sep 09, 2026
Response after Non-Final Action
Sep 23, 2026
Non-Final Rejection mailed — §103 (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12744966
CONTROL DEVICE, CONTROL METHOD, AND RECORDING MEDIUM
3y 0m to grant Granted Sep 22, 2026
Patent 12707120
LOW-LATENCY CONTENT DELIVERY OVER A PUBLIC NETWORK
2y 0m to grant Granted Aug 11, 2026
Patent 12689787
SYSTEM FOR PROGRAMMING CONTENT CHANNELS
2y 5m to grant Granted Jul 21, 2026
Patent 12647640
Information Processing Apparatus, Information Processing Method, and Program
5y 1m to grant Granted Jun 02, 2026
Patent 12641188
METHOD OF BROADCASTING REAL-TIME ON-LINE COMPETITIONS AND APPARATUS THEREFOR
2y 8m to grant Granted May 26, 2026
Study what changed to get past this examiner. Based on 5 most recent grants.

Strategy Recommendation AI-generated — please review before filing

Get a prosecution strategy drawn from examiner precedents, rejection analysis, and claim mapping.
Typically takes 5-10 seconds — AI-generated, attorney review required before filing

Prosecution Projections

3-4
Expected OA Rounds
51%
Grant Probability
70%
With Interview (+19.4%)
3y 8m (~1y 8m remaining)
Median Time to Grant
High
PTA Risk
Based on 451 resolved cases by this examiner. Grant probability derived from career allowance rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month