Prosecution Insights
Last updated: November 20, 2026
Application No. 19/060,895

AUGMENTING DATASETS FOR TRAINING AUDIO GENERATION MODELS

Non-Final OA §103
Filed
Feb 24, 2025
Priority
Jun 30, 2022 — continuation of 12/254,864
Examiner
SAINT CYR, LEONARD
Art Unit
2658
Tech Center
2600 — Communications
Assignee
Amazon Technologies Inc.
OA Round
1 (Non-Final)
78%
Grant Probability
Favorable
1-2
OA Rounds
1y 4m
Est. Remaining
95%
With Interview

Examiner Intelligence

Grants 78% — above average
78%
Career Allowance Rate
916 granted / 1182 resolved
+15.5% vs TC avg
Strong +18% interview lift
Without
With
+17.9%
Interview Lift
resolved cases with interview
Typical timeline
3y 1m
Avg Prosecution
24 currently pending
Career history
1221
Total Applications
across all art units

Statute-Specific Performance

§101
16.9%
-23.1% vs TC avg
§103
41.7%
+1.7% vs TC avg
§102
27.2%
-12.8% vs TC avg
§112
1.3%
-38.7% vs TC avg
Black line = Tech Center average estimate • Based on career data from 1182 resolved cases

Office Action

§103
DETAILED ACTION Notice of Pre-AIA or AIA Status The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA . Double Patenting The nonstatutory double patenting rejection is based on a judicially created doctrine grounded in public policy (a policy reflected in the statute) so as to prevent the unjustified or improper timewise extension of the “right to exclude” granted by a patent and to prevent possible harassment by multiple assignees. A nonstatutory double patenting rejection is appropriate where the conflicting claims are not identical, but at least one examined application claim is not patentably distinct from the reference claim(s) because the examined application claim is either anticipated by, or would have been obvious over, the reference claim(s). See, e.g., In re Berg, 140 F.3d 1428, 46 USPQ2d 1226 (Fed. Cir. 1998); In re Goodman, 11 F.3d 1046, 29 USPQ2d 2010 (Fed. Cir. 1993); In re Longi, 759 F.2d 887, 225 USPQ 645 (Fed. Cir. 1985); In re Van Ornum, 686 F.2d 937, 214 USPQ 761 (CCPA 1982); In re Vogel, 422 F.2d 438, 164 USPQ 619 (CCPA 1970); In re Thorington, 418 F.2d 528, 163 USPQ 644 (CCPA 1969). A timely filed terminal disclaimer in compliance with 37 CFR 1.321(c) or 1.321(d) may be used to overcome an actual or provisional rejection based on nonstatutory double patenting provided the reference application or patent either is shown to be commonly owned with the examined application, or claims an invention made as a result of activities undertaken within the scope of a joint research agreement. See MPEP § 717.02 for applications subject to examination under the first inventor to file provisions of the AIA as explained in MPEP § 2159. See MPEP § 2146 et seq. for applications not subject to examination under the first inventor to file provisions of the AIA . A terminal disclaimer must be signed in compliance with 37 CFR 1.321(b). The filing of a terminal disclaimer by itself is not a complete reply to a nonstatutory double patenting (NSDP) rejection. A complete reply requires that the terminal disclaimer be accompanied by a reply requesting reconsideration of the prior Office action. Even where the NSDP rejection is provisional the reply must be complete. See MPEP § 804, subsection I.B.1. For a reply to a non-final Office action, see 37 CFR 1.111(a). For a reply to final Office action, see 37 CFR 1.113(c). A request for reconsideration while not provided for in 37 CFR 1.113(c) may be filed after final for consideration. See MPEP §§ 706.07(e) and 714.13. The USPTO Internet website contains terminal disclaimer forms which may be used. Please visit www.uspto.gov/patent/patents-forms. The actual filing date of the application in which the form is filed determines what form (e.g., PTO/SB/25, PTO/SB/26, PTO/AIA /25, or PTO/AIA /26) should be used. A web-based eTerminal Disclaimer may be filled out completely online using web-screens. An eTerminal Disclaimer that meets all requirements is auto-processed and approved immediately upon submission. For more information about eTerminal Disclaimers, refer to www.uspto.gov/patents/apply/applying-online/eterminal-disclaimer. Claims 1 – 20 are rejected on the ground of nonstatutory double patenting as being unpatentable over claims 1 - 20 of U.S. Patent No. 12,254,864. Although the claims at issue are not identical, they are not patentably distinct from each other because claims 1 - 20 of the instant application are similar in scope and content of the claims of the cited US patent. It would have been obvious to an artisan at the time the invention was made to use the teaching of claims 1 – 20 of the '864' Patent as a general teaching for predicting new encoded speech sequences, to perform method as claimed in the present invention. The instant claims obviously encompass the claimed invention of the '864' Patent and differ only in the method steps. The extent that the instant claims are broaden and therefore generic to claimed invention of '864' Patent [species], In re Goodman 29 USPQ 2d 2010 CAFC 1993, states that a generic claim cannot be issued without a terminal disclaimer, if a species claim has been previously been claimed in a patent. And since the structure is as recited, the method step is obtained and therefore, obvious. Here is a comparison between claim 1 of the instant application and claim 5 of the cited patent (12,254,864). Instant Application 19/060,895 Cited Patent 12,254,864 Comparison 1. A computer-implemented method, comprising: 5. A method comprising: Same receiving first audio data representing first speech; receiving first audio data representing first speech; Same generating, using the first audio data, first encoded data representing semantic information and feature data of the first speech; generating, using the first audio data, first encoded data representing semantic information and feature data of the first speech; Same processing the first encoded data using a computer model to generate second encoded data, the second encoded data representing a predicted continuation of the first speech, wherein the computer model is trained to predict a subsequent portion of encoded audio data based on a preceding portion of encoded audio data; and training a computer model to predict a subsequent portion of the first encoded data based on a preceding portion of the first encoded data; receiving second audio data representing second speech; processing the second encoded data using the computer model to generate third encoded data, the third encoded data representing a predicted continuation of the second speech; and Similar generating, using the second encoded data, second audio data representing first synthesized speech having voice characteristics similar to those of the first speech. generating, using the second audio data, second encoded data representing semantic information and feature data of the second speech; generating, using the third encoded data, third audio data representing first synthesized speech having voice characteristics similar to those of the second speech. Similar Claim Rejections - 35 USC § 103 The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action: A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made. Claims 1 – 20 are rejected under 35 U.S.C. 103 as being unpatentable over Haidar et al. (US PAP 2022/0122590) in view of Finkelstein et al. (US PAP 2022/0051654). As per claims 1, 11, Haidar et al. teach computer-implemented method/system, comprising: receiving first audio data representing first speech ("obtaining an input speech sequence that comprises an input set of speech frame feature vectors that each represent a respective speech frame that corresponds to a respective time step"; paragraph 11); generating, using the first audio data, first encoded data representing semantic information and feature data of the first speech ("processing the input speech sequence, using a subsampling operation of the encoder NN, into the first speech sequence, wherein the first speech sequence includes fewer speech frame feature vectors than the input speech sequence."; paragraphs 11-14); processing the first encoded data using a computer model to generate second encoded data, the second encoded data representing a predicted of the first speech ("transform the second speech sequence, using a self-attention operation of the encoder NN, into a third speech sequence that comprises a third set of speech frame feature vectors; process the third speech sequence, using a probability operation of the encoder NN, to predict a sequence of first labels corresponding to the third set of speech frame feature vectors; and process the third speech sequence using a decoder NN to predict a sequence of second labels corresponding to the third set of speech frame feature vectors."; paragraphs 17- 19); wherein the computer model is trained to predict a subsequent portion of encoded audio data based on a preceding portion of encoded audio data ("during a training stage of the encoder NN and the decoder NN: computing a loss function based on the predicted sequence of first labels and the predicted sequence of second labels; performing back propagation using gradient decent to update learnable parameters of the decoder NN and the encoder NN to reduce the loss function. "; paragraphs 7 - 10). However, Haidar et al. do not specifically teach predicted continuation speech; generating, using the second encoded data, second audio data representing first synthesized speech having voice characteristics similar to those of the first speech. Finkelstein et al. teach providing the intermediate synthesized speech representation to the second TTS model includes providing the sequence of fixed-length reference frames sampled from the intermediate synthesized speech representation to the encoder portion, whereby the encoder portion is configured to encode the sequence of fixed-length reference frames into the utterance embedding. The prosodic features that represent the intended prosody possessed by the intermediate synthesized speech representation may include duration, pitch contour… the corresponding utterance embedding into a sequence of fixed-length predicted frames providing a prosodic representation of the input text utterance. Here, the prosodic representation represents the intended prosody specified by the utterance embedding. The second TTS model may be trained so that a number of the fixed-length predicted frames decoded by the decoder portion is equal to a number of the fixed-length reference frames sampled from the intermediate synthesized speech representation (decoding portion is equal to a number of the fixed-length reference frames sampled from the intermediate synthesized speech representation implies continuation of the speech; paragraphs 5, 6, see also 60- 63). Therefore, it would have been obvious to one of ordinary skill in the art before the effective filling date of the claimed invention to generate synthesized speech having voice characteristics as taught by Finkelstein et al. in Haidar et al., because that would help improve the naturalness of synthesized speech and provide potential for robustly synthesizing speech (paragraph 29, lines 6, 7). As per claims 2, 12, Haidar et al. in view of Finkelstein et al. further disclose processing the first encoded data using a computer model comprises processing the first encoded data using a language model (“trained RNN language model”; Haidar et al., paragraphs 77, 93). As per claims 3, 13, Haidar et al. in view of Finkelstein et al. further disclose the first audio data is captured by a first device and the method further comprises: using, by the first device, a vocoder to generate the second audio data (“during a training stage of the encoder NN and the decoder NN”; Haidar et al., paragraphs 7 – 9; Finkelstein et al. paragraphs 58, 59). As per claims 4, 14, Haidar et al. in view of Finkelstein et al. further disclose receiving, by the computer model, an input prompt, wherein the input prompt corresponds to a request to generate the first synthesized speech (“using a first text-to-speech (TTS) model, an intermediate synthesized speech representation for the input text utterance. The intermediate synthesized speech representation possesses the intended prosody. The method also includes providing, by the data processing hardware, the intermediate synthesized speech representation to a second TTS model including an encoder portion and a decoder portion.”; Finkelstein et al., Abstract, paragraphs 4 – 16). As per claims 5, 15, Haidar et al. in view of Finkelstein et al. further disclose receiving, an indication that the input prompt corresponds to a particular speaker identity associated with the voice characteristics (“features containing information about a speaker, a gender of the speaker, and/or whether the utterance is a question or phrase.”; Finkelstein et al., paragraphs 4 – 16, 29 - 39). As per claims 6, 16, Haidar et al. in view of Finkelstein et al. further disclose generating second audio data representing the first synthesized speech comprises generating a prediction of a continuation of the first speech (“the corresponding utterance embedding into a sequence of fixed-length predicted frames providing a prosodic representation of the input text utterance. Here, the prosodic representation represents the intended prosody specified by the utterance embedding. The second TTS model may be trained so that a number of the fixed-length predicted frames decoded by the decoder portion is equal to a number of the fixed-length reference frames sampled from the intermediate synthesized speech representation”; Finkelstein et al., paragraphs 4 – 16, 29 - 39). As per claims 7, 17, Haidar et al. in view of Finkelstein et al. further disclose determining, using the second encoded data, first data representing a first transcript of the predicted continuation of the first speech; processing the first data using a TTS model to generate third audio data representing second synthesized speech; and training the TTS model based on processing the second audio data and the third audio data (Finkelstein et al., paragraphs 4 – 16, 29 - 39). As per claims 8, 18, Haidar et al. in view of Finkelstein et al. further disclose receiving second data representing a second transcript of content to be output as synthesized speech having second voice characteristics of second speech; and processing the second data using the trained TTS model to generate fourth audio data representing third synthesized speech having the second voice characteristics of the second speech (Finkelstein et al., paragraphs 4 – 16, 29 - 39). As per claims 9, 19, Haidar et al. in view of Finkelstein et al. further disclose prior to receiving the first audio data: receiving third audio data representing third speech; generating, using the third audio data, third encoded data representing semantic information and feature data of the first speech; and training the computer model to predict a subsequent portion of the third encoded data based on a preceding portion of the third encoded data ("transform the second speech sequence, using a self-attention operation of the encoder NN, into a third speech sequence that comprises a third set of speech frame feature vectors; process the third speech sequence, using a probability operation of the encoder NN, to predict a sequence of first labels corresponding to the third set of speech frame feature vectors; and process the third speech sequence using a decoder NN to predict a sequence of second labels corresponding to the third set of speech frame feature vectors."; Haidar et al., paragraphs 11 – 19). As per claims 10, 20, Haidar et al. in view of Finkelstein et al. further disclose performing ASR processing on the third audio data to generate ASR output data, the ASR output data including at least a first indication of a first phoneme and a second indication of a second phoneme; determining a first portion of the third encoded data that represents a first portion of the third audio data corresponding to the first phoneme; and determining a second portion of the third encoded data that represents a second portion of the third audio data corresponding to the second phoneme (“the encoder portion may be configured to encode the sequence of fixed-length reference frames into the utterance embedding by, for each syllable in the intermediate synthesized speech representation encoding phone-level linguistic features associated with each phoneme in the syllable into a phoneme feature-based syllable embedding…The encoder portion 300a includes hierarchical levels of reference frames 211, phonemes”: Finkelstein et al., paragraphs 4 – 16, 29 – 39, 48). Conclusion The prior art made of record and not relied upon is considered pertinent to applicant's disclosure. Hakkani-Tur et al. teach token level utterance encodings corresponding to different tokens of transcription. Wu et al. teach voice synthesis method, model training method. Zhang et al. teach speech processing method, wherein speech synthesis model includes a plurality of encoders. Lim et al. teach generating a second audio signal using linear prediction coefficients. Kao et al. teach predicting a subsequent portion of audio data (e.g., a subsequent frame of audio data). Any inquiry concerning this communication or earlier communications from the examiner should be directed to LEONARD SAINT-CYR whose telephone number is (571)272-4247. The examiner can normally be reached Monday- Friday. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Richemond Dorvil can be reached at (571)272-7602. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /LEONARD SAINT-CYR/Primary Examiner, Art Unit 2658
Read full office action

Prosecution Timeline

Feb 24, 2025
Application Filed
Nov 02, 2026
Non-Final Rejection mailed — §103 (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12801867
SWITCHBOARD PLATFORM FOR FOUNDATION MODELS
2y 6m to grant Granted Nov 17, 2026
Patent 12784748
Delay Gating for Voice Arbitration
2y 9m to grant Granted Nov 03, 2026
Patent 12784120
ADAPTIVE MISSION STRATEGY OPTIMIZATION THROUGH AI-GENERATED AMBIENT RECOMMENDATIONS FOR TACTICAL COMMAND
2y 1m to grant Granted Nov 03, 2026
Patent 12755734
INSERTION ERROR REDUCTION WITH CONFIDENCE SCORE-BASED WORD FILTERING
3y 6m to grant Granted Oct 06, 2026
Patent 12755095
PERCEPTION CAPTURE SYSTEM
2y 4m to grant Granted Oct 06, 2026
Study what changed to get past this examiner. Based on 5 most recent grants.

Strategy Recommendation AI-generated — please review before filing

Get a prosecution strategy drawn from examiner precedents, rejection analysis, and claim mapping.
Typically takes 5-10 seconds — AI-generated, attorney review required before filing

Prosecution Projections

1-2
Expected OA Rounds
78%
Grant Probability
95%
With Interview (+17.9%)
3y 1m (~1y 4m remaining)
Median Time to Grant
Low
PTA Risk
Based on 1182 resolved cases by this examiner. Grant probability derived from career allowance rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month