Prosecution Insights
Last updated: July 05, 2026
Application No. 18/256,587

Enhanced Video Stabilization Based on Machine Learning Models

Final Rejection §112
Filed
Jun 08, 2023
Priority
Dec 10, 2020 — nonprovisional of PCTUS2020064166
Examiner
CALDERON, CYNTHIA
Art Unit
2639
Tech Center
2600 — Communications
Assignee
Google LLC
OA Round
4 (Final)
77%
Grant Probability
Favorable
5-6
OA Rounds
0m
Est. Remaining
95%
With Interview

Examiner Intelligence

Grants 77% — above average
77%
Career Allowance Rate
607 granted / 789 resolved
+14.9% vs TC avg
Strong +18% interview lift
Without
With
+18.0%
Interview Lift
resolved cases with interview
Typical timeline
2y 5m
Avg Prosecution
21 currently pending
Career history
807
Total Applications
across all art units

Statute-Specific Performance

§101
0.8%
-39.2% vs TC avg
§103
76.8%
+36.8% vs TC avg
§102
14.9%
-25.1% vs TC avg
§112
3.0%
-37.0% vs TC avg
Black line = Tech Center average estimate • Based on career data from 789 resolved cases

Office Action

§112
CTFR 18/256,587 CTFR 84181 DETAILED ACTION Notice of Pre-AIA or AIA Status 07-03-aia AIA 15-10-aia 1. The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA. Notice of Amendments 2. The Examiner acknowledges the amended claims filed on 05/20/2026. - Claims 1, 3-4, 6, 8, 19 and 20 have been amended. - Claim 2 has been cancelled. Information Disclosure Statement 3. The information disclosure statement (IDS) submitted on 04/14/2026 is in compliance with the provisions of 37 CFR 1.97 and was considered by the examiner. Claim Rejections - 35 USC § 112 07-30-02 AIA 4. The following is a quotation of 35 U.S.C. 112(b): (b) CONCLUSION.—The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the inventor or a joint inventor regards as the invention. The following is a quotation of 35 U.S.C. 112 (pre-AIA), second paragraph: The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the applicant regards as his invention. 07-34-01 5. Claims 3-5 and 12-13 are rejected under 35 U.S.C. 112(b) or 35 U.S.C. 112 (pre-AIA), second paragraph, as being indefinite for failing to particularly point out and distinctly claim the subject matter which the inventor or a joint inventor (or for applications subject to pre-AIA 35 U.S.C. 112, the applicant), regards as the invention. Regarding claim 3 , it recites “ a real camera pose” in line 3. It is unclear if “real camera pose” of claim 3, line 3 is related to the real camera pose of claim 1, line 22 or if it is directed to a second and different real camera pose. Similarly, it is unclear if “the real camera pose” of claim 3, line 4 is directed to the real camera pose of claim 1, line 22 or the real camera pose of claim 3, line 3. Regarding claim 4 , it recites “ a virtual camera pose” in line 3. It is unclear if “virtual camera pose” of claim 4, line 3 is related to the virtual camera pose of claim 1, line 18 or if it is directed to a second and different virtual camera pose. Regarding claim 5 , it recites “ the virtual camera pose” in line 3. It is unclear if “virtual camera pose” of claim 5, line 3 is related to the virtual camera pose of claim 1, line 18 or if it is directed to the virtual camera pose of claim 4, line 3. Regarding claim 12 , it recites “ a real camera pose” in line 3. It is unclear if “real camera pose” of claim 12, line 3 is related to the real camera pose of claim 1, line 22 or if it is directed to a second and different real camera pose. Claim 12 further recites “ a virtual camera pose” in line 3. It is unclear if “virtual camera pose” of claim 12, line 3 is related to the virtual camera pose of claim 1, line 18 or if it is directed to a second and different virtual camera pose. Regarding claim 13 , it recites “ the real camera pose” and “ the virtual camera pose” in line 4. It is unclear if “the real camera pose” of claim 13, line 4 is directed to the real camera pose of claim 1, line 22 or the real camera pose of claim 3, line 3. In addition, it is unclear if “virtual camera pose” of claim 13, line 4 is related to the virtual camera pose of claim 1, line 18 or if it is directed to the virtual camera pose of claim 4, line 3. The examiner suggests amending claims 3-5 and 12-13 to properly refer back to the claimed virtual camera pose and real camera pose of claim 1. Alternatively, the examiner suggests, assuming there is support in the specification, amending claims 3-5 and 12-13 to clearly define a second virtual camera pose and a second real camera pose that can differentiate from the ones claimed in claim 1 or recite virtual/real camera poses that are predicted or generated at different specific timings. Appropriate correction is required. Allowable Subject Matter 12-151-07 AIA 07-97 12-51-07 6. Claim s 1, 6-11 and 14-21 are allowed. 13-03 AIA The following is an examiner’s statement of reasons for allowance: 7. Regarding claim 1 , the prior art does not teach or fairly suggest “…method, comprising: receiving, by a mobile computing device, one or more image parameters associated with a video frame of a plurality of video frames; receiving, from a motion sensor of the mobile computing device, motion data associated with the video frame, wherein the motion data is different from the one or more image parameters; and predicting, by applying a neural network to the one or more image parameters and the motion data, a stabilized version of the video frame, wherein the stabilized version removes image degradations caused by a camera shake of the mobile computing device, wherein the neural network comprises an encoder and a decoder, and wherein applying the neural network comprises: applying the encoder of the neural network to the one or more image parameters to generate a latent space representation; adjusting the latent space representation based on the motion data; and applying the decoder of the neural network to the latent space representation as adjusted to output the stabilized version, wherein applying the decoder to the latent space representation comprises: predicting a virtual camera pose for the video frame; and mapping pixels of the video frame from a real camera domain to a virtual camera domain to generate the stabilized version of the video frame, wherein the mapping is performed using a real-to-virtual projection matrix determined based on the predicted virtual camera pose and a real camera pose…” and used in combination with all of the other limitations of claim 1. 8. Claims 3-18 and 21 depend on allowable claim 1. Therefore, the dependent claims are also held allowable. 9. Regarding claim 19 , the prior art does not teach or fairly suggest “…device, comprising: one or more processors; and data storage, wherein the data storage has stored thereon computer-executable instructions that, when executed by the one or more processors, cause the computing device to carry out functions comprising: receiving, by the computing device, one or more image parameters associated with a video frame of a plurality of video frames; receiving, from a motion sensor of the computing device, motion data associated with the video frame, wherein the motion data is different from the one or more image parameters; and predicting, by applying a neural network to the one or more image parameters and the motion data, a stabilized version of the video frame, wherein the stabilized version removes image degradations caused by a camera shake of the computing device, wherein the neural network comprises an encoder and a decoder, and wherein applying the neural network comprises: applying the encoder of the neural network to the one or more image parameters to generate a latent space representation; adjusting the latent space representation based on the motion data; and applying the decoder of the neural network to the latent space representation as adjusted to output the stabilized version, wherein applying the decoder to the latent space representation comprises: predicting a virtual camera pose for the video frame; and mapping pixels of the video frame from a real camera domain to a virtual camera domain to generate the stabilized version of the video frame, wherein the mapping is performed using a real-to-virtual projection matrix determined based on the predicted virtual camera pose and a real camera pose…” and used in combination with all of the other limitations of claim 19. 10. Regarding claim 20 , the prior art does not teach or fairly suggest “…when executed by one or more processors of a computing device, cause the computing device to carry out functions comprising: receiving, by the computing device, one or more image parameters associated with a video frame of a plurality of video frames; receiving, from a motion sensor of the computing device, motion data associated with the video frame, wherein the motion data is different from the one or more image parameters; and predicting, by applying a neural network to the one or more image parameters and the motion data, a stabilized version of the video frame, wherein the stabilized version removes image degradations caused by a camera shake of the computing device, wherein the neural network comprises an encoder and a decoder, and wherein applying the neural network comprises: applying the encoder of the neural network to the one or more image parameters to generate a latent space representation; adjusting the latent space representation based on the motion data; and applying the decoder of the neural network to the latent space representation as adjusted to output the stabilized version, wherein applying the decoder to the latent space representation comprises: predicting a virtual camera pose for the video frame; and mapping pixels of the video frame from a real camera domain to a virtual camera domain to generate the stabilized version of the video frame, wherein the mapping is performed using a real-to-virtual projection matrix determined based on the predicted virtual camera pose and a real camera pose…” and used in combination with all of the other limitations of claim 20. 11 . Any comments considered necessary by applicant must be submitted no later than the payment of the issue fee and, to avoid processing delays, should preferably accompany the issue fee. Such submissions should be clearly labeled “Comments on Statement of Reasons for Allowance.” Citation of Pertinent Art 07-96 AIA 12. The prior art made of record and not relied upon is considered pertinent to applicant’s disclosure. Zhang et al. (US Patent 12,294,744) discloses performing the pupil location recognition on the eye image of the target person using a pre-trained deep neural network and projecting, based on the depth map of the target image and the pose of the real viewpoint corresponding to the target image, the target image onto the imaging plane corresponding to the virtual viewpoint comprises: determining a first projection matrix based on the pose of the real viewpoint corresponding to the target image; back-projecting the target image onto three-dimensional space based on the first projection matrix and the depth map of the target image; determining a second projection matrix based on a pose of the virtual viewpoint; and projecting, based on the second projection matrix, pixels in the three-dimensional space onto the imaging plane corresponding to the virtual viewpoint. Shi et al. (US Patent 10,462,370) discloses the first transformation being determined based on the OIS position data for the particular frame and the device position data for the particular frame, wherein the first transformation involves a first projection matrix for projecting image data for the particular frame to an intermediate space; determining a second transformation for the particular frame based on the first transformation and positions of the recording device determined, based on the device position data, for one or more frames in the series of frames that are captured after the particular frame, wherein the second transformation involves a second projection matrix for projecting the image data in the intermediate space to a stabilized version of the particular frame; and generating the stabilized version of the particular frame using the second transformation . Conclusion 07-40 AIA 13. Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL . See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action. 14. Any inquiry concerning this communication or earlier communications from the examiner should be directed to CYNTHIA CALDERON whose telephone number is (571)270-3580. The examiner can normally be reached M-F 9:00 AM-5:00 PM. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, TWYLER HASKINS can be reached at (571)272-7406. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /CYNTHIA CALDERON/Primary Examiner, Art Unit 2639 06/01/2026 Application/Control Number: 18/256,587 Page 2 Art Unit: 2639 Application/Control Number: 18/256,587 Page 3 Art Unit: 2639 Application/Control Number: 18/256,587 Page 4 Art Unit: 2639 Application/Control Number: 18/256,587 Page 5 Art Unit: 2639 Application/Control Number: 18/256,587 Page 6 Art Unit: 2639 Application/Control Number: 18/256,587 Page 7 Art Unit: 2639 Application/Control Number: 18/256,587 Page 8 Art Unit: 2639 Application/Control Number: 18/256,587 Page 9 Art Unit: 2639
Read full office action

Prosecution Timeline

Show 3 earlier events
Oct 07, 2025
Final Rejection mailed — §112
Jan 26, 2026
Request for Continued Examination
Feb 05, 2026
Response after Non-Final Action
Feb 23, 2026
Non-Final Rejection mailed — §112
May 04, 2026
Examiner Interview Summary
May 04, 2026
Applicant Interview (Telephonic)
May 20, 2026
Response Filed
Jun 04, 2026
Final Rejection mailed — §112 (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12659598
IMAGE PROCESSING APPARATUS AND CONTROL METHOD THEREOF, IMAGE CAPTURING APPARATUS, AND STORAGE MEDIUM
2y 1m to grant Granted Jun 16, 2026
Patent 12659573
EXTERNAL DISPLAY DEVICE, INFORMATION PROCESSING DEVICE, AND EXTERNAL DISPLAY METHOD
2y 2m to grant Granted Jun 16, 2026
Patent 12659571
METHOD AND SYSTEM FOR A FACE DETECTION MANAGEMENT
1y 10m to grant Granted Jun 16, 2026
Patent 12659590
DUAL APERTURE ZOOM DIGITAL CAMERA
1y 3m to grant Granted Jun 16, 2026
Patent 12648078
BASE MEMBER, ELECTRONIC DEVICE, AND STRUCTURE
2y 8m to grant Granted Jun 02, 2026
Study what changed to get past this examiner. Based on 5 most recent grants.

Strategy Recommendation AI-generated — please review before filing

Get a prosecution strategy drawn from examiner precedents, rejection analysis, and claim mapping.
Typically takes 5-10 seconds — AI-generated, attorney review required before filing

Prosecution Projections

5-6
Expected OA Rounds
77%
Grant Probability
95%
With Interview (+18.0%)
2y 5m (~0m remaining)
Median Time to Grant
High
PTA Risk
Based on 789 resolved cases by this examiner. Grant probability derived from career allowance rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month