Prosecution Insights
Last updated: April 19, 2026
Application No. 17/106,027

MONITORING BIAS METRICS AND FEATURE ATTRIBUTION FOR TRAINED MACHINE LEARNING MODELS

Final Rejection §112
Filed
Nov 27, 2020
Examiner
ROY, SANCHITA
Art Unit
2146
Tech Center
2100 — Computer Architecture & Software
Assignee
Amazon Technologies, Inc.
OA Round
6 (Final)
72%
Grant Probability
Favorable
7-8
OA Rounds
3y 3m
To Grant
99%
With Interview

Examiner Intelligence

Grants 72% — above average
72%
Career Allow Rate
228 granted / 316 resolved
+17.2% vs TC avg
Strong +46% interview lift
Without
With
+46.0%
Interview Lift
resolved cases with interview
Typical timeline
3y 3m
Avg Prosecution
19 currently pending
Career history
335
Total Applications
across all art units

Statute-Specific Performance

§101
11.3%
-28.7% vs TC avg
§103
45.4%
+5.4% vs TC avg
§102
10.9%
-29.1% vs TC avg
§112
27.3%
-12.7% vs TC avg
Black line = Tech Center average estimate • Based on career data from 316 resolved cases

Office Action

§112
Notice of Pre-AIA or AIA Status The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA . Claims 1-20 are pending in the case. This action is responsive to the Amendment filed on 1/30/2026. Information Disclosure Statement Documents listed in applicant’s Information Disclosure Statements dated 1/15/2026, have been considered but have been crossed out, as they patent applications that are not currently published and will not be listed as cited references in any subsequent patent publication resulting from the instant application. Response to Arguments Applicant's amendments with regards to the 35 U.S.C. § 112(a) rejection of claim(s) 1-20 have been considered, but are not persuasive. Examiner notes that applicant incorrectly refers to claims 1, 5 and 14, instead of claims 1, 6 and 14. Applicant argues PNG media_image1.png 163 643 media_image1.png Greyscale PNG media_image1.png 163 643 media_image1.png Greyscale PNG media_image2.png 158 629 media_image2.png Greyscale Examiner respectfully disagrees. The above paragraph and the rest of Applicant’s specification discloses - monitoring a trained machine learning model by relying upon reference data, and - collecting reference data as part of training the trained machine learning model, and therefore discloses the reference data, upon which monitoring of the trained machine learning model relies, was collected as part of training the trained machine learning model. However the original disclosure does not disclose a determination step for making a determination that reference that was collected as part of training, and therefore does not disclose a determination step for “determine that the reference data, upon which monitoring of the trained machine learning model relies, was collected as part of training the trained machine learning model according to the selection of the one or more bias metrics or feature attribution received before the training of the trained machine learning model” as recited in claim 1, and “determining that the reference data was collected, upon which monitoring of the trained machine learning model relies, as part of training the trained machine learning model according to the selection of the one or more bias metrics or feature attribution received before the training of the trained machine learning model” as recited in claims 6 and 14. The 35 U.S.C. § 112(a) rejection of claim(s) 1-20 is respectfully maintained. Claim Rejections - 35 USC § 112 The following is a quotation of the first paragraph of 35 U.S.C. 112(a): (a) IN GENERAL.—The specification shall contain a written description of the invention, and of the manner and process of making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it pertains, or with which it is most nearly connected, to make and use the same, and shall set forth the best mode contemplated by the inventor or joint inventor of carrying out the invention. The following is a quotation of the first paragraph of pre-AIA 35 U.S.C. 112: The specification shall contain a written description of the invention, and of the manner and process of making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it pertains, or with which it is most nearly connected, to make and use the same, and shall set forth the best mode contemplated by the inventor of carrying out his invention. Claims 1-20 are rejected under 35 U.S.C. 112(a) or 35 U.S.C. 112 (pre-AIA ), first paragraph, as failing to comply with the written description requirement. The claim(s) contains subject matter which was not described in the specification in such a way as to reasonably convey to one skilled in the relevant art that the inventor or a joint inventor, or for applications subject to pre-AIA 35 U.S.C. 112, the inventor(s), at the time the application was filed, had possession of the claimed invention. Claim 1 recites “determine that the reference data, upon which monitoring of the trained machine learning model relies, was collected as part of training the trained machine learning model according to the selection of the one or more bias metrics or feature attribution received before the training of the trained machine learning model”, and claims 6 and 14, each recite “determining that the reference data was collected, upon which monitoring of the trained machine learning model relies, as part of training the trained machine learning model according to the selection of the one or more bias metrics or feature attribution received before the training of the trained machine learning model” (Emphasis added). The original specification discloses - monitoring a trained machine learning model by relying upon reference data, and - collecting reference data as part of training the trained machine learning model, and therefore discloses the reference data, upon which monitoring of the trained machine learning model relies, was collected as part of training the trained machine learning model. However the original disclosure does not disclose a determination step for making a determination that reference that was collected as part of training, and therefore does not disclose a determination step for “determine that the reference data, upon which monitoring of the trained machine learning model relies, was collected as part of training the trained machine learning model according to the selection of the one or more bias metrics or feature attribution received before the training of the trained machine learning model” as recited in claim 1, and “determining that the reference data was collected, upon which monitoring of the trained machine learning model relies, as part of training the trained machine learning model according to the selection of the one or more bias metrics or feature attribution received before the training of the trained machine learning model” as recited in claims 6 and 14. Therefore the above noted limitations of claims 1, 6 and 14 do not have support in the original specification. Claims 2-5, 7-13 and 15-20, merely recite additional functions performed by the inventions of claims 1, 6 and 14. Accordingly, claims 2-5, 7-13 and 15-20 are also rejected under 35 U.S.C. 112(a). Applicant is requested to make appropriate amendments to the claims or clearly point of the specific portions of paragraphs in the specification that support the claim limitations. Conclusion The prior art made of record and not relied upon is considered pertinent to applicant's disclosure. Bhide (US 20210406712 A1) discloses determining divergence metrics for a machine learning pipeline. Wick (US20200372406A1) discloses selecting a subset of one or more bias metrics or the feature attributions. Merrill (US 20190378210 A1) discloses constantly training and monitoring a deployed machine learning model for divergence. Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action. Any inquiry concerning this communication or earlier communications from the examiner should be directed to SANCHITA ROY whose telephone number is (571)272-5310. The examiner can normally be reached Monday-Friday 12-8. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Usmaan Saeed can be reached at (571) 272-4046. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. SANCHITA ROY Primary Examiner Art Unit 2146 /SANCHITA ROY/Primary Examiner, Art Unit 2146
Read full office action

Prosecution Timeline

Nov 27, 2020
Application Filed
Nov 18, 2023
Non-Final Rejection — §112
Feb 12, 2024
Response Filed
May 18, 2024
Final Rejection — §112
Jul 22, 2024
Response after Non-Final Action
Aug 02, 2024
Response after Non-Final Action
Aug 02, 2024
Applicant Interview (Telephonic)
Aug 23, 2024
Request for Continued Examination
Aug 27, 2024
Response after Non-Final Action
Sep 07, 2024
Non-Final Rejection — §112
Jan 06, 2025
Response Filed
Mar 31, 2025
Final Rejection — §112
Aug 04, 2025
Response after Non-Final Action
Aug 29, 2025
Request for Continued Examination
Sep 09, 2025
Response after Non-Final Action
Sep 27, 2025
Non-Final Rejection — §112
Jan 30, 2026
Response Filed
Mar 14, 2026
Final Rejection — §112 (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12599476
AI-BASED VIDEO ANALYSIS OF CATARACT SURGERY FOR DYNAMIC ANOMALY RECOGNITION AND CORRECTION
2y 5m to grant Granted Apr 14, 2026
Patent 12585966
INTELLIGENT DEVICE SELECTION USING HISTORICAL INTERACTIONS
2y 5m to grant Granted Mar 24, 2026
Patent 12585870
READER MODE-OPTIMIZED ATTENTION APPLICATION
2y 5m to grant Granted Mar 24, 2026
Patent 12579656
MACHINE LEARNING DENTAL SEGMENTATION SYSTEM AND METHODS USING GRAPH-BASED APPROACHES
2y 5m to grant Granted Mar 17, 2026
Patent 12562275
INTERACTIVE SUBGROUP DISCOVERY
2y 5m to grant Granted Feb 24, 2026
Study what changed to get past this examiner. Based on 5 most recent grants.

AI Strategy Recommendation

Get an AI-powered prosecution strategy using examiner precedents, rejection analysis, and claim mapping.
Powered by AI — typically takes 5-10 seconds

Prosecution Projections

7-8
Expected OA Rounds
72%
Grant Probability
99%
With Interview (+46.0%)
3y 3m
Median Time to Grant
High
PTA Risk
Based on 316 resolved cases by this examiner. Grant probability derived from career allow rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month