Prosecution Insights
Last updated: August 04, 2026
Application No. 18/050,929

CALIBRATING CONFIDENCE OF CLASSIFICATION MODELS

Non-Final OA §103
Filed
Oct 28, 2022
Examiner
BRAHMACHARI, MANDRITA
Art Unit
2144
Tech Center
2100 — Computer Architecture & Software
Assignee
Intel Corporation
OA Round
2 (Non-Final)
77%
Grant Probability
Favorable
2-3
OA Rounds
0m
Est. Remaining
99%
With Interview

Examiner Intelligence

Grants 77% — above average
77%
Career Allowance Rate
317 granted / 414 resolved
+21.6% vs TC avg
Strong +30% interview lift
Without
With
+29.6%
Interview Lift
resolved cases with interview
Typical timeline
2y 11m
Avg Prosecution
28 currently pending
Career history
440
Total Applications
across all art units

Statute-Specific Performance

§101
0.9%
-39.1% vs TC avg
§103
85.4%
+45.4% vs TC avg
§102
2.0%
-38.0% vs TC avg
§112
1.9%
-38.1% vs TC avg
Black line = Tech Center average estimate • Based on career data from 414 resolved cases

Office Action

§103
CTFR 18/050,929 CTFR 91069 Notice of Pre-AIA or AIA Status 07-03-aia AIA 15-10-aia The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA. DETAILED ACTION The action is in response to claims dated 4/13/2026 Claims pending in the case: 1-25 Claim Rejections - 35 USC § 103 07-06 AIA 15-10-15 In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status. 07-20-aia AIA The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action: A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made. 07-21-aia AIA Claim (s) 1-7, 9-17, 19-25 is/are rejected under 35 U.S.C. 103 as being unpatentable over Yao (Automatic Weakly Supervised Object Detection From High Spatial Resolution Remote Sensing Images via Dynamic Curriculum Learning) in view of Rowe (US 20220366280) . Rowe not used in the prior office action. Regarding Claim 1, Yao teaches, A method, comprising: accessing a deep neural network (DNN) that has been trained to receive an input and to output a class of the input and a confidence score indicating a likelihood of the input falling into the class (Yao: Pg. 677 col 2 [1]: baseline DNN with classification and detection score); inputting calibration samples into the DNN, the DNN outputting classes of the calibration samples, the calibration samples associated with ground-truth labels indicating ground-truth classes of the calibration samples (Yao: Pg. 679 col 1 section B [1-2]: collaborative learning strategy using samples labeled with ground-truth); and training a calibration function associated with the DNN, the calibration function to compute confidence scores of classifications predicted by the DNN, wherein training the calibration function comprises optimizing a value … learnable parameter based on the classes of the calibration samples and the ground-truth classes of the calibration samples (Yao: Pg. 680 col 1 Algorithm 1, Pg. 683 col 1 section D [1-2]: learning a function to generate confidence score; section A-2 Pg. 678 col 2 [2] – Pg. 679 col 1 [1]: function to generate confidence score), wherein … after the training … determine a new confidence score indicating a new likelihood of the input falling into the class (Yao: Pg. 680 col 1 section B-3: a new detection model is learned (new probability score), Pg. 679 col 1 [1], Pg. 683 col 2 section D [2]: get image difficulty score which is confidence-based); Although Yao does not recite determining a confidence score, Yao teaches, calibrating a function to determine a difficulty score which is confidence based and therefore may be regarded as the confidence score. Yao does not specifically teach, the calibration function comprising a first learnable parameter and a second learnable parameter; determine a new confidence score; Rowe teaches, the calibration function comprising a first learnable parameter and a second learnable parameter (Rowe [68-72]: [69]: “α and β are variable parameters that are tuned by the system during training of the confidence score model”); determine a new confidence score (Rowe: [74]: iteratively training confidence model); It would have been obvious to a person of ordinary skill in the art before the effective filing date of the claimed invention to combine the teachings of Yao and Rowe because the combination would enable using a function for determining a confidence score. One of ordinary skill in the art would have been motivated to combine the teachings because the combination would enable using a confidence measure to determine accuracy of prediction (see Rowe [4]). Regarding claim 2, Yao and Rowe teach the invention as claimed in claim 1 above and, wherein training the calibration function comprises: optimizing the value of the first learnable parameter and the value of the second learnable parameter by minimizing a loss between the classes of the calibration samples and the ground-truth classes of the calibration samples (Yao: Pg. 679 col 1 section B [1-2]: collaborative learning strategy using samples labeled with ground-truth; Pg. 680 col 1 Algorithm 1, Pg. 683 col 1 section D [1-2]: learning a function to generate confidence score; section A-2 Pg. 678 col 2 [2] – Pg. 679 col 1 [1]: function to generate confidence score) (Rowe [34]: confidence model training by minimizing error) . Regarding claim 3, Yao and Rowe teach the invention as claimed in claim 1 above and, wherein the value of the first learnable parameter or the value of the second learnable parameter is above zero (Yao: Pg. 679 col 1 section B [1-2]: collaborative learning updating parameters; Pg. 681 col 1 [2]: positive values) (Rowe [68-72, 74]: confidence model training function with learnable parameters). Training parameters may be positive. It is noted here that the parameter being positive is non-functional and is not functionally involved in the steps recited. Thus, this descriptive material will not distinguish the claimed invention from the prior art in terms of patentability. Regarding claim 4, Yao and Rowe teach the invention as claimed in claim 1 above and, wherein a value of the new confidence score decreases as the value of the first learnable parameter or the value of the second learnable parameter increases (Rowe [68-72, 74]: confidence model training function with learnable parameters). It is noted here that the changes would depend on the function being used and this information is not functionally involved in the steps recited beyond outputting a confidence score by some function. Regarding claim 5, Yao and Rowe teach the invention as claimed in claim 1 above and, wherein: associating the calibration function with the DNN comprises associating the calibration (Yao: Pg. 679 col 1 section B [1-2]: collaborative learning; section A-2 Pg. 678 col 2 [2] – Pg. 679 col 1 [1]: function to generate confidence score) (Rowe [68-72, 74]: confidence model training function with learnable parameters). Regarding claim 6, Yao and Rowe teach the invention as claimed in claim 5 above and, wherein the calibration function is a function of an entropy of a vector generated by the one or more of hidden layers (Yao: Pg. 676 col 1 [2], Pg. 678 col 2 [2] - Pg. 679 col 1 [1], Pg. 683 Table III. Section D [1]: entropy based) Regarding claim 7, Yao and Rowe teach the invention as claimed in claim 5 above and, wherein the output layer includes a softmax function that determines the likelihood of the input falling into the class (Yao Pg. 978 col 1 [1]: softmax to assign to a class). Regarding claim 9, Yao and Rowe teach the invention as claimed in claim 1 above and, wherein an accuracy of the DNN before training the calibration function is the same as an accuracy of the DNN after training the calibration function (Rowe [68-72, 74]: confidence model with a calibration function). Regarding claim 10, Yao and Rowe teach the invention as claimed in claim 1 above and, wherein the DNN has been trained by: inputting one or more training samples into the DNN, the DNN outputting classes of the one or more training samples, the one or more training samples associated with ground-truth labels indicating ground-truth classes of the one or more training samples (Yao: Pg. 679 col 1 section B [1-2]: collaborative learning strategy using samples labeled with ground-truth) (Rowe [25, 32]: model to generate a class); and optimizing values of internal parameters of the DNN based on the classes of the one or more training samples and the ground-truth classes of the one or more training samples (Yao: Pg. 679 col 2 section B-2 [2], Pg. 680 col 1 Algorithm 1: dynamic learning) (Rowe [25, 32]: model to generate a class), wherein the one or more training samples are different from the calibration samples (Rowe: Fig. 2, [68-72, 74]: confidence model training data set) (Yao: Pg. 679 col 1 section B [1]: use different sample sets based on difficulty score). Regarding Claim(s) 11-17, 19-20 , this/these claim(s) is/are similar in scope as claim(s) 1-7, 9-10 respectively. Therefore, this/these claim(s) is/are rejected under the same rationale. Regarding Claim(s) 21-25 , this/these claim(s) is/are similar in scope as claim(s) 1-3, 5 and 10 respectively. Therefore, this/these claim(s) is/are rejected under the same rationale 07-21-aia AIA Claim (s) 8, 18 is/are rejected under 35 U.S.C. 103 as being unpatentable over Yao (Automatic Weakly Supervised Object Detection From High Spatial Resolution Remote Sensing Images via Dynamic Curriculum Learning) and Rowe (US 20220366280) in view of Gautham (US 20240095539) . Regarding claim 8, Yao and Rowe teach the invention as claimed in claim 1 above and, further comprising: verifying an accuracy of the DNN based on the classes of the calibration samples and the ground-truth classes of the calibration samples, … (Yao: Pg. 680 col 1 section B- 3: difficulty score) (Rowe: Fig. 2, [29, 41]: determine accuracy); Yao and Rowe teaches accuracy and difficulty score but does not specifically recite, the accuracy indicated by a ratio of a number of one or more calibration samples that the DNN correctly classified to a total number of the calibration samples; This however is well known in the art; Nonetheless, Gautham teaches, accuracy indicated by a ratio of a number of one or more calibration samples that the DNN correctly classified to a total number of the calibration samples (Gautham: [50] algorithm: “accuracy function, defined by the ratio of correctly classified samples to the total samples for the given local model”); It would have been obvious to a person of ordinary skill in the art before the effective filing date of the claimed invention to combine the teachings of Yao, Rowe and Gautham because the combination would enable using a ratio of correctly classified to the total as a measure of accuracy of the model. One of ordinary skill in the art would have been motivated to combine the teachings because the combination would enable using an accuracy measure common in the art. Regarding Claim(s) 18 , this/these claim(s) is/are similar in scope as claim(s) 8. Therefore, this/these claim(s) is/are rejected under the same rationale . Response to Arguments Applicants’ prior art arguments have been fully considered but since they pertain to the amended sections of the claim, they are considered moot in view of the new grounds of rejection presented above. Conclusion 07-96 AIA The prior art made of record and not relied upon is considered pertinent to applicant's disclosure in attached 892 . 07-40 AIA Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL . See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the date of this final action. Any inquiry concerning this communication or earlier communications from the examiner should be directed to MANDRITA BRAHMACHARI whose telephone number is (571)272-9735. The examiner can normally be reached Monday to Friday, 11 am to 8 pm EST. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Tamara Kyle can be reached at 571 272 4241. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /Mandrita Brahmachari/Primary Examiner, Art Unit 2144 Application/Control Number: 18/050,929 Page 2 Art Unit: 2144 Application/Control Number: 18/050,929 Page 3 Art Unit: 2144 Application/Control Number: 18/050,929 Page 4 Art Unit: 2144 Application/Control Number: 18/050,929 Page 5 Art Unit: 2144 Application/Control Number: 18/050,929 Page 6 Art Unit: 2144 Application/Control Number: 18/050,929 Page 7 Art Unit: 2144 Application/Control Number: 18/050,929 Page 8 Art Unit: 2144 Application/Control Number: 18/050,929 Page 9 Art Unit: 2144 Application/Control Number: 18/050,929 Page 10 Art Unit: 2144
Read full office action

Prosecution Timeline

Show 2 earlier events
Dec 04, 2025
Non-Final Rejection (signed) — §103
Jan 13, 2026
Non-Final Rejection mailed — §103
Mar 29, 2026
Interview Requested
Apr 13, 2026
Response Filed
Apr 14, 2026
Examiner Interview Summary
Apr 14, 2026
Applicant Interview (Telephonic)
May 26, 2026
Final Rejection mailed — §103
Jul 27, 2026
Response after Non-Final Action

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12694313
QUANTUM CIRCUIT SIMULATION
4y 3m to grant Granted Jul 28, 2026
Patent 12681622
Information Processing System, Information Processing Method, and Recording Medium
2y 9m to grant Granted Jul 14, 2026
Patent 12665078
AN EVENT-DRIVEN SPIKING NEUTRAL NETWORK SYSTEM FOR DETECTION OF PHYSIOLOGICAL CONDITIONS
4y 6m to grant Granted Jun 23, 2026
Patent 12664450
REPLACING LAMBDA EXPRESSIONS IN A RETE NETWORK WITH CORRESPONDING CODE CLASSES
3y 8m to grant Granted Jun 23, 2026
Patent 12657370
CLIENT DEVICE PROCESSING RECEIVED EMOJI-FIRST MESSAGES
2y 4m to grant Granted Jun 16, 2026
Study what changed to get past this examiner. Based on 5 most recent grants.

Strategy Recommendation AI-generated — please review before filing

Get a prosecution strategy drawn from examiner precedents, rejection analysis, and claim mapping.
Typically takes 5-10 seconds — AI-generated, attorney review required before filing

Prosecution Projections

2-3
Expected OA Rounds
77%
Grant Probability
99%
With Interview (+29.6%)
2y 11m (~0m remaining)
Median Time to Grant
Moderate
PTA Risk
Based on 414 resolved cases by this examiner. Grant probability derived from career allowance rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month