Prosecution Insights
Last updated: August 17, 2026
Application No. 18/639,913

NLU TRAINING WITH USER CORRECTIONS TO ENGINE ANNOTATIONS

Non-Final OA §103
Filed
Apr 18, 2024
Priority
Jun 04, 2014 — continuation of 10/754,925 +1 more
Examiner
KANAAN, MAROUN P
Art Unit
3687
Tech Center
3600 — Transportation & Electronic Commerce
Assignee
Microsoft Technology Licensing, LLC
OA Round
4 (Non-Final)
63%
Grant Probability
Moderate
4-5
OA Rounds
1y 3m
Est. Remaining
94%
With Interview

Examiner Intelligence

Grants 63% of resolved cases
63%
Career Allowance Rate
448 granted / 716 resolved
+10.6% vs TC avg
Strong +32% interview lift
Without
With
+31.5%
Interview Lift
resolved cases with interview
Typical timeline
3y 7m
Avg Prosecution
17 currently pending
Career history
740
Total Applications
across all art units

Statute-Specific Performance

§101
31.4%
-8.6% vs TC avg
§103
39.2%
-0.8% vs TC avg
§102
18.6%
-21.4% vs TC avg
§112
7.5%
-32.5% vs TC avg
Black line = Tech Center average estimate • Based on career data from 716 resolved cases

Office Action

§103
Notice of Pre-AIA or AIA Status The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA . DETAILED ACTION Continued Examination Under 37 CFR 1.114 A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 06/18/2026 has been entered. Status of Claims Claims 1, 5, 11-12, 17, 19, 21 have been previously canceled. Claims 2, 9, and 16 have been amended. Claims 2-4, 6-10, 13-16, 18, 20, and 22-27 are currently pending. Detailed Action Claim Rejections - 35 USC § 103 In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status. The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action: A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made. The text of those sections of Title 35, U.S. Code not included in this action can be found in a prior Office action. The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows: 1. Determining the scope and contents of the prior art. 2. Ascertaining the differences between the prior art and the claims at issue. 3. Resolving the level of ordinary skill in the pertinent art. 4. Considering objective evidence present in the application indicating obviousness or nonobviousness. Claim(s) 2-4, 6-10, 13-16, 18, 20, and 22-27 is/are rejected under 35 U.S.C. 103 as being unpatentable over Flanagan et al. (US 2012/0215559 A1) in view of Byron et al. (US 2015/0142418 A1). As per claim 2, a computer-implemented method comprising: Flanagan teaches: receiving a free-form text transcription of a clinical encounter (Para. 19-20); generating engine annotations based on free-form text transcription by applying a natural language understanding (NLU) engine to the free-form text transcription, the engine annotations including medical codes, identified by the NLU engine, as being associated with the clinical encounter (Para. 73 wherein “, the text narrative may be re-formatted prior to fact extraction to add, remove or correct one or more sentence boundaries within the text narrative. In some embodiments, this may involve altering the punctuation in at least one location within the text narrative”. The information includes medical codes as seen in Para. 102); receiving user annotations derived manually from the free-form text transcription by one or more human users, the user annotations including at least one medical code, identified by the one or more human users, as being associated with the clinical encounter (Para. 55 wherein “, the text narrative may be re-formatted prior to fact extraction to add, remove or correct one or more sentence boundaries within the text narrative. In some embodiments, this may involve altering the punctuation in at least one location within the text narrative”. See also Para. 59 wherein “In some embodiments, as discussed above, a fact review system may allow a user to add, delete and/or modify (collectively referred to as "change") a clinical fact extracted from a free-form narration of a patient encounter provided by a clinician, resulting in a change to the set of extracted facts”); and Flanagan does not explicitly teach however Byron teaches: generating training data by merging the engine annotations with the user annotations to obtain merged annotations (Para. 59, 75, and 113 wherein “fact review component 106 may allow the user to specify a location in the text narrative where the generated text should be inserted, or may allow the user to correct the location initially determined automatically. In some embodiments, CLU engine 104 or another suitable component may be used to update the generated text in response to the user's indication of a new location at which to insert it in the text narrative”); Flanagan does not explicitly teach however Byron teaches: comparing the engine annotations with the user annotations to identify at least one redundant annotation (Para. 114 wherein a user can correct information that is extracted. Para. 117 teaches training the engine using the extracted information. Para. 123 teaches wherein the training/correcting involves identifying redundant facts in the document); removing the at least one redundant annotation from the merged annotations to obtain the training data (Para. 123); and Flanagan further teaches: training the NLU engine to perform medical coding based on the training data (Para. 75 and 102). It would have been obvious to one of ordinary skill in the art at the time of filling to combine the method and apparatus for linking extracted clinical facts as taught in Flanagan with the error correction of a natural language document by finding redundant information as taught in Byron. The well-known elements described are merely a combination of old elements, and in combination, each element merely would have performed the same function as it did separately, and one of ordinary skill in the art would have recognized that the results of the combination were predictable. As per claim 3, Flanagan teaches the computer-implemented method of claim 2, wherein generating the training data by merging the engine annotations with the user annotations comprises: comparing an order of annotations between the engine annotations and the user annotations (Para. 46 and 73); and generating information identifying differences in the order (Para. 46). As per claim 4, Flanagan teaches the computer-implemented method of claim 2, wherein generating the training data by merging the engine annotations with the user annotations comprises: comparing the engine annotations with the user annotations and removing one or more redundant annotations (Para. 75). As per claim 6, Flanagan teaches the computer-implemented method of claim 2, wherein the training data includes: a first engine annotation identified as an error made by the NLU engine from the engine annotations generated (Para. 46 and 73); and a first user annotation identified as a correction of the error made by the NLU engine (Para. 46 and 73). As per claim 7, Flanagan teaches the computer-implemented method of claim 2, wherein generating the engine annotations comprises: generating one or more engine annotations and one or more engine links based on the free-form text transcription by applying the NLU engine to the free-form text transcription, wherein each of the one or more engine links associates one of the one or more engine annotations with a corresponding portion of the free-form text transcription (Para. 76 and 91). As per claim 8, Flanagan teaches the computer-implemented method of claim 7, wherein the user annotations include at least one of a rejection of an engine annotation, a replacement of an engine annotation, a replacement of an engine link, or a re-ordering of the engine annotations (Para. 104). As per claim 26, Flanagan teaches the computer-implemented method of claim 2, wherein the at lest one medical code in the user annotations is excluded from the engine annotations (Para. 73-74 and 105). As per claim 27, Flanagan teaches the computer-implemented method of claim 2, wherein the training data includes a list of medical codes, associated with the free-form text transcription, that includes the medical codes in the engine annotations and the at least one medical code in the user annotations (105-106). Claims 9, 10, 1316, 18, 20, and 22-25 recite substantially similar limitations as seen above and hence are rejected for similar rationale as noted above. Response to Arguments Applicant's arguments with respect to the art rejection above have been considered but are moot in view of the new ground(s) of rejection. It is respectfully submitted that the Examiner has applied new passages and citations to the claims at the present time. Conclusion Any inquiry concerning this communication or earlier communications from the examiner should be directed to MAROUN P KANAAN whose telephone number is (571)270-1497. The examiner can normally be reached Monday-Friday 8:00-5:00. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Mamon Obeid can be reached at (571) 270-1813. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. MAROUN P. KANAAN Primary Examiner Art Unit 3687 /MAROUN P KANAAN/Primary Examiner, Art Unit 3687
Read full office action

Prosecution Timeline

Show 8 earlier events
Jan 07, 2026
Examiner Interview Summary
Feb 27, 2026
Response after Non-Final Action
Mar 26, 2026
Final Rejection mailed — §103
May 08, 2026
Applicant Interview (Telephonic)
May 12, 2026
Examiner Interview Summary
Jun 18, 2026
Request for Continued Examination
Jun 25, 2026
Response after Non-Final Action
Jul 01, 2026
Non-Final Rejection mailed — §103 (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12706207
SYSTEMS AND METHODS FOR CREDENTIALING AND PRIVILEGING OF HEALTHCARE PRACTITIONERS
2y 10m to grant Granted Aug 11, 2026
Patent 12683008
DATA-BASED MENTAL DISORDER RESEARCH AND TREATMENT SYSTEMS AND METHODS
3y 1m to grant Granted Jul 14, 2026
Patent 12670973
Providing Secure and Seamless Authentication and Workflow for Medical Records and Affiliated Systems
6y 2m to grant Granted Jun 30, 2026
Patent 12665076
PROVIDER ASSESSMENT SYSTEM, METHODS FOR ASSESSING PROVIDER PERFORMANCE, METHODS FOR CURATING PROVIDER NETWORKS BASED ON PROVIDER PERFORMANCE, AND METHODS FOR DEFINING A PROVIDER NETWORK BASED ON PROVIDER PERFORMANCE
2y 5m to grant Granted Jun 23, 2026
Patent 12657335
DATA AGGREGATION BASED ON DISPARATE LOCAL PROCESSING OF REQUESTS
2y 10m to grant Granted Jun 16, 2026
Study what changed to get past this examiner. Based on 5 most recent grants.

Strategy Recommendation AI-generated — please review before filing

Get a prosecution strategy drawn from examiner precedents, rejection analysis, and claim mapping.
Typically takes 5-10 seconds — AI-generated, attorney review required before filing

Prosecution Projections

4-5
Expected OA Rounds
63%
Grant Probability
94%
With Interview (+31.5%)
3y 7m (~1y 3m remaining)
Median Time to Grant
High
PTA Risk
Based on 716 resolved cases by this examiner. Grant probability derived from career allowance rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month