Prosecution Insights
Last updated: October 04, 2026
Application No. 18/841,323

System and Method for Annotating Pathology Images to Predict Outcome

Non-Final OA §103
Filed
Aug 23, 2024
Priority
Feb 24, 2022 — provisional 63/313,548 +1 more
Examiner
REICHERT, RACHELLE LEIGH
Art Unit
3686
Tech Center
3600 — Transportation & Electronic Commerce
Assignee
Vinay Pulim
OA Round
3 (Non-Final)
30%
Grant Probability
At Risk
3-4
OA Rounds
1y 11m
Est. Remaining
63%
With Interview

Examiner Intelligence

Grants only 30% of cases
30%
Career Allowance Rate
62 granted / 205 resolved
-21.8% vs TC avg
Strong +33% interview lift
Without
With
+33.2%
Interview Lift
resolved cases with interview
Typical timeline
4y 1m
Avg Prosecution
34 currently pending
Career history
251
Total Applications
across all art units

Statute-Specific Performance

§101
39.2%
-0.8% vs TC avg
§103
32.6%
-7.4% vs TC avg
§102
8.1%
-31.9% vs TC avg
§112
15.4%
-24.6% vs TC avg
Black line = Tech Center average estimate • Based on career data from 205 resolved cases

Office Action

§103
DETAILED ACTION Notice of Pre-AIA or AIA Status The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA . Claims 1, 13 and 23 have been amended. Claims 8-9 and 11-12 and 24 were previously cancelled. Claims 1-7, 10, 13-23, and 25 are pending. Continued Examination Under 37 CFR 1.114 A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 07/08/2026 has been entered. Claim Rejections - 35 USC § 103 In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status. The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action: A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made. Claims 1, 3-7, 13-20, 23 and 25 are rejected under 35 U.S.C. 103 as being unpatentable over Faust (U.S. Pub. No. 2020/0272864 A1) in view of Yip (U.S. Pub. No. 2021/0166380 A1). Regarding claim 1, Faust discloses a computer-implemented method for predicting a clinical outcome of a patient, the method comprising: processing a pathology image associated with a patient (Paragraphs [0097] and [0128] discuss receiving pathology images of a patient.), wherein the processing includes: determining a region of interest of the pathology image (Paragraph [0108] discusses determining a region of interest with the corresponding image data.); and segmenting the pathology image into a plurality of tiles, wherein each of the plurality of tiles has a uniform size (Paragraphs [0103] and [0185] discuss segmenting the image into images patches or tiles, for example 1024 x 1024, construed as the tiles being a uniform size.); generating, using a machine learning model that processes the processed pathology image as input (Paragraphs [0091],[0106] and [0110] discuss a convolutional neural network being trained to classify and annotate input data, wherein the input data is images.), an annotated pathology image associated with the patient, wherein the annotated pathology image includes annotations for different classes of tissues (Paragraphs [0091], [0103-0104], [0106] and [0110] discuss the convolutional neural network outputting the results of the analysis, including any annotations for different classes of tissues.); and determining, based on determined areas for each of the different classes of tissues the annotated pathology image, a metric indicative of the clinical outcome of the patient (Paragraphs [0116] and [0182] discuss outputting the results, which include an aggregate percentage score or prediction scores displayed as a percentage for each class across the whole slide and lists the most likely diagnosis.), but Faust does not appear to explicitly disclose wherein the annotations for different classes of tissues that include a tumor regression tissue class. Yip teaches wherein the annotations for the different classes of tissues indicate a tumor regression (Paragraphs [0092], [0128] and [0355] discuss the imaging accounting for varying specifics, including the size of a tumor, and using a tissue class locator that is used to determine the class of the tissue and is overlayed onto the image, construed as annotations to determine whether it is progressing or regressing in response to therapy.). Therefore, it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Faust to include indicating a tumor regression, as taught by Yip, “ for new easily accessible techniques of diagnostic testing for biomarkers, such as TILs, PD-L1, and others using H&E images, for identifying and characterizing such biomarkers in an efficient manner, across population groups, for producing better optimized drug treatment recommendations and protocols, and improved forecasting of disease progression (Yip, Paragraph [0013]).” Regarding claim 3, Faust discloses a wherein the pathology image comprises a histopathology slide image (Paragraph [0089] discusses wherein the pathology images include histopathologic slides.). Regarding claim 4, Faust discloses a wherein the machine learning model has been trained on a plurality of training data items, and wherein each training data item includes an annotated pathology image with tissue classes (Paragraph [0103] discusses the machine learning model having been trained on annotated images to differentiate between tumor classes.). Regarding claim 5, Faust discloses a generating rendering data, when rendered by a user device, causes the user device to display a user interface that displays the annotated pathology image associated with the patient and the indicated clinical outcome of the patient (Paragraph [0129] discusses an interface application on one or more user devices that displays the pathology images with annotated information.). Regarding claim 6, Faust discloses wherein the user interface comprises a user selectable element to upload the pathology image for applying the machine learning model (Paragraphs [0128] and [0133] discuss that a user may interact with the interface application by selecting data to input into a digital pathology platform or external system, which is used for training.). Regarding claim 7, Faust discloses wherein the different classes of tissues comprise tumor, necrosis, and normal background, wherein the normal background indicates an uninvolved tissue (Paragraphs [0103] and [0230] discuss the different classes of tissue including tumor, necrosis, and normal tissue.), but Faust does not appear to explicitly disclose wherein the different classes of tissue comprise tumor regression. Yip teaches wherein the different classes of tissues comprise a tumor regression (Paragraphs [0092], [0128] and [0355] discuss the imaging accounting for varying specifics, including the size of a tumor, and using a tissue class locator that is used to determine the class of the tissue and is overlayed onto the image, construed as annotations to determine whether it is progressing or regressing in response to therapy.). Therefore, it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Faust to include a tumor regression, as taught by Yip, “ for new easily accessible techniques of diagnostic testing for biomarkers, such as TILs, PD-L1, and others using H&E images, for identifying and characterizing such biomarkers in an efficient manner, across population groups, for producing better optimized drug treatment recommendations and protocols, and improved forecasting of disease progression (Yip, Paragraph [0013]).” 2025Attorney Docket No. 317EP.001US01Claim 13 recites substantially similar limitations as those already addressed in claim 1, and, as such, is rejected for similar reasons as given above. Claim 13 further recites: one or more computers (Faust discloses in paragraph [0021] that computers are used to implement the invention. See also Figure 1.); and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations (Faust discloses in paragraph [0021] that a computer product with non-transitory computer readable media storing program instructions to perform the disclosed steps.). 2025Attorney Docket No. 317EP.001US01 Claim 14 recites substantially similar limitations as those already addressed in claim 2, and, as such, is rejected for similar reasons as given above. Claim 15 recites substantially similar limitations as those already addressed in claim 3, and, as such, is rejected for similar reasons as given above. Claim 16 recites substantially similar limitations as those already addressed in claim 4, and, as such, is rejected for similar reasons as given above. Claim 17 recites substantially similar limitations as those already addressed in claim 5, and, as such, is rejected for similar reasons as given above. Claim 18 recites substantially similar limitations as those already addressed in claim 6, and, as such, is rejected for similar reasons as given above. Claim 19 recites substantially similar limitations as those already addressed in claim 7, and, as such, is rejected for similar reasons as given above. Regarding claim 20, Faust discloses a wherein the metric indicative of the clinical outcome of the patient comprises a percent residual viable tumor, wherein the percent residual viable tumor is computed based on areas of the different classes of tissues in the pathology image (Paragraphs [0116] and [0127] discuss prediction scores displayed as a percentage for the tumor using the different classes of tissues in the image.). Claim 23 recites substantially similar limitations as those already addressed in claim 1, and, as such, is rejected for similar reasons as given above. Claim 23 further includes: one or more computer-readable storage medium storing instructions that, when executed by one or more computers, cause the one or more computers to perform operations (Faust discloses in paragraph [0021] that a computer product with non-transitory computer readable media storing program instructions to perform the disclosed steps that is used by a computer.). Regarding claim 25, Faust wherein determining the metric indicative of the clinical outcome of the patient comprises: determining an area for each of the different classes of tissues of the annotated pathology image, wherein determining the metric uses the determined areas for each of the different classes of tissues of the annotated pathology image (Paragraphs [0116], [0182] and [0256-0257] discuss using lesional areas to analyze the different classes of tissue, which is used to determine clinical outcome of the patient.). Claims 2, 10 and 22 are rejected under 35 U.S.C. 103 as being unpatentable over Faust in view of Yip, and in further view of Golden (U.S. Pub. No. 2020/0380675 A1). Regarding claim 2, Faust discloses a wherein the clinical outcome of the patient comprises responsiveness to one or more treatment regimens, survival, and disease progression (Paragraphs [0150], [0239] and [0274] discuss outcomes including survival, prognostic outcomes and progression.), but Faust does not appear to explicitly disclose wherein the clinical outcome of the patient comprises disease recurrence. Golden teaches wherein the clinical outcome of the patient comprises disease recurrence (Claims 312 and 323 recite wherein the clinical outcomes predicted include cancer recurrence.) Therefore, it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Faust to include disease recurrence, as taught by Golden, in order to “provide radiologists better tools to improve the PPV of malignancy prediction which would allow them to reduce the number of invasive biopsy procedures for patients who do not stand to benefit from them (Golden, Paragraph [0277]).” Regarding claim 10, Faust discloses wherein processing the pathology image further comprises: normalizing color of the pathology image based on color of a set of pathology images, wherein the set of pathology images includes the pathology image associated with the patient (Paragraphs [0120], [0345] and [0394] discusses normalizing images including color from a series of images taken from the same patient.); applying image transformations to the pathology image, wherein the image transformations include rotation (Paragraph [0315] discusses rotating and adjusting brightness of image.); but Faust does not appear to explicitly disclose applying image transformations to the pathology image, wherein the image transformations include shift, flip, zoom, affine transformation, and adjusting contrast. Golden teaches applying image transformations to the pathology image, wherein the image transformations include shift, flip, zoom, affine transformation, and adjusting contrast (Paragraphs [0026], [0029], [0035], [0359] discuss the image transformations including shift, flip, zoom, affine transformation and adjusting contrast. Examiner notes that Golden also discusses normalizing the images (see at least paragraph [0120]).). Therefore, it would have been obvious to one ordinary skill in the art of healthcare before the effective filing date of the claimed invention to modify the images of Faust to include additional transformations, as taught by Golden, for a more optimal reading of the image (Golden, Paragraph [0359]). Claim 22 recites substantially similar limitations as those already addressed in claim 10, and, as such, is rejected for similar reasons as given above. Claim 21 is rejected under 35 U.S.C. 103 as being unpatentable over Faust in view of Yip, and in further view of Saltz (U.S. Pub. No. 2020/0388029 A1). Regarding claim 21, Faust does not appear to explicitly disclose wherein the metric indicative of the clinical outcome of the patient comprises a percent regression and a percent necrosis in the pathology image. Saltz teaches wherein the metric indicative of the clinical outcome of the patient comprises a percent regression and a percent necrosis in the pathology image (Paragraphs [0089], [0327] and [0368] discuss providing a TIL fraction or percentage for regression or necrosis of the tumor.). Therefore, it would have been obvious to one ordinary skill in the art of healthcare before the effective filing date of the claimed invention to modify the analysis of Faust to include percent regression and percent necrosis, as taught by Saltz, in order to “generate tumor infiltrating lymphocyte maps that are useful in generating prognostic values in diagnosis and/or related classification (Saltz, Paragraph [0019]).” Response to Arguments Claims Rejections – 35 U.S.C. § 112(a) The previous § 112(a) rejection has been withdrawn in view of the amendments to the claims. Claims Rejections – 35 U.S.C. § 103 Applicant’s arguments are directed towards the amendments, which have been addressed with a new reference, rendering Applicant’s arguments moot. Conclusion Any inquiry concerning this communication or earlier communications from the examiner should be directed to Rachelle Reichert whose telephone number is (303)297-4782. The examiner can normally be reached M-F 9-5 MT. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Jason Dunham can be reached at (571)272-8109. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /RACHELLE L REICHERT/Primary Examiner, Art Unit 3686
Read full office action

Prosecution Timeline

Show 2 earlier events
Oct 22, 2025
Applicant Interview (Telephonic)
Oct 23, 2025
Examiner Interview Summary
Nov 24, 2025
Response Filed
Apr 08, 2026
Final Rejection mailed — §103
Jun 05, 2026
Response after Non-Final Action
Jul 08, 2026
Request for Continued Examination
Jul 10, 2026
Response after Non-Final Action
Aug 26, 2026
Non-Final Rejection mailed — §103 (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12683003
THERAPY DATA MANAGEMENT SYSTEM
5y 2m to grant Granted Jul 14, 2026
Patent 12648789
AGGREGATION AND REPORTING OF SURGICAL HUB DATA
2y 8m to grant Granted Jun 09, 2026
Patent 12575855
SURGICAL SYSTEM DISTRIBUTED PROCESSING
4y 11m to grant Granted Mar 17, 2026
Patent 12406769
PATIENT MONITORING SYSTEM
1y 8m to grant Granted Sep 02, 2025
Patent 12400186
PERSONALIZED MEDICAL ADJUDICATION AND TREATMENT SYSTEM
4y 6m to grant Granted Aug 26, 2025
Study what changed to get past this examiner. Based on 5 most recent grants.

Strategy Recommendation AI-generated — please review before filing

Get a prosecution strategy drawn from examiner precedents, rejection analysis, and claim mapping.
Typically takes 5-10 seconds — AI-generated, attorney review required before filing

Prosecution Projections

3-4
Expected OA Rounds
30%
Grant Probability
63%
With Interview (+33.2%)
4y 1m (~1y 11m remaining)
Median Time to Grant
High
PTA Risk
Based on 205 resolved cases by this examiner. Grant probability derived from career allowance rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month