Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Applicant’s Response
In Applicant’s Response dated 8/18/26, the Applicant amended claims 1, 2, 5, 6, 12, 13, canceled claim 4, added Claim 14 and 15 and argued Claims previously rejected in the Office Action dated 5/19/26. Claims 1, 2, 5-15 are pending examination.
Continued Examination Under 37 CFR 1.114
A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 8/18/26 has been entered.
Priority
Receipt is acknowledged of certified copies of papers required by 37 CFR 1.55.
Information Disclosure Statement
The information disclosure statement (IDS) submitted on 7/20/26 is in compliance with the provisions of 37 CFR 1.97. Accordingly, the information disclosure statement is being considered by the examiner.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1, 2 and 5-15 are rejected under 35 U.S.C. 103 as being unpatentable over Crawford et al., United States Patent Publication 2022/0270762 (hereinafter “Crawford”), in view of Gupta et al., United States Patent Publication 20120207378 (hereinafter “Gupta”), in further view of Slabaugh et al., United States Patent Publication 2007/0014473 (hereinafter “Slabaugh”).
Claim 1:
Crawford discloses:
An image processing apparatus comprising at least one processor,
wherein the processor is configured to:
receive a medical image (see paragraph [0077]). Crawford teaches receiving a medical image;
derive running vectors representing running directions of the plurality of tubular structures (see paragraphs [0013] and [0014]), Crawford teaches creating directional vectors representing certain anatomical features found in the medical image; and
display the medical image including the plurality of tubular structures being separate along the running direction thereof on a display (see paragraph [0081] and figures 7A-7D, 8A-8D). Crawford teaches displaying a medical image with tubular structures of an aortas/vessels.
obtain a direction vector from a first pixel to a second pixel (see paragraphs [0084] and [0085]). Crawford teaches obtaining a direction based on a start and end point which could be a pixel; and
obtaining an angle between the direction vector and at least one running vector selected from a first running vector at the first pixel and a second running vector at the second pixel, determine the likelihood that the same label is assigned to the first pixel and the second pixel to separate the plurality of tubular structures such that the likelihood becomes higher as the angles becomes smaller (see paragraphs [0013] and [0023]). Crawford teaches using an anatomical feature identification algorithm to determine based on a features like angles to match similar features with the likelihood that they will be labeled the similarity. Crawford also teaches using the running travel vector and directional vector to determine if they will be the same label.
Crawford fails to expressly teaches separating the structures using the running vectors to separate the tubular structures.
Gupta discloses:
extract a plurality of pixels corresponding to a plurality of tabular structures from the medical image (see paragraph [0013]). Crawford teaches extracting a pixels of an image that related to tabular structures.
derive, at each pixel of the plurality of tubular structures, a respective running vector representing a running direction (see paragraphs [0005] and [0014]) Gupta teaches creating directional vectors representing the direction of the blood vessels within the image; and
separate the plurality of tubular structures using the running vectors (see paragraph [0013]). Gupta teaches segmenting the vessels using the identified vectors in the images.
Accordingly, it would have been obvious to one having ordinary skill in the art before the effective filing date to modify the method disclosed by Crawford to include separating the tubular structures using the running vectors for the purpose of automatic segmentation to increase efficiency of clinicians, accurate detection of blood vessels, as taught by Gupta.
Crawford and Gupta fail to expressly disclose setting an energy and performing graph cut.
Slabaugh discloses:
setting an energy of an edge connecting the first pixel and the second pixel based on the likelihood, the energy being reduced as the angle becomes smaller (see paragraph [0029]). Slabaugh teaches setting an energy of an edge connecting pixels and likelihood (i.e. cost of assigning labels to adjacent pixels). ;
performing a graph cut process based on the energy to assign labels to the plurality of pixels to separate thereby separating the plurality of tubular structures (see paragraph [0029]). Slabaugh teaches performing the graph cut based on the energy to assign labels to the pixels to separate them.
Accordingly, it would have been obvious to one having ordinary skill in the art before the effective filing date to modify the method disclosed by Crawford and Gupta to include setting an energy and perform graph cuts to separate pixels for the purpose of efficient image segmentation of pixels using a shape, as taught by Slabaugh.
Claim 2:
Crawford discloses:
wherein the processor is configured to derive the respective running vector using a trained model for deriving the running vector at each pixel of the plurality of tubular structures from the medical image (see paragraph [0066] and [0067]). Crawford teaches using machine learning to segment the image based on the pixels of the anatomical features.
Crawford fails to expressly teaches separating the structures using the running vectors to separate the tubular structures.
Gupta discloses:
derive the respective running vector at each pixel (see paragraphs [0005] and [0014]) Gupta teaches creating directional vectors representing the direction of the blood vessels within the image; and
Accordingly, it would have been obvious to one having ordinary skill in the art before the effective filing date to modify the method disclosed by Crawford to include separating the tubular structures using the running vectors for the purpose of automatic segmentation to increase efficiency of clinicians, accurate detection of blood vessels, as taught by Gupta.
Claims 5-6:
Crawford discloses:
wherein the processor is configured to, in separating the plurality of tubular structures using the graph cut process by selecting a pixel group including N (> 3) pixels are in the same direction or continuously change and which are adjacent to each other and minimizing an N-th order energy with labels of the pixels included in the pixel group as variables, the variables being represented by 0 or 1, set the N-th order energy to be lower in a case where all of variables corresponding to the pixels included in the pixel group are 0 or all of the variables corresponding to the pixels included in the pixel group are 1 than in a case where all of the variables are not 0 and all of the variables are not 1; and wherein the processor is configured to, in separating the plurality of tubular structures using the graph cut process by selecting a pixel group including N (>3) pixels having a shortest weighted path based on the likelihood that the same label is assigned and minimizing an N-th order energy with labels of the pixels included in the pixel group as variables, the variables being represented by 0 or 1, set the N-th order energy to be lower in a case where all of variables corresponding to the pixels included in the pixel group are 0 or all of the variables corresponding to the pixels included in the pixel group are 1 than in a case where all of the variables are not 0 and all of the variables are not 1 (see paragraph [0072] and [0073]). Crawford teaches using a graph cut process that identifies the anatomical features as nodes on a graph, has method that groups similar anatomical structures that have similar properties. For example, Crawford recites Anatomical feature identification module may then use an anatomical feature identification algorithm to explore the anatomical knowledge dataset to identify the patient specific anatomical features within the medical images by establishing links between the grouped labeled pixels with existing knowledge within the anatomical knowledge dataset. For example, the existing knowledge may include known information regarding various anatomic features such as tissue types, e.g., bone, blood vessel, or organ, etc., represented as nodes within a graph database of the anatomical knowledge dataset. Crawford also teaches anatomical feature identification module 116 initially may group the pixels labeled by segmentation module 114, e.g., by establishing links between the different labeled/classified pixels based on similarities between the labeled pixels. For example, all the pixels labeled “bone” may be grouped/linked together in a first group, all the pixels labeled “organ” may be grouped/linked together in a second group, and all the pixels labeled “blood vessel” may be grouped/linked together a third group.
Crawford fails to expressly teaches separating the structures using the running vectors to separate the tubular structures.
Gupta discloses:
running vectors representing running directions of the plurality of tubular structures (see paragraphs [0005] and [0014]) Gupta teaches creating directional vectors representing the direction of the blood vessels within the image; and
Accordingly, it would have been obvious to one having ordinary skill in the art before the effective filing date to modify the method disclosed by Crawford to include tubular structures using the running vectors for the purpose of automatic segmentation to increase efficiency of clinicians, accurate detection of blood vessels, as taught by Gupta.
Claim 7:
Crawford discloses:
wherein the processor is configured to:
derive a running vector at a plurality of center pixels along a center of the plurality of tubular structures (see paragraph [0013]). Crawford teaches generating the directional vector based on the center pixels of the anatomical structures;
derive a shortest path tree from an origin of a class representing each of the plurality of tubular structures such that an angle formed by an edge connecting the plurality of center pixels and the running vector is minimized (see paragraph [0013]). Crawford teaches deriving the shortest path tree by determining start and end points of the isolated anatomical feature and a direction of travel from the start point to the end point; raycasting at predefined intervals along an axis in at least three directions perpendicular to the direction of travel and determining distances between intersections of each ray cast and the 3D surface mesh model; calculating a center point at each interval by triangulating the distances between intersections of each ray cast and the 3D surface mesh model; adjusting the direction of travel at each interval based on a directional vector between adjacent calculated center points, such that raycasting at the predefined intervals occur in at least three directions perpendicular to the adjusted direction of travel at each interval; and calculating a centerline of the isolated anatomical feature based on the calculated center points from the start point to the end point; and
separate the plurality of tubular structures by cutting the shortest path tree such that the plurality of center pixels are in the same class as an origin having a closer path and a higher likelihood that the same label is assigned (see paragraph [0015]). Crawford teaches determining start and end points of the isolated anatomical feature; taking slices at predefined intervals along an axis from the start point to the end point; calculating a cross-sectional area of each slice defined by a perimeter of the isolated anatomical feature; and generating a heat map of the isolated anatomical feature based on the cross-sectional area of each slice.
Crawford fails to expressly teaches separating the structures using the running vectors to separate the tubular structures.
Gupta discloses:
separate the plurality of tubular structures such that the plurality of center pixels are in the same class as an origin (see paragraph [0013]). Gupta teaches segmenting the vessels using the identified vectors in the images.
Accordingly, it would have been obvious to one having ordinary skill in the art before the effective filing date to modify the method disclosed by Crawford to include separating the tubular structures using the running vectors for the purpose of automatic segmentation to increase efficiency of clinicians, accurate detection of blood vessels, as taught by Gupta.
Claim 8:
Crawford fails to expressly teaches separating the structures using the running vectors to separate the tubular structures.
Gupta discloses:
wherein the processor is configured to separate pixels other than pixels along the running vectors into tubular structures different from each other (see paragraph [0013]). Gupta teaches segmenting the vessels using the identified vectors in the images.
Accordingly, it would have been obvious to one having ordinary skill in the art before the effective filing date to modify the method disclosed by Crawford to include separating the tubular structures using the running vectors for the purpose of automatic segmentation to increase efficiency of clinicians, accurate detection of blood vessels, as taught by Gupta.
Claim 9:
Crawford discloses:
wherein the processor is configured to separate the plurality of tubular structures such that a boundary of the plurality of tubular structures is derived between pixels other than pixels where the running vectors intersect each other (see figure 8C, [0011], [0118] and [0121]). Crawford teaches separating anatomical feature such that it determines the boundaries such as the start and end of the feature.
Claim 10:
Crawford discloses:
wherein the processor is configured to separate the plurality of tubular structures using a trained model in which machine learning is performed so as to minimize a loss in a direction in which the running vectors are continuous, based on the medical image and the running vectors (see paragraph [0066], [0067], [0127] and [0128]). Crawford teaches using machine learning to segment the image based on the pixels of the anatomical features. Crawford also teaches improving functions to minimize loss during machine learning to segment the image.
Claim 11:
Crawford discloses:
wherein the plurality of tubular structures include at least two of an artery, a vein, a portal vein, a ureter, or a nerve (see paragraph [0111] and [0114]). Crawford teaches multiple arteries.
Claims 12, 13:
Although Claim 12 is a method claim and Claim 13 is a non-transitory computer-readable claim, they are interpreted and rejected for the same reasons as the apparatus of Claim 1.
Claim 14:
Crawford and Gupta fail to expressly disclose setting an energy and performing graph cut.
Slabaugh discloses:
wherein the processor is configured to reduce the energy of the edge connecting the first pixel and the second pixel such that the edge is not cut between the first pixel and the second pixel in the graph cut process and the same label is assigned to the first pixel and the second pixel (see paragraphs [0005]-[0006]). Slabaugh teaches not cutting between the pixels based on energy minimization and how the labels are assigned.
Accordingly, it would have been obvious to one having ordinary skill in the art before the effective filing date to modify the method disclosed by Crawford and Gupta to include setting an energy and perform graph cuts to separate pixels for the purpose of efficient image segmentation of pixels using a shape, as taught by Slabaugh.
Claim 15:
Crawford and Gupta fail to expressly disclose setting an energy and performing graph cut.
Gupta discloses:
wherein the processor selects the first pixel and the second pixel based on a first angle between the direction vector and the first running vector at the first pixel and a second angle between the direction vector and the second running vector at the second pixel, the first angle and the second angle being less than a predetermined threshold value, and wherein a change in direction between the first running vector and the second running vector is less than a predetermined angle (see paragraphs [0014]-[0016]). Gupta teaches selects the pixels based the small angle between the pixels and the selection based on the direction and if the direction is perpendicular.
Accordingly, it would have been obvious to one having ordinary skill in the art before the effective filing date to modify the method disclosed by Crawford to include separating the tubular structures using the running vectors for the purpose of automatic segmentation to increase efficiency of clinicians, accurate detection of blood vessels, as taught by Gupta.
Response to Arguments
Applicant’s arguments, see REM, filed 8/18/26, with respect to the rejections of claims 1, 2, 4-13 under 35 USC 103 have been fully considered and are persuasive. Therefore, the rejection has been withdrawn. However, upon further consideration, a new ground of rejection is made in view of Crawford, Gupta and Slabaugh.
Claim Rejections under 35 USC 103
Applicant argues Crawford separately discloses a direction vector of a vessel
and a physical attribute such as an angle, Crawford does not disclose that the angle is an angle between a direction vector from a first pixel to a second pixel and a running vector at either pixel. Crawford does not disclose using such an angle in its probabilistic matching or otherwise connecting the angle to a likelihood that the first pixel and the second pixel are assigned the same label.
The Examiner disagrees.
Crawford automatically process the medical images using a segmentation algorithm to label pixels of the medical images and to generate scores indicative of a likelihood that the pixels were labeled correctly; use an anatomical feature identification algorithm to probabilistically match associated groups of the labeled pixels against an anatomical knowledge dataset to classify one or more patient specific anatomical features within the medical images (see paragraph [0023]). Crawford using a mathematical feature to determine if the based on segmentation features (such as angles ) if the structures are labeled correctly. Thus, Crawford teaches this argued limitation.
Applicant argues Crawford does not disclose or suggest the specific processing relationship recited in amended Claim 1, which requires "obtaining a direction vector from a first pixel to a second pixel; obtaining an angle between the direction vector and at least one running vector selected from a first running vector at the first pixel and a second running vector at the second pixel; determining a likelihood that the same label is assigned to the first pixel and the second pixel such that the likelihood becomes higher as the angle becomes smaller; setting an energy of an edge connecting the first pixel and the second pixel based on the likelihood, the energy being reduced as the angle becomes smaller; performing a graph cut process based on the energy to assign labels to the plurality of pixels thereby separating the plurality of tubular structures"
The Examiner agrees.
The Examiner introduced new art, Slabaugh to teach the new limitation. See the above rejection for the claims. Thus the combination of art teaches the argued limitation and new claim amendments.
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to TIONNA M BURKE whose telephone number is (571)270-7259. The examiner can normally be reached M-F 8a-4p.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Stephen Hong can be reached at (571)272-4124. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/TIONNA M BURKE/Examiner, Art Unit 2178 9/19/26
Prosecution Insights