DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Amendment
Applicant submitted amendments on 12/10/2025. The Examiner acknowledges the amendment and has reviewed the claims accordingly.
Priority
Receipt is acknowledged of certified copies of papers required by 37 CFR 1.55.
Information Disclosure Statement
The IDS(s) dated 5/24/2023 and 10/9/2024 that have been previously considered remain placed in the application file.
Overview
Claims 1-13, 15-17 19, and 21 are pending in this application and have been considered below.
Claims 14,18, and 20 are canceled by the applicant.
Claims 1-13, 15-17 19, and 21 are rejected.
Applicant Arguments
In regards to Argument 1, Applicant states Claim 1 has been amended to include the language of claim 14, excluding “causing a warning to a user”, which the Examiner acknowledged as being the only aspect the cited art disclose (See Remarks, page 8 middle).
Examiner’s Response
In response to Argument 1, the Examiner respectfully disagrees. The Applicant suggests the Examiner acknowledged Haslam in view of Meissner as only teaching “causing a warning to a user”.
Under BRI, and as acknowledged in the previous office action, the list of actions is connected by “and/or”, meaning the control signal only needs to be configured for at least one of the disjunctive list of actions to meet the bounds of the claimed invention. Contrary to the Applicant’s assertion, this is not an acknowledgement that the cited art only discloses one of the actions, but simply that the control signal needs only to be configured for at least one of the actions to meet the claim limitation under BRI.
The combination of Haslam and Meissner teaches generating a control signal based on foreign object detection that is configured for multiple actions in the recited list, beyond just a warning. Haslam teaches detecting features (e.g., abnormities or unexpected elements) in medical imaging data by comparing input data to generated synthetic/example datasets (expected image content) using machine learning models ([93-95, 224-226]). Upon detection, Haslam outputs anonymized data and scores, which can trigger further processing such as re-evaluation with additional data layers if confidence is low ([60, 314-317]). This output serves as a control signal for initiating documentation of the detection result (e.g., displaying diagnosis data with confidence scores on a user interface; [215]).
Meissner complements Haslam by teaching intraoperative imaging with foreign object detection via image subtraction/comparison between acquired fluoroscopic images and calculated expected content (virtual roadmap mask for DRR; [6-8, 41-49]). Upon detection, Meissner generates control signals configured for adjusting/suggesting a position and/or acquisition direction of the imaging device (adjusts acquisition direction/orientation for better detection visualization; [9, 20-21, 44, 77]).
The Examiner interprets the prior art to teach amened claim 1, 17 and 19.
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claim(s) 1-14, 17, 19, and 21 is/are rejected under 35 U.S.C. 103 as obvious over Haslam et al (US 20210346091 A1, hereafter referred to as Haslam) in view of Meissner et al (US 20090192385 A1, hereafter referred to as Meissner).
Claim 1
Regarding Claim 1, Haslam teaches a computer-implemented method of detecting at least one foreign object in one or more intraoperative images, the method comprising the steps:
- acquiring at least one intraoperative image of at least a part of a patient's body undergoing a medical procedure (Haslam in ¶8 discloses "generating a 3D physical model of a patient specific anatomic feature from 2D medical images"; ¶17 discloses "2D medical images may be images from the patient taken from a CT, MRI, PET and/or SPCET scanner." - intraoperative forms of the imaging modalities are well-known in the art);
- calculating or providing expected image content of the acquired intraoperative image based on data characterizing the patient and/or the medical procedure (Haslam in ¶292 discloses "a set of standard anatomical models are generated by retrieving all the available data within our data-store for a given anatomical feature in its healthy state (no pathology)"; ¶233 discloses "the automated pipeline will detect these anomalies by comparing the information provided against a simplified standard set of parameters expected within the 3D volumes"); and
- comparing, in a calculative manner, the acquired intraoperative image with the calculated/provided expected image content thereby automatically detecting the at least one foreign object in the intraoperative image (Haslam in ¶233 discloses "the automated pipeline will detect these anomalies by comparing the information provided against a simplified standard set of parameters expected within the 3D volumes"; ¶314 discloses "The Anatomical classification described above provides the basis to detect any deviation from standard of a given scan").
Haslam does not explicitly teach all of acquiring at least one intraoperative image of at least a part of a patient's body undergoing a medical procedure; wherein the method further comprises:
- automatically generating, based on the detection of the at least one foreign object, a control signal, and wherein the control signal is configured for: adjusting/suggesting a collimation of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting a position and/or acquisition direction of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting X-ray acquisition parameters, stopping the acquisition of intraoperative images, initiating a documentation of a detection result of the detection of the at least one foreign object, and/or adjusting/suggesting one or more parameters of a robotic arm used during the intraoperative imaging.
However, Meissner teaches - acquiring at least one intraoperative image of at least a part of a patient's body undergoing a medical procedure (Meissner in Abstract discloses "the roadmap mask is in the form of a 2-dimensional digitally reconstructed radiograph from the same orientation as that of a fluoroscopic X-ray device which takes real-time images of the patient during treatment"; ¶42 discloses "The live fluoroscopy image shown in FIG. 2G");
wherein the method further comprises:
- automatically generating, based on the detection of the at least one foreign object, a control signal, and wherein the control signal is configured for: adjusting/suggesting a collimation of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting a position and/or acquisition direction of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting X-ray acquisition parameters, stopping the acquisition of intraoperative images, initiating a documentation of a detection result of the detection of the at least one foreign object, and/or adjusting/suggesting one or more parameters of a robotic arm used during the intraoperative imaging (Examiner notes the use of "or" in the claim, which would require just one of the listed embodiments. Meissner in ¶9, 20-21, 44, 77 discloses "During the procedure, fluoroscopic images may be desirable from more than one vantage point (working view, orientation) … fluoroscopic images may be taken from other orientations, or where the patient has been moved … A new road mask may need to be produced, involving further administration of contrast agent and X-ray exposure." Discloses at least “adjusting/suggesting a position and/or acquisition direction of an imaging device used for generating the acquired intraoperative image”).
Therefore, it would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to modify the invention of Haslam by incorporating the acquisition of at least one intraoperative image during a medical procedure that is taught by Meissner, since both reference are analogous art in the field of medical imaging for anomaly detection; thus, one of ordinary skilled in the art would be motivated to combine the references since Haslam’s automated pipeline for detecting anomalies by comparing acquired image content against a simplified standard set of parameters expected within the 3D volumes with Meissner’s real-time fluoroscopic X-ray imaging acquisition during treatment yields the predictable result of enabling the detection of deviations from standard anatomy in live intraoperative images to identify foreign objects.
Thus, the claimed subject matter would have been obvious to a person having ordinary skill in the art before the effective filing date of the claimed invention.
Claim 2
Regarding Claim 2, Haslam in view of Meissner teaches the computer-implemented method according to claim 1, wherein the at least one intraoperative image is a live fluoroscopy video stream (Meissner in Abstract discloses "the roadmap mask is in the form of a 2-dimensional digitally reconstructed radiograph from the same orientation as that of a fluoroscopic X-ray device which takes real-time images of the patient during treatment"; ¶42 discloses "The live fluoroscopy image shown in FIG. 2G").
Claim 3
Regarding Claim 3, Haslam in view of Meissner teaches the computer-implemented method according to claim 1, wherein the data characterizing the patient and/or the medical procedure are embodied as at least one of: - imaging device parameters of an imaging device used for generating the acquired intraoperative image; - patient information; - medical procedure information describing a nature and/or application of the medical procedure, which the patient was undergoing when the at least one intraoperative image was acquired; and - one or more previous images of the patient (Examiner notes the use of "at least one of" in the claim, which would require just one of the listed embodiments. Haslam in ¶41 discloses "A threshold-based segmentation method may be used and the threshold value is a function of the 2D medical images scanning parameters"; ¶43 discloses "threshold-based segmentation method may be used and the threshold value is optimized based on one or more of the following parameters: scan type, bone type, tissue type, age, gender and weight of the patient"; ¶292 discloses "a set of standard anatomical models are generated by retrieving all the available data within our data-store for a given anatomical feature in its healthy state (no pathology) … models may also need to take into account some important aspects related to the patient … patient age, sex and clinical history."; See also ¶30 and 409-410).
Claim 4
Regarding Claim 4, Haslam in view of Meissner teaches the computer-implemented method according to claim 1,
wherein the intraoperative image was generated with an imaging device of a first imaging modality (Haslam in ¶8 discloses "generating a 3D physical model of a patient specific anatomic feature from 2D medical images"; ¶17 discloses "2D medical images may be images from the patient taken from a CT, MRI, PET and/or SPCET scanner." - intraoperative forms of the imaging modalities are well-known in the art),
wherein the step of calculating expected image content comprises:
- creating a synthetic image of the first imaging modality, the synthetic image representing the expected image content (Haslam in ¶292 discloses "A set of standard anatomical models are generated by retrieving all the available data within our data-store for a given anatomical feature in its healthy state (no pathology). The available segmentation data for a given anatomical feature (a bone, a specific organ) is registered and scaled in order to align the segmentation from the different data-sets corresponding to the various scans. The aligned and scaled segmentation data is then used to extract and compare the Hounsfield values as well as the CT scans and/or the MRI value; the similarity between each scan can then be used to generate the standard anatomical model of the feature and its expected appearance in a medical scan.").
Claim 5
Regarding Claim 5, Haslam in view of Meissner teaches the computer-implemented method according to claim 4, wherein the step of creating the synthetic image further comprises:
- creating or acquiring a synthetic patient model (Haslam in ¶292 discloses "A set of standard anatomical models are generated by retrieving all the available data within our data-store for a given anatomical feature in its healthy state (no pathology). The available segmentation data for a given anatomical feature (a bone, a specific organ) is registered and scaled in order to align the segmentation from the different data-sets corresponding to the various scans. The aligned and scaled segmentation data is then used to extract and compare the Hounsfield values as well as the CT scans and/or the MRI value; the similarity between each scan can then be used to generate the standard anatomical model of the feature and its expected appearance in a medical scan."),
- adjusting the synthetic patient model based on patient information and/or based on intraoperative image data (Haslam in ¶292 discloses "A set of standard anatomical models … Such models may also need to take into account some important aspects related to the patient from which the data comes from"), and
- using the adjusted synthetic patient model in the creation of the synthetic image (Haslam in ¶292 discloses "A set of standard anatomical models are generated … The available segmentation data for a given anatomical feature (a bone, a specific organ) is registered and scaled in order to align the segmentation from the different data-sets corresponding to the various scans. … the similarity between each scan can then be used to generate the standard anatomical model of the feature and its expected appearance in a medical scan. Such models may also need to take into account some important aspects related to the patient from which the data comes from").
Claim 6
Regarding Claim 6, Haslam in view of Meissner teaches the computer-implemented method according to claim 5,
wherein the at least one intraoperative image is a 2D image wherein the step of using the adjusted synthetic patient model in the creation of the synthetic image further comprises:
- deriving a 3D image from the synthetic patient model (Haslam in ¶293 discloses "The Standard anatomical model is stored as a reference within the ATLAS and ATLAS is also available in order to facilitate the retrieval of data. As new data is added to the Axial3D database, the standard models are updated to include the new data; the history of standard model generated for each anatomical feature is also preserved."), and
- deriving the synthetic image from the 3D image by calculating a Digitally Reconstructed Radiograph (DRR) thereby using imaging device parameters of the imaging device, which generated the 2D image (Meissner in Abstract discloses "The roadmap mask is in the form of a 2-dimensional digitally reconstructed radiograph from the same orientation as that of a fluoroscopic X-ray device which takes real-time images of the patient during treatment.").
Claim 7
Regarding Claim 7, Haslam in view of Meissner teaches the computer-implemented method according to claim 5,
wherein the step of creating the synthetic image further comprises:
- virtually placing and/or orienting the adjusted synthetic patient model relative to the imaging device of the first imaging modality based on medical procedure information (Meissner in Abstract discloses "The roadmap mask is in the form of a 2-dimensional digitally reconstructed radiograph from the same orientation as that of a fluoroscopic X-ray device which takes real-time images of the patient during treatment … When the orientation of the fluoroscopic image is changed during the course of treatment, the roadmap mask image for the corresponding orientation is used").
Claim 8
Regarding Claim 8, Haslam in view of Meissner teaches the computer-implemented method according to claim 4,
the method further comprising the steps:
- segmenting anatomical structures in the synthetic image (Haslam in ¶8 discloses "the server processes the 2D medical images and automatically generates a 3D printable model of a patient specific anatomic feature from the 2D medical images using a segmentation technique"; ¶279 discloses "Both nodes and relationships contain additional information; in particular they contain a reference to a image containing such anatomical feature, its segmentation"),
- segmenting anatomical structures in the acquired intraoperative image (Haslam in ¶8 discloses "the server processes the 2D medical images and automatically generates a 3D printable model of a patient specific anatomic feature from the 2D medical images using a segmentation technique"), and
- comparing the segmented images for detecting the at least one foreign object (Haslam in ¶304-311 discloses "The general approach to perform such a task is the following: … derive accurate segmentation using the automated segmentation algorithms … compare to the existing data-set of interesting features and attempt to find a number of matches … the standard models are used to further refine the filtering and cross-checking by fitting a linear transform between the semi-classified segmented objects and what the standard model looks like". ).
Claim 9
Regarding Claim 9, Haslam in view of Meissner teaches the computer-implemented method according to claim 4,
the method further comprising the steps:
- cropping the synthetic image based on positional information of the imaging device of the first imaging modality, a field of view of the imaging device of the first imaging modality, and/or medical procedure information (Meissner in Abstract discloses "The roadmap mask is in the form of a 2-dimensional digitally reconstructed radiograph from the same orientation as that of a fluoroscopic X-ray device which takes real-time images of the patient during treatment.").
Claim 10
Regarding Claim 10, Haslam in view of Meissner teaches the computer-implemented method according to claim 1,
wherein the step of providing the expected image content of the acquired intraoperative image comprises:
- providing a look up table, in which objects are stored as entries that are and/or are not expected to be present in images of the medical procedure (Haslam in ¶279-286 discloses "Axial3D uses a graph database in order to store such information in an ATLAS of human anatomy relevant to medical scanning techniques … Key features of ATLAS are: 1. to provide the Axial3D R&D and segmentation group a simple and fast information retrieval system (accessing the relevant scan and segmentation data); 2. provide a centralized area where specific information on anatomical features is stored (organ appearance and properties); 3. provide a simple method to access information of related organs; 4. provide a backbone of Ground Truth data for organ classification and automatic medical scan interpretation. Typical examples of ATLAS usage include, but are not limited to: 1. retrieve the reference of all scans in our data-store related to hips in CT scans". ), and
- comparing the automatically detected at least one foreign object of the intraoperative image with the entries in the look up table (Haslam in ¶292 discloses " A set of standard anatomical models are generated by retrieving all the available data within our data-store for a given anatomical feature in its healthy state (no pathology)"; ¶304-307 discloses "derive accurate segmentation using the automated segmentation algorithms … compare to the existing data-set of interesting features and attempt to find a number of matches").
Claim 11
Regarding Claim 11, Haslam in view of Meissner teaches the computer-implemented method according to claim 1,
wherein the step of comparing, in a calculative manner, the acquired intraoperative image with the calculated/provided expected image content comprises:
- using an image analysis algorithm and/or video analysis algorithm for analyzing the at least one acquired intraoperative image (Meissner in Abstract discloses "A system and method of producing virtual roadmap image of a patient … CT-like image data may be obtained for a patient … and differenced so as to form a roadmap mask. The roadmap mask is in the form of a 2-dimensional digitally reconstructed radiograph from the same orientation as that of a fluoroscopic X-ray device which takes real-time images of the patient during treatment. The fluoroscopic image may be subtracted from the roadmap mask so as to more clearly visualize the position of a catheter introduced into the patient for treatment. When the orientation of the fluoroscopic image is changed during the course of treatment, the roadmap mask image for the corresponding orientation is used.").
Claim 12
Regarding Claim 12, Haslam in view of Meissner teaches the computer-implemented method according to claim 11, wherein the video analysis algorithm uses machine learning, preferably a neural network (Haslam in ¶55 discloses "The segmentation technique may use a Neural Network method, in which the Neural Network is trained from a database of existing medical images.").
Claim 13
Regarding Claim 13, Haslam in view of Meissner teaches the computer-implemented method according to claim 11,
wherein the video analysis algorithm uses a histogram analysis (Haslam in ¶71 discloses "The feature extraction algorithm may be used to extract one or more of the following: … histogram of the Hounsfield Units corresponding to the anatomic feature across an anatomical knowledge dataset". See also ¶44-46).
Claim 17
Regarding Claim 17, Haslam teaches a non-transitory computer-readable storage medium storing a program, that when executed on at least one processor of a computer or when loaded onto the at least one processor of the computer, causes the computer to perform a method to detect at least one foreign object in one or more intraoperative images, the method comprising:
acquiring at least one intraoperative image of at least a part of a patient's body undergoing a medical procedure (Haslam in ¶8 discloses "generating a 3D physical model of a patient specific anatomic feature from 2D medical images"; ¶17 discloses "2D medical images may be images from the patient taken from a CT, MRI, PET and/or SPCET scanner." - intraoperative forms of the imaging modalities are well-known in the art);
calculating or providing expected image content of the acquired intraoperative image based on data characterizing the patient and/or the medical procedure (Haslam in ¶292 discloses "a set of standard anatomical models are generated by retrieving all the available data within our data-store for a given anatomical feature in its healthy state (no pathology)"; ¶233 discloses "the automated pipeline will detect these anomalies by comparing the information provided against a simplified standard set of parameters expected within the 3D volumes"); and
comparing the acquired intraoperative image with the calculated/provided expected image content thereby automatically detecting the at least one foreign object in the intraoperative image (Haslam in ¶233 discloses "the automated pipeline will detect these anomalies by comparing the information provided against a simplified standard set of parameters expected within the 3D volumes"; ¶314 discloses "The Anatomical classification described above provides the basis to detect any deviation from standard of a given scan").
Haslam does not explicitly teach all of acquiring at least one intraoperative image of at least a part of a patient's body undergoing a medical procedure; wherein the method further comprises:
- automatically generating, based on the detection of the at least one foreign object, a control signal, and wherein the control signal is configured for: adjusting/suggesting a collimation of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting a position and/or acquisition direction of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting X-ray acquisition parameters, stopping the acquisition of intraoperative images, initiating a documentation of a detection result of the detection of the at least one foreign object, and/or adjusting/suggesting one or more parameters of a robotic arm used during the intraoperative imaging.
However, Meissner teaches - acquiring at least one intraoperative image of at least a part of a patient's body undergoing a medical procedure (Meissner in Abstract discloses "the roadmap mask is in the form of a 2-dimensional digitally reconstructed radiograph from the same orientation as that of a fluoroscopic X-ray device which takes real-time images of the patient during treatment"; ¶42 discloses "The live fluoroscopy image shown in FIG. 2G");
wherein the method further comprises:
- automatically generating, based on the detection of the at least one foreign object, a control signal, and wherein the control signal is configured for: adjusting/suggesting a collimation of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting a position and/or acquisition direction of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting X-ray acquisition parameters, stopping the acquisition of intraoperative images, initiating a documentation of a detection result of the detection of the at least one foreign object, and/or adjusting/suggesting one or more parameters of a robotic arm used during the intraoperative imaging (Examiner notes the use of "or" in the claim, which would require just one of the listed embodiments. Meissner in ¶9, 20-21, 44, 77 discloses "During the procedure, fluoroscopic images may be desirable from more than one vantage point (working view, orientation) … fluoroscopic images may be taken from other orientations, or where the patient has been moved … A new road mask may need to be produced, involving further administration of contrast agent and X-ray exposure." Discloses at least “adjusting/suggesting a position and/or acquisition direction of an imaging device used for generating the acquired intraoperative image”).
Therefore, it would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to modify the invention of Haslam by incorporating the acquisition of at least one intraoperative image during a medical procedure that is taught by Meissner, since both reference are analogous art in the field of medical imaging for anomaly detection; thus, one of ordinary skilled in the art would be motivated to combine the references since Haslam’s automated pipeline for detecting anomalies by comparing acquired image content against a simplified standard set of parameters expected within the 3D volumes with Meissner’s real-time fluoroscopic X-ray imaging acquisition during treatment yields the predictable result of enabling the detection of deviations from standard anatomy in live intraoperative images to identify foreign objects.
Thus, the claimed subject matter would have been obvious to a person having ordinary skill in the art before the effective filing date of the claimed invention.
Claim 19
Regarding Claim 19, Haslam teaches a medical image analysis system comprising:
- an image acquisition unit which is configured to acquire at least one intraoperative image of at least a part of a patient's body undergoing a medical procedure (Haslam in ¶8 discloses "generating a 3D physical model of a patient specific anatomic feature from 2D medical images"; ¶17 discloses "2D medical images may be images from the patient taken from a CT, MRI, PET and/or SPCET scanner." - intraoperative forms of the imaging modalities are well-known in the art);
a processing unit which is configured to (Haslam in Abstract discloses “the server processes the 2D medical images and automatically generates a 3D printable model of a patient specific anatomic feature from the 2D medical images using a segmentation technique.”):
- calculate or provide expected image content of the acquired intraoperative image based on data characterizing the patient and/or the medical procedure (Haslam in ¶292 discloses "a set of standard anatomical models are generated by retrieving all the available data within our data-store for a given anatomical feature in its healthy state (no pathology)"; ¶233 discloses "the automated pipeline will detect these anomalies by comparing the information provided against a simplified standard set of parameters expected within the 3D volumes"); and
- compare, in a calculative manner, the acquired intraoperative image with the calculated/provided expected image content thereby automatically detecting the at least one foreign object in the intraoperative image (Haslam in ¶233 discloses "the automated pipeline will detect these anomalies by comparing the information provided against a simplified standard set of parameters expected within the 3D volumes"; ¶314 discloses "The Anatomical classification described above provides the basis to detect any deviation from standard of a given scan").
Haslam does not explicitly teach all of an image acquisition unit which is configured to acquire at least one intraoperative image of at least a part of a patient's body undergoing a medical procedure; and
- automatically generating, based on the detection of the at least one foreign object, a control signal, and wherein the control signal is configured for: adjusting/suggesting a collimation of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting a position and/or acquisition direction of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting X-ray acquisition parameters, stopping the acquisition of intraoperative images, initiating a documentation of a detection result of the detection of the at least one foreign object, and/or adjusting/suggesting one or more parameters of a robotic arm used during the intraoperative imaging.
However, Meissner teaches an image acquisition unit which is configured to acquire at least one intraoperative image of at least a part of a patient's body undergoing a medical procedure (Meissner in Abstract discloses "the roadmap mask is in the form of a 2-dimensional digitally reconstructed radiograph from the same orientation as that of a fluoroscopic X-ray device which takes real-time images of the patient during treatment"; ¶42 discloses "The live fluoroscopy image shown in FIG. 2G");
wherein the method further comprises:
- automatically generating, based on the detection of the at least one foreign object, a control signal, and wherein the control signal is configured for: adjusting/suggesting a collimation of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting a position and/or acquisition direction of an imaging device used for generating the acquired intraoperative image, adjusting/suggesting X-ray acquisition parameters, stopping the acquisition of intraoperative images, initiating a documentation of a detection result of the detection of the at least one foreign object, and/or adjusting/suggesting one or more parameters of a robotic arm used during the intraoperative imaging (Examiner notes the use of "or" in the claim, which would require just one of the listed embodiments. Meissner in ¶9, 20-21, 44, 77 discloses "During the procedure, fluoroscopic images may be desirable from more than one vantage point (working view, orientation) … fluoroscopic images may be taken from other orientations, or where the patient has been moved … A new road mask may need to be produced, involving further administration of contrast agent and X-ray exposure." Discloses at least “adjusting/suggesting a position and/or acquisition direction of an imaging device used for generating the acquired intraoperative image”).
Therefore, it would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to modify the invention of Haslam by incorporating the acquisition of at least one intraoperative image during a medical procedure that is taught by Meissner, since both reference are analogous art in the field of medical imaging for anomaly detection; thus, one of ordinary skilled in the art would be motivated to combine the references since Haslam’s automated pipeline for detecting anomalies by comparing acquired image content against a simplified standard set of parameters expected within the 3D volumes with Meissner’s real-time fluoroscopic X-ray imaging acquisition during treatment yields the predictable result of enabling the detection of deviations from standard anatomy in live intraoperative images to identify foreign objects.
Thus, the claimed subject matter would have been obvious to a person having ordinary skill in the art before the effective filing date of the claimed invention.
Claim 21
Regarding Claim 21, Haslam in view of Meissner teaches the medical image analysis system according to claim 19, wherein the at least one intraoperative image is a live fluoroscopy video stream (Meissner in Abstract discloses "the roadmap mask is in the form of a 2-dimensional digitally reconstructed radiograph from the same orientation as that of a fluoroscopic X-ray device which takes real-time images of the patient during treatment"; ¶42 discloses "The live fluoroscopy image shown in FIG. 2G").
Claim(s) 15-16 is/are rejected under 35 U.S.C. 103 as obvious over Haslam et al (US 20210346091 A1, hereafter referred to as Haslam) in view of Meissner et al (US 20090192385 A1, hereafter referred to as Meissner), further in view of Falt et al (WO 2015054314 A1, hereafter referred to as Falt).
Claim 15
Regarding Claim 15, Haslam in view of Meissner teaches the computer-implemented method according to claim 1.
Haslam in view of Meissner does not explicitly teach all of wherein in case a body part of a medical practitioner is automatically detected in comparing the acquired intraoperative image with the calculated/provided expected image content as the at least one foreign object in the intraoperative image, the method comprises the step of:
- automatically calculating an X-ray dose, which the detected body part of the medical practitioner receives during the medical procedure.
However, Falt teaches wherein in case a body part of a medical practitioner is automatically detected in comparing the acquired intraoperative image with the calculated/provided expected image content as the at least one foreign object in the intraoperative image, the method comprises the step of:
- automatically calculating an X-ray dose, which the detected body part of the medical practitioner receives during the medical procedure (Falt in Abstract discloses "Systems and methods for determining radiation exposure during an x-ray guided medical procedure … x-ray equipment model that simulates the emission of radiation from x-ray equipment during the x-ray guided medical procedure, a human exposure model that simulates one or more human anatomies during the x-ray guided medical procedure, a radiation metric processor that calculates at least one radiation exposure metric, and a feedback system for outputting information based on the at least one radiation exposure metric. The radiation metric processor calculates radiation exposure metrics based on input parameters that correspond to operating settings as well as the location and structure of one or more human anatomies.").
Therefore, it would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to modify the invention of Haslam in view of Meissner by incorporating the step of automatically calculating an X-ray dose that the medical practitioner receives during the medical procedure that is taught by Falt, since both reference are analogous art in the field of guided medical procedures involving intraoperative imaging; thus, one of ordinary skilled in the art would be motivated to combine the references since Haslam in view of Meissner’s automated pipeline for detecting anomalies in intraoperative images by comparing against expected content with Falt’s radiation metric processor for calculating exposure metrics based on detected anatomical structures and procedure parameters yields the predictable result of enhancing procedural safety by quantifying radiation risks to medical personnel in real-time when anomalies like practitioner body parts are identified.
Thus, the claimed subject matter would have been obvious to a person having ordinary skill in the art before the effective filing date of the claimed invention.
Claim 16
Regarding Claim 16, Haslam in view of Meissner, further in view of Falt teaches the computer-implemented method according to claim 15,
wherein the automatic calculation of the X-ray dose uses a power of the X-ray device (Falt in Abstract discloses "The radiation metric processor calculates radiation exposure metrics based on input parameters that correspond to operating settings as well as the location and structure of one or more human anatomies"; ¶9 discloses "can change the operating settings of the x-ray equipment during the course of the fluoroscopic procedure … There are a number of different input parameters that correspond to operating settings that may impact the level of radiation exposure delivered to the patient or the medical team … the radiation dose rate may be impacted by x-ray tube voltages and currents"),
a surface area of the detected body part of the medical practitioner (Falt in Abstract discloses "The radiation metric processor calculates radiation exposure metrics based on input parameters that correspond to operating settings as well as the location and structure of one or more human anatomies"; ¶9 discloses "can change the operating settings of the x-ray equipment during the course of the fluoroscopic procedure … There are a number of different input parameters that correspond to operating settings that may impact the level of radiation exposure delivered to the patient or the medical team"; ¶121 discloses "the surface area locations where radiation enters the patient may be calculated" - calculates surface area of detected body parts in an X-ray dose exposure method by using 3D human exposure models, which a POSITA would apply to a medical practitioner given the reference specifically aims to determine radiation exposure delivered to the medical team), and
an exposure time of the detected body part of the medical practitioner (Falt in Abstract discloses "The radiation metric processor calculates radiation exposure metrics based on input parameters that correspond to operating settings as well as the location and structure of one or more human anatomies"; ¶9 discloses "can change the operating settings of the x-ray equipment during the course of the fluoroscopic procedure … There are a number of different input parameters that correspond to operating settings that may impact the level of radiation exposure delivered to the patient or the medical team"; ¶142 discloses "Over the course of an entire procedure, the timeline will contain metrics at different points in time which can be used to visualize the relationship between a set of control input parameters and dose rate over time." - calculates dose as a function of time for detected body parts in an X-ray dose exposure method by using 3D human exposure models, which a POSITA would apply to a medical practitioner given the reference specifically aims to determine radiation exposure delivered to the medical team).
Conclusion
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to JUSTIN P CASCAIS whose telephone number is (703)756-5576. The examiner can normally be reached Monday-Friday 8:00-4:00.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Mr. O’Neal Mistry can be reached on (313) 446-4912. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/J.P.C./Examiner, Art Unit 2674
/Ross Varndell/Primary Examiner, Art Unit 2674
Date: 1/8/2025