DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Information Disclosure Statement
The information disclosure statement (IDS) submitted on 12/28/2024 was filed in compliance with the provisions of 37 CFR 1.97. Accordingly, the information disclosure statement is being considered by the examiner.
Drawings
The drawings are objected to as failing to comply with 37 CFR 1.84(p)(5) because they include the following reference character(s) not mentioned in the description:
FIG. 8: Although this figure includes the label 335, this label does not appear in the specification.
FIGS. 10A and 11A: Although this figure includes the label 354, this label does not appear in the specification.
Corrected drawing sheets in compliance with 37 CFR 1.121(d), or amendment to the specification to add the reference character(s) in the description in compliance with 37 CFR 1.121(b) are required in reply to the Office action to avoid abandonment of the application. Any amended replacement drawing sheet should include all of the figures appearing on the immediate prior version of the sheet, even if only one figure is being amended. Each drawing sheet submitted after the filing date of an application must be labeled in the top margin as either “Replacement Sheet” or “New Sheet” pursuant to 37 CFR 1.121(d). If the changes are not accepted by the examiner, the applicant will be notified and informed of any required corrective action in the next Office action. The objection to the drawings will not be held in abeyance.
Specification
The disclosure is objected to because of the following informalities:
[0033]: As written it reads “For example, the dimensions of the long and short axis of the Node 04, a measure of the roundness of the Node 04, and a PET standardized uptake value (SUV) may be displayed […] As another example, if only the short axis threshold is selected by a user or by a control system, Node 04, Node 07, and Node 08 may be highlighted in the GUI because their short axes exceed the short axis threshold”. However, this is the first indication of the terms “PET” and “GUI” therefore the terms should be spelled out to provide clarity.
[0084]: As written it reads “The computer storage media can include, but are not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid-state memory technology, CD-ROM, DVD, or other optical storage, magnetic disk storage, of any other hardware medium which can be used to store desired information and that can be accessed by components of the system”. However, this is the first indication of the terms “RAM”, “ROM”, “EPROM”, “EEPROM”, “CD-ROM”, and “DVD”, therefore the terms should be spelled out to provide clarity.
Appropriate correction is required.
Claim Objections
Claim 7 is objected to because of the following informalities:
Regarding claim 7, as written it reads “wherein the performed operations further comprise overlaying PET imaging information on the image of the anatomic model”. However, this is the first instance of the term “PET” within the claims therefore, the term should be spelled out to provide clarity.
Appropriate correction is required.
Claim Rejections - 35 USC § 102
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention.
(a)(2) the claimed invention was described in a patent issued under section 151, or in an application for patent published or deemed published under section 122(b), in which the patent or application, as the case may be, names another inventor and was effectively filed before the effective filing date of the claimed invention.
Claim(s) 1-9, 11-14, 16, 18-20, and 22-24 is/are rejected under 35 U.S.C. 102(a)(1) and 35 U.S.C. 102(a)(2) as being anticipated by Kopel et al. US 2019/0247127 A1 “Kopel”.
Regarding claim 1, Kopel teaches “A system for providing navigational guidance for a medical procedure, the system comprising:” (“FIG. 1 shows an electromagnetic navigation (EMN) system 100 suitable for implementing methods for performing endobronchial diagnostic and/or treatment procedures in an area of a patient's chest in accordance with this disclosure” [0041]. Therefore, FIG. 1 shows a system for providing navigational guidance (i.e. electromagnetic navigation) for a medical procedure (i.e. endobronchial diagnostic and/or treatment procedures.);
“a processor” (“FIG. 2 shows a simplified block diagram of computing device 80. Computing device 80 may include a memory 202, a processor 204, a display 206, a network interface 208, an input device 210, and/or an output module 212. Memory 202 may store the application 81 and/or image data 214. The application 81 may, when executed by the processor 204, cause the display 206 to present a graphical user interface (GUI) based on GUI instructions 216” [0051]. As shown in FIG. 1, the electromagnetic navigation (EMN) system 100 includes the computing device 80, the computing device 80 including the components shown in FIG. 2. Therefore, the system includes a processor.); and
“a memory operably coupled to the processor and storing instructions that, when executed by the processor, cause the system to perform operations comprising:” (See memory 202 as discussed in [0051] above. Therefore, the system includes a memory operably coupled to the processor and storing instructions (i.e. application 81) that when executed by the processor, cause the system to perform specific operations.);
“receiving an anatomic model of an anatomic region” (“Starting at step S302, the computing device 80 receives first image data [of] a surgical site. As noted above, the surgical site includes at least a portion of the patient's body. For illustrative purposes, the description below will use the patient's lungs as the surgical site. In some embodiments, the first image data may include image data from multiple pre-operative scans” [0056]; “Next, at step S304, the computing device 80 processes the first image data to identify one or more structures in the first image data. For example, the computing device 80 may identify the patient's lungs, and particularly, the bronchial network of the patient's airways in the first image data. The computing device 80 may further identify one or more lumens of the patient's vascular system, one or more lymph nodes and/or ducts of the patient's lymphatic system, other organs, markers, and/or one or more cysts or lesions or other aberrant structures in the first image data, as well as the pleural surfaces and/or fissures of the patient's lungs” [0057]; “Thereafter, at step S306, application 81 generates a three-dimensional (3D) model of the surgical site. The 3D model includes graphical representations of the surgical site, such as the patient's lungs, showing the locations of the lumens and structures of the bronchial, vascular, and lymphatic trees, as well as the pleural surfaces and fissures of the patient's lungs, markers, and/or lesions or other aberrant structures that may be present in the patient's lungs, as was identified in step S304. Next, at step S308, the computing device 80 labels one or more of the structures identified at step S304 in the model generated at step S306. In embodiments, the computing device 80 may label one or more lymph nodes based on a predetermined naming scheme or convention, such as based on the International Association for the Study of Lung Cancer's (IASLC) lymph node map” [0058]. Therefore, since the computing device 80 receives first image data of a surgical site, such as a patient’s lungs, processed the first image data to identify one or more structures in the first image data (i.e. including one or more lymph nodes), and generates a 3D model of the surgical site, the method carried out by the system involves receiving an anatomic model of an anatomic region (i.e. patient’s lungs).);
“performing an analysis of the anatomic model to facilitate selection of a plurality of nodal sites for analysis” (See [0057] and [0058] above and “Then, at step S310, a target is selected. The target may be selected from among the structures identified at step S304. The target may be automatically selected by the computing device 80, semi-automatically, and/or manually by the clinician providing input to the computing device 80, such as via input device 210. […] The clinician may also select one or more lesions and/or targets by viewing the first image data and/or the 3D model. […] In some embodiments, a plurality of targets are selected at step S310 and ordered in a list. For example, the computing device 80 may select a plurality of lymph nodes identified at step S304 as the targets” [0059]. In order for the computing device 80 to identify structures within the image data (i.e. received in step S302) in step S304 and subsequently generate a 3D model for a clinician (i.e. and/or computing device 80) to view/access when selecting one or more targets (i.e. corresponding to a plurality of lymph nodes, for example), the method carried out by the system must involve performing an analysis of the anatomic model to facilitate selection of a plurality of nodal sites for analysis.);
“generating a procedure sequence for the plurality of nodal sites” (“After a target is selected, the computing device 80, at step S312, determines a pathway to the target. In embodiments, the computing device 80 determines a pathway via a luminal network, such as the patient's airways, from the target to the patient's trachea. […] In embodiments where multiple targets are selected, a plurality of pathways may be determined to visit each target. Additionally, the computing device 80 may automatically, or with input from the clinician, generate a diagnosis and/or treatment plan based on the identified structures, the selected targets, and/or the pathway” [0060]. Therefore, since the computing device 80 determines a plurality of pathways when multiple targets (i.e. corresponding to lymph nodes identified in step S304 and selected in step S310) are selected, the method carried out by the system involves generating a procedure sequence for the plurality of nodal sites.);
“providing navigational guidance to direct a medical instrument to a nodal site of the plurality of nodal sites in the procedure sequence” (“Following step S312, a navigation phase, as described above, may commence. Those of skill in the art will recognize that the planning phase may occur as a separate action from the navigation phase (e.g., at some date or time prior to the actual procedure). The navigation phase may include the endobronchial navigation of the LG 92 and/or the EBUS 62 of the system 100 to the target selected at step S310 via the pathway determined at step S312. As an initial step of the navigation phase a navigation plan is selected and loaded for display of the target and the pathway on the 3D model at step S314. In embodiments, the computing device 80 may cause a display device, such as display 206, to display the 3D model with the target and the pathway indicated thereon” [0061]. In this case, the LG 92 is a locatable guide (see [0042]) and the EBUS 62 is an endobronchial ultrasound tool (see [0045]). Therefore, since the navigation phase includes endobronchial navigation of the LG 92 and/or the EBUS 62 to the target selected at step S310 (see [0059]) along the pathway determined at step S312 (see [0060]), the method carried out by the system involves providing navigational guidance to direct a medical instrument (i.e. LG 92 and/or EBUS 62) to a nodal site of the plurality of nodal sites in the procedure sequence.); and
“gathering local image data from the medical instrument at the nodal site” (“At step S328, the computing device 80 provides guidance for positioning the LG 92 and/or EBUS 62 relative to the target. For example, the computing device 80 may cause the display 206 to display visual guidance for positing the LG 92 and/or EBUS 62 relative to the target. […] The computing device 80 then, at step S330, determines whether the LG 92 and/or EBUS 62 are correctly positioned relative to the target […] Alternatively, if the computing device 80 determines that the LG 92 and/or EBUS 62 are correctly positioned relative to the target (“YES” at step S330), processing proceeds to step S332” [0066]; “At step S332, the computing device 80 receives ultrasound image data of the target. The ultrasound image data may be captured by the EBUS 62 and may be provided to the computing device 80 via an ultrasound workstation and/or a direct connection between the EBUS 62 and the computing device 80” [0067]. Therefore, since the computing device 80 receives ultrasound image data of the target via the EBUS 62 once it has been positioned correctly relative to the target, the method carried out by the system involves gathering local image data (i.e. ultrasound image data) from the medical instrument (i.e. EBUS 62) at the nodal site (i.e. target/lymph node selected in step S310).).
Regarding claim 2, Kopel discloses all features of the claimed invention as discussed with respect to claim 1 above, and Kopel further teaches “wherein performing the analysis includes identifying a plurality of anatomic stations for the anatomic model” (See [0057] and [0058] as discussed in claim 1 above. Therefore, since the computing device 80 may identify one or more lumens of the patient’s vascular system, one or more lymph nodes and/or ducts of the patient’s lymphatic system, other organs, markers, and/or one or more cysts or lesions or other aberrant structures in the first image data, as well as the pleural surfaces and/or fissures of the patient’s lungs and label the structures on the 3D model (see step S308, in [0058]), the step of performing the analysis includes identifying a plurality of anatomic stations (i.e. lumens, lymph nodes, etc.) for the anatomic model (i.e. 3D model of patient’s lungs).).
Regarding claim 3, Kopel discloses all features of the claimed invention as discussed with respect to claim 1 above, and Kopel further teaches “wherein performing the analysis includes identifying a plurality of lymph nodes in the anatomic model” (See [0057] and [0058] as discussed in claim 1 above. Therefore, since the computing device 80 may identify one or more lymph nodes and/or ducts in the patient’s lymphatic system (see step S304 in [0057]) and label them on the 3D model (see step S308, in [0058]), the step of performing the analysis includes identifying a plurality of lymph nodes in the anatomic model.).
Regarding claim 4, Kopel discloses all features of the claimed invention as discussed with respect to claim 3 above, and Kopel further teaches “wherein the performed operations further comprise displaying on a graphical user interface an image of the anatomic model and an image of a segmented lymph node of the plurality of lymph nodes” (“FIG. 8 shows yet another view of the GUI of FIGS. 6 and 7 showing additional features and/or details that may be displayed during various steps of the method 300. […] In addition to the features described in FIGS. 6 and 7, FIG. 8 shows a view 824 of the 3D rendering 826 of a selected lymph node 608. The view 824 of the 3D rendering 826 may show markers 828 indicating positions where previous treatments were performed. For example, the view 824 of the 3D rendering 826 may show markers representing the pose of a biopsy needle when a tissue sample was obtained. FIG. 8 further shows a view 830 of the ultrasound image data captured by the EBUS 62, where the ultrasound image data is augmented with indicators 832 representing the positions of identified structures in the ultrasound image data” [0086]. Therefore, since FIG. 8 shows a GUI displayed during various steps of the method 300 (i.e. carried out by the system), the performed operations further comprise displaying on a graphical user interface an image of the anatomic model (i.e. 3D model of patient’s lungs i.e., middle box in FIG. 8) and an image of a segmented lymph node of the plurality of lymph nodes (i.e. ultrasound image data captured by EBUS 62 at the selected target, see 830 FIG. 8).).
Regarding claim 5, Kopel discloses all features of the claimed invention as discussed with respect to claim 4 above, and Kopel further teaches “wherein the image of the segmented lymph node is overlayed on an image of an anatomic station of the anatomic model” (See [0059] and [0060] as discussed in claim 1 above and “At step S370, the computing device 80 displays a view of the 3D rendering showing the position of the treatment tool relative to the target. In embodiments, the computing device 80 may cause the display 206 to display a view of the 3D rendering showing the pose of the treatment tool relative to the target and any interaction between the treatment tool and the target. For example, as shown in FIG. 5, a view of the 3D model may be displayed showing the pose of an EBUS 508 relative to a target 516, and interaction between a biopsy needle 512 and the target 516” [0076] and “Ultrasound images 514 captured by the ultrasound sensor are shown overlaid onto the 3D model, with a 3D rendering of the target 516 displayed thereon” [0083]. As shown in FIG. 5, the ultrasound images 514 is overlaid onto the 3D model. Therefore, the image of the segmented lymph node (i.e. target 516) is overlayed on an image of an anatomic station of the anatomic model (i.e. 3D model).).
Regarding claim 6, Kopel discloses all features of the claimed invention as discussed with respect to claim 5 above, and Kopel further teaches “wherein the performed operations further comprise highlighting the image of the segmented lymph node if a staging threshold is met” (See [0076], [0083] and FIG. 5 as discussed in claim 5 above, and “In embodiments, the computing device 80 may cause the display 206 to a view of the 3D model showing the additional targets. For example, the additional targets may be highlighted and/or displayed with a different characteristic, such as a different color, than targets that have already been imaged. In some embodiments, one or more regions of the 3D model may be displayed with a different characteristic, such as a different color, to indicate that there are additional targets to be imaged in those regions of the 3D model” [0072]. As shown in FIG. 5, there are multiple lymph nodes 506 presented, but only the target 516 (i.e. segmented lymph node) is overlaid with the image 514, thereby highlighting it (i.e. based on its selection in step S304, for example). Therefore, the performed operations further comprise highlighting the image of the segmented lymph node (i.e. target 516 in FIG. 5) is a staging threshold is met (i.e. it is selected in step S304).).
Regarding claim 7, Kopel discloses all features of the claimed invention as discussed with respect to claim 4 above, and Kopel further teaches “wherein the performed operations further comprise overlaying PET imaging information on the image of the anatomic model” (“The computing device 80 includes hardware and/or software, such as an application 81, used to facilitate the various phases of an EMN procedure, as described further below. For example, computing device 80 utilizes radiographic image data acquired from a CT scan, cone beam computed tomography (CBCT) scan, magnetic resonance imaging (MRI) scan, positron emission tomography (PET) scan, X-ray scan, and/or any other suitable imaging modality to generate and display a 3D model of the patient's airways, identify a target on the radiographic image data and/or 3D model (automatically, semi-automatically or manually), and allow for the determination and selection of a pathway through the patient's airways to the target” [0046]; “For example, the first image data may include image data from a CT scan, a CBCT scan, a MRI scan, a PET scan, an X-ray scan, etc.” [0056]; “FIG. 6 shows yet another illustrative GUI that may be displayed during various steps of the method 300. Similar to FIGS. 4 and 5, FIG. 6 also shows a view of the 3D model including the patient's trachea 602 and airway tree 604, along with the positions of a plurality of lymph nodes 606 displayed thereon. […] Additional details, such as anatomical features or characteristics, regarding the selected lymph node 608 may be displayed in a view 610. The additional details may include a PET uptake, a size, etc. Additional structures, such as one or more lesions 612 may also be displayed on the view of the 3D model” [0084]. Therefore, since the computing device 80 can utilize radiographic image data acquired from a PET scan to generate and display a 3D model of the patient’s airways, and the GUI may display additional details regarding the selected lymph node 608, such as PET uptake, the performed operations further comprise overlaying PET imaging information (i.e. PET image data or PET uptake) on the image of the anatomical model (i.e. 3D model, see FIG. 6, for example).).
Regarding claim 8, Kopel discloses all features of the claimed invention as discussed with respect to claim 3 above, and Kopel further teaches “wherein the navigational guidance includes a displayed list view of the plurality of lymph nodes grouped by a plurality of anatomic stations for the anatomic model” (“FIG. 7 shows another view of the GUI of FIG. 6 showing additional features and/or details that may be displayed during various steps of the method 300. […] Additionally, FIG. 7 may show a list 722 of lymph nodes for which treatment is required” [0085]. As shown in FIG. 7, a list 722 of lymph nodes is displayed, where each of the lymph nodes (i.e. 4R, 7, 4L, 10L and 11L) are located at different positions (i.e. anatomic stations) in the center/center left portion of the model. Therefore, the navigational guidance includes a displayed list view of the plurality of lymph nodes grouped by a plurality of anatomic stations for the anatomic model.).
Regarding claim 9, Kopel discloses all features of the claimed invention as discussed with respect to claim 8 above, and Kopel further teaches “wherein the list view includes a size or a shape for at least one of the plurality of lymph nodes” (See [0085] as discussed in claim 8 above and FIGS. 7 and 8. As shown in FIG. 7, the PET uptake, Size on CT, Size on U/S and U/S Features are displayed for lymph node 10L. Additionally, FIG. 8 shows the PET uptake, Size on CT, Size on U/S and U/S Features are displayed for lymph node 4L. Therefore, the list view includes a size or a shape for at least one of the plurality of lymph nodes.).
Regarding claim 11, Kopel discloses all features of the claimed invention as discussed with respect to claim 3 above, and Kopel further teaches “wherein the performed operations further comprise displaying critical anatomy near at least one of the plurality of nodal sites” (See [0084] as discussed in claim 7 above. As shown in FIG. 6, for example, the lymph nodes 606 are present at various positions along the patient’s trachea 602 and airway tree 604. Therefore, since the 3D model shows the patient’s trachea 602 and airway tree 604 with the lymph nodes displayed throughout, the performed operations further comprise displaying critical anatomy (i.e. trachea, airway tree) near at least one of the plurality of nodal sites (i.e. lymph nodes).).
Regarding claim 12, Kopel discloses all features of the claimed invention as discussed with respect to claim 1 above, and Kopel further teaches “wherein the navigational guidance includes an image of the anatomic model and a representation of a navigable path through the procedure sequence for the plurality of nodal sites” (See [0060] and [0061] as discussed in claim 1 above. Therefore, since the computing device 80 causes a display device to display the 3D model with the target and the pathway indicated thereon (see [0061]) and a plurality of pathways are determined to visit each target (i.e. lymph node, see [0060]), the navigational guidance includes an image of the anatomical model and a representation of a navigable path through the procedure sequence for the plurality of nodal sites.).
Regarding claim 13, Kopel discloses all features of the claimed invention as discussed with respect to claim 12 above, and Kopel further teaches “wherein the representation of the navigable path includes a first portion indicating a portion of the navigable path that has been reached by the medical instrument and a second portion indicating a portion of the navigable path that has not been reached by the medical instrument and wherein the first portion is visually distinguishable from the second portion” (“For example, the additional targets may be highlighted and/or displayed with a different characteristic, such as a different color, than targets that have already been imaged. In some embodiments, one or more regions of the 3D model may be displayed with a different characteristic, such as a different color, to indicate that there are additional targets to be imaged in those regions of the 3D model. Thereafter, at step S364, the computing device 80 selects (automatically, semi-automatically, or manually) a next target. The next target may be selected based on the predetermined diagnosis and/or treatment plan, based on its proximity to the previous target, based on its accessibility from the current position of the EBUS 62, etc. The computing device 80 then, at step S366, determines a pathway from the current position of the EBUS 62 to the next target. The computing device 80 may further cause the display 206 to display the pathway to the next target on the 3D model” [0072].
In this case, since additional targets may be highlighted and/or displayed with different characteristics and the computing device 80 determines a pathway from the current position of the EBUS 62 to the next target (i.e. the additional targets having different colors than targets that have already been imaged), the representation of the navigable path includes a first portion indicating a portion of the navigable path that has been reached by the medical instrument (i.e. EBUS 62) and a second portion indicating a portion of the navigable path that has not been reached by the medical instrument (i.e. additional targets to be imaged) and wherein the first portion is visually distinguishable from the second portion (i.e. targets displayed along the pathway having different characteristics such as colors, see [0072]).).
Regarding claim 14, Kopel discloses all features of the claimed invention as discussed with respect to claim 12 above, and Kopel further teaches “wherein the navigational guidance further includes a displayed representation of critical anatomy along the navigable path or displayed nodal markers adjacent to one or more of the plurality of nodal sites” (See [0084] and FIG. 6 as discussed in claim 7 above. As shown in FIG. 6, the patient’s trachea 602 and airway tree 604 are displayed along with the plurality of lymph nodes 606. Therefore, the navigational guidance further includes a displayed representation of critical anatomy along the navigable path or displayed nodal markers (i.e. ovals/circles shown in FIGS. 4-6, for example) adjacent to one or more of the plurality of nodal sites.).
Regarding claim 16, Kopel discloses all features of the claimed invention as discussed with respect to claim 1 above, and Kopel further teaches “wherein the navigational guidance includes an indicator configured to indicate that at least one nodal site of the plurality of nodal sites has or has not been sampled by the medical instrument” (See [0072] as discussed in claim 13 above. Furthermore, as shown in FIG. 8, the box on the right includes check marks next to lymph nodes 4R and 7, thus indicating that these targets have been imaged by the EBUS 62 already. Therefore, since additional targets may be highlighted and/or displayed with a different characteristic, such as a different color, than targets that have already been imaged or a check mark can be displayed (see FIG. 8), the navigational guidance includes an indicator (i.e. color or check mark) configured to indicate that at least one nodal site (i.e. lymph node) of the plurality of nodal sites has or has not been sampled by the medical instrument.).
Regarding claim 18, Kopel discloses all features of the claimed invention as discussed with respect to claim 1 above, and Kopel further teaches “wherein the navigational guidance includes an indicator configured to indicate a nodal site of the plurality of nodal sites to be sampled by the medical instrument” (See [0072] as discussed in claim 13 above. Furthermore, as shown in FIG. 8, the box on the right includes check marks next to lymph nodes 4R and 7, thus indicating that these targets have been imaged by the EBUS 62 already. Therefore, lymph nodes 4L, 10L and 11L have not been imaged by the EBUS 62. Therefore, since additional targets may be highlighted and/or displayed with a different characteristic, such as a different color, than targets that have already been imaged or a check mark can be displayed indicating which lymph nodes have been imaged already (i.e. lymph nodes without a check having not been imaged yet, see FIG. 8), the navigational guidance includes an indicator (i.e. color or check mark) configured to indicate that at least one nodal site (i.e. lymph node) of the plurality of nodal sites to be sampled by the medical instrument.).
Regarding claim 19, Kopel discloses all features of the claimed invention as discussed with respect to claim 18 above, and Kopel further teaches “wherein the indicator is displayed with a three- dimensional image of the anatomic model” (See [0072] as discussed in claim 13, FIG. 8 and “FIG. 6 is a view of yet another illustrative graphical user interface showing a 3D model of at least a portion of the patient's chest which may be displayed by the computing device of FIG. 2 during performance of the method of FIGS. 3A-3D” [0031]; “FIG. 8 is yet another view of the graphical user interface of FIGS. 6 and 7 showing additional details that may be displayed by the computing device of FIG. 2 during performance of the method of FIGS. 3A-3D” [0033]. As shown in FIG. 8, the list with the check marks is displayed along with the 3D model of the patient’s lungs. Therefore, the indicator is displayed with a three-dimensional image of the anatomic model.).
Regarding claim 20, Kopel discloses all features of the claimed invention as discussed with respect to claim 18 above, and Kopel further teaches “wherein the indicator is displayed with a virtual or a real-time endoscopic image view” (See [0086] as discussed with respect to claim 4 above. In this case, the view 830 represents a virtual endoscopic image view which is acquired by the EBUS 62. As shown in FIG. 8, the indicators (i.e. check marks on list) are displayed on the same GUI screen as the view 830. Therefore, the indicator is displayed with a virtual or a real-time endoscopic image view.).
Regarding claim 22, Kopel discloses all features of the claimed invention as discussed with respect to claim 1 above, and Kopel further teaches “wherein providing navigational guidance includes displaying a user interface orientation element including a direction indicator for an imaging element of the medical instrument and a representation of a critical anatomy” (“FIG. 5 shows another illustrative GUI that may be displayed during various steps of the method 300. As noted above, FIG. 5 shows a view of the 3D model including portions of the patient's bronchial tree 502, vascular tree 504, and lymph nodes 506. Also shown in FIG. 5 is a representation of the EBUS 508 including an ultrasound sensor 510 and a biopsy needle 512. FIG. 5 is a representation of the EBUS 508 including an ultrasound sensor 510 and a biopsy needle 512. Ultrasound images 514 captured by the ultrasound sensor are shown overlaid onto the 3D model, with a 3D rendering of the target 516 displayed thereon” [0083]. As shown in FIG. 5, the ultrasound sensor 510 is oriented toward the target 516. Therefore, the step of providing navigational guidance includes displaying a user interface orientation element including a direction indicator (i.e. corresponding to the location of the ultrasound sensor 510) for an imaging element (i.e. 510) of the medical instrument (i.e. EBUS 508) and a representation of a critical anatomy (i.e. bronchial tree 502, vascular tree 504).).
Regarding claim 23, Kopel discloses all features of the claimed invention as discussed with respect to claim 1 above, and Kopel further teaches “wherein providing navigational guidance includes displaying a representation of a field of view area of an imaging element of the medical instrument” (See [0086] as discussed with respect to claim 4 above. The view 830 represents a field of view area of an imaging element of medical instrument (i.e. EBUS 62). Thus, the step of providing navigational guidance includes displaying a representation of a field of view area of an imaging element of the medical instrument (i.e. EBUS 62).).
Regarding claim 24, Kopel discloses all features of the claimed invention as discussed with respect to claim 1 above, and Kopel further teaches “wherein the performed operations further comprise displaying the local image data with an image annotation of the local image data” (“FIG. 8 further shows a view 830 of the ultrasound image data captured by the EBUS 62, where the ultrasound image data is augmented with indicators 832 representing the positions of identified structures in the ultrasound image data” [0086]. As shown in FIG. 8, the indicators 832 (i.e. annotations indicating the borders of structures within the image) are presented on the view 830. In this case, the view 830, shown in FIG. 8, represents a local image of the lymph node (i.e. target) which is captured by the EBUS 62. Therefore, the performed operations further comprise displaying the local image data with an image annotation of the local image data (i.e. indicators 832).).
Conclusion
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure:
Sartor et al. US 2018/0333095 A1 “Sartor” is pertinent to the applicant’s disclosure because it discloses “Turning now to FIG. 7, a flowchart illustrating an exemplary method 700 for performing lymph node surgical procedures and presenting lymph node information data 255 is shown, in accordance with the present disclosure. Method 700 details steps taken during removal of all or a portion of region of interest 209 and lymph nodes 205 and confirmation that accurate and correct lymph nodes 205 were removed. Method 700 begins at step 705 where a clinician selects a 3D model 215 including region of interest 209 or lymph node 205 for which a surgical procedure is to be performed. Next, at step 707, the selected 3D model is registered with the patient. Thereafter, at step 710, the clinician performs a laparoscopic procedure and moves surgical tool 32 and laparoscope 30 to region of interest 209 or lymph node 205, as further described in the detailed description of FIG. 1. As surgical tool 32 is moved to the physical location of lymph nodes 205 and/or region of interest 209, the location of EM sensor 94 of surgical tool 32 is tracked at step 715. Next, at step 720, using the physical location of laparoscope 30, laparoscopic view 310 changes. Location window 320 including images generated from 3D model 215 changes based on the physical location of EM sensor 94 of laparoscope 30 due to the registration between 3D model 215 and the patient and detection of EM sensor 94 in the EM field. Additionally, based on the location of EM sensor 94 of surgical tool 32 and or laparoscope camera 30, current and previous lymph node information data 255 of those lymph nodes 205 may be obtained. For example, where lymph nodes 205 have been previously biopsied, previous lymph node information data 255 may be obtained from computing device 80 and displayed” [0066].
Georgescu et al. US 2020/0193594 A1 “Georgescu” is pertinent to the applicant’s disclosure because it discloses “Systems and methods for identifying and assessing lymph nodes are provided. Medical image data (e.g., one or more computed tomography images) of a patient is received and anatomical landmarks in the medical image data are detected. Anatomical objects are segmented from the medical image data based on the one or more detected anatomical landmarks. Lymph nodes are identified in the medical image data based on the one or more detected anatomical landmarks and the one or more segmented anatomical objects. The identified lymph nodes may be assessed by segmenting the identified lymph nodes from the medical image data and quantifying the segmented lymph nodes. The identified lymph nodes and/or the assessment of the identified lymph nodes are output” [Abstract].
Any inquiry concerning this communication or earlier communications from the examiner should be directed to KAITLYN E SEBASTIAN whose telephone number is (571)272-6190. The examiner can normally be reached Mon.- Fri. 7:30-4:30 (Alternate Fridays Off).
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Anne M Kozak can be reached at (571) 270-0552. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/KAITLYN E SEBASTIAN/Examiner, Art Unit 3797
Prosecution Insights