Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Continued Examination Under 37 CFR 1.114
A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 4 May, 2026 has been entered.
Response to Amendment
The amendment filed 4 May, 2026 has been entered.
The amendment of claims 1, 17, 18, and 20 has been acknowledged.
The cancellation of claims 11 and 16 has been acknowledged.
Response to Arguments
Applicant’s arguments, see page 6, section “Claim Objections”, filed 4 May, 2026 with respect to the objection of claim 11 has been fully considered and is persuasive. The objection of claim 11 is withdrawn.
Applicant’s arguments, see page 6, section “Claim Rejections – 35 USC 103”, filed 4 May, 2026 with respect to the rejection of claims 1, 16, 17, 19, and 20 has been fully considered and is persuasive. The rejection of claims 1 and 11 – 20 under 35 U.S.C. § 103 is withdrawn. However, upon further examination a new rejection is made for claims 11, 12 – 15, and 17 – 20 under 35 U.S.C. § 103.
Claim Rejections - 35 USC § 112
The following is a quotation of 35 U.S.C. 112(b):
(b) CONCLUSION.—The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the inventor or a joint inventor regards as the invention.
The following is a quotation of 35 U.S.C. 112 (pre-AIA ), second paragraph:
The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the applicant regards as his invention.
Claim 19 is rejected under 35 U.S.C. 112(b) or 35 U.S.C. 112 (pre-AIA ), second paragraph, as being indefinite for failing to particularly point out and distinctly claim the subject matter which the inventor or a joint inventor (or for applications subject to pre-AIA 35 U.S.C. 112, the applicant), regards as the invention.
Claim 19 recites “the method of claim 16”, however claim 16 has been cancelled. It is unclear which of the preceding claims claim 19 is now referring to. For the purpose of this examination, examiner interprets claim 19 to depend from independent claim 1.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1, 17, 19, and 20 are rejected under 35 U.S.C. 103 as being unpatentable over Musahl et al (U.S. Patent Publication No. 2018/0214074 A1, hereinafter “Musahl”) in view of Barut et al (U.S. Patent Publication No. 2021/0393330 A1, hereinafter “Barut”) and further in view of Lang et al (U.S. Patent Publication No. 2017/0258526 A1, hereinafter “Lang”).
Regarding claim 1, Musahl teaches a method of performing a physiological measurement, the method comprising:
applying a first marker to a portion of a tissue (¶ 0035: In order to accurately measure motion (e.g., lateral pivot shift) using video, markers can be affixed externally to the patient's skin in a noninvasive manner), the first marker having a pattern of markings thereon, each marking of the pattern of markings having an initial position (¶ 0035: While a variety of marking schemes can be supported by innovations herein, an example can include using circular stickers in a predetermined pattern.), the pattern of markings including a plurality of dots (¶ 0043: Markers, as described herein, are visible, noninvasive, external markings on a patient. Markers can include, but are not limited to, stickers, ink, and other identifiable visual features. Markers can be included in all shapes and sizes. For example, solid or outlined shapes such as circles, rectangles, triangles, and others can be affixed or drawn on bodily landmarks or arbitrary locations. In alternative examples, various lined, grid, or other patterns can be affixed or drawn.)
capturing an image of the pattern of markings at a first time after applying the first marker to the tissue (¶ 0036: A digital camera can be positioned to capture motion of the markers and other aspects during a test.), at least one marking of the pattern of markings having a subsequent position at the first time when the image is captured (¶ 0036: For example, in a pivot shift test, the video camera can record the lateral aspect of the knee during the pivot shift test.);
determining a change of position of the at least one marking by comparing the subsequent position of the at least one marking in the captured image to the initial position of the at least one marking (¶ 0038: With respect to the lateral pivot shift test, the anteroposterior (AP) position of the femur can be calculated on consecutive still images extracted from the video recording. AP translation over time can be recorded and associated with various diagnoses.);
determining a change in spacing between the subsequent position of the at least one marking and an adjacent dot (¶ 0048: In embodiments, processing component can determine quantities such as distance, angle, time, velocity, acceleration, and other measurements. Such measurements can be absolute (e.g., five millimeters) or relative ( e.g., one-third of the distance between two known markers), and listed according to one or more units (e.g., millimeters) or in a unit-less form (e.g., according to an arbitrary coordinate system defined by at least processing component 120, according to relative measurements).; ¶ 0055: Processing component 120 can view the changes between various times within a video and/or subsequent still images to define the motion of markers and/or the target area in terms of quantitative assessment. These results can be provided in tabulated form and/or displayed visually in terms of graphs or other visual depictions of the data. This quantitative data can be used to explicitly define abnormal motion in terms of measured changes, and thus be used in a diagnosis according to existing or derived criteria.); and
based on the change in spacing between the subsequent position of the at least one marking and the adjacent dot, determining the physiological measurement of the tissue (¶ 0039: A sudden anterior translation of the distal femur can be associated with various grades or measurements indicative of ACL injury. In studies and/or embodiments, the sudden anterior translation of the lateral epicondyle can be on average 3.7±2.1 mm and occurred within 0.2±0.1 seconds from the start of such anterior translation. These shifts are successfully detected in accordance with disclosures herein, facilitating a simple and affordable method to evaluate the lateral pivot shift test.; ¶ 0055: Processing component 120 can view the changes between various times within a video and/or subsequent still images to define the motion of markers and/or the target area in terms of quantitative assessment. These results can be provided in tabulated form and/or displayed visually in terms of graphs or other visual depictions of the data. This quantitative data can be used to explicitly define abnormal motion in terms of measured changes, and thus be used in a diagnosis according to existing or derived criteria.).
Musahl does not explicitly teach a plurality of fiducials, the plurality of fiducials being embedded within a grid of the plurality of dots; wherein the physiological measurement is a change in volume of the tissue.
However, Barut does teach the pattern of markings including a plurality of dots and a plurality of fiducials, the plurality of fiducials being embedded within a grid of the plurality of dots (Figure 8A and 9; ¶ 0179: In some embodiments, a temporary tattoo 815 may comprise a radiopaque material upon the flexible substrate. The radiopaque material may be printed, deposited, sprayed, or otherwise formed or placed on the flexible substrate. As most clearly depicted in FIG. 8B, the radiopaque material may be arranged on the substrate to form a grid pattern.; ¶ 0180: In some embodiments, the temporary tattoo 815 may form a design, depiction, or decorative image. For example, as demonstrated in FIGS. SA-B, the temporary tattoo 815 may depict a combination of letters and symbols.).; and
wherein the physiological measurement is a change in volume of the tissue (¶ 0204: In some embodiments, the computing device may be used to calculate and/or account for changes in flexion of the joint between the images. In some embodiments, changes in flexion are identified by comparing the radiopaque grid pattern of the temporary tattoos across the plurality of images. For example, the position and orientation of the grid lines may be compared across the images to determine displacement. Skin movement is indicative of changes in position of the joint movement and accordingly the displacement of the grid lines may be measured to calculate a displacement of the joint (i.e., flexing or twisting).; Examiner’s note: While Barut does not explicitly state that it measures volume, it is understood that the movement and change in shape, spacing, displacement, orientation of the patient’s joints, skin, or grid pattern on the skin would directly correspond to a change in the volume of the tissue on which the grid pattern is applied.).
Musahl and Barut are considered to be analogous art as both pertain to image analysis of fiducial patterns applied to a person. Therefore, it would have been obvious to one of ordinary skill in the art to combine the quantified injury diagnostics (as taught by Musahl) and the knee imaging co-registration devices (as taught by Barut) before the effective filing date of the claimed invention. The motivation for this combination of references would be the method of Barut ensures that each patient receives personalized surgical and rehabilitative care which improves the chance of successful clinical outcomes and lessening the economic burden on the facility associated with near-term revision. (See ¶ 0137).
This motivation for the combination of Musahl and Barut is supported by KSR exemplary rationale (G) Some teaching, suggestion, or motivation in the prior art that would have led one of ordinary skill to modify the prior art reference or to combine prior art reference teachings to arrive at the claimed invention. MPEP 2141 (III).
Additionally, Lang does explicitly teach wherein the physiological measurement is a change in volume of the tissue (¶ 0728: Automated re-registration can, for example, be performed using an image and/or video capture system integrated into, attached to or separate from the OHMD (optical head mounted display) which can capture information about the surgically altered tissue or tissue surface or tissue contour or tissue perimeter or tissue volume or other tissue features in the live patient data after the surgical alteration and compare the information to information in the virtual data of the patient, e.g. for the virtual data after performing the comparable step in a virtual surgical plan. Automated re-registration can, for example, be performed using an image and/or video capture system integrated into, attached to or separate from the OHMD which can capture information about the surgically altered tissue or tissue surface or tissue contour or tissue perimeter or tissue volume or other tissue features in the live patient data after the surgical alteration and compare the information to information in the virtual data of the patient, e.g. for the virtual data after performing the comparable step in a virtual surgical plan.).
Musahl and Lang are considered to be analogous art as both pertain to fiducial patterns being applied to a person. Therefore, it would have been obvious to one of ordinary skill in the art to combine the quantified injury diagnostics (as taught by Musahl) and the devices and methods for surgery (as taught by Lang) before the effective filing date of the claimed invention. The motivation for this combination of references would be the method of Lang enables the position, orientation, alignment, and change in position, orientation and alignment in relationship to the patient and the surgical site of each additional OHMD can be individually monitored thereby maintaining alignment and superimposition of corresponding structures in the live data of the patient and the virtual data of the patient for each additional OHMD irrespective of their position, orientation, and alignment in relationship to the patient and/or the surgical site. (See ¶ 0146).
This motivation for the combination of Musahl, Barut, and Lang is supported by KSR exemplary rationale (G) Some teaching, suggestion, or motivation in the prior art that would have led one of ordinary skill to modify the prior art reference or to combine prior art reference teachings to arrive at the claimed invention. MPEP 2141 (III).
Regarding claim 17, the Musahl, Barut, and Lang combination teaches the method of claim 1.
Additionally, Musahl and Barut teach wherein the plurality of fiducials each have a cross shape (Musahl ¶ 0043: In alternative examples, various lined, grid, or other patterns can be affixed or drawn.; Barut Figure 8B; ¶ 0170: The fiducial marker system 800 comprises a plurality of rigid bands 805 and one or more temporary tattoos 815.).
Regarding claim 19, the Musahl, Barut, and Lang combination teaches the method of claim 16.
Additionally, Musahl teaches wherein determining the change of position of the at least one marking includes comparing a subsequent position of at least one feature of at least one of the fiducials in the captured image to an initial position of the at least one feature of the of at least one of the fiducials in a template image (¶ 0036: A digital camera can be positioned to capture motion of the markers and other aspects during a test. For example, in a pivot shift test, the video camera can record the lateral aspect of the knee during the pivot shift test.; ¶ 0038: With respect to the lateral pivot shift test, the anteroposterior (AP) position of the femur can be calculated on consecutive still images extracted from the video recording. AP translation over time can be recorded and associated with various diagnoses.; ¶ 0052: In a detailed example of processing component 120 determining image parameters, a marker can be a circle with a diameter of one-half inch. With this information provided, processing component 120 can utilize images from capture component 110 (which, for example, may show the marker as an oval if the capture component does not view the marker straight-on) to determine an angle to the target and adjust calculations accordingly. Further, by being provided information (e.g., that the markers are one-half inch in diameter), a scale can be defined relative to the known-sized markers.).
Regarding claim 20, the Musahl and Lang combination teaches a system for performing a physiological measurement of a tissue of a person, the system comprising:
a computer processor coupled to a memory (¶ 0105: With reference to FIG. 10, the exemplary environment 1000 for implementing various aspects of the innovation includes a computer 1002, the computer 1002 including a processing unit 1004, a system memory 1006 and a system bus 1008.), wherein the computer processor is programmed to perform a physiological measurement by:
receiving image data from a patient device, the image data including a pattern of markings of a marker on the tissue at a first time after applying the marker to the portion of the tissue ¶ 0036: A digital camera can be positioned to capture motion of the markers and other aspects during a test.;
determining a change of position of at least one marking of the pattern of markings by comparing a subsequent position of the at least one marking to an initial position of the at least one marking (¶ 0038: With respect to the lateral pivot shift test, the anteroposterior (AP) position of the femur can be calculated on consecutive still images extracted from the video recording. AP translation over time can be recorded and associated with various diagnoses.); and
based on the change of position of the at least one marking, determining the physiological measurement of the person (¶ 0039: A sudden anterior translation of the distal femur can be associated with various grades or measurements indicative of ACL injury. In studies and/or embodiments, the sudden anterior translation of the lateral epicondyle can be on average 3.7±2.1 mm and occurred within 0.2±0.1 seconds from the start of such anterior translation. These shifts are successfully detected in accordance with disclosures herein, facilitating a simple and affordable method to evaluate the lateral pivot shift test.),
additionally, Lang teaches the physiological measurement being a change in volume of the tissue (¶ 0728: Automated re-registration can, for example, be performed using an image and/or video capture system integrated into, attached to or separate from the OHMD (optical head mounted display) which can capture information about the surgically altered tissue or tissue surface or tissue contour or tissue perimeter or tissue volume or other tissue features in the live patient data after the surgical alteration and compare the information to information in the virtual data of the patient, e.g. for the virtual data after performing the comparable step in a virtual surgical plan. Automated re-registration can, for example, be performed using an image and/or video capture system integrated into, attached to or separate from the OHMD which can capture information about the surgically altered tissue or tissue surface or tissue contour or tissue perimeter or tissue volume or other tissue features in the live patient data after the surgical alteration and compare the information to information in the virtual data of the patient, e.g. for the virtual data after performing the comparable step in a virtual surgical plan.).
Claims 12, 13, 15, and 18 are rejected under 35 U.S.C. 103 as being unpatentable over Musahl et al (U.S. Patent Publication No. 2018/0214074 A1, hereinafter “Musahl”) in view of Barut et al (U.S. Patent Publication No. 2021/0393330 A1, hereinafter “Barut”) and further in view of Lang et al (U.S. Patent Publication No. 2017/0258526 A1, hereinafter “Lang”) and Daon et al (U.S. Patent Publication No. 2013/0131505 A1, hereinafter “Daon”).
Regarding claim 12, the Musahl, Barut, and Lang combination teaches the method of claim 1.
Musahl does not explicitly teach further comprising, prior to applying the marker to the portion of the tissue, applying a stencil to the portion of the tissue, the stencil having the pattern of markings cut out to provide for the semi-permanent ink to pass through openings forming the pattern of markings and into the tissue.
However Daon does teach further comprising, prior to applying the marker to the portion of the tissue, applying a stencil to the portion of the tissue, the stencil having the pattern of markings cut out to provide for the semi-permanent ink to pass through openings forming the pattern of markings and into the tissue (¶ 0008: The pattern may be configured to be transferable from a transfer film to the skin, or may be directly applied to the skin through a mask or a stencil bearing the multi-element fiducial pattern.).
Musahl and Daon are considered to be analogous art as both pertain to fiducial patterns being applied to a person. Therefore, it would have been obvious to one of ordinary skill in the art to combine the quantified injury diagnostics (as taught by Musahl) and the surgical location monitoring system (as taught by Daon) before the effective filing date of the claimed invention. The motivation for this combination of references would be the method of Daon has known configurations so that observational data and/or tracking markers can be precisely mapped to the coordinate system. (See ¶ 0061).
This motivation for the combination of Musahl, Barut, Lang, and Daon is supported by KSR exemplary rationale (G) Some teaching, suggestion, or motivation in the prior art that would have led one of ordinary skill to modify the prior art reference or to combine prior art reference teachings to arrive at the claimed invention. MPEP 2141 (III).
Regarding claim 13, the Musahl, Barut, Lang, and Daon combination teaches the method of claim 12.
Additionally, Daon teaches wherein the tissue is adjacent to a surgical incision (¶ 0006: The present invention involves a surgical monitoring system comprising a fiducial reference configured for (1) applying to a location on skin proximate a surgical site, (2) for having a three-dimensional location and orientation determinable based on scan data of the surgical site, and (3) for having the three-dimensional location and orientation determinable based on image information about the surgical site.).
Regarding claim 15, the Musahl and Lang combination teaches the method of claim 1.
Additionally, Daon teaches wherein the pattern of markings includes straight line segment markings and curved line segment markings (Figure 7A – 7F; ¶ 0081: In one embodiment, the computer system has a predetermined knowledge of the configuration of multi-element fiducial pattern 710 and examines slices of a scan of the surgical site to locate pattern segments 720 of multi-element fiducial pattern 710 based on one or more of the radio-opacity density of the material of the pattern segments 720, their shapes and their unique tracking markers 740.; Examiner’s note: The markings indicated in Figure 7A show letters which contain straight line segment markings as well as curved line segment markings.).
Regarding claim 18, the Musahl and Lang combination teaches the method of claim 1.
Additionally, Musahl teaches wherein the pattern includes three fiducials (¶ 0035: For example, in a lateral pivot shift test, three skin markers can be attached to bony landmarks on the lateral side of the knee joint.),
Additionally, Daon teaches each pattern having a cross shape (Figure 9C and 9D; ¶ 0094: FIGS. 9C and 9D illustrate a similar use of constellations, wherein skin 912 of the surgical site receives transfer member 902, for example incise film or transfer tape, which bear elements 922. Elements 922, in addition to having radio-opaque qualities, also are visible to tracker 932 so that the location of elements 922, and their corresponding constellations 942 and 952, may be apparent on scans and image data.)
Claim 14 is rejected under 35 U.S.C. 103 as being unpatentable over Musahl et al (U.S. Patent Publication No. 2018/0214074 A1, hereinafter “Musahl”) in view of Barut et al (U.S. Patent Publication No. 2021/0393330 A1, hereinafter “Barut) and further in view of Lang et al (U.S. Patent Publication No. 2017/0258526 A1, hereinafter “Lang”), Daon et al (U.S. Patent Publication No. 2013/0131505 A1, hereinafter “Daon”), and Knowlton et al (U.S. Patent Publication No. 2021/0085356 A1, hereinafter “Knowlton”).
Regarding claim 14, the Musahl, Barut, Lang, and Daon combination teaches the method of claim 13.
Neither Musahl, Barut, Lang, or Daon teaches wherein the surgical incision was used during one of:
a breast reconstruction or augmentation surgery;
a facial plastic or reconstruction surgery;
a cardio-thoracic surgery such as a sternal repair after coronary artery bypass graft surgery (CABG); and
a hernia surgery.
However Knowlton teaches wherein the surgical incision was used during one of:
a breast reconstruction or augmentation surgery (¶ 0042: Plastic surgery procedures have been developed to resect the redundant lax skin. These procedures must employ long incisions that are typically hidden around anatomical boundaries such as the ear and scalp for a facelift and the inframammary fold for a breast uplift (mastopexy).; ¶ 0511: The harvest pattern comprises indicators or markers on a skin surface on at least one of the donor site and the recipient site, but is not so limited. The markers include any compound that may be applied directly to the skin to mark an area of the skin.);
a facial plastic or reconstruction surgery (¶ 0042: “Facial Cervical Rhytidoplasty” as used herein includes a procedure known as a facelift. However, a major part of this aesthetic surgical procedure involves the restoration of the cervical-mandibular angle in the neck. A facelift is performed through a curvilinear incision around the ear and extending into temporal/occipital scalp.; ¶ 0511: The harvest pattern comprises indicators or markers on a skin surface on at least one of the donor site and the recipient site, but is not so limited. The markers include any compound that may be applied directly to the skin to mark an area of the skin.);
a cardio-thoracic surgery such as a sternal repair after coronary artery bypass graft surgery (CABG); and
a hernia surgery.
Musahl and Knowlton are considered to be analogous art as both pertain to fiducial patterns being applied to a person. It would have been obvious to one of ordinary skill in the art to combine the quantified injury diagnostics (as taught by Musahl) and pixel array medical systems (as taught by Knowlton) before the effective filing date of the claimed invention because such a modification is the result of combining prior art elements according to known methods to yield predictable results. More specifically, Musahl as modified by Knowlton can yield a predictable result of performing various surgeries to be performed utilizing a marker placed on the patient’s skin. Thus, a person of ordinary skill would have appreciated including in Musahl the ability to do a breast reconstruction or augmentation or facial plastic or reconstruction surgery since the claimed invention is merely a combination of old elements, and in the combination each element merely would have performed the same function as it did separately, and one of ordinary skill in the art would have recognized that the results of the combination were predictable.
This motivation for the combination of Musahl, Barut, Lang, Daon, and Knowlton is supported by KSR exemplary rationale (A) Some teaching, suggestion, or motivation in the prior art that would have led one of ordinary skill to modify the prior art reference or to combine prior art reference teachings to arrive at the claimed invention. MPEP 2141 (III).
Conclusion
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure.
Zhao et al (U.S. Patent Publication No. 2023/0196707 A1) teaches a plurality of fiducial patterns, including cross shaped fiducial markers within a grid of dots.
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to ANDREW JONES whose telephone number is (703)756-4573. The examiner can normally be reached Monday - Friday 8:00-5:00 EST, off Every Other Friday.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Matthew Bella can be reached at (571) 272-7778. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/ANDREW B. JONES/Examiner, Art Unit 2667
/MATTHEW C BELLA/Supervisory Patent Examiner, Art Unit 2667
Prosecution Insights