DETAILED ACTION
This office action is in response to the communication received on December 27, 2024 concerning application No. 17/796,087 filed on July 18, 2022.
Claims 1-15 are currently pending.
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Continued Examination Under 37 CFR 1.114
A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on December 27, 2024 has been entered.
Response to Arguments
Applicant's arguments filed 12/27/2024 regarding the claim interpretations have been fully considered. The amendments to the claims have been entered and after further consideration “electronic application” will no longer be interpreted under 35 USC 112f. However, “an intermediate module” is still being considered under 35 USC 112f. regarding applicant’s argument that the claims are being limited to the specific examples in the specification, examiner notes that the interpretation of the claim limitations under 35 USC 112(f) includes a software for performing the limitation or an equivalent thereof. By having the interpretation include “an equivalent thereof”, the interpretation is not limited to only the specific examples in the specification.
Applicant’s arguments with respect to claim(s) 1, 5, 6, 13, 15 and 16 and the previously relied upon references Kakileti and Padwal have been fully considered but are moot because the new ground of rejection does not rely on any reference applied in the prior rejection of record for any teaching or matter specifically challenged in the argument.
Claim Objections
Claims 5, 8-9 and 13 are objected to because of the following informalities:
Claim 5, line 2, “interfaces” should read “user interface”,
Claim 8, line 2, “a thermal imager” should read “the thermal imager”,
Claim 9, line 6, “an intermediate module” should read “the intermediate module”,
Claim 13, line 3, “the mobile” should read “the mobile electronic device.”.
Appropriate correction is required.
Claim Interpretation
The following is a quotation of 35 U.S.C. 112(f):
(f) Element in Claim for a Combination. – An element in a claim for a combination may be expressed as a means or step for performing a specified function without the recital of structure, material, or acts in support thereof, and such claim shall be construed to cover the corresponding structure, material, or acts described in the specification and equivalents thereof.
The following is a quotation of pre-AIA 35 U.S.C. 112, sixth paragraph:
An element in a claim for a combination may be expressed as a means or step for performing a specified function without the recital of structure, material, or acts in support thereof, and such claim shall be construed to cover the corresponding structure, material, or acts described in the specification and equivalents thereof.
The claims in this application are given their broadest reasonable interpretation using the plain meaning of the claim language in light of the specification as it would be understood by one of ordinary skill in the art. The broadest reasonable interpretation of a claim element (also commonly referred to as a claim limitation) is limited by the description in the specification when 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, is invoked.
As explained in MPEP § 2181, subsection I, claim limitations that meet the following three-prong test will be interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph:
(A) the claim limitation uses the term “means” or “step” or a term used as a substitute for “means” that is a generic placeholder (also called a nonce term or a non-structural term having no specific structural meaning) for performing the claimed function;
(B) the term “means” or “step” or the generic placeholder is modified by functional language, typically, but not always linked by the transition word “for” (e.g., “means for”) or another linking word or phrase, such as “configured to” or “so that”; and
(C) the term “means” or “step” or the generic placeholder is not modified by sufficient structure, material, or acts for performing the claimed function.
Use of the word “means” (or “step”) in a claim with functional language creates a rebuttable presumption that the claim limitation is to be treated in accordance with 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph. The presumption that the claim limitation is interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, is rebutted when the claim limitation recites sufficient structure, material, or acts to entirely perform the recited function.
Absence of the word “means” (or “step”) in a claim creates a rebuttable presumption that the claim limitation is not to be treated in accordance with 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph. The presumption that the claim limitation is not interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, is rebutted when the claim limitation recites function without reciting sufficient structure, material or acts to entirely perform the recited function.
Claim limitations in this application that use the word “means” (or “step”) are being interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, except as otherwise indicated in an Office action. Conversely, claim limitations in this application that do not use the word “means” (or “step”) are not being interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, except as otherwise indicated in an Office action.
This application includes one or more claim limitations that do not use the word “means,” but are nonetheless being interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, because the claim limitation(s) uses a generic placeholder that is coupled with functional language without reciting sufficient structure to perform the recited function and the generic placeholder is not preceded by a structural modifier. Such claim limitation(s) is/are:
“an intermediate module” in claim 1.
Because this/these claim limitation(s) is/are being interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, it/they is/are being interpreted to cover the corresponding structure described in the specification as performing the claimed function, and equivalents thereof. For the purpose of examination and this office action “an intermediate module” will be interpreted as any software structure/component mediating and targeting information between an electronic application and a server or equivalent thereof (see [0043] of the present applications specification).
If applicant does not intend to have this/these limitation(s) interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, applicant may: (1) amend the claim limitation(s) to avoid it/them being interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph (e.g., by reciting sufficient structure to perform the claimed function); or (2) present a sufficient showing that the claim limitation(s) recite(s) sufficient structure to perform the claimed function so as to avoid it/them being interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph.
Claim Rejections - 35 USC § 112
The following is a quotation of 35 U.S.C. 112(b):
(b) CONCLUSION.—The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the inventor or a joint inventor regards as the invention.
The following is a quotation of 35 U.S.C. 112 (pre-AIA ), second paragraph:
The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the applicant regards as his invention.
Claim 15 is rejected under 35 U.S.C. 112(b) or 35 U.S.C. 112 (pre-AIA ), second paragraph, as being indefinite for failing to particularly point out and distinctly claim the subject matter which the inventor or a joint inventor (or for applications subject to pre-AIA 35 U.S.C. 112, the applicant), regards as the invention.
The term “high” in claim 15, line 3 is a relative term which renders the claim indefinite. The term “high” is not defined by the claim, the specification does not provide a standard for ascertaining the requisite degree, and one of ordinary skill in the art would not be reasonably apprised of the scope of the invention. The term “high” does not provide a standard for how high the percentage of chance of having a pathological pattern needs to be in order to be considered “high”.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claim(s) 1, 3-4, 6-7 and 10-11 is/are rejected under 35 U.S.C. 103 as being unpatentable over Cozzie (US 20100312136) in view of Cantu et al. (US 20200258219, hereinafter Cantu).
Regarding claim 1, Cozzie teaches an auxiliary system for evaluating breast thermographic images (Abstract teaches a system for analyzing thermographic imaging of a breast), comprising:
an electronic device provided with a screen ([0080] discloses the processor makes information on a display device which is considered a screen) and connected with at least one thermal imager ([0032] and fig. 1, the image processing device 110 which is connected to thermographic imaging device 105), the electronic device being provided with at least one embedded electronic application which is installed in the electronic device and is provided with a interface ([0080] discloses the processor 110 is configured to send the information and receive the report and make the report available on a display device. The display device is considered the interface. The information on the processor that instructs the processor is considered the embedded electronic application);
an intermediate module communicating with the embedded electronic application ([0080] discloses the processor is configured to forward information to authority 103, the part of the processor that receives the information and forwards it and the part of authority 103 that receives the data is considered the intermediate module), the intermediate module being provided with a data driver, in which the intermediate module receives thermal image data from the embedded electronic application ([0033] discloses the captured thermographic images are transmitted to the processor 110, the part of the processor that receives the images is considered the data driver);
a server ([0036] and fig. 1, authority 103 which comprises the server), communicating with the intermediate module ([0036] discloses the authority receives images from the processor 110, meaning the authority is in communication with the intermediate module), provided with an artificial intelligence tool ([0126] discloses the authority includes a neural network module 118) and a data repository ([0036] storage 116);
wherein,
the thermal image data is pre-processed by a pre-processing algorithm to identify color patterns similarity and/or disparity ([0066] discloses a comparison of all points in the series 1 thermograph with the same points in the corresponding series 2 thermograph is performed. The comparison includes determining whether the temperature of the corresponding points are similar or different. Fig. 3 shows the temperature points correspond to a specific color shade. Therefore by comparing the temperatures, color pattern similarity and/or disparity is being identified. Claim 12 further discloses the analysis performed on the images is performed after the comparing, meaning the thermal image data is pre-processed. Additionally, [0106] discloses the authority 103 is used to compare the images and [0036] discloses the authority includes algorithms. The algorithm of authority 103 used to perform the comparison is considered the pre-processing algorithm) and, if a disparity in the color patterns is detected, the thermal image data are submitted to a process of color identification by pixel to extract the region of interest from the thermal image data ([0067] discloses that the hottest region of the breast is selected as the region of interest. Fig. 3 shows the temperature points correspond to a specific color shade, therefore by selecting the hottest region, the pixel with the lightest color is being identified and extracted as the region of interest from the thermal image);
the intermediate module sends the captured thermal image data to the server ([0032] discloses the processor 110 forwards the images to authority 103); and
the artificial intelligence tool receives the thermal image data and returns an index of suspicion ([0036]-[0037] discloses the module 118 processes the images and generates a report 126, in order to process the images the module must first receive them. [0080] discloses the report includes TH values which [0083] discloses is indicative of whether cancer is present. The report is considered the index of suspicion), which is received by the intermediate module and directed to the embedded electronic application running in the electronic device ([0083] discloses the report 126 is sent back to the processor 110 which makes the report available for output on a display device).
Cozzie does not specifically teach the system is a mobile system that includes a mobile electronic device and the artificial intelligence tool is trained with a sequence of thermal mammographic images wherein cancer was previously diagnosed by a physician.
However,
Cantu in a similar field of breast cancer screening teaches the system is a mobile system that includes a mobile electronic device that is provided with at least one embedded electronic application ([0081] discloses executing instructions using computer-executable components integrated with the application such as a mobile device or smartphone. The integrated application is considered the embedded electronic application).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie to have the system be a mobile system that comprises a mobile electronic device in order to be able to use the system in multiple different locations, thereby making the system more versatile.
Cantu further teaches training an artificial intelligence tool with a sequence of thermal mammographic images wherein cancer was previously diagnosed by a physician ([0009] “training a breast cancer screening model includes: accessing a set of thermographic images of a torso of a patient, the set of thermographic images associated with a pathology label in block S110…inputting the input vector and the pathology label as a training example in breast cancer screening model”. [0021] discloses the pathology label includes a label that indicate the presence of cancerous masses. [0051] further teaches the breast cancer screening model is implemented as an artificial neural network (intelligence).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie to have the artificial intelligence tool be trained with a sequence of thermal mammographic images wherein cancer was previously diagnosed by a physician in order to generate a more accurate model because it is using previously obtained data as training material.
Regarding claim 3, Cozzie in view of Cantu teaches the system of claim 1, as set forth above. Cozzie teaches the intermediate module stores the index of suspicion received in the data repository of the server ([0106] discloses the collected images and scores that make up report 126 are stored in the database 116. Also, [0130] “reports can be stored in database 116”).
Regarding claim 4, Cozzie in view of Cantu teaches the system of claim 3, as set forth above. Cozzie further teaches the repository comprises a data history of at least one patient, wherein the history is updated with patient information and the index of suspicion ([0106] discloses the database 116 contains previously collected images and scores (index) which means the database stores a data history of at least one patient. further [0080] discloses the report includes patient medical history, therefore by storing the currently generated report in database the history is being updated with patient information and the index of suspicion).
Regarding claim 6, Cozzie teaches an auxiliary process for evaluation of breast thermographic images (Abstract and title, teach a method for analyzing thermographic imaging of a breast), comprising the steps of:
collecting at least one breast thermographic image by an embedded electronic application installed and running in an electronic device ([0096] step 405 discloses capturing thermographic images of the breast. [0023] discloses transferring the thermographic images to image processing device 110. The process stored in processor 110 which performs the transferring is considered the embedded electronic application), wherein the at least one breast thermographic image is collected by a thermal imager connected with the electronic device ([0023] discloses the images are captured using thermographic imaging device 105 that is connected to processor 110 (electronic device));
pre-processing the breast thermographic image by a pre-processing algorithm to identify color patterns similarity and/or disparity ([0066] discloses a comparison of all points in the series 1 thermograph with the same points in the corresponding series 2 thermograph is performed. The comparison includes determining whether the temperature of the corresponding points are similar or different. Fig. 3 shows the temperature points correspond to a specific color shade. Therefore by comparing the temperatures, color pattern similarity and/or disparity is being identified. Claim 12 further discloses the analysis performed on the images is performed after the comparing, meaning the thermal image data is pre-processed. Additionally, [0106] discloses the authority 103 is used to compare the images and [0036] discloses the authority includes algorithms. The algorithm of authority 103 used to perform the comparison is considered the pre-processing algorithm) and, if a disparity in the color patterns is detected, the breast thermographic image is submitted to a process of color identification by pixel to extract the region of interest from the thermal image data ([0067] discloses that the hottest region of the breast is selected as the region of interest. Fig. 3 shows the temperature points correspond to a specific color shade, therefore by selecting the hottest region, the pixel with the lightest color is being identified and extracted as the region of interest from the thermal image);
sending, by an intermediate module (2), the breast thermographic image to a server ([0036] discloses the authority receives images from the processor 110), which is provided with an artificial intelligence tool ([0126] discloses the authority includes a neural network module 118) evaluating the breast thermographic image and returning an index of suspicion ([0036]-[0037] discloses the module 118 processes the images and generates a report 126. [0080] discloses the report includes TH values which [0083] discloses is indicative of whether cancer is present. The report is considered the index of suspicion); and
receiving the index of suspicion by the embedded electronic application and making available the index of suspicion in an interface of the embedded electronic application ([0083] discloses the report 126 is sent back to the processor 110 which makes the report available for output on a display device (interface)).
Cozzie does not specifically teach the system is a mobile system that includes a mobile electronic device and the artificial intelligence tool is trained with a sequence of thermal mammographic images wherein cancer was previously diagnosed by a physician.
However,
Cantu in a similar field of breast cancer screening teaches the system is a mobile system that includes a mobile electronic device that is provided with at least one embedded electronic application ([0081] discloses executing instructions using computer-executable components integrated with the application such as a mobile device or smartphone. The integrated application is considered the embedded electronic application).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie to have the system be a mobile system that comprises a mobile electronic device in order to be able to use the system in multiple different locations, thereby making the system more versatile.
Cantu further teaches training an artificial intelligence tool with a sequence of thermal mammographic images wherein cancer was previously diagnosed by a physician ([0009] “training a breast cancer screening model includes: accessing a set of thermographic images of a torso of a patient, the set of thermographic images associated with a pathology label in block S110…inputting the input vector and the pathology label as a training example in breast cancer screening model”. [0021] discloses the pathology label includes a label that indicate the presence of cancerous masses. [0051] further teaches the breast cancer screening model is implemented as an artificial neural network (intelligence).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie to have the artificial intelligence tool be trained with a sequence of thermal mammographic images wherein cancer was previously diagnosed by a physician in order to generate a more accurate model because it is using previously obtained data as training material.
Regarding claim 7, Cozzie in view of Cantu teaches the method of claim 6, as set forth above. Cantu further teaches the process is implemented in an auxiliary mobile system, as defined in claim 1 ([0081] discloses executing instructions using computer-executable components integrated with the application such as a mobile device or smartphone. The mobile device or smartphone is considered the auxiliary mobile system).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie in view of Cantu to have the process be implemented in an auxiliary mobile system in order to be able to use the system in multiple different locations, thereby making the system more versatile.
Regarding claim 10, Cozzie in view of Cantu teaches the method of claim 6, as set forth above. Cozzie further teaches a step of sending and updating patient history data, wherein the intermediate module sends patient information and/or index of suspicion to the server repository ([0106] discloses the database 116 contains previously collected images and scores (index) which means the database stores a data history. Further [0080] discloses the report includes patient medical history, therefore by storing the currently generated report in the database the history is being updated with patient information and the index of suspicion).
Regarding claim 11, Cozzie in view of Cantu teaches the system of claim 1, as set forth above. Cantu further teaches the mobile electronic device is a smartphone ([0081] discloses executing instructions using computer-executable components integrated with the application such as a mobile device or smartphone, therefore the mobile electronic device is a smartphone).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie in view of Cantu to have the mobile electronic device is a smartphone in order to be able to use the system in multiple different locations, thereby making the system more versatile.
Claim(s) 2 is/are rejected under 35 U.S.C. 103 as being unpatentable over Cozzie in view of Cantu as applied to claim 1 above, and further in view of Kandikar et al. (US 20190385308).
Regarding claim 2, Cozzie in view of Cantu teaches the system of claim 1, as set forth above. Cozzie in view of Cantu does not specifically teach the artificial intelligence tool comprises a convolutional neural network.
However,
Kandikar in a similar field of screening for cancer discloses an artificial intelligence tool comprising a convolution neural network for obtaining the location of a tumor ([0086] discloses the artificial intelligence algorithm is a convolutional neural network and obtains the location of a tumor).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to substitute the artificial intelligence tool of Cozzie in view of Cantu for the convolutional neural network of Kandikar because it amounts to simple substitution of one known element for another to obtain the predictable results of evaluating the breast thermographic images
Claim(s) 5, 8, and 13 is/are rejected under 35 U.S.C. 103 as being unpatentable over Cozzie in view of Cantu as applied to claims 1 and 6 above, and further in view of Chandler (US 20110243406).
Regarding claim 5, Cozzie in view of Cantu teaches the system of claim 1, as set forth above. Cozzie in view of Cantu does not specifically teach the embedded electronic application interface comprises at least one framework support mask in capturing the breast thermographic image, said framework support mask comprising framing guides to help frame breasts captured in the breast thermographic image onto the screen of the mobile electronic device.
However,
Chandler in a similar field of capturing medical images teaches an electronic application interface comprises at least one framework support mask in capturing the breast thermographic image, said framework support mask comprising framing guides to help frame breasts captured in the breast thermographic image onto the screen of the electronic device ([0023]-[0025] discloses displaying on an interface screen 40 a capture outline 50 (framework support mask) in fig. 3 of a body area being imaged. The capture outline is a transparent mask used to guide the operator in what body area is to be captured and the proper orientation thereof. Fig. 3 shows the support mask includes framing guides (outline) to help frame the region being captured on the screen of the device. [0027] discloses a breast region is a category that is imaged and [0017] discloses the obtained images are thermal images).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the embedded electronic application disclosed by Cozzie in view of Cantu to comprises at least one framework support mask in capturing the breast thermographic image, said framework support mask comprising framing guides to help frame breasts captured in the breast thermographic image onto the screen of the mobile electronic device in order to help guide the operator in obtaining the correct image of the patient, as recognized by Chandler ([0024]).
Regarding claim 8, Cozzie in view of Cantu teaches the method of claim 6, as set forth above. Cozzie further teaches a previous step of capturing the breast thermographic image by a thermal imager connected to the electronic device ([0023] discloses the images are captured using thermographic imaging device 105 that is connected to processor 110 (electronic device).
Cozzie in view of Cantu does not specifically teach the step of capturing the breast thermographic image comprises a sub-step of image framework from a support mask implemented in the interface of the embedded electronic application.
However,
Chandler in a similar field of capturing medical images teaches a step of capturing the breast thermographic image comprises a sub-step of image framework from a support mask implemented in the interface of the embedded electronic application ([0023]-[0025] discloses displaying on an interface screen 40 a capture outline 50 (framework support mask) in fig. 3 of a body area being imaged. The capture outline is a transparent mask used to guide the operator in what body area is to be captured and the proper orientation thereof. Fig. 3 shows the support mask includes framing guides (outline) to help frame the region being captured on the screen of the device. [0027] discloses a breast region is a category that is imaged and [0017] discloses the obtained images are thermal images).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the method disclosed by Cozzie in view of Cantu to the step of capturing the breast thermographic image comprises a sub-step of image framework from a support mask implemented in the interface of the embedded electronic application in order to help guide the operator in obtaining the correct image of the patient, as recognized by Chandler ([0024]).
Regarding claim 13, Cozzie in view of Cantu and Chandler teaches the method of claim 8, as set forth above. Chandler further teaches the framework support mask comprises framing guides to help frame the breasts into a screen of the electronic device ([0023]-[0025] discloses displaying on an interface screen 40 a capture outline 50 (framework support mask) in fig. 3 of a body area being imaged. The capture outline is a transparent mask used to guide the operator in what body area is to be captured and the proper orientation thereof. Fig. 3 shows the support mask includes framing guides (outline) to help frame the region being captured on the screen of the device. [0027] discloses a breast region is a category that is imaged and [0017] discloses the obtained images are thermal images).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the method disclosed by Cozzie in view of Cantu to have the framework support mask comprise framing guides to help frame the breasts into a screen of the mobile electronic device in order to help guide the operator in obtaining the correct image of the patient, as recognized by Chandler ([0024]).
Claim(s) 9 is/are rejected under 35 U.S.C. 103 as being unpatentable over Cozzie in view of Cantu as applied to claim 6 above, and further in view of Harrison (EP0885587A1).
Regarding claim 9, Cozzie in view of Cantu teaches the method of claim 6, as set forth above. Cozzie further teaches the step of sending the breast thermographic image to a server comprises the sub-steps of:
receiving evaluation request by an intermediate module ([0034] discloses the processor is used to upload the images to the authority 103, the process of obtaining the images needed to upload is considered the evaluation request. The part of the processor that transmits/receives data and the part of the authority that transmits/receives data is considered the intermediate module), communicating with the electronic application and with the server, wherein the intermediate module receives the data from the breast thermographic image and directs it to the server ([0032] discloses the processor 110 forwards the images to authority 103, therefore the processor communicates with the application and the server);
wherein, the intermediate module is responsible for receiving the index of suspicion evaluated by the artificial intelligence tool from the server and sending it to the electronic application ([0083] discloses the report 126 is sent back to the processor 110 and is therefore received by the intermediate module and sends it to the electronic application).
Cozzie in view of Cantu does not specifically teach converting the breast thermographic image into a data string on the mobile electronic device.
However,
Harrison in a similar field of thermographic imaging teaches converting the breast thermographic image into a data string on the electronic device (pg. 8, lines 1-10 disclose converting the thermographic images into binary files, which is an example of a character chain which is a data string as discussed in [0048] of the present applications specification).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the method disclosed by Cozzie in view of Cantu to convert the breast thermographic image into a data string on the mobile electronic device in order to improve the speed and efficiency of the image processing, as recognized by Harrison (pg. 8, lines 35-40).
Claim(s) 12 is/are rejected under 35 U.S.C. 103 as being unpatentable over Cozzie in view of Cantu as applied to claim 1 above, and further in view of Guyon et al. (WO2011087807A2, hereinafter Guyon).
Regarding claim 12, Cozzie in view of Cantu teaches the system of claim 1, as set forth above. Cozzie in view of Cantu does not specifically teach the index of suspicion is a percentage of chance of having a pathological pattern, wherein a next step message is displayed on the screen based on the index of suspicion returned by the artificial intelligence tool.
However,
Guyon in a similar field of cancer screening teaches the index of suspicion is a percentage of chance of having a pathological pattern, wherein a next step message is displayed on the screen based on the index of suspicion returned by the artificial intelligence tool (pg. 27, para. 4, “the bottom of the exemplary display window includes a statement describing the basis for the assessment and provides a recommendation that the user consult a physician if any of the features is symptomatic of melanoma with more than 50% confidence”, the percent confidence corresponds to the percentage of change of having a pathological pattern and the percent confidence is determined using an ensemble of classifiers. Pg. 24, para. 9, discloses the ensemble classifiers are machine classifiers which are an example of an artificial intelligence tool).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie in view of Cantu to have the index of suspicion is a percentage of chance of having a pathological pattern, wherein a next step message is displayed on the screen based on the index of suspicion returned by the artificial intelligence tool in order to reduce the need for an operator to analyze the index of suspicion to determine the next steps, thereby allowing for a more streamlined and efficient process.
Claim(s) 14-15 is/are rejected under 35 U.S.C. 103 as being unpatentable over Cozzie (US 20100312136) in view of Nam et al. (WO2018070760A1, hereinafter Nam), Chandler (US 20110243406), Cantu et al. (US 20200258219, hereinafter Cantu) and Guyon et al. (WO2011087807A2, hereinafter Guyon).
Regarding claim 14, Cozzie teaches an auxiliary system for evaluating breast thermographic images (Abstract teaches a system for analyzing thermographic imaging of a breast), comprising:
a device ([0032] the combination of the processor 110 and imaging device 105) being provided with an electronic application and comprising a thermal camera capable of acquiring breast thermographic image ([0032] and fig. 1, the image processing device 110 which is connected to thermographic imaging device 105. [0025] discloses the imaging device is used for capturing thermographic images), said electronic application being a software provided with a user interface and displaying acquired breast thermographic image on a screen of the device ([0080] discloses the processor 110 is configured to send the information and receive the report and make the report available on a display device, where the report includes the series 1 and 2 images used. [0079] discloses the series 1 and 2 images are the thermographic images. The display device is considered the user interface and the information on the processor that instructs the processor is considered the electronic application that is software);
a remote server ([0036] and fig. 1, authority 103 which comprises the remote server) configured to receive the acquired breast thermographic image ([0023] and [0034], [0036] disclose the thermographic images are transferred/uploaded to the authority 103), said remote server provided with an artificial intelligence tool ([0126] discloses the authority includes a neural network module 118) and a data repository ([0036] storage 116), wherein the breast thermographic image is pre-processed by a pre-processing algorithm, executed in the remote server, to identify color patterns similarity and/or disparity ([0066] discloses a comparison of all points in the series 1 thermograph with the same points in the corresponding series 2 thermograph is performed. The comparison includes determining whether the temperature of the corresponding points are similar or different. Fig. 3 shows the temperature points correspond to a specific color shade. Therefore by comparing the temperatures, color pattern similarity and/or disparity is being identified. Claim 12 further discloses the analysis performed on the images is performed after the comparing, meaning the thermal image data is pre-processed. Additionally, [0106] discloses the authority 103 is used to compare the images and [0036] discloses the authority includes algorithms. The algorithm of authority 103 used to perform the comparison is considered the pre-processing algorithm) and, if a disparity in the color pattern is detected, the breast thermographic image is submitted to a process of color identification by pixel to extract a region of interest from the breast thermographic image ([0067] discloses that the hottest region of the breast is selected as the region of interest. Fig. 3 shows the temperature points correspond to a specific color shade, therefore by selecting the hottest region, the pixel with the lightest color is being identified and extracted as the region of interest from the thermal image); and wherein the artificial intelligence tool receives the pre-processed breast thermographic image and returns an index of suspicion ([0036]-[0037] discloses the module 118 processes the images and generates a report 126, in order to process the images the module must first receive them. [0080] discloses the report includes TH values which [0083] discloses is indicative of whether cancer is present. The report is considered the index of suspicion), which is displayed on the screen of the device by the electronic application ([0083] discloses the report 126 is sent back to the processor 110 which makes the report available for output on a display device);
Cozzie does not specifically teach a smartphone device being provided with an electronic application and comprising a thermal camera capable of acquiring breast thermographic image.
However,
Nam in a similar field of thermographic breast imaging discloses a smartphone device being provided with an electronic application and comprising a thermal camera capable of acquiring breast thermographic image (pg. 4, para. 4, “the present invention can diagnose breast cancer directly by a mobile terminal such as a smart phone having only one per person and having a thermal imaging camera”. Additionally, pg. 5, para. 2 discloses the apparatus includes an image preprocessing unit which is considered an electronic application and pg. 5, para. 3 discloses an infrared camera (thermal imaging) which photographs a part of the body (breast)).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie to be a smartphone device being provided with an electronic application and comprising a thermal camera capable of acquiring breast thermographic image in order to provide a simple and inexpensive primary breast cancer diagnostic means, as recognized by Nam (pg. 4, para. 4).
Cozzie in view of Nam does not specifically teach wherein during the breast thermographic image acquisition, a support mask is displayed on the screen by the electronic application, said support mask comprises framing guides helping frame the breasts onto the screen.
However,
Chandler in a similar field of capturing medical images teaches during the breast thermographic image acquisition, a support mask is displayed on the screen by the electronic application, said support mask comprising framing guides to help frame breasts onto the screen ([0023]-[0025] discloses displaying on an interface screen 40 a capture outline 50 (framework support mask) in fig. 3 of a body area being imaged. The capture outline is a transparent mask used to guide the operator in what body area is to be captured and the proper orientation thereof. Fig. 3 shows the support mask includes framing guides (outline) to help frame the region being captured on the screen of the device. [0027] discloses a breast region is a category that is imaged and [0017] discloses the obtained images are thermal images).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the embedded electronic application disclosed by Cozzie in view of Nam to have during the breast thermographic image acquisition, a support mask is displayed on the screen by the electronic application, said support mask comprises framing guides helping frame the breasts onto the screen in order to help guide the operator in obtaining the correct image of the patient, as recognized by Chandler ([0024]).
Cozzie in view of Nam and Chandler does not specifically teach the artificial intelligence tool is previously trained and fed with a sequence of thermal mammographic images where cancer was previously diagnosed by a physician.
However,
Cantu in a similar field of breast cancer screening teaches an artificial intelligence tool is previously trained and fed with a sequence of thermal mammographic images where cancer was previously diagnosed by a physician ([0009] “training a breast cancer screening model includes: accessing a set of thermographic images of a torso of a patient, the set of thermographic images associated with a pathology label in block S110…inputting the input vector and the pathology label as a training example in breast cancer screening model”. [0021] discloses the pathology label includes a label that indicate the presence of cancerous masses. [0051] further teaches the breast cancer screening model is implemented as an artificial neural network (intelligence)).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie in view of Nam and Chandler to have the artificial intelligence tool be previously trained and fed with a sequence of thermal mammographic images where cancer was previously diagnosed by a physician in order to generate a more accurate model because it is using previously obtained data as training material.
Cozzie in view of Nam, Chandler, and Cantu does not specifically teach the electronic application displays on the screen of the device a next step message for the user based on the index of suspicion.
However,
Guyon in a similar field of screening for cancer discloses an electronic application displays on the screen of the device a next step message for the user based on the index of suspicion (pg. 27, para. 4, “the bottom of the exemplary display window includes a statement describing the basis for the assessment and provides a recommendation that the user consult a physician if any of the features is symptomatic of melanoma with more than 50% confidence”).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie in view of Nam, Chandler, and Cantu to have the electronic application display on the screen of the device a next step message for the user based on the index of suspicion in order to reduce the need for an operator to analyze the index of suspicion to determine the next steps, thereby allowing for a more streamlined and efficient process.
Regarding claim 15, Cozzie in view of Nam, Chandler, Cantu, and Guyon teaches the system of claim 14, as set forth above. Guyon further teaches the index of suspicion is a percentage of chance of having a pathological pattern, wherein if the percentage of chance of having a pathological pattern is high, the electronic device displays a message instructing the user to find a specialized physician (pg. 27, para. 4, “the bottom of the exemplary display window includes a statement describing the basis for the assessment and provides a recommendation that the user consult a physician if any of the features is symptomatic of melanoma with more than 50% confidence”, the percent confidence corresponds to the percentage of change of having a pathological pattern. Pg. 8, para. 2 discloses the physician being recommended is a particular (specialized) physician).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the system disclosed by Cozzie in view of Nam, Chandler, Cantu, and Guyon to have the index of suspicion is a percentage of chance of having a pathological pattern, wherein if the percentage of chance of having a pathological pattern is high, the electronic device displays a message instructing the user to find a specialized physician in order to reduce the need for an operator to analyze the index of suspicion to determine the next steps, thereby allowing for a more streamlined and efficient process.
.
Claim(s) 16 is/are rejected under 35 U.S.C. 103 as being unpatentable over Cozzie in view of Nam, Chandler, Cantu, and Guyon as applied to claim 14 above, and further in view of Naimi et al. (US 20110243409, hereinafter Naimi).
Regarding claim 15, Cozzie in view of Nam, Chandler, Cantu, and Guyon teaches the system of claim 14, as set forth above. Cozzie in view of Nam, Chandler, Cantu, and Guyon does not specifically teach the pre-processing algorithm divides the breast thermographic image into two halves, image A and image B, wherein the pre-processing algorithm applies a horizontal flip technique on image A so that it is compared with the image B, and analyzes the color pattern to identify similarity in colors.
However,
Naimi in a similar field of thermal breast imaging teaches a pre-processing algorithm divides the breast thermographic image into two halves (figs. 1A-C shows the thermographic image as a whole and figs. 3A-3B and 4A-4B show the thermographic image split into two halves), image A and image B, wherein the pre-processing algorithm applies a horizontal flip technique on image A so that it is compared with the image B ([0118] discloses the preprocessing includes a flip of a coordinate system for a thermospatial representation of a left breast (image A) and a non-flipped coordinate system for a thermospatial representation of a right breast (image B), and analyzes the color pattern to identify similarity in colors ([0121] discloses the comparing the thermal signature of breasts of different sizes (e.g., a left and right breast of the same subject). [0097] discloses the thermospatial representation (signature) is in the form of a color-coded image, therefore the color patterns of the images are being compared. [0152] further discloses the comparison between thermal signatures is used for identifying dissimilarity between the thermal signatures).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to substitute the pre-processing algorithm of Cozzie in view of Nam, Chandler, Cantu, and Guyon for the pre-processing algorithm of Naimi because it amounts to simple substitution of one known element for another to obtain the predictable results of identifying color pattern similarities and disparities in the images to be analyzed.
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be dir