DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Continued Examination Under 37 CFR 1.114
A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after allowance or after an Office action under Ex Parte Quayle, 25 USPQ 74, 453 O.G. 213 (Comm'r Pat. 1935). Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, prosecution in this application has been reopened pursuant to 37 CFR 1.114. Applicant’s submission filed on April 8, 2026 has been entered and made of record.
Prosecution on the merits of this application is reopened on claims 1-30. After further consideration and updated search, claims 1-30 are found to be unpatentable for the reasons indicated below (Refer to Claim Rejections - 35 USC § 112, Claim Rejections - 35 USC § 102, and Claim Rejections - 35 USC § 103 Sections below).
Information Disclosure Statement
The information disclosure statement (IDS) submitted on April 8, 2026 was filed after the mailing date of the Notice of Allowance on March 5, 2026. The submission is in compliance with the provisions of 37 CFR 1.97. Accordingly, the information disclosure statement is being considered by the examiner.
Claim Objections
Claim 21 is objected to because of the following informalities:
Line 8: “user interfaces that instructed subject” should read -- user interfaces that instructed the subject --
Appropriate correction is required.
Claim Rejections - 35 USC § 112
The following is a quotation of 35 U.S.C. 112(b):
(b) CONCLUSION.—The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the inventor or a joint inventor regards as the invention.
The following is a quotation of 35 U.S.C. 112 (pre-AIA ), second paragraph:
The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the applicant regards as his invention.
Claims 3-5, 13-15, 22-24, 26, and 27 are rejected under 35 U.S.C. 112(b) or 35 U.S.C. 112 (pre-AIA ), second paragraph, as being indefinite for failing to particularly point out and distinctly claim the subject matter which the inventor or a joint inventor (or for applications subject to pre-AIA 35 U.S.C. 112, the applicant), regards as the invention.
Claim 3 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. It is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 1 from which claim 3 depends upon (e.g., one or more user interfaces that provide step-by-step instructions with guided assistance for positioning an integrated camera of the mobile device to capture the set of throat images, claim 1 at lines 6-7, one or more user interfaces that provide step-by-step instructions for entering the set of clinical factors, claim 1 at lines 10-11, and user interface including the disease state prediction for the subject, claim 1 at lines 24-25).
Claim 4 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. Similar to claim 3 above, it is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 1 from which claim 4 depends upon (e.g., one or more user interfaces that provide step-by-step instructions with guided assistance for positioning an integrated camera of the mobile device to capture the set of throat images, claim 1 at lines 6-7, one or more user interfaces that provide step-by-step instructions for entering the set of clinical factors, claim 1 at lines 10-11, and user interface including the disease state prediction for the subject, claim 1 at lines 24-25).
Claim 5 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. Similar to claim 3 above, it is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 1 from which claim 5 depends upon (e.g., one or more user interfaces that provide step-by-step instructions with guided assistance for positioning an integrated camera of the mobile device to capture the set of throat images, claim 1 at lines 6-7, one or more user interfaces that provide step-by-step instructions for entering the set of clinical factors, claim 1 at lines 10-11, and user interface including the disease state prediction for the subject, claim 1 at lines 24-25).
Claim 13 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. It is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 11 from which claim 13 depends upon (e.g., one or more user interfaces that provide step-by-step instructions with guided assistance for positioning an integrated camera of the mobile device to capture the set of throat images, claim 11 at lines 9-12, one or more user interfaces that provide step-by-step instructions for entering the set of clinical factors, claim 11 at lines 15-17, and user interface including the disease state prediction for the subject, claim 11 at line 31).
Claim 14 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. Similar to claim 13 above, it is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 11 from which claim 14 depends upon (e.g., one or more user interfaces that provide step-by-step instructions with guided assistance for positioning an integrated camera of the mobile device to capture the set of throat images, claim 11 at lines 9-12, one or more user interfaces that provide step-by-step instructions for entering the set of clinical factors, claim 11 at lines 15-17, and user interface including the disease state prediction for the subject, claim 11 at line 31).
Claim 15 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. Similar to claim 13 above, it is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 11 from which claim 15 depends upon (e.g., one or more user interfaces that provide step-by-step instructions with guided assistance for positioning an integrated camera of the mobile device to capture the set of throat images, claim 11 at lines 9-12, one or more user interfaces that provide step-by-step instructions for entering the set of clinical factors, claim 11 at lines 15-17, and user interface including the disease state prediction for the subject, claim 11 at line 31).
Claim 22 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. It is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 21 from which claim 22 depends upon (e.g., using one or more user interfaces that instruct the subject to use a camera of the device to capture the throat images, claim 21 at lines 4-5, one or more user interfaces that instructed subject to input the set of clinical factors, claim 21 at lines 7-8, and user interface including the disease state prediction for the subject, claim 21 at lines 19-20).
Claim 23 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. Similar to claim 22 above, it is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 21 from which claim 23 depends upon (e.g., using one or more user interfaces that instruct the subject to use a camera of the device to capture the throat images, claim 21 at lines 4-5, one or more user interfaces that instructed subject to input the set of clinical factors, claim 21 at lines 7-8, and user interface including the disease state prediction for the subject, claim 21 at lines 19-20).
Claim 24 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. Similar to claim 22 above, it is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 21 from which claim 24 depends upon (e.g., using one or more user interfaces that instruct the subject to use a camera of the device to capture the throat images, claim 21 at lines 4-5, one or more user interfaces that instructed subject to input the set of clinical factors, claim 21 at lines 7-8, and user interface including the disease state prediction for the subject, claim 21 at lines 19-20).
Claim 26 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. Similar to claim 22 above, it is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 21 from which claim 26 depends upon (e.g., using one or more user interfaces that instruct the subject to use a camera of the device to capture the throat images, claim 21 at lines 4-5, one or more user interfaces that instructed subject to input the set of clinical factors, claim 21 at lines 7-8, and user interface including the disease state prediction for the subject, claim 21 at lines 19-20).
Claim 27 recites the limitation “the one or more user interfaces” in lines 1-2. There is insufficient antecedent basis for this limitation in the claim. Similar to claim 22 above, it is unclear as to which one or more user interfaces the limitation is referring to. For example, there are at least three different one or more user interfaces in claim 21 from which claim 27 depends upon (e.g., using one or more user interfaces that instruct the subject to use a camera of the device to capture the throat images, claim 21 at lines 4-5, one or more user interfaces that instructed subject to input the set of clinical factors, claim 21 at lines 7-8, and user interface including the disease state prediction for the subject, claim 21 at lines 19-20).
Appropriate correction is required.
Claim Rejections - 35 USC § 102
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(2) the claimed invention was described in a patent issued under section 151, or in an application for patent published or deemed published under section 122(b), in which the patent or application, as the case may be, names another inventor and was effectively filed before the effective filing date of the claimed invention.
Claims 21-24, 29 and 30 are rejected under 35 U.S.C. 102(a)(2) as being anticipated by Evron (WO 2021/044431).
Re claim 21: Evron disclose a computer-implemented method (i.e., “system for diagnosing or predicting a medical condition 100”, page 18 lines 16-18) comprising:
receiving, by an application server from a mobile application executing on a device of a subject (i.e., “The photos can be sent from the mobile phone or other device via the internet cloud 122 and stored on the cloud and/or at an application server 132 and/or database server”, page 18 lines 23-26), one or more throat images capturing an inside of the subject’s throat (i.e., “a new user/patient may have a sore throat. He/she activates a cellphone App and takes one or more photos of his/her throat using mobile 110”, page 23 lines 2-6), the throat images captured using one or more user interfaces that instruct the subject to use a camera of the device to capture the throat images (See for example, “Camera guidance networks”, and “The second neural network is classification-based and is set up to classify each frame obtained from the camera with the at least one of the following outputs: move camera right, move camera left, move camera up, move camera down, open mouth, lower tongue, perfect placement”, page 25 lines 13-23);
receiving, by the application server from the mobile application, a set of clinical factors associated with the subject (i.e., “metadata”, page 21 line 15 through page 23 line 1) that were input by the subject in one or more user interfaces that instructed subject to input the set of clinical factors (See for example, “The user uploads the photo/images to the cellphone App, as well as the answers to the questions in a capturing metadata”, page 23 lines 2-6);
inputting, at the application server, the throat images into a machine-learned model (i.e., “It takes an image and metadata () and outputs a prediction whether the patient suffers from bacterial or viral pharyngitis”, page 23 lines 23-27; and “analyzing said image and/or said metadata of said patient using a machine learning system previously trained with said training samples”, claim 1 at page 55) trained on a plurality of training throat images labeled with respective training labels indicating presence or absence of one or more bacterial or viral pathogens (i.e., “obtaining training images and/or metadata step 202, images and/or metadata associated with a specific disease, disorder or condition are obtained. For example, in diagnosing a strep throat, images of throats, previously determined by laboratory tests to be with a streptococcal throat infection (e.g. Fig. 3B) and images without a streptococcus- infected throat, but with a viral pharyngitis (e.g. Fig. 3A) are obtained”, page 21 lines 15-23);
determining, at the application server (i.e., “Servers 130, 132 are configured to perform the method(s) of the present invention”, page 19 lines 15-16), a disease state prediction for the subject based on at least an output of the machine-learned model, wherein the disease state prediction indicates whether a bacterial or viral pathogen is present in the subject (i.e., “distinguish between viral and bacterial”, page 27 lines 26-29);
transmitting, from the application server to the device via a network connection, the disease state prediction for the subject (See for example, “The input for the application is obtained from the mobile phone or computer camera in addition to the metadata that is also fed by the user. The diagnostic algorithm is a software code that sits in the cloud to which the input is transferred, consisting of the image and the metadata, and where the input processing takes place. The output of the processing software is a medical diagnosis of the disease”, page 34 lines 4-9); and
presenting, via the mobile application executing on the device, a user interface including the disease state prediction for the subject (i.e., “The outputs of the software may be displayed, such as on the App on cellphone/mobile 110, or on smart device 112”, page 19 lines 17-18).
Re claim 22, as best understood: Evron disclose wherein the one or more user interfaces provide guided assistance for capturing the one or more throat images with the camera (See for example, “Camera guidance networks”, and “The second neural network is classification-based and is set up to classify each frame obtained from the camera with the at least one of the following outputs: move camera right, move camera left, move camera up, move camera down, open mouth, lower tongue, perfect placement”, page 25 lines 13-23).
Re claim 23, as best understood: Evron disclose wherein the one or more user interfaces instruct the subject on how to position or orient the camera (See for example, “Camera guidance networks”, and “The second neural network is classification-based and is set up to classify each frame obtained from the camera with the at least one of the following outputs: move camera right, move camera left, move camera up, move camera down, open mouth, lower tongue, perfect placement”, page 25 lines 13-23).
Re claim 24, as best understood: Evron disclose wherein the one or more user interfaces ask a set of questions, including having the subject input information about the subject (See for example, “metadata may be used, such as binary “yes-no” question responses, and/or qualitative and/or quantitative user/patient question responses”, page 21 line 15 through page 23 line 1).
Re claim 29: Evron disclose wherein the disease state prediction comprises at least one of: a probability of a viral pathogen infection; a probability of a bacterial pathogen infection; and a probability of no pathogen infection (See for example, “In the inference stage: The input is the image and its metadata, and the output is probability of viral and bacterial pharyngitis”, page 10 lines 22-23).
Re claim 30: Evron disclose wherein the set of clinical factors comprises at least one from a group consisting of: age (i.e., “By “metadata” is meant all the non-visuals signs and symptoms of the disease or disorder, such as, but not limited to … patient’s age”, page 18 lines 13-15); a presence or absence of swollen lymph nodes (i.e., “enlarged lymph nodes”, page 18 lines 13-15); subject temperature (i.e., “3) How high is your temperature?”, page 22 line 14); a presence or absence of fever (i.e., “fever”, page 18 lines 13-15); a presence or absence of a cough (i.e., “coughing”, page 18 lines 13-15); a presence or absence of a runny nose (i.e., “runny nose”, page 18 lines 13-15); a presence or absence of a headache (i.e., “headache”, page 18 lines 13-15); a presence or absence of body aches; a presence or absence of vomiting; a presence or absence of diarrhea; a presence or absence of fatigue; a presence or absence of chills; and a duration of pharyngitis.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1, 3, 4, 6-11, 13, 14, and 17-20 are rejected under 35 U.S.C. 103 as being unpatentable over Evron (WO 2021/044431) in view of Bundsgaard et al. (U.S. Pub. No. 2022/0400940).
As to claims 1, 11 and 20, Evron teaches a computer-implemented method (i.e., “system for diagnosing or predicting a medical condition 100”, page 18 lines 16-18)/a computer-implemented system comprising: a processor (i.e., “processor”, page 49 lines 10-16); and a non-transitory computer-readable storage medium (i.e., “machine-readable medium”, page 50 lines 4-22) storing instructions that, when executed by one or more processors, cause an application server to perform operations comprising/a non-transitory computer-readable storage medium (i.e., “machine-readable medium”, page 50 lines 4-22) storing instructions that, when executed by one or more processors, cause an application server to perform operations comprising:
receiving, via a network connection and by an application server from a mobile application executing on a mobile device of a subject (i.e., “The photos can be sent from the mobile phone or other device via the internet cloud 122 and stored on the cloud and/or at an application server 132 and/or database server”, page 18 lines 23-26), a set of one or more throat images capturing an inside of the subject’s throat (i.e., “a new user/patient may have a sore throat. He/she activates a cellphone App and takes one or more photos of his/her throat using mobile 110”, page 23 lines 2-6);
receiving, by the application server from the mobile application via the network connection, a set of clinical factors associated with the subject (i.e., “metadata”, page 21 line 15 through page 23 line 1) that were input by the subject in one or more user interfaces that provide step-by-step instructions for entering the set of clinical factors, the step-by-step instructions including a set of questions (See for example, page 21 line 15 through page 23 line 1) asking the subject to input information including identifying information for the subject and at least one symptom (See for example, “The user uploads the photo/images to the cellphone App, as well as the answers to the questions in a capturing metadata”, page 23 lines 2-6);
inputting, at the application server, the set of throat images into a machine-learned model (i.e., “It takes an image and metadata () and outputs a prediction whether the patient suffers from bacterial or viral pharyngitis”, page 23 lines 23-27; and “analyzing said image and/or said metadata of said patient using a machine learning system previously trained with said training samples”, claim 1 at page 55) trained on a plurality of training throat images labeled with respective training labels indicating presence or absence of one or more bacterial or viral pathogens (i.e., “obtaining training images and/or metadata step 202, images and/or metadata associated with a specific disease, disorder or condition are obtained. For example, in diagnosing a strep throat, images of throats, previously determined by laboratory tests to be with a streptococcal throat infection (e.g. Fig. 3B) and images without a streptococcus- infected throat, but with a viral pharyngitis (e.g. Fig. 3A) are obtained”, page 21 lines 15-23);
determining, at the application server (i.e., “Servers 130, 132 are configured to perform the method(s) of the present invention”, page 19 lines 15-16), a disease state prediction for the subject based on at least an output of the machine-learned model, wherein the disease state prediction indicates whether a bacterial or viral pathogen is present in the subject (i.e., “distinguish between viral and bacterial”, page 27 lines 26-29);
transmitting, from the application server to the mobile device via the network connection, the disease state prediction for the subject (See for example, “The input for the application is obtained from the mobile phone or computer camera in addition to the metadata that is also fed by the user. The diagnostic algorithm is a software code that sits in the cloud to which the input is transferred, consisting of the image and the metadata, and where the input processing takes place. The output of the processing software is a medical diagnosis of the disease”, page 34 lines 4-9); and
presenting, via the mobile application executing on the mobile device, a user interface including the disease state prediction for the subject (i.e., “The outputs of the software may be displayed, such as on the App on cellphone/mobile 110, or on smart device 112”, page 19 lines 17-18).
However, Evron does not explicitly disclose the set of throat images captured using one or more user interfaces that provide step-by-step instructions with guided assistance for positioning an integrated camera of the mobile device to capture the set of throat images.
Bundsgaard et al. teaches a set of throat images that are captured using one or more user interfaces that provide step-by-step instructions with guided assistance for positioning an integrated camera of the mobile device to capture the set of throat images (See for example, “the user 101 is instructed by the app to position him-/herself in front of a mirror 102, as shown in FIGS. 1 and 3. FIG. 3 is a diagrammatic representation of the user 101, mirror 102, and mobile device 103 of FIG. 1, the reflections of the user 101’ and the mobile device 103’ in the mirror, and the obtaining of an image of an area of the user’s oral cavity. In an embodiment, the mirror 102 is at a given distance from the user’s face, preferably at a given distance from the user’s oral cavity, and the app instructs the user to position him/herself accordingly”, Paragraph [0063]; and Paragraph [0064]).
Evron and Bundsgaard et al. are analogous art because they are from the field of digital image processing for medical imaging.
Before the effective filing date of the claimed invention, it would have been obvious to a person of ordinary skill in the art to modify Evron by incorporating the set of throat images captured using one or more user interfaces that provide step-by-step instructions with guided assistance for positioning an integrated camera of the mobile device to capture the set of throat images.
The suggestion/motivation for doing so would have been to obtain one or more images of an area of his/her oral cavity without the need of dedicated equipment or any other tools that are not normally present in an average household.
Therefore, it would have been obvious to combine Bundsgaard et al. with Evron to obtain the invention as specified in claims 1, 11 and 20.
As to claims 3 and 13, as best understood, Evron teaches wherein the one or more user interfaces instruct the subject on how to position or orient the integrated camera (See for example, “Camera guidance networks”, and “The second neural network is classification-based and is set up to classify each frame obtained from the camera with the at least one of the following outputs: move camera right, move camera left, move camera up, move camera down, open mouth, lower tongue, perfect placement”, page 25 lines 13-23).
As to claims 4 and 14, as best understood, Evron does not explicitly disclose wherein the one or more user interfaces instruct the subject on how to use a mirror to capture the set of throat images with the integrated camera.
Bundsgaard et al. teaches one or more user interfaces that instruct the subject on how to use a mirror to capture the set of throat images with the integrated camera (See for example, “the user 101 is instructed by the app to position him-/herself in front of a mirror 102, as shown in FIGS. 1 and 3. FIG. 3 is a diagrammatic representation of the user 101, mirror 102, and mobile device 103 of FIG. 1, the reflections of the user 101’ and the mobile device 103’ in the mirror, and the obtaining of an image of an area of the user's oral cavity. In an embodiment, the mirror 102 is at a given distance from the user’s face, preferably at a given distance from the user’s oral cavity, and the app instructs the user to position him/herself accordingly. The mirror may be e.g. a wall-mounted mirror, a floor mirror, a tabletop mirror, or a handheld mirror”, Paragraph [0063]).
Therefore, in view of Bundsgaard et al., it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Evron by incorporating the one or more user interfaces instruct the subject on how to use a mirror to capture the one or more throat images with the camera, as taught by Bundsgaard et al., in order to allow the user to be able to obtain one or more images of an area of his/her oral cavity without the need of dedicated equipment or any other tools that are not normally present in an average household
As to claim 6, Evron teaches wherein the mobile application automatically evaluates a quality of the set of throat images (i.e., “the methods and systems employ another algorithm that checks and ensures image quality”, page 24 lines 14-15; and “the camera placement and the image quality algorithms are performed on a local device, for example the same device that captured the video input (smartphone, tablet etc.)”, page 25 lines 8-11).
As to claim 7, Evron does not explicitly disclose wherein the mobile application automatically instructs the subject to capture a new image if the quality of the set of throat images is not sufficient.
Bundsgaard et al. teaches a mobile application (i.e., “the mobile device 103 is configured to execute an application software (“app”) and comprises a main camera 207 for capturing images”, Paragraph [0062]) that automatically instructs the subject to capture a new image if the quality of the set of throat images is not sufficient (i.e., “The user 101 is instructed by the app to capture another image of his/her oral cavity, if the image quality is below a threshold for image quality, i.e. if the images do not have clinical image quality”, Paragraph [0077]).
Therefore, in view of Bundsgaard et al., it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to further Evron by incorporating the mobile application automatically instructs the subject to capture a new image if the quality of the set of throat images is not sufficient, as taught by Bundsgaard et al., in order to allow the user to obtain images of high quality.
As to claims 8 and 17, Evron teaches wherein the disease state prediction comprises at least one of: a probability of a viral pathogen infection; a probability of a bacterial pathogen infection; and a probability of no pathogen infection (See for example, “In the inference stage: The input is the image and its metadata, and the output is probability of viral and bacterial pharyngitis”, page 10 lines 22-23).
As to claims 9 and 18, Evron teaches wherein the set of clinical factors comprises at least one from a group consisting of: age (i.e., “By “metadata” is meant all the non-visuals signs and symptoms of the disease or disorder, such as, but not limited to … patient’s age”, page 18 lines 13-15); a presence or absence of swollen lymph nodes (i.e., “enlarged lymph nodes”, page 18 lines 13-15); subject temperature (i.e., “3) How high is your temperature?”, page 22 line 14); a presence or absence of fever (i.e., “fever”, page 18 lines 13-15); a presence or absence of a cough (i.e., “coughing”, page 18 lines 13-15); a presence or absence of a runny nose (i.e., “runny nose”, page 18 lines 13-15); a presence or absence of a headache (i.e., “headache”, page 18 lines 13-15); a presence or absence of body aches; a presence or absence of vomiting; a presence or absence of diarrhea; a presence or absence of fatigue; a presence or absence of chills; and a duration of pharyngitis.
As to claims 10 and 19, Evron teaches wherein at least one of the set of throat images is pre-processed before being input into the machine-learned model, the pre-processing comprising at least one from a group consisting of: uniform aspect ratio correction; rescaling; normalization; object detection; segmentation; cropping; dimensionality reduction; dimensionality increment; brightness adjustment; image shifting; image flipping; zoom in or out; image rotation; image quality filtering; and image pixel correction (i.e., “Camera guidance networks: The camera placement algorithm is based on DNN (Deep Neural net algorithms) which is actually based on two neural networks that are combined together. The input to these two networks are the video frames. One of these networks performs semantic segmentation of the oro-pharyngeal organs and tissues, such as the uvula, tonsils, teeth, lips, tongue and gums”, page 25 lines 13-18).
As to claim 16, Evron teaches wherein the mobile application automatically evaluates a quality the set of throat images (i.e., “the methods and systems employ another algorithm that checks and ensures image quality”, page 24 lines 14-15; and “the camera placement and the image quality algorithms are performed on a local device, for example the same device that captured the video input (smartphone, tablet etc.)”, page 25 lines 8-11).
However, Evron does not explicitly disclose wherein the mobile application automatically instructs the subject to capture a new image if the quality of the set of throat images is not sufficient.
Bundsgaard et al. teaches a mobile application (i.e., “the mobile device 103 is configured to execute an application software (“app”) and comprises a main camera 207 for capturing images”, Paragraph [0062]) that automatically instructs the subject to capture a new image if the quality of the set of throat images is not sufficient (i.e., “The user 101 is instructed by the app to capture another image of his/her oral cavity, if the image quality is below a threshold for image quality, i.e. if the images do not have clinical image quality”, Paragraph [0077]).
Therefore, in view of Bundsgaard et al., it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to further Evron by incorporating the mobile application automatically instructs the subject to capture a new image if the quality of the set of throat images is not sufficient, as taught by Bundsgaard et al., in order to allow the user to obtain images of high quality.
Claims 2 and 12 are rejected under 35 U.S.C. 103 as being unpatentable over Evron in view of Bundsgaard et al. as applied to claims 1 and 11 above, and further in view of Tran (U.S. Pub. No 2020/0405148). The teachings of Evron and have been discussed above.
As to claims 2 and 12, Evron and do not explicitly disclose receiving, by the application server from the mobile device via the network connection, profile information of the subject created using one or more user interfaces that instruct the subject to create a profile.
Tran teaches receiving, by the application server from the mobile device via the network connection, profile information of the subject created using one or more user interfaces that instruct the subject to create a profile (i.e., “a patient or healthcare provider may create a patient profile comprising, e.g., identifying, characterizing, and/or medical information, including information about a patient’s medical history, profession, and/or lifestyle”, Paragraph [0253]; and Paragraphs [0254]-[0255]).
Evron, Bundsgaard et al. and Tran are analogous art because they are from the field of digital image processing for medical imaging.
Before the effective filing date of the claimed invention, it would have been obvious to a person of ordinary skill in the art to further modify Evron and Bundsgaard et al. by incorporating receiving, by the application server from the mobile device via the network connection, profile information of the subject created using one or more user interfaces that instruct the subject to create a profile, as taught by Tran.
The suggestion/motivation for doing so would have been to further store auxiliary data that can be analyzed for the disease state prediction.
Therefore, it would have been obvious to combine Tran with Evron and Bundsgaard et al. to obtain the invention as specified in claims 2 and 12.
Claims 5 and 15 are rejected under 35 U.S.C. 103 as being unpatentable over Evron in view of Bundsgaard et al. as applied to claims 1 and 11 above, and further in view of Hefez et al. (U.S. Pub. No. 2018/0160887). The teachings of Evron and Bundsgaard et al. have been discussed above.
As to claims 5 and 15, as best understood, Evron and Bundsgaard et al. do not explicitly disclose wherein the one or more user interfaces provide diagrams or tutorials illustrating specific features of the throat that should be within view to capture the set of throat images.
Hefez et al. teaches one or more user interfaces that provide diagrams or tutorials illustrating specific features of the throat that should be within view to capture the set of throat images (See for example, Paragraphs [0150] and [0154]; “examination logic module 408 can be configured to utilize guiding module 406 in order to provide various guidance data instructing user 102 how to maneuver system 200 to the desired system 200 spatial disposition with respect to patient’s 103 body”, Paragraph [0191]; and Paragraph [0192]).
Evron, Bundsgaard et al. and Hefez et al. are analogous art because they are from the field of digital image processing for medical imaging.
Before the effective filing date of the claimed invention, it would have been obvious to a person of ordinary skill in the art to further modify Evron and Bundsgaard et al. by incorporating the one or more user interfaces provide diagrams or tutorials illustrating specific features of the throat that should be within view to capture the one or more throat images, as taught by Hefez et al.
The suggestion/motivation for doing so would have been to trigger the capturing of images when the throat features are present within the field of view of the camera.
Therefore, it would have been obvious to combine Hefez et al. with Evron and Bundsgaard et al. to obtain the invention as specified in claims 5 and 15.
Claim 25 is rejected under 35 U.S.C. 103 as being unpatentable over Evron in view of Tran (U.S. Pub. No 2020/0405148). The teachings of Evron have been discussed above.
As to claim 25, Evron does not explicitly disclose receiving, by the application server from the device via the network connection, profile information of the subject created using one or more user interfaces that instruct the subject to create a profile.
Tran teaches receiving, by the application server from the device via the network connection, profile information of the subject created using one or more user interfaces that instruct the subject to create a profile (i.e., “a patient or healthcare provider may create a patient profile comprising, e.g., identifying, characterizing, and/or medical information, including information about a patient’s medical history, profession, and/or lifestyle”, Paragraph [0253]; and Paragraphs [0254]-[0255]).
Evron and Tran are analogous art because they are from the field of digital image processing for medical imaging.
Before the effective filing date of the claimed invention, it would have been obvious to a person of ordinary skill in the art to modify Evron by incorporating the receiving, by the application server from the device via the network connection, profile information of the subject created using one or more user interfaces that instruct the subject to create a profile, as taught by Tran.
The suggestion/motivation for doing so would have been to further store auxiliary data that can be analyzed for the disease state prediction.
Therefore, it would have been obvious to combine Tran with Evron to obtain the invention as specified in claim 25.
Claims 26 and 28 are rejected under 35 U.S.C. 103 as being unpatentable over Evron in view of Bundsgaard et al. (U.S. Pub. No. 2022/0400940). The teachings of Evron have been discussed above.
As to claim 26, as best understood, Evron does not explicitly disclose wherein the one or more user interfaces instruct the subject on how to use a mirror to capture the one or more throat images with the camera.
Bundsgaard et al. teaches one or more user interfaces that instruct the subject on how to use a mirror to capture the one or more throat images with the camera (See for example, “the user 101 is instructed by the app to position him-/herself in front of a mirror 102, as shown in FIGS. 1 and 3. FIG. 3 is a diagrammatic representation of the user 101, mirror 102, and mobile device 103 of FIG. 1, the reflections of the user 101’ and the mobile device 103’ in the mirror, and the obtaining of an image of an area of the user's oral cavity. In an embodiment, the mirror 102 is at a given distance from the user’s face, preferably at a given distance from the user’s oral cavity, and the app instructs the user to position him/herself accordingly. The mirror may be e.g. a wall-mounted mirror, a floor mirror, a tabletop mirror, or a handheld mirror”, Paragraph [0063]).
Evron and Bundsgaard et al. are analogous art because they are from the field of digital image processing for medical imaging.
Before the effective filing date of the claimed invention, it would have been obvious to a person of ordinary skill in the art to modify Evron by incorporating the one or more user interfaces instruct the subject on how to use a mirror to capture the one or more throat images with the camera, as taught by Bundsgaard et al.
The suggestion/motivation for doing so would have been to allow the user to be able to obtain one or more images of an area of his/her oral cavity without the need of dedicated equipment or any other tools that are not normally present in an average household.
Therefore, it would have been obvious to combine Bundsgaard et al. with Evron to obtain the invention as specified in claim 26.
As to claim 28, Evron teaches wherein the mobile application automatically evaluates a quality of the one or more throat images (i.e., “the methods and systems employ another algorithm that checks and ensures image quality”, page 24 lines 14-15; and “the camera placement and the image quality algorithms are performed on a local device, for example the same device that captured the video input (smartphone, tablet etc.)”, page 25 lines 8-11).
However, Evron does not explicitly disclose wherein the mobile application automatically instructs the subject to capture a new image if the quality of the one or more throat images is not sufficient.
Bundsgaard et al. teaches a mobile application (i.e., “the mobile device 103 is configured to execute an application software (“app”) and comprises a main camera 207 for capturing images”, Paragraph [0062]) that automatically instructs the subject to capture a new image if the quality of the one or more throat images is not sufficient (i.e., “The user 101 is instructed by the app to capture another image of his/her oral cavity, if the image quality is below a threshold for image quality, i.e. if the images do not have clinical image quality”, Paragraph [0077]).
Therefore, in view of Bundsgaard et al., it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Evron by incorporating the mobile application automatically instructs the subject to capture a new image if the quality of the one or more throat images is not sufficient, as taught by Bundsgaard et al., in order to allow the user to obtain images of high quality.
Claim 27 is rejected under 35 U.S.C. 103 as being unpatentable over Evron in view of Hefez et al. (U.S. Pub. No. 2018/0160887). The teachings of Evron have been discussed above.
As to claim 27, as best understood, Evron does not explicitly disclose wherein the one or more user interfaces provide diagrams or tutorials illustrating specific features of the throat that should be within view to capture the one or more throat images.
Hefez et al. teaches one or more user interfaces that provide diagrams or tutorials illustrating specific features of the throat that should be within view to capture the one or more throat images (See for example, Paragraphs [0150] and [0154]; “examination logic module 408 can be configured to utilize guiding module 406 in order to provide various guidance data instructing user 102 how to maneuver system 200 to the desired system 200 spatial disposition with respect to patient’s 103 body”, Paragraph [0191]; and Paragraph [0192]).
Evron and Hefez et al. are analogous art because they are from the field of digital image processing for medical imaging.
Before the effective filing date of the claimed invention, it would have been obvious to a person of ordinary skill in the art to modify Evron by incorporating the one or more user interfaces provide diagrams or tutorials illustrating specific features of the throat that should be within view to capture the one or more throat images, as taught by Hefez et al.
The suggestion/motivation for doing so would have been to trigger the capturing of images when the throat features are present within the field of view of the camera.
Therefore, it would have been obvious to combine Hefez et al. with Evron to obtain the invention as specified in claim 27.
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to JOSE M TORRES whose telephone number is (571)270-1356. The examiner can normally be reached Monday thru Friday; 10:00 AM to 6:00 PM EST.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Jennifer Mehmood can be reached at 571-272-2976. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/JOSE M TORRES/Examiner, Art Unit 2664 06/05/2026