DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Response to Amendment
The amendment filed 02/19/2026 has been entered. Claims 3, 13, 15, and 20 have been canceled. Accordingly, claims 1-2, 5-12, 14, and 16-19 remain pending in the application. Applicant’s amendments to the claims have overcome each and every objection and 112(b) rejections previously set forth in the Non-Final Office Action mailed 11/19/2025.
Response to Arguments
Applicant's arguments filed 02/19/2026 have been fully considered but they are not persuasive.
Applicant argues that He, Chen, Pi, Yuen, Gruhlke, and Kim, when taken alone or in proper combination fail to disclose, teach, or suggest every limitation of the independent claims.
Examiner respectfully disagrees. Gruhlke (US20170079591) teaches the amended features and therefore He in view of Chen and Gruhlke (and Kim for claim 18) teach or suggest every limitation of the independent claims. See further below for how Gruhlke teaches the amended features.
Applicant further argues that Chen, nor He, disclose or teach “an optical sensor … configured to receive reflected light off the portion of the subject originating from the illuminated portion of the organic light-emitting diodes of the electronic display, such that measurements captured by the optical sensor for purposes of determining vital signs are recorded in an instance in which the illuminated portion is under the portion of the subject”. Applicant also argues Chen does not record reflected light off the portion of the subject originating from the illuminated portion of the organic light emitting diodes and “Chen is configured to avoid emitting light in display emission periods of the pixel lines adjacent the optical emitter or transceiver”.
Examiner respectfully disagrees. While Chen discloses a second illumination timing using an optical emitter in ¶ [0081], this portion of Chen is/was not relied upon. Chen discloses in ¶ [0067]:
“Similarly, when an optical transceiver is positioned behind a light-emitting display, the performance of the light-emitting display and/or the optical transceiver may be improved by synchronizing the illumination timing of the light-emitting display (a first illumination timing) and an illumination timing (a second illumination timing) or optical sample timing of the optical transceiver”
Rather than using the optical emitter for the emission of light (second illumination timing), Chen also teaches synchronizing of a first illumination timing which relies on the light-emitting display to an optical transceiver (and is also relied upon for teaching wherein the electronic display is configured to repeatedly refresh in a continuous rolling pattern and in coordination with a synchronization signal) ([0067]). Chen further teaches wherein the display (104; 206) may be an OLED display comprising organic light-emitting elements (210) ([0036], [0045]). Because the optical sensor is synchronized with the organic light-emitting diodes of the OLED display, Chen therefore at least teaches wherein the optical sensor (transceiver) is configured to receive reflected light off the portion of the subject originating from the illuminated portion of the organic light-emitting diodes of the electronic display.
Nevertheless, Gruhlke (US20170079591) is being relied upon for teaching “an optical sensor … configured to receive reflected light off the portion of the subject originating from the illuminated portion of the organic light-emitting diodes of the electronic display, such that measurements captured by the optical sensor for purposes of determining vital signs are recorded in an instance in which the illuminated portion is under the portion of the subject, … wherein one or more vital signs of the subject are determined based at least in part on the recorded measurements”, and thus arguments with respect to Chen are moot.
Gruhlke teaches obtaining vital measurements such as blood pressure (BP) and heart rate (HR) via a PPG measurement (Abstract, [0032]). Gruhlke teaches a smartphone (210) including a touchscreen display (250) (Fig. 2, [0049]) and wherein the touchscreen display (250) may generate light that shines into a user’s skin when the user touches the touchscreen display (e.g. the illuminated portion is under the portion of the subject), obtain a PPG measurement, and determine a heart rate of the user ([0051], [0056]). Gruhlke teaches in some implementations the display may be an OLED display ([0029]). Similar to Chen above, Gruhlke teaches wherein a light sensor (182) may be synchronized to pixels of the touchscreen display (250) ([0060]). Gruhlke further teaches wherein the touchscreen display is pulsed at a frequency equal to a synchronization frequency, e.g. the refresh rate of the display ([0060]). Gruhlke teaches the light sensor (182) may measure light reflected off the user’s finger when the light source (e.g. the colored image displayed via the pixels on the touchscreen display 250) is active ([0059-0060]). Gruhlke therefore teaches the amended feature argued upon; Gruhlke teaches an optical sensor (182) configured to receive light originating from an illuminated portion of OLEDs of an electronic display (250) such that measurements (PPG) captured by the optical sensor (182) for purposes of determining vital signs (i.e. heart rate) are recorded in an instance in which the illuminated portion is under the portion of the subject (a user’s finger touches the touchscreen display 250), and wherein one or more vital signs (heart rate) is determined based at least in part on the recorded measurements ([0029], [0051], [0056], [0059-0060]).
Claim Rejections - 35 USC § 112
The following is a quotation of the first paragraph of 35 U.S.C. 112(a):
(a) IN GENERAL.—The specification shall contain a written description of the invention, and of the manner and process of making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it pertains, or with which it is most nearly connected, to make and use the same, and shall set forth the best mode contemplated by the inventor or joint inventor of carrying out the invention.
The following is a quotation of the first paragraph of pre-AIA 35 U.S.C. 112:
The specification shall contain a written description of the invention, and of the manner and process of making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it pertains, or with which it is most nearly connected, to make and use the same, and shall set forth the best mode contemplated by the inventor of carrying out his invention.
Claim 14 is rejected under 35 U.S.C. 112(a) or 35 U.S.C. 112 (pre-AIA ), first paragraph, as failing to comply with the written description requirement. The claim contains subject matter which was not described in the specification in such a way as to reasonably convey to one skilled in the relevant art that the inventor or a joint inventor, or for applications subject to pre-AIA 35 U.S.C. 112, the inventors, at the time the application was filed, had possession of the claimed invention.
Claim 14 recites “determining the instance in which the illuminated portion is under the portion of the subject based at least in part on the synchronization signal”. However, no support for this is found in the specification. At most, the specification describes in ¶ [0017], [0059], and [0088] that determining an instance in which the electronic display is on (or off) is based at least in part on the synchronization signal. However, the specification including these sections do not describe determining an instance in which an illuminated portion is under a portion of a subject based at least in part on a synchronization signal. While an instance of illumination (i.e. the display is on) may be determined based on the synchronization signal, the specification does not appear to describe how using a synchronization signal may help determine an instance in which the illuminated portion is under the portion of the subject. Therefore, it is unclear whether the inventors possess the invention comprising “determining the instance in which the illuminated portion is under the portion of the subject based at least in part on the synchronization signal”.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claims 1, 5-6, and 8-11 are rejected under 35 U.S.C. 103 as being unpatentable over He (US20200050818) in view of Chen (US20210287602) and Gruhlke (US20170079591). Gruhlke is cited in the IDS filed 10/23/2023.
Regarding claim 1, He teaches an electronic device (200) comprising (Figs. 2A-2B, [0069]):
a housing (“Electronic Device Housing” in figure 2A, [0070-0071]);
an electronic display (423) attached to the housing comprising (Figs. 2A-2G & 4A-4B, [0092]):
a first side (431) configured to direct transmitted light toward a portion of a subject (60) proximate the electronic display (423) via organic light-emitting diodes (OLED) (433) (Figs. 4A-4B & 5A-5B, [0092-0093], [0106-0107]); and
an optical sensor (optical sensor module) disposed within the housing, opposite the first side (431) of the electronic display (423), and configured to receive reflected light off the portion of the subject (60) (Figs. 4A-4B & 5A-5B, [0010], [0050], [0058], “The added optical sensor module and the related circuitry are under the display screen inside the phone housing”, [0069], [0093], “A portion of the reflected or scattered light in the zone 615 illuminated by the OLED pixels in the fingerprint illumination zone 613 is directed into the optical sensor module underneath the OLED display module 433 and a photodetector sensing array inside the optical sensor module receives such light”, [0095], [0098], [0106-0108]), and
wherein the optical sensor is disabled in an instance in which the illuminated portion (613) is not under the portion of the subject (Fig. 4B, [0094], “…once a touch in the zone 615 is detected, the OLED pixels in the fingerprint illumination zone 613 are turned on to activate the optical sensing module to perform the fingerprint sensing”, wherein touching the zone 615, OLED pixels of illumination zone 613 being turned on, and the optical sensing module being activated comprise the optical sensor being enabled in an instance in which the illuminated portion 613 is under the portion (finger) of the subject; figure 4B shows substantial overlap of zone 615 and 613; this also means that prior to detecting the subject’s finger touch, the optical sensing module was disabled, i.e. disabled in an instance in which the illuminated portion is not under the portion (finger) of the subject);
wherein one or more vital signs of the subject are determined based at least in part on the reflected light ([0054], [0098], [0137], “The intensity variation of this intensity signal is evaluated to determine the heart rate of the user”, [0154], wherein glucose level, oxygen saturation, heart rate, and the like comprise one or more vital signs).
However, He fails to teach wherein the electronic display is configured to repeatedly refresh a displayed output in a continuous rolling pattern and in coordination with a synchronization signal, such that the electronic display continuously comprises an illuminated portion of the organic light-emitting diodes of the electronic display and an unilluminated portion of the organic light-emitting diodes of the electronic display.
In an analogous electronic device field of endeavor, Chen teaches such a feature. Chen teaches an electronic device (100) comprising a housing (102) and an electronic display (104) (Fig. 1A, [0001], [0032-0033], [0036]). Moreover, Chen teaches the electronic device (100) comprises an under-display optical sensor (optical transceiver 118) (Fig. 1B, [0034]). Chen further teaches the display (104) may be an OLED display comprising organic light-emitting diodes (OLED) ([0036]). Chen teaches the light-emitting display (300) may be refreshed according to a vertical and horizontal synchronization signal which indicate a start of a new display frame and a refresh of a next line of pixels respectively (Fig. 5B, [0058], [0066-0067]). Chen teaches wherein the electronic display (300) is configured to refresh line-by-line, i.e. rolling pattern (Fig. 3, [0057], wherein figure 3 depicts the line-by-line or rolling pattern). Moreover, Chen teaches the display is refreshed during each of a plurality of display frames, therefore teaching repeatedly refreshing over a plurality of display frames ([0058]). Chen teaches, and shows in figure 5B, that the V-Sync and H-Sync signals are used to and indicate a start of a refresh of the light-emitting display (Fig. 5B, [0058], [0066-0068], “…one or more synchronization signals used to refresh the light-emitting display, such as the afore-mentioned V-Sync and H-Sync signals…”). In addition, Chen teaches wherein the electronic display is refreshed such that the electronic display continuously comprises illuminated portions and unilluminated portions (Fig. 5B, [0065-0067]). Chen teaches and shows an example set of illumination timings (520) for pixels in multiple adjacent lines (Fig. 5B, [0065]). Chen teaches each line of pixels may transition through emission periods (502, illumination periods) and emission blanking periods (504, unilluminated periods). Moreover, Chen teaches the timing of a next line (e.g. line 524) is delayed with respect to the timing of a previous line (e.g. line 522) (Fig. 5B, [0065]). As shown in figure 5B, this results in portions (lines) of the display screen being illuminated and portions of the display screen being unilluminated as a result of the delay (Fig. 5B). Moreover, this occurs continuously throughout the display frame (506) as further shown in figure 5B. Since figure 5B only shows 3 lines of pixels, one can further extrapolate this pattern to hundreds to thousands more lines of pixels, which display screens typically have, and it becomes even more clear that the display screen would continuously comprise illuminated and unilluminated portions. Chen therefore teaches “wherein the electronic display is configured to repeatedly refresh a display output in a continuous rolling pattern and in coordination with a synchronization signal, such that the electronic display continuously comprises an illuminated portion of the organic light-emitting diodes of the electronic display and an unilluminated portion of the organic light-emitting diodes of the electronic display”.
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to have the OLED display screen repeatedly refresh in a rolling pattern in coordination with a synchronization signal such that the display continuously comprises illuminated and unilluminated portions as taught by Chen (Figs. 3 & 5A-5B, [0057-0058], [0062], [0064-0068]). By coordinating the display refresh with a synchronization signal, an optical sensor may use the same signal for synchronization and the performance of the light-emitting display and optical sensors may be improved as recognized by Chen ([0067]). Moreover, by addressing/refreshing lines of pixels one at a time rather than globally, lower instantaneous current is needed, reducing heat generation and electrical stress.
However, the modified combination noted above fails to teach wherein the optical sensor is configured to receive reflected light off the portion of the subject originating from the illuminated portion of the organic light-emitting diodes of the electronic display, such that measurements captured by the optical sensor for purposes of determining vital signs are recorded in an instance in which the illuminated portion is under the portion of the subject, and wherein one or more vital signs of the subject are determined based at least in part on the recorded measurements.
Gruhlke teaches obtaining vital measurements such as blood pressure (BP) and heart rate (HR) via a PPG measurement (Abstract, [0032]). Gruhlke teaches a smartphone (210) including a touchscreen display (250) (Fig. 2, [0049]) and wherein the touchscreen display (250) may generate light that shines into a user’s skin when the user touches the touchscreen display (e.g. the illuminated portion is under the portion of the subject), obtain a PPG measurement, and determine a heart rate of the user ([0051], [0056]). Gruhlke teaches in some implementations the display may be an OLED display ([0029]). Similar to Chen above, Gruhlke teaches wherein a light sensor (182) may be synchronized to pixels of the touchscreen display (250) ([0060]). Gruhlke further teaches wherein the touchscreen display is pulsed at a frequency equal to a synchronization frequency, e.g. the refresh rate of the display ([0060]). Gruhlke teaches the light sensor (182) may measure light reflected off the user’s finger when the light source (e.g. the colored image displayed via the pixels on the touchscreen display 250) is active ([0059-0060]). Gruhlke therefore teaches an optical sensor (182) configured to receive light originating from an illuminated portion of OLEDs of an electronic display (250) such that measurements (PPG) captured by the optical sensor (182) for purposes of determining vital signs (i.e. heart rate) are recorded in an instance in which the illuminated portion is under the portion of the subject (a user’s finger touches the touchscreen display 250), and wherein one or more vital signs (heart rate) is determined based at least in part on the recorded measurements ([0029], [0051], [0056], [0059-0060]).
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of Chen to leverage the illumination of the display screen, have the optical sensor receive reflected light off the user originating from illumination of the display screen, record PPG measurements, and have the vital signs be based on the recorded PPG measurements as taught by Gruhlke ([0029], [0051], [0056], [0059-0060]). A heart rate of a user may be determined via a touchscreen of a phone shining light towards a user’s skin and a light sensor receiving light reflected from the user, without the need of a fingerprint zone, as recognized by Gruhlke ([0051], [0059-0060]).
Regarding claim 5, He in view of Chen and Gruhlke teaches the invention as claimed above in claim 1.
However, He fails to teach wherein the optical sensor is enabled based at least in part on the synchronization signal.
In an analogous electronic device field of endeavor, Chen teaches such a feature. Chen teaches an electronic device (100) comprising a housing (102) and an electronic display (104) (Fig. 1A, [0001], [0032-0033], [0036]). Moreover, Chen teaches the electronic device (100) comprises an under-display optical sensor (optical transceiver 118) (Fig. 1B, [0034]). Chen teaches the light-emitting display (300) may be refreshed according to a vertical and horizontal synchronization signal which indicate a start of a new display frame and a refresh of a next line of pixels respectively (Fig. 5B, [0058], [0066-0067]). Chen further teaches synchronizing the light-emitting display and the optical sensor (transceiver) ([0067]). Chen teaches the V-Sync and H-sync signals may be used to synchronize the light-emitting display and the optical sensor (transceiver ([0068]). Chen teaches the optical sensor (1004) is configured to receive light in synchronization with the synchronization signal ([0099]). Chen therefore teaches wherein an optical sensor is enabled based at least in part on the synchronization signal.
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to synchronize the optical sensor with the refresh of the display screen as taught by Chen ([0058], [0066-0068], [0099]). Through this synchronization, the performance of the light-emitting display and optical sensor may be improved as recognized by Chen ([0067], [0075]).
Regarding claim 6, He in view of Chen and Gruhlke teaches the invention as claimed above in claim 1.
He further teaches wherein the one or more vital signs comprise at least a heart rate (Figs. 5A-5B, [0098], [0137]).
Regarding claim 8, He in view of Chen and Gruhlke teaches the invention as claimed above in claim 1.
He further teaches wherein the one or more vital signs comprises at least one of heart rate variability and peripheral blood oxygen saturation ([0054], [0154], wherein oxygen saturation based on optical sensing in returned light from a user’s finger or palm comprises peripheral blood oxygen saturation).
Regarding claim 9, He in view of Chen and Gruhlke teaches the invention as claimed above in claim 1.
However, He fails to teach wherein an ambient light vital signs measurement is made by the optical sensor in an instance in which the electronic display is not illuminated, and the one or more vital signs of the subject are determined based at least in part on the ambient light vital signs measurement.
In an analogous device for determining vital signs field of endeavor, Gruhlke teaches such a feature. Gruhlke teaches an apparatus (200) for obtaining vital sign measurements such as heart rate via photoplethysmography (PPG) (Figs. 1-2, Title, Abstract, [0029], [0032-0033], [0049], [0051]). Gruhlke teaches when a light source is not active (not illuminated), a light sensor (182) may measure ambient light pollution ([0060], [0068]). Gruhlke teaches when the light source is active and the light sensor (182) is measuring both the reflected light from the user’s finger and the ambient light pollution together, the ambient light pollution may be subtracted from the measurement, thereby leaving only the useful part of the signal ([0060], [0068], [0070]). Gruhlke teaches the measurement obtained by the light sensor (182) may be used by the processor of the smartphone to determine a PPG measurement for the user ([0060], [0068], [0070]) and a user’s heart rate and blood pressure may be determined from the PPG measurement ([0032], [0046]). Gruhlke therefore teaches generating an ambient light vital signs measurement (ambient light pollution) in an instance in which the light source is not illuminated/on and wherein the vital signs measurement is based on the ambient light vital signs measurement (wherein ambient light pollution is removed or subtracted from the measured light).
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to measure ambient light pollution while the light source is off, to subtract the ambient light pollution from the received reflected light when the light source is on, and to determine vital signs using the resulting light measured as taught by Gruhlke ([0060], [0068], [0070]). Noise induced by ambient light may predictably be removed by following the teachings of Gruhlke ([0060], [0068], [0070]). By removing noise or ambient light pollution from the calculation of vital signs, the calculation of vital signs may predictably be made more accurate. Modifying He with the teachings of Gruhlke would predictably result in measuring ambient light when the electronic display (light source) is not illuminated and determining vital signs based on the ambient light by subtracting the ambient light from the measured light while the electronic display is illuminated.
Regarding claim 10, He in view of Chen and Gruhlke teaches the invention as claimed above in claim 1.
However, He fails to teach wherein the optical sensor is further configured to perform an ambient light operational measurement in an instance in which the optical sensor is not performing a vital signs measurement.
In an analogous device for determining vital signs field of endeavor, Gruhlke teaches such a feature. Gruhlke teaches an apparatus (200) for obtaining vital sign measurements such as heart rate via photoplethysmography (PPG) (Figs. 1-2, Title, Abstract, [0029], [0032-0033], [0049], [0051]). Gruhlke teaches PPG measurements (vital signs measurement) are acquired by directing light source(s) to emit light ([0044]). Gruhlke teaches when a light source is not active (not illuminated), a light sensor (182) may measure ambient light pollution ([0060], [0068]); because the light source is not active to emit light, PPG measurements therefore cannot be performed. Gruhlke teaches when the light source is active and the light sensor (182) is measuring both the reflected light from the user’s finger and the ambient light pollution together, the ambient light pollution may be subtracted from the measurement, thereby leaving only the useful part of the signal ([0060], [0068]). Gruhlke teaches the measurement obtained by the light sensor (182) may be used by the processor of the smartphone to determine a PPG measurement for the user ([0060]) and a user’s heart rate may be determined from the PPG measurement ([0032]). Gruhlke therefore teaches performing an ambient light operational measurement (measurement of ambient light pollution) in an instance in which the optical sensor is not performing a vital signs measurement (wherein a vital signs measurement may not be made unless the light source is active and emitting light).
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to perform an ambient light pollution measurement while the light source off and thus not performing a vital signs measurement as taught by Gruhlke ([0060], [0068]). By measuring ambient light pollution, the measured ambient light pollution and thus noise can be removed/subtracted from the measured light signal when calculating for vital signs as recognized by Gruhlke ([0060], [0068]). He modified by the teachings of Gruhlke would predictably result in measuring ambient light pollution in an instance in which the optical sensor is not performing a vital signs measurement since the light source is required to be active for performing the vital signs measurement.
Regarding claim 11, He teaches a computer-implemented method comprising ([0043], [0049], wherein the method being implemented on an electronic device including a mobile computing device, e.g. smartphone, comprises a computer-implemented method):
providing an electronic device (200) comprising (Figs. 2A-2B, [0069]):
a housing (“Electronic Device Housing” in figure 2A, [0070-0071]);
an electronic display (423) attached to the housing comprising (Figs. 2A-2G & 4A-4B, [0092]):
a first side (431) configured to direct transmitted light toward a portion of a subject (60) proximate the electronic display (423) via organic light-emitting diodes (OLED) (433) (Figs. 4A-4B & 5A-5B, [0092-0093], [0106-0107]); and
an optical sensor (optical sensor module) disposed within the housing, opposite the first side (431) of the electronic display (423), and configured to receive reflected light off the portion of the subject ([0010], [0050], [0058], “The added optical sensor module and the related circuitry are under the display screen inside the phone housing”, [0069], [0093], “A portion of the reflected or scattered light in the zone 615 illuminated by the OLED pixels in the fingerprint illumination zone 613 is directed into the optical sensor module underneath the OLED display module 433 and a photodetector sensing array inside the optical sensor module receives such light”, [0095], [0098]),
wherein the optical sensor is disabled in an instance in which the illuminated portion (613) is not under the portion of the subject (Fig. 4B, [0094], “…once a touch in the zone 615 is detected, the OLED pixels in the fingerprint illumination zone 613 are turned on to activate the optical sensing module to perform the fingerprint sensing”, wherein touching the zone 615, OLED pixels of illumination zone 613 being turned on, and the optical sensing module being activated comprise the optical sensor being enabled in an instance in which the illuminated portion 613 is under the portion (finger) of the subject; figure 4B shows substantial overlap of zone 615 and 613; this also means that prior to detecting the subject’s finger touch, the optical sensing module was disabled, i.e. disabled in an instance in which the illuminated portion is not under the portion (finger) of the subject);
causing organic light-emitting diodes (433) to transmit light from the first side (431) of the electronic display (423) toward the portion of the subject (60) proximate the electronic display (423) (Figs. 4A-4B & 5A-5B, [0092-0093], [0106-0107]);
receiving, from the optical sensor (optical sensor module) disposed within the housing opposite the first side (431) of the electronic display (423), an electronic signal representative of the reflected light off the portion of the subject (60) (Figs. 4A-4B & 5A-5B, Claim 1, [0011-0012], [0093], [0095], [0098], [0106-0110], [0137], wherein received light signals are converted into electronic signals comprising detector/intensity signals); and
determining one or more vital signs of the subject based at least in part on the reflected light ([0054], [0098], [0137], “The intensity variation of this intensity signal is evaluated to determine the heart rate of the user”, [0154], wherein glucose level, oxygen saturation, heart rate, and the like comprise one or more vital signs).
However, He fails to teach wherein the electronic display is configured to repeatedly refresh a displayed output in a continuous rolling pattern and in coordination with a synchronization signal, such that the electronic display continuously comprises an illuminated portion of the organic light-emitting diodes of the electronic display and an unilluminated portion of the organic light-emitting diodes of the electronic display.
In an analogous electronic device field of endeavor, Chen teaches such a feature. Chen teaches an electronic device (100) comprising a housing (102) and an electronic display (104) (Fig. 1A, [0001], [0032-0033], [0036]). Moreover, Chen teaches the electronic device (100) comprises an under-display optical sensor (optical transceiver 118) (Fig. 1B, [0034]). Chen further teaches the display (104) may be an OLED display comprising organic light-emitting diodes (OLED) ([0036]). Chen teaches the light-emitting display (300) may be refreshed according to a vertical and horizontal synchronization signal which indicate a start of a new display frame and a refresh of a next line of pixels respectively (Fig. 5B, [0058], [0066-0067]). Chen teaches wherein the electronic display (300) is configured to refresh line-by-line, i.e. rolling pattern (Fig. 3, [0057], wherein figure 3 depicts the line-by-line or rolling pattern). Moreover, Chen teaches the display is refreshed during each of a plurality of display frames, therefore teaching repeatedly refreshing over a plurality of display frames ([0058]). Chen teaches, and shows in figure 5B, that the V-Sync and H-Sync signals are used to and indicate a start of a refresh of the light-emitting display (Fig. 5B, [0058], [0066-0068], “…one or more synchronization signals used to refresh the light-emitting display, such as the afore-mentioned V-Sync and H-Sync signals…”). In addition, Chen teaches wherein the electronic display is refreshed such that the electronic display continuously comprises illuminated portions and unilluminated portions (Fig. 5B, [0065-0067]). Chen teaches and shows an example set of illumination timings (520) for pixels in multiple adjacent lines (Fig. 5B, [0065]). Chen teaches each line of pixels may transition through emission periods (502, illumination periods) and emission blanking periods (504, unilluminated periods). Moreover, Chen teaches the timing of a next line (e.g. line 524) is delayed with respect to the timing of a previous line (e.g. line 522) (Fig. 5B, [0065]). As shown in figure 5B, this results in portions (lines) of the display screen being illuminated and portions of the display screen being unilluminated as a result of the delay (Fig. 5B). Moreover, this occurs continuously throughout the display frame (506) as further shown in figure 5B. Since figure 5B only shows 3 lines of pixels, one can further extrapolate this pattern to hundreds to thousands more lines of pixels, which display screens typically have, and it becomes even more clear that the display screen would continuously comprise illuminated and unilluminated portions. Chen therefore teaches “wherein the electronic display is configured to repeatedly refresh a display output in a continuous rolling pattern and in coordination with a synchronization signal, such that the electronic display continuously comprises an illuminated portion of the organic light-emitting diodes of the electronic display and an unilluminated portion of the organic light-emitting diodes of the electronic display”.
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to have the OLED display screen repeatedly refresh in a rolling pattern in coordination with a synchronization signal such that the display continuously comprises illuminated and unilluminated portions as taught by Chen (Figs. 3 & 5A-5B, [0057-0058], [0062], [0064-0068]). By coordinating the display refresh with a synchronization signal, an optical sensor may use the same signal for synchronization and the performance of the light-emitting display and optical sensors may be improved as recognized by Chen ([0067]). Moreover, by addressing/refreshing lines of pixels one at a time rather than globally, lower instantaneous current is needed, reducing heat generation and electrical stress.
However, the modified combination noted above fails to teach wherein the optical sensor is configured to receive reflected light off the portion of the subject originating from the illuminated portion of the organic light-emitting diodes of the electronic display, recording measurements associated with the electronic signal received from the optical sensor for purposes of determining vital signs in an instance in which the illuminated portion is under the portion of the subject; and wherein the determining one or more vital signs of the subject is based at least in part on the recorded measurements.
Gruhlke teaches obtaining vital measurements such as blood pressure (BP) and heart rate (HR) via a PPG measurement (Abstract, [0032]). Gruhlke teaches a smartphone (210) including a touchscreen display (250) (Fig. 2, [0049]) and wherein the touchscreen display (250) may generate light that shines into a user’s skin when the user touches the touchscreen display (e.g. the illuminated portion is under the portion of the subject), obtain a PPG measurement, and determine a heart rate of the user ([0051], [0056]). Gruhlke teaches in some implementations the display may be an OLED display ([0029]). Similar to Chen above, Gruhlke teaches wherein a light sensor (182) may be synchronized to pixels of the touchscreen display (250) ([0060]). Gruhlke further teaches wherein the touchscreen display is pulsed at a frequency equal to a synchronization frequency, e.g. the refresh rate of the display ([0060]). Gruhlke teaches the light sensor (182) may measure light reflected off the user’s finger when the light source (e.g. the colored image displayed via the pixels on the touchscreen display 250) is active ([0059-0060]). Gruhlke therefore teaches an optical sensor (182) configured to receive light originating from an illuminated portion of OLEDs of an electronic display (250), recording measurements (PPG) associated with the electronic signal received from the optical sensor for purposes of determining vital signs (heart rate) in an instance in which the illuminated portion is under the portion of the subject (a user’s finger touches the touchscreen display 250), and wherein determining the one or more vital signs (heart rate) of the subject is based at least in part on the recorded measurements (PPG) ([0029], [0051], [0056], [0059-0060]).
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of Chen to leverage the illumination of the display screen, have the optical sensor receive/record reflected light off the user originating from illumination of the display screen, and have the vital signs be based on the recorded measurement as taught by Gruhlke ([0029], [0051], [0056], [0059-0060]). A heart rate of a user may be determined via a touchscreen of a phone shining light towards a user’s skin and a light sensor receiving light reflected from the user, without the need of a fingerprint zone, as recognized by Gruhlke ([0051], [0059-0060]).
Claims 2 and 12 are rejected under 35 U.S.C. 103 as being unpatentable over He (US20200050818) in view of Chen (US20210287602) and Gruhlke (US20170079591) as applied to claims 1 and 11 above, and further in view of Pi (US20180046281).
Regarding claims 2 and 12, He in view of Chen and Gruhlke teaches the inventions as claimed above in claims 1 and 11 respectively.
However, He fails to explicitly teach wherein no portion of the optical sensor is visible from the first side of the electronic display.
In an analogous mobile device system for determining vital signs of a subject field of endeavor, Pi teaches such a feature. Pi teaches an optical fingerprint sensor package in a mobile device including an OLED screen (10) (Fig. 1, [0046]). Pi teaches wherein light from the OLED display can be used to sense a user’s blood to obtain heart rate, oxygen level, glucose level, and the like ([0050]). Pi teaches wherein the optical sensor may be made invisible by hiding the sensor underneath the display screen, hidden from plain view from the top surface of the mobile phone ([0067-0068]).
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to have the optical sensor be underneath the display screen and hidden from plain view from the top surface of the mobile phone device as taught by Pi ([0067-0068]). He similarly teaches wherein the optical sensor module is placed underneath the display screen, but fails to explicitly disclose wherein the optical sensor is not visible from the top surface of the mobile phone device (Figs. 2A-2B, 4B, & 5A-5B, [0018], [0069]). Pi teaches wherein the optical sensor may be hidden from plain view from the top surface of the mobile phone by hiding the sensor underneath the display screen ([0068]). By using an under-display sensor and thus “invisible” sensor, the entire top surface of the mobile device may be used for enlarging the display screen size while providing for optical sensing and other biometric measurements as recognized by Pi ([0068]).
Claims 1, 5-6, and 8-11
Claims 2 and 12
Claims 7 and 17 are rejected under 35 U.S.C. 103 as being unpatentable over He (US20200050818) in view of Chen (US20210287602) and Gruhlke (US20170079591) as applied to claims 6 and 11 above, and further in view of Yuen (US20140135594).
Regarding claim 7, He in view of Chen and Gruhlke teaches the invention as claimed above in claim 6.
However, He fails to teach wherein the heart rate is determined based at least in part on a period of the recorded measurements.
In an analogous device for determining vital signs field of endeavor, Yuen teaches such a feature. Yuen teaches a device (300) including a light source (181) and light detector (182) configured to transmit and receive light to and from a user’s finger (302) (Fig. 3A, [0068], [0070]). Yuen teaches calculating heart rate based on light that is reflected back to the light detector (182) (Abstract, [0068], [0070-0071]). Yuen teaches heart rate is calculated based on an algorithm that detects multiple heart beats in the reflected light received within a sampling time period and measures a time interval between a first detected heart beat and a second detected heart beat (Claim 10, [0012], wherein an interval between a first and second detected heart beat in the reflected light signal comprises a period of the reflected light). Yuen teaches a first estimate of heart beats is determined by dividing the sampling time interval with the time interval between beats, and the first estimate of heart beats may be extrapolated to estimate a user’s heart beats per minute (heart rate) (Claim 10, [0012]). Yuen therefore teaches determining heart rate based on a period (time interval) of a reflected light.
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to additionally determine heart rate based on a period of the reflected light as taught by Yuen (Claim 10, [0012]). Having multiple ways to determine heart rate may increase reliability or robustness of the heart rate monitoring device.
Regarding claim 17, He in view of Chen and Gruhlke teaches the invention as claimed above in claim 11.
However, He fails to teach the invention further comprising: determining a period of the recorded measurements; and calculating a heart rate based at least in part on the period of the recorded measurements.
In an analogous device for determining vital signs field of endeavor, Yuen teaches such a feature. Yuen teaches a device (300) including a light source (181) and light detector (182) configured to transmit and receive light to and from a user’s finger (302) (Fig. 3A, [0068], [0070]). Yuen teaches calculating heart rate based on light that is reflected back to the light detector (182) (Abstract, [0068], [0070-0071]). Yuen teaches heart rate is calculated based on an algorithm that detects multiple heart beats in the reflected light received within a sampling time period and measures a time interval between a first detected heart beat and a second detected heart beat (Claim 10, [0012], wherein an interval between a first and second detected heart beat in the reflected light signal comprises a period of the reflected light). Yuen teaches a first estimate of heart beats is determined by dividing the sampling time interval with the time interval between beats, and the first estimate of heart beats may be extrapolated to estimate a user’s heart beats per minute (heart rate) (Claim 10, [0012]). Yuen therefore teaches determining a period (time interval) of a reflected light (recorded measurements) and calculating a heart rate based on the period (time interval) of the reflected light (recorded measurements).
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to additionally determine heart rate based on a period of the reflected light as taught by Yuen (Claim 10, [0012]). Having multiple ways to determine heart rate may increase reliability or robustness of the heart rate monitoring device.
Claim 14 is rejected under 35 U.S.C. 103 as being unpatentable over He (US20200050818) in view Chen (US20210287602) and Gruhlke (US20170079591) as applied to claim 11 above, and further in view of Lin (US20190265859).
Regarding claim 14, He in view of Chen and Gruhlke teaches the invention as claimed above in claim 11.
However, He fails to teach the invention further comprising: receiving the synchronization signal indicating a start of an electronic display refresh.
In an analogous device for determining vital signs field of endeavor, Gruhlke teaches such a feature. Gruhlke teaches an apparatus (200) for obtaining vital sign measurements such as heart rate via photoplethysmography (PPG) (Figs. 1-2, Title, Abstract, [0029], [0032-0033], [0049], [0051]). Gruhlke teaches a light sensor (182) and the pixels of a display (250) may be synchronized to mitigate ambient light pollution ([0060], [0069]). Gruhlke teaches the display (250) is pulsed at a frequency equal to the synchronization frequency which may be the refresh rate of the display (250) ([0060]). Gruhlke teaches by performing this synchronization, light measured by the light sensor (182) while the display is off may be subtracted/removed from the light measured while the display is on ([0060], [0068]). Gruhlke teaches the light sensors (182) are synchronized to/with the refresh rate of the display (250) ([0069]). Gruhlke therefore teaches wherein the light sensors receive a synchronization signal indicating a start of an electronic display refresh (refresh rate of the display) and wherein determining the instance in which the display is on is based on the synchronization signal.
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to synchronize the light sensor with the display’s refresh rate and to determine when the display is on based on the synchronization as taught by Gruhlke ([0060], [0069]). By having the light sensors synchronize with the display’s refresh rate and thus receive the synchronization signal, light signals measured while the display is off and on may be differentiated to help mitigate ambient light pollution/noise as recognized by Gruhlke ([0060], [0068]).
However, the modified combination noted above fails to teach determining the instance in which the illuminated portion is under the portion of the subject based at least in part on the synchronization signal.
In an analogous electronic device field of endeavor, Lin teaches such a feature. Lin teaches a touch display system (10) comprising a smart phone including a display panel (102) (Fig. 1, [0033]). Lin teaches the pixels of the display are driven by a synchronizing signal ([0033]). Moreover, Lin teaches a touch controller (108) may drive and sense a touch sensor according to the synchronizing signal sync, thereby achieving touch display synchronization with the display panel (102); the display of the display panel is synchronized with the touch detection of the touch sensor ([0033]). Lin teaches wherein the touch sensor (410) is configured to receive a pressing or touch from a user and generate a corresponding signal change, i.e. determine touch or an instance in which the illuminated display/touch screen is under a portion of the subject ([0044]). Lin teaches that the timing of the touch controller (i.e. touch sensing) and the timing of the panel display (i.e. display is active) is the same due to the synchronizing ([0034]); Lin therefore teaches when a touch is determined, the display is also active and thus an illuminated portion is under a portion of the subject when a touch is determined. Lin thus teaches determining an instance in which the illuminated portion is under a portion of a subject based at least in part on a synchronization signal.
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to synchronize the display panel and touch sensor as taught by Lin ([0033-0034], [0044]). By synchronizing the display with the touch sensor, signal interference may be reduced between a touch controller and a display driving circuit as recognized by Lin (Abstract, [0025]). Since measuring PPG or a user’s vitals as taught by He is based on the user’s finger touching the display, He would be motivated to synchronize the touch controller/sensor with the display driver to reduce signal interference.
Claim 16 is rejected under 35 U.S.C. 103 as being unpatentable over He (US20200050818) in view Chen (US20210287602), Gruhlke (US20170079591), and Lin (US20190265859) as applied to claim 14 above, and further in view of Baldwin (US9607138).
Regarding claim 16, He in view of Chen, Gruhlke, and Lin teaches the invention as claimed above in claim 14.
However, He fails to teach the invention further comprising: receiving, from the optical sensor in the instance in which the illuminated portion is not under the portion of the subject, an ambient electronic signal representative of an ambient light in a surrounding environment.
In an analogous electronic device field of endeavor, Baldwin teaches such a feature. Baldwin teaches a computing device (1000) such as a smartphone (Fig. 10, Column 15 lines 50-58). Baldwin teaches wherein the computing device may include a light-detecting element able to determine or detect ambient light (Column 18 line 59 – Column 19 line 13). Baldwin teaches when a user is not holding the device but the device is exposed to ambient light (e.g. the device is detecting ambient light), the device may determine that it has been set down by the user and may turn off the display (Column 18 lines 60-67). Moreover, Baldwin teaches wherein the device may be determined to be placed in a bag or other compartment by detecting an absence of ambient light and thus turn off or disable additional feature (Column 18 line 67 – Column 19 line 6). Baldwin therefore teaches receiving, from an optical sensor (light-detecting element) in an instance in which the illuminated portion is not under the portion of the subject (i.e. wherein the device is set down by the user or placed in a bag or other compartment), an ambient electronic signal representative of an ambient light in a surrounding environment.
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to have the electronic device detect ambient light in instances not being used by the user as taught by Baldwin (Column 18 line 59 – Column 19 line 13). By detecting ambient light, the device may determine whether the device is being used and may accordingly turn off display and other functions in the instance it is not being used to predictably save power as recognized by Baldwin (Column 18 line 59 – Column 19 line 13).
However, the modified combination noted above fails to teach updating one or more vital signs of the subject based at least in part on the ambient light in the surrounding environment.
In an analogous electronic device field of endeavor, Gruhlke teaches such a feature. Gruhlke teaches a smartphone device (210) including a touchscreen display (250) (Fig. 2, [0049-0050]). Gruhlke teaches measuring ambient light pollution via a light sensor (182) ([0060]). Gruhlke teaches removing the ambient light pollution from a PPG measurement, thereby updating the PPG measurement ([0060]). Moreover, Gruhlke teaches wherein a user’s heart rate is determined via the PPG measurement ([0032], [0051]). Gruhlke therefore teaches updating one or more vital signs (heart rate) based at least in part on an ambient light in the surrounding environment.
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to update the vital signs measurement by removing ambient light pollution from the PPG measurement as recognized by Gruhlke ([0051], [0060]). Ambient light causes noise/artifacts as recognized by Gruhlke ([0068]), thus by removing a measure of ambient light from the recorded measurements, more accurate vital signs readings may predictably be produced.
Claims 18 is rejected under 35 U.S.C. 103 as being unpatentable over He (US20200050818) in view of Chen (US20210287602), Kim (US20230157561), and Gruhlke (US20170079591).
Regarding claim 18, He teaches a mobile device system (200) comprising (Figs. 2A-2B, [0069], wherein a portable device such as a smartphone comprises a mobile device system):
a mobile device housing (“Electronic Device Housing” in figure 2A, [0070-0071]);
an organic light-emitting diode (OLED) electronic display (423) attached to the mobile device housing comprising (Figs. 2A-2G & 4A-4B, [0092]):
a first side (431) configured to direct transmitted light toward a portion of a subject (60) proximate the OLED electronic display (423) via organic light-emitting diodes (Figs. 4A-4B & 5A-5B, [0092-0093], [0106-0107]),
an optical sensor (optical sensor module) disposed within the mobile device housing, opposite the first side (431) of the OLED electronic display (423), and configured to receive reflected light off the portion of the subject (60) (Figs. 4A-4B & 5A-5B, [0010], [0050], [0058], “The added optical sensor module and the related circuitry are under the display screen inside the phone housing”, [0069], [0093], “A portion of the reflected or scattered light in the zone 615 illuminated by the OLED pixels in the fingerprint illumination zone 613 is directed into the optical sensor module underneath the OLED display module 433 and a photodetector sensing array inside the optical sensor module receives such light”, [0095], [0098], [0106-0108]),
wherein the optical sensor is disabled in an instance in which the illuminated portion (613) is not under the portion of the subject (Fig. 4B, [0094], “…once a touch in the zone 615 is detected, the OLED pixels in the fingerprint illumination zone 613 are turned on to activate the optical sensing module to perform the fingerprint sensing”, wherein touching the zone 615, OLED pixels of illumination zone 613 being turned on, and the optical sensing module being activated comprise the optical sensor being enabled in an instance in which the illuminated portion 613 is under the portion (finger) of the subject; figure 4B shows substantial overlap of zone 615 and 613; this also means that prior to detecting the subject’s finger touch, the optical sensing module was disabled, i.e. disabled in an instance in which the illuminated portion is not under the portion (finger) of the subject); and
a host processor (705), disposed within the mobile device housing and electrically connected to the optical sensor (702), the host processor (705) comprising (Fig. 4B, [0058], [0071], wherein circuitry and electronics of the device 200 is arranged inside the device housing, [0095]):
a processor (705) (Fig. 4B, [0095]); and
wherein the mobile device system (200) is configured to (Figs. 2A-2B, [0069-0071]):
cause the OLED electronic display (423) to transmit light from the first side (431) of the OLED electronic display (423) toward a portion of the subject (60) proximate the OLED electronic display (423) (Figs. 4A-4B & 5A-5B, [0092-0093], [0106-0107]);
receive, from the optical sensor disposed within the mobile device housing opposite the first side (431) of the OLED electronic display (423), an electronic signal representative of the reflected light off the portion of the subject (60) (Figs. 4A-4B & 5A-5B, Claim 1, [0011-0012], [0093], [0095], [0098], [0106-0110], [0137], wherein received light signals are converted into electronic signals comprising detector/intensity signals); and
determine one or more vital signs of the subject based at least in part on the reflected light ([0054], [0098], [0137], “The intensity variation of this intensity signal is evaluated to determine the heart rate of the user”, [0154], wherein glucose level, oxygen saturation, heart rate, and the like comprise one or more vital signs).
However, He fails to teach wherein the electronic display is configured to repeatedly refresh a displayed output in a continuous rolling pattern and in coordination with a synchronization signal, such that the electronic display continuously comprises an illuminated portion of the organic light-emitting diodes of the electronic display and an unilluminated portion of the organic light-emitting diodes of the electronic display.
In an analogous electronic device field of endeavor, Chen teaches such a feature. Chen teaches an electronic device (100) comprising a housing (102) and an electronic display (104) (Fig. 1A, [0001], [0032-0033], [0036]). Moreover, Chen teaches the electronic device (100) comprises an under-display optical sensor (optical transceiver 118) (Fig. 1B, [0034]). Chen further teaches the display (104) may be an OLED display comprising organic light-emitting diodes (OLED) ([0036]). Chen teaches the light-emitting display (300) may be refreshed according to a vertical and horizontal synchronization signal which indicate a start of a new display frame and a refresh of a next line of pixels respectively (Fig. 5B, [0058], [0066-0067]). Chen teaches wherein the electronic display (300) is configured to refresh line-by-line, i.e. rolling pattern (Fig. 3, [0057], wherein figure 3 depicts the line-by-line or rolling pattern). Moreover, Chen teaches the display is refreshed during each of a plurality of display frames, therefore teaching repeatedly refreshing over a plurality of display frames ([0058]). Chen teaches, and shows in figure 5B, that the V-Sync and H-Sync signals are used to and indicate a start of a refresh of the light-emitting display (Fig. 5B, [0058], [0066-0068], “…one or more synchronization signals used to refresh the light-emitting display, such as the afore-mentioned V-Sync and H-Sync signals…”). In addition, Chen teaches wherein the electronic display is refreshed such that the electronic display continuously comprises illuminated portions and unilluminated portions (Fig. 5B, [0065-0067]). Chen teaches and shows an example set of illumination timings (520) for pixels in multiple adjacent lines (Fig. 5B, [0065]). Chen teaches each line of pixels may transition through emission periods (502, illumination periods) and emission blanking periods (504, unilluminated periods). Moreover, Chen teaches the timing of a next line (e.g. line 524) is delayed with respect to the timing of a previous line (e.g. line 522) (Fig. 5B, [0065]). As shown in figure 5B, this results in portions (lines) of the display screen being illuminated and portions of the display screen being unilluminated as a result of the delay (Fig. 5B). Moreover, this occurs continuously throughout the display frame (506) as further shown in figure 5B. Since figure 5B only shows 3 lines of pixels, one can further extrapolate this pattern to hundreds to thousands more lines of pixels, which display screens typically have, and it becomes even more clear that the display screen would continuously comprise illuminated and unilluminated portions. Chen therefore teaches “wherein the electronic display is configured to repeatedly refresh a display output in a continuous rolling pattern and in coordination with a synchronization signal, such that the electronic display continuously comprises an illuminated portion of the organic light-emitting diodes of the electronic display and an unilluminated portion of the organic light-emitting diodes of the electronic display”.
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to have the OLED display screen repeatedly refresh in a rolling pattern in coordination with a synchronization signal such that the display continuously comprises illuminated and unilluminated portions as taught by Chen (Figs. 3 & 5A-5B, [0057-0058], [0062], [0064-0068]). By coordinating the display refresh with a synchronization signal, an optical sensor may use the same signal for synchronization and the performance of the light-emitting display and optical sensors may be improved as recognized by Chen ([0067]). Moreover, by addressing/refreshing lines of pixels one at a time rather than globally, lower instantaneous current is needed, reducing heat generation and electrical stress.
However, the modified combination noted above fails to teach an instruction memory including program code, the instruction memory and program code configured to, with the processor, cause the host processor to perform the steps of causing the electronic display to transmit light, receiving from an optical sensor an electronic signal representative of the reflected light, and determining vital signs based on the reflected light.
In an analogous mobile device system for determining vital signs of a subject field of endeavor, Kim teaches such a feature. Kim teaches a mobile electronic device (100) comprising a smart phone which includes a processor (120) and memory (130) (Figs. 1-4, [0069], [0085], [0091]). Kim teaches the electronic device (100) may use an OLED display panel (230) as a light source ([0087], [0095]). Kim teaches using a photoplethysmography (PPG) sensor (140, 340, 440) to receive light reflected from a user’s finger (220) and thus acquire a PPG signal ([0037], [0081-0082], [0086], [0096]). Kim teaches wherein the device (100) may acquire vital sign information such as heart rate variability, oxygen saturation, blood pressure, or blood glucose levels based on the PPG signal acquired by using the OLED display panel as a light source ([0203]). Kim teaches wherein the disclosure may be implemented as a software program stored on a memory that is readable and executable by an electronic device and processor ([0248]).
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to have the steps of acquiring a user’s vital signs via PPG implemented as a program including instructions stored on a memory that is readable and executable by a processor as taught by Kim ([0203], [0248]). By implementing the method steps as a program stored in a memory, a machine or device will be allowed to operate to perform said steps as recognized by Kim ([0248]). Having the device perform the steps results in less work required by the user.
However, the modified combination noted above fails to teach wherein the optical sensor is configured to receive reflected light off the portion of the subject originating from the illuminated portion of the organic light-emitting diodes of the electronic display; and recording measurements associated with the electronic signal received from the optical sensor for purposes of determining vital signs in an instance in which the illuminated portion is under the portion of the subject.
Gruhlke teaches obtaining vital measurements such as blood pressure (BP) and heart rate (HR) via a PPG measurement (Abstract, [0032]). Gruhlke teaches a smartphone (210) including a touchscreen display (250) (Fig. 2, [0049]) and wherein the touchscreen display (250) may generate light that shines into a user’s skin when the user touches the touchscreen display (e.g. the illuminated portion is under the portion of the subject), obtain a PPG measurement, and determine a heart rate of the user ([0051], [0056]). Gruhlke teaches in some implementations the display may be an OLED display ([0029]). Similar to Chen above, Gruhlke teaches wherein a light sensor (182) may be synchronized to pixels of the touchscreen display (250) ([0060]). Gruhlke further teaches wherein the touchscreen display is pulsed at a frequency equal to a synchronization frequency, e.g. the refresh rate of the display ([0060]). Gruhlke teaches the light sensor (182) may measure light reflected off the user’s finger when the light source (e.g. the colored image displayed via the pixels on the touchscreen display 250) is active ([0059-0060]). Gruhlke therefore teaches an optical sensor (182) configured to receive light originating from an illuminated portion of OLEDs of an electronic display (250) and recording measurements (PPG) associated with the electronic signal received from the optical sensor for purposes of determining vital signs (heart rate) in an instance in which the illuminated portion is under the portion of the subject (a user’s finger touches the touchscreen display 250) ([0029], [0051], [0056], [0059-0060]).
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of Chen to leverage the illumination of the display screen, have the optical sensor receive reflected light off the user originating from illumination of the display screen, and have the vital signs be based on the recorded measurement as taught by Gruhlke ([0029], [0051], [0056], [0059-0060]). A heart rate of a user may be determined via a touchscreen of a phone shining light towards a user’s skin and a light sensor receiving light reflected from the user, without the need of a fingerprint zone, as recognized by Gruhlke ([0051], [0059-0060]).
Claim 19 is rejected under 35 U.S.C. 103 as being unpatentable over He (US20200050818) in view of Chen (US20210287602), Kim (US20230157561), and Gruhlke (US20170079591) as applied to claim 18 above, and further in view of Pi (US20180046281).
Regarding claim 19, He in view of Chen, Kim, and Gruhlke teaches the invention as claimed above in claim 18.
However, He fails to explicitly teach wherein no portion of the optical sensor is visible from the first side of the OLED electronic display.
In an analogous mobile device system for determining vital signs of a subject field of endeavor, Pi teaches such a feature. Pi teaches an optical fingerprint sensor package in a mobile device including an OLED screen (10) (Fig. 1, [0046]). Pi teaches wherein light from the OLED display can be used to sense a user’s blood to obtain heart rate, oxygen level, glucose level, and the like ([0050]). Pi teaches wherein the optical sensor may be made invisible by hiding the sensor underneath the display screen, hidden from plain view from the top surface of the mobile phone ([0067-0068]).
It would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to have modified the invention of He to have the optical sensor be underneath the display screen and hidden from plain view from the top surface of the mobile phone device as taught by Pi ([0067-0068]). He similarly teaches wherein the optical sensor module is placed underneath the display screen, but fails to explicitly disclose wherein the optical sensor is not visible from the top surface of the mobile phone device (Figs. 2A-2B, 4B, & 5A-5B, [0018], [0069]). Pi teaches wherein the optical sensor may be hidden from plain view from the top surface of the mobile phone by hiding the sensor underneath the display screen ([0068]). By using an under-display sensor and thus “invisible” sensor, the entire top surface of the mobile device may be used for enlarging the display screen size while providing for optical sensing and other biometric measurements as recognized by Pi ([0068]).
Conclusion
Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to TOMMY T LY whose telephone number is (571) 272-6404. The examiner can normally be reached M-F 12:00pm-8:00pm eastern time.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Anhtuan Nguyen can be reached at 571-272-4963. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/TOMMY T LY/ Examiner, Art Unit 3797
/SERKAN AKAR/ Primary Examiner, Art Unit 3797
Prosecution Insights