Detailed Action
Notice of Pre-AIA or AIA Status
1. The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Acknowledgements
2. Applicant’s arguments, filed on 10/16/2025, are acknowledged. Amended claims 1, 7, 13, and newly added claims 19 and 20 are acknowledged. Claims 1-20 remain pending and have been examined.
Response to Arguments
3. Applicant's arguments filed 10/16/2025 have been fully considered but they are not
persuasive.
4. On page 2, Applicant argues/remarks:
“…Gao has not been shown to disclose the specific feature of:
“determining a first exposure time period of a first target photosensitive chip row in the current frame based on an exposure start time of a first pixel row of an upper boundary of the first target area, and
an exposure end time of a second pixel row of a lower boundary of the first target area”,
…as recited in previously presented claim 1.
Applicant further adds to amend independent claim 1 to recite in part:
“indicating, based on the first exposure time period, an infrared light source to perform light compensation only in the first exposure time period when the photosensitive chip is exposed in the current frame”.
5. Response
Gao, on page 1-lines 30-32, teaches that the image sensor scans and exposes each line of pixels of each frame and transmits the information to an image signal processor; wherein this initial frame can be viewed as a first image. Thereafter, environmental brightness is calculated in accordance with each frame of image; as such, this can correspond to determine a target area within the frame of image in accordance with environmental brightness (since it isn’t limited in any claim that the entire frame can’t be a region of interest or a target area).
Gao, on page 2 line 3-7, teaches the obtaining the exposure time of each frame of image and the exposure time of each row of pixels of the image sensor. Accordingly, lamp supplementation (flash) is in accordance with the obtainment of turn-on and turn-off times, in accordance with exposure time of each frame and each row of pixels.
Exposure time is interpreted to include a start and end time; else it would not give meaning to only account for either a beginning time without an ending time or vice versa. Thus, the exposure time of each frame and specifically also exposure time of each row, in accordance with Gao, is interpreted to be finite.
Pg. 4-lines 14-19 teach the calculation of a start and end point of using a BV value used to calculate a time the LED is turned on; wherein the BV value is a range [a, b] extracted from a boundary scene. Pg. 4-lines 25-26 also teaches the obtaining the exposure time difference between adjacent lines.
As stated above, an initial frame is one which is sensed and transmitted to the image signal processor. After determining brightness level of the environment, a fill light is adjusted for auxiliary shooting, as taught on pg. 1-line 23. Thus, based on a previously obtained image (first image), a fill light adjusted image is shot (a current image). Gao specifies this to be the case for each frame obtained; thus each exposure period and fill light application is particular to each frame.
6. Newly introduced claims 19 and 20 are addressed below.
Claim Rejections - 35 USC § 103
7. In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
8. Claims 1-20 are rejected under U.S.C. 103 being unpatentable over Gao (CN
111601046 A) in view of Chen (CN111447374A).
9. Regarding claim 1, claim 1 is rejected for reasons related to claim 7 (see claim 7 below).
10. Regarding claim 2, claim 2 is rejected for reasons related to claim 8(see claim 8 below).
11. Regarding claim 3, claim 3 is rejected for reasons related to claim 9 (see claim 9 below).
12. Regarding claim 4, claim 4 is rejected for reasons related to claim 10 (see claim 10 below).
13. Regarding claim 5, claim 5 is rejected for reasons related to claim 11 (see claim 11 below).
14. Regarding claim 6, claim 6 is rejected for reasons related to claim 12 (see claim 12 below).
15. Regarding claim 19, claim 19 is rejected for reasons related to claim 20 (see claim 20 below).
16. Regarding claim 7, an apparatus, comprising:
a camera comprising a photosensitive chip; at least one processor (…Gao on pg.
1, line 17-18 teaches a camera assembly including an image sensor and an image signal
processor…); and
at least one memory coupled to the at least one processor and storing programming
instructions for execution by the at least one processor to cause the apparatus to perform
operations (…pg. 5, line 7 teaches a memory which stores data and communicates with
the signal processor…) comprising:
determining a first target area in a first image shot by the camera before a current frame,
wherein the first target area is an area on which light compensation needs to be performed in
the first image (…pg.1, lines 30-34 teach the image signal processor calculates current
environmental brightness according to each frame of image after exposure and if the
current environment brightness is low, the fill light is turned on. Gao doesn’t further
specify a particular object target.
However, Chen teaches a method and device for light supplement adjusting
wherein pg. 3 lines 35-36 teach (S110) when a photographing device is in the night mode
and a face that meets a first preset condition is detected within the photographing range
of the photographing device, the fill light is turned on. Thus, a face that meets a first
preset condition is viewed as a first target area.
Therefore, it would have been obvious to one of ordinary skill in the art before the
effective filing date of the claimed invention that a supplemental light relative to a
specific target area could have been determined according the teachings of Chen,
thereby identifying a particular target area that may be subjected for further image
processing…).
Gao further teaches:
determining a first exposure time period of a first target photosensitive chip row in the
current frame based on an exposure start time of a first pixel row of an upper boundary of the
first target area and an exposure end time of a second pixel row of a lower boundary of the first
target area (…Gao, on page 2 line 3-7, teaches the obtaining the exposure time of each frame of image and the exposure time of each row of pixels of the image sensor. Accordingly, lamp supplementation (flash) is in accordance with the obtainment of turn-on and turn-off times, in accordance with exposure time of each frame and each row of pixels.
Gao, on Pg. 4-lines 14-24, teaches, based on a calculation of a histogram of
a current frame, for current environment brightness BV, each line of pixels of each frame
of image is exposed by rolling shutter and values of calculation are obtained; wherein
first, the image signal processor calculates a starting point of the PWM wave high level;
and secondly, the image signal processor controls the end point of the high level by
calling the BV value; wherein the BV value is used to calculate the time that the LED
needs to be turned on. Further, the BV value is a range [a, b] which is extracted from a
boundary scene.
With reference to Fig. 2, a start exposure time and an end exposure time are
depicted in correspondence wherein “LED” is on turned on…);
wherein the first target photosensitive chip row is in the photosensitive chip and
generates image content in the first target area (…wherein Fig. 2 teaches a start exposure time and end exposure, with respect to an image sensor and its rows of pixels, an image sensor is taught by Gao…); and
indicating, based on the first exposure time period, an infrared light source to perform
light compensation only in the first exposure time period when the photosensitive chip is exposed in the current frame (…pg. 1, lines 36-37 teach current environment brightness is compared with the preset brightness value preset in the image signal processor, and if the current environment brightness is low, a fill light is turned on; Gao specifies this to be the case for each frame obtained; thus each exposure period and fill light application is particular to each frame. Further, pg. 5, line 22 an infrared fill light is taught…).
17. Regarding claim 8, Gao in view of Chen teaches the apparatus according to claim 7 (see
claim 7 above), wherein the determining a first target area in a first image shot by the camera
before a current frame comprises:
determining the first target area in the first image based on a preset target object
(…Chen teaches a method and device for light supplement adjusting wherein pg. 3 lines
35-36 teach S110 when a photographing device is in the night mode and a face that
meets a first preset condition is detected within the photographing range of the
photographing device, the fill light is turned on. Therein Chen teaches a first preset
condition that may be viewed as a preset target object.
Therefore, it would have been obvious to one of ordinary skill in the art before the
effective filing date of the claimed invention that a preset condition detectable can be a
basis for specifically identifying an object and thereby determine processes that may be
implemented similarly as identifying environmental conditions as taught by Gao, thereby not always using up energy and processing resources…).
18. Regarding claim 9, Gao in view of Chen teaches the apparatus according to claim 7 (see
claim 7 above), wherein the first target area is a face area in the first image (…though Gao
teaches an area, as such an environment of a driver’s surrounding being a target of
observation, Gao does not teach a target area specifying a face being an object of a
target.
However, Chen teaches a method and device for light supplement adjusting wherein pg. 3 lines 35-36 teach (S110) when a photographing device is in the night mode
and a face that meets the first preset condition is detected within the photographing
range of the photographing device, the fill light is turned on.
Therefore, it would have been obvious to one of ordinary skill in the art before the
effective filing date of the claimed invention that a face detection means to capture an
image of a driver can help to provide better observatory parameters thus to have a
plausible means to prevent situations that may cause harm to a driver and others of the
vicinity…).
19. Regarding claim 10, Gao in view of Chen teaches the apparatus according claim 7 (see
claim 7 above), wherein the photosensitive chip comprises
a plurality of photosensitive chip rows, and a plurality of pixel rows in the first image correspond to the plurality of photosensitive chip rows (…pg. 1, line 18 teaches a camera assembly including an image sensor and pg. 2 lines 3-4 teach rows of pixels of the image sensor…), and
the determining a first exposure time period of a first target photosensitive chip row in
the current frame based on the first target area comprises:
determining the first target photosensitive chip row corresponding to one or more pixel
rows from the first pixel row of the upper boundary of the first target area to the second pixel row
of the lower boundary of the first target area in the first image (…Gao on pg. 4, lines 14-19 teaches a first point where the image signal processor calculates a starting point of the
PWM wave high level; and secondly, the image signal processor controls the end point
of the high level by calling the BV value; wherein the BV value is used to calculate the
time that the LED needs to be turned on. Further, the BV value is a range [a, b] which is
extracted from a boundary scene. With reference to Fig. 2, a start exposure time and an
end exposure time are depicted in correspondence wherein “LED” is on turned on.
Chen further teaches, on pg. 6, lines 3-8, that the size of the face in the image can
be represented by pixel values and a first preset threshold is used to represent the size
of the face image.
Therefore, it would have been obvious to one of ordinary skill in the art before the
effective filing date of the claimed invention that a preset threshold can be used to
represent a face (target area) and thus process the pixels further for additional image
enhancement…).
Gao further teaches:
determining the first exposure time period of the first target photosensitive chip row in
the current frame (…pg. 2, lines 3-4 teach the obtaining exposure time of each frame of
image and the exposure time of each row of pixels of the image sensor; further pg. 4 line
11 teaches that each line of pixels of each frame of image is exposed by rolling exposure
line by line, see Fig. 2 …).
20. Regarding claim 11, Gao in view of Chen teaches the apparatus according to claim 7
(see claim 7 above). However, Gao doesn’t further teach wherein the operations further
comprise:
determining a second target area in a second image obtained in the current frame,
wherein the second target area is an area on which light compensation needs to be performed in the second image (…however, Chen on pg. 6, lines 1-14 teaches the shooting device can detect each frame of images in the video shot within a preset time period, and when a human face is detected in one frame of image, the number of detections is increased. It
should be noted that, regardless of whether there are one or more faces in a frame of
image, only the number of detections is increased by 1. If a face is detected in the 1#
frame image, the number of detections is +1, that is, the number of detections = 1, and 2
faces are detected in the 2# frame image, and then the number of detections is +1, that is,
the number of detections = 2. Thus, Chen teaches a second target area that may be
detected.
Therefore, it would have been obvious to one of ordinary skill in the art before the
effective filing date of the claimed invention that multiple target areas can be detected ,
as taught by Chen, and thus also be subjected to a fill light as taught by Gao…).
Gao in view of Chen further teaches:
determining a second exposure time period of a second target photosensitive chip row in
a subsequent frame based on the second target area, wherein the second target photosensitive
chip row is in the photosensitive chip and generates image content in the second target area;
and
indicating, based on the second exposure time period, the infrared light source to
perform light compensation in response to at least that the photosensitive chip is
exposed in the subsequent frame.
(…Gao, on pg.1, lines 30-34, teaches that the image signal processor calculates
current environmental brightness according to each frame of image after exposure and
if the current environment brightness is low, the fill light is turned on. The reference
teaches frames of images. Therein Gao teaches a seemingly continuous process of
image capturing wherein current environmental brightness is calculated and accordingly
provide a fill light in low brightness environments. Hence, the process is repeated from frame to frame, be it a second, third, or fourth…).
21. Regarding claim 12, Gao teaches the apparatus according to claim 7 (see claim 7
above), wherein the operations further comprise:
determining a third exposure time period of the first target photosensitive chip row in a
subsequent frame based on the first exposure time period; and
indicating, based on the third exposure time period, the infrared light source to perform
light compensation in response to at least that the photosensitive chip is exposed in the
subsequent frame (…Gao, on pg.1, lines 30-34, teaches that the image signal processor
calculates current environmental brightness according to each frame of image after
exposure and if the current environment brightness is low, the fill light is turned on. The
reference teaches frames of images. Therein Gao teaches a seemingly continuous
process of image capturing wherein current environmental brightness is calculated and
accordingly provide a fill light in low brightness environments…).
22. Regarding claim 13, an apparatus comprising:
a camera, the camera comprises: a photosensitive chip (…Gao on pg. 1, line 17-18
teaches a camera assembly including an image sensor and an image signal
processor…), and the operations comprise:
determining a first target area in a first image shot by the camera before a current frame,
wherein the first target area is an area on which light compensation needs to be performed in
the first image (…pg.1, lines 30-34 teach the image signal processor calculates current environmental brightness according to each frame of image after exposure and if the
current environment brightness is low, the fill light is turned on.
Gao doesn’t further specify a particular object target.
However, Chen teaches a method and device for light supplement adjusting
wherein pg. 3 lines 35-36 teach S110 when a photographing device is in the night mode
and a face that meets a first preset condition is detected within the photographing range
of the photographing device, the fill light is turned on. Thus, a face that meets a first
preset condition is viewed as a first target area.
Therefore, it would have been obvious to one of ordinary skill in the art before the
effective filing date of the claimed invention that a supplemental light relative to a
specific target area could have been determined according the teachings of Chen,
thereby identifying a particular target area that may be subjected for further image
processing…).
Gao further teaches:
determining a first exposure time period of a first target photosensitive chip row in the
current frame based on an exposure start time of a first pixel row of an upper boundary of the
first target area and exposure end time of a second pixel row of a lower boundary of the first
target area (…Gao, on Pg. 4-lines 14-24, teaches, based on a calculation of a histogram of
a current frame, for current environment brightness BV, each line of pixels of each frame
of image is exposed by rolling shutter and values of calculation are obtained; wherein
first, the image signal processor calculates a starting point of the PWM wave high level;
and secondly, the image signal processor controls the end point of the high level by
calling the BV value; wherein the BV value is used to calculate the time that the LED
needs to be turned on. Further, the BV value is a range [a, b] which is extracted from a
boundary scene. In Fig. 2, a start exposure time and an end exposure time are depicted
in correspondence wherein “LED” is on turned on…); and
indicating, based on the first exposure time period, an infrared light source to perform
light compensation only in the first exposure time period when the photosensitive chip is exposed in the current frame (…pg. 1, lines 36-37 teach current environment brightness is compared with the preset brightness value preset in the image signal processor, and if the current environment brightness is low, a fill light is turned on; Gao specifies this to be the case for each frame obtained; thus each exposure period and fill light application is particular to each frame. Further, pg. 5, line 22 teaches an
infrared fill light…).
Though Gao teaches a memory which stores data, Gao doesn’t further specify a non-
transitory computer storage medium wherein the non-transitory computer storage medium stores programming instructions for execution by at least one processor of an apparatus to cause the apparatus to perform operations (…However, Chen teaches a storage device 104 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as non-volatile memory.
Therefore, it would have been obvious to one of ordinary skill in the art before the
effective filing date of the claimed invention that a non-volatile storage memory as taught
by Chen could have been employed as a non-transitory storage medium thus to retain
executable computer programs for image signal processing, thus to produce in this
instance images that are at an acceptable brightness level…).
23. Regarding claim 14, Gao in view of Chen teaches the non-transitory computer storage
medium according to claim 13 (see claim 13 above), wherein
the determining a first target area in a first image shot by the camera before a current frame comprises: determining the first target area in the first image based on a preset target object (…Chen teaches a method and device for light supplement adjusting wherein pg. 3 lines 35-36 teach (S110) when a photographing device is in the night mode and a face that meets a first preset condition is detected within the photographing range of the photographing device, the fill light is turned on. Thus, a face that meets a first preset condition is viewed as a first target area based on a preset target object.
Therefore, it would have been obvious to one of ordinary skill in the art before the
effective filing date of the claimed invention that a supplemental light relative to a specific target area could have been determined according the teachings of Chen, thereby identifying a particular target area that may be subjected for further image processing…).
24. Regarding claim 15, Gao in view of Chen teaches the non-transitory computer storage
medium according to claim 13 (see claim 13 above), wherein the first target area is a face area
in the first image (…though Gao teaches an area, as such an environment of a driver’s
surrounding being a target of observation, Gao does not teach a target area specifying a
face being an object of target.
However, Chen teaches a method and device for light supplement adjusting
wherein pg. 3 lines 35-36 teaches (S110) when a photographing device is in the night
mode and a face that meets the first preset condition is detected within the
photographing range of the photographing device, the fill light is turned on.
Therefore, it would have been obvious to one skilled in the art before the effective
filing date of the claimed invention that a face detection means to capture an image of a
driver can help to provide better observatory parameters thus to have a plausible means
to prevent situations that may cause harm to a driver and others of the vicinity…).
25. Regarding claim 16, Gao in view of Chen teaches the non-transitory computer storage medium according to claim 13 (see claim 13 above), wherein the photosensitive chip comprises:
a plurality of photosensitive chip rows, and a plurality of pixel rows in the first image
correspond to the plurality of photosensitive chip rows (…(Gao) pg. 1, line 18 teaches a
camera assembly including an image sensor and pg. 2 lines 3-4 teach rows of pixels of
the image sensor…), and
the determining a first exposure time period of a first target photosensitive chip row in
the current frame based on the first target area comprises:
determining the first target photosensitive chip row corresponding to one or more pixel
rows from the first pixel row of the upper boundary of the first target area to the second pixel row
of the lower boundary of the first target area in the first image (…(Gao) pg. 2, lines 3-4 teach
the obtaining exposure time of each frame of image and the exposure time of each row of
pixels of the image sensor. Gao, on Pg. 4-lines 14-24, teaches, based on a calculation of
a histogram of a current frame, for current environment brightness BV, each line of
pixels of each frame of image is exposed by rolling shutter and values of calculation are
obtained; wherein first, the image signal processor calculates a starting point of the
PWM wave high level; and secondly, the image signal processor controls the end point
of the high level by calling the BV value; wherein the BV value is used to calculate the
time that the LED needs to be turned on. Further, the BV value is a range [a, b] which is
extracted from a boundary scene…); and
determining the first exposure time period of the first target photosensitive chip row in
the current frame (…(Gao) pg. 2, lines 3-4 teach the obtaining exposure time of each frame
of image and the exposure time of each row of pixels of the image sensor; further pg. 4
line 11 teaches that each line of pixels of each frame of image is exposed by rolling
exposure line by line, see Fig. 2…).
26. Regarding claim 17, Gao in view of Chen teaches the non-transitory computer storage medium according to claim 13 (see claim 13 above), wherein the operations further comprise:
determining a second target area in a second image obtained in the current frame,
wherein the second target area is an area on which light compensation needs to be performed
in the second image (…Chen on pg. 6, lines 1-14 teaches the shooting device can detect
each frame of images in the video shot within a preset time period, and when a human
face is detected in one frame of image, the number of detections is increased. It should
be noted that, regardless of whether there are one or more faces in a frame of image,
only the number of detections is increased by 1. If a face is detected in the 1# frame
image, the number of detections is +1, that is, the number of detections = 1, and 2 faces
are detected in the 2# frame image, and then the number of detections is +1, that is, the
number of detections = 2. Thus, Chen teaches a second target area that may be detected.
Therefore, it would have been obvious to one skilled in the art before the effective
filing date of the claimed invention that multiple target areas can be detected , as taught
by Chen, and thus also be subjected to a fill light as taught by Gao…).
Gao in view of Chen further teaches:
determining a second exposure time period of a second target photosensitive chip row in
a subsequent frame based on the second target area, wherein the second target photosensitive
chip row is in the photosensitive chip and generates image content in the second target area;
and indicating, based on the second exposure time period, the infrared light source to
perform light compensation in response to at least that the photosensitive chip is
exposed in the subsequent frame (…Gao on pg.1, lines 30-34, teaches that the image signal
processor calculates current environmental brightness according to each frame of image
after exposure and if the current environment brightness is low, the fill light is turned on.
The reference teaches frames of images. Therein Gao teaches a seemingly continuous
process of image capturing wherein current environmental brightness is calculated and accordingly provide a fill light in low brightness environments. Hence, the process is
repeated from frame to frame, be it a second, third, or fourth frame…).
27. Regarding claim 18, Gao in view of Chen teaches the non-transitory computer storage
medium according to claim 13, wherein the operations further comprise:
determining a third exposure time period of the first target photosensitive chip row in a
subsequent frame based on the first exposure time period; and indicating, based on the third
exposure time period, the infrared light source to perform light compensation in
response to at least that the photosensitive chip is exposed in the subsequent frame (…Gao,
on pg.1, lines 30-34, teaches that the image signal processor calculates current
environmental brightness according to each frame of image after exposure and if the
current environment brightness is low, the fill light is turned on. The reference teaches
frames of images. Therein Gao teaches a seemingly continuous process of image
capturing wherein current environmental brightness is calculated and accordingly
provide a fill light in low brightness environments…).
28. Regarding claim 20, Gao in view of Chen teaches the apparatus according to claim 7, wherein
the first exposure time period of the first target photosensitive chip row in the current frame is determined as a time interval between the exposure start time of the first pixel row of the upper boundary of the first target area and the exposure end time of the second pixel row of the lower boundary of the first target area (…wherein the “on” period, parallel to a horizontal time line in Fig. 2, can be viewed as a time interval, wherein that period specifically corresponds to the first and last row of the sensor and its pixels. As addressed in claim 7, Gao, on page 2 line 3-7, teaches the obtaining the exposure time of each frame of image and the exposure time of each row of pixels of the image sensor. Accordingly, lamp supplementation (flash) is in accordance with the obtainment of turn-on and turn-off times, in accordance with exposure time of each frame and each row of pixels…).
Conclusion
29. Any inquiry concerning this communication or earlier communications from the examiner should be directed to SURAFEL YILMAKASSAYE whose telephone number is (703)756-1910. The examiner can normally be reached Monday-Friday 8:30am-5:00pm.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, TWYLER HASKINS can be reached at (571)272-7406. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/TWYLER L HASKINS/ Supervisory Patent Examiner, Art Unit 2639