CTNF 19/001,638 CTNF 97661 DETAILED ACTION Notice of Pre-AIA or AIA Status 07-03-aia AIA 15-10-aia The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA. 12-151 AIA 26-51 12-51 Status of Claims • This action is in reply to the Application Number 19/001,638 filed on 12/26/2024. • Claims 1-20 are currently pending and have been examined. • This action is made NON-FINAL. • The examiner would like to note that this application is now being handled by examiner Kai Wang. Priority 02-27 Acknowledgment is made of applicant’s claim for foreign priority under 35 U.S.C. 119 (a)-(d). The certified copy has been filed in Application No. 19/001,638, filed on 02/07/2025. Information Disclosure Statement The information disclosure statement (IDS) submitted on 12/26/2024 is in compliance with the provisions of 37 CFR 1.97. Accordingly, the information disclosure statement is being considered by the examiner. Claim Rejections - 35 USC § 101 07-04-01 AIA 07-04 35 U.S.C. 101 reads as follows: Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of this title. Claims 1, 11 and 18 are rejected under 35 U.S.C. 101 because the claimed invention is directed to an abstract idea without significantly more. The complete step-by-step analysis under 35 U.S.C. 101 is provided below: STEP One : Do Claims 1, 11 and 18 Fall Within One of The Statutory Categories ? Yes, claim 1 and 11 is directed towards a machine, claim 18 is directed towards a method including at least one step. STEP Two A , Prong One: Is a Judicial Exception Recited? Yes, claim 1 recites the limitation of detecting the pedestrian in the acquired video. This limitation, as drafted, is a simple process that, under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of “ a controller”. That is, other than reciting “a controller” nothing in the claim elements precludes the step from practically being performed in the mind. For example, but for the “a vehicle controller” language, the claim encompasses a person looking at video data collected and forming a simple judgement. The mere nominal recitation of by a controller does not take the claim limitations out of the mental process grouping. Thus, the claim 1 recites a mental process. Independent claim 1 includes limitations that recite an abstract idea and will be used as a representative claim for the remainder of the 101 rejection. The other analogous claims 11 and 18 are rejected for the same reasons as the representative claim 1 as discussed here. STEP Two A , Prong Two: Is the Abstract Idea integrated into a Practical Application? No. The claim 1 recites additional elements of acquiring video obtained by imaging, with a camera, a sidewalk along which a pedestrian passes, the sidewalk bordering on a roadway on which an automated driving vehicle travels; and cause a terminal apparatus of an operator of the automated driving vehicle to output a notification that the video is available for display, and displaying the video in response to an operation. The acquiring video step from the sensors and from the external source is recited at a high level of generality (i.e. as a general means of gathering sidewalk road condition data for use in the evaluating step), and amounts to mere data gathering, which is a form of insignificant extra-solution activity. The displaying notification and displaying the video in response to an operation steps on the operator terminal apparatus is also recited at a high level of generality (i.e. as a general means of displaying the evaluation result from the evaluating step), and amounts to mere post solution displaying, which is a form of insignificant extra-solution activity. The “controller” merely describes how to generally “apply” the otherwise mental judgements in a generic or general purpose vehicle control environment. The vehicle control system is recited at a high level of generality and is merely automates the evaluating step. Accordingly, even in combination, these additional elements do not integrate the abstract idea into a practical application because they do not impose any meaningful limits on practicing the abstract idea. The claim is directed to the abstract idea. STEP Two B: Does the Claim as a whole amount to significantly more than the Judicial Exception? No . As discussed with respect to Step 2A Prong Two, the additional elements in the claim amount to no more than insignificant extra-solution activity. Under the 2019 PEG, a conclusion that an additional element is insignificant extra-solution activity in Step 2A should be re-evaluated in Step 2B. Here, the acquiring video step and the displaying step were considered to be extra-solution activity in Step 2A, and thus they are re-evaluated in Step 2B to determine if they are more than what is well-understood, routine, conventional activity in the field. The background recites that the sensors are all conventional camera mounted on the sidewalk, and the specification does not provide any indication that the vehicle controller is anything other than a conventional computer within a vehicle. MPEP 2106.05(d)(II), and the cases cited therein, including Intellectual Ventures I, LLC v. Symantec Corp., 838 F.3d 1307, 1321 (Fed. Cir. 2016), TLI Communications LLC v. AV Auto. LLC, 823 F.3d 607, 610 (Fed. Cir. 2016), and OIP Techs., Inc., v. Amazon.com, Inc., 788 F.3d 1359, 1363 (Fed. Cir. 2015), indicate that mere collection or receipt of data over a network is a well‐understood, routine, and conventional function when it is claimed in a merely generic manner (as it is here). Further, the Federal Circuit in Trading Techs. Int’l v. IBG LLC, 921 F.3d 1084, 1093 (Fed. Cir. 2019), and Intellectual Ventures I LLC v. Erie Indemnity Co., 850 F.3d 1315, 1331 (Fed. Cir. 2017), for example, indicated that the mere displaying of data is a well understood, routine, and conventional function. Accordingly, a conclusion that the collecting step is well-understood, routine, conventional activity is supported under Berkheimer. The claim is ineligible. Dependent claim(s) 2-10, 12-17 and 19-20 do not recite any further limitations that cause the claim(s) to be patent eligible. Rather, the limitations of dependent claims are directed toward additional aspects of the judicial exception and/or additional elements that do not integrate the judicial exception into a practical application. Regarding some of the other examples of additional limitations in the dependent claims such as “transmit a request to the driving assistance apparatus …” (claim 2) and “transmit the notification or video via the communication interface to the terminal apparatus …” (claims 3 and 6), the examiner submits that these limitations are insignificant extra-solution activities that merely use a computer (processor) to perform the process. In particular, sending a message or video data steps are also recited at a high level of generality (i.e. as a general means of sending/transmitting a message requesting data based on previous steps), and amounts to mere post solution action, which is a form of insignificant extra-solution activity. Therefore, dependent claims 2-10, 12-17 and 19-20 are not patent eligible under the same rationale as provided for in the rejection of claim 1 and the explanations provided above. Therefore, claim(s) 1-20 are ineligible under 35 USC §101. Claim Rejections - 35 USC § 103 07-06 AIA 15-10-15 In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status. 07-20-aia AIA The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action: A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made. 07-21-aia AIA Claim (s) 1, 10, 18 are rejected under 35 U.S.C. 103 as being unpatentable over Masuike (US20190221115A1) in view of James (US20230245564A1) and Matsuba (US20220321899A1) . Regarding claims 1 and 18: Masuike teaches: acquire video obtained by imaging, with a camera, ( Masuike , para[63], “the camera constantly photographs images overlooking surroundings of the road on which the roadside device 1 is installed”) a sidewalk along which a pedestrian passes, the sidewalk bordering on a roadway on which a vehicle travels; ( Masuike , Fig. 1 depicts a sidewalk along which a pedestrian passes, the sidewalk bordering on a roadway on which a vehicle travels, and para[63], “the camera constantly photographs images overlooking surroundings of the road on which the roadside device 1 is installed”) PNG media_image1.png 676 603 media_image1.png Greyscale and upon detecting the pedestrian in the acquired video, ( Masuike , para[60], “The roadside device 1 includes … a camera (detector) 3 that detects information for determining the state of the sidewalk ”, and para [69], “Examples of the state of sidewalk are as follows: … presence or absence of pedestrian ”) cause a terminal apparatus of an operator of the vehicle to output a notification ( Masuike , para[127], “the in-vehicle device 110 may notify a driver of the state and the danger level of the sidewalk ”) Masuike does not explicitly teach, but James teaches: A driving assistance apparatus comprising a controller configured to : ( James , para [43], “ an autonomous vehicle as used herein should be understood to encompass a vehicle that includes an advanced driver assist system (ADAS) . An ADAS can automate, adapt, and/or enhance vehicle systems for safety and better driving such as by circumventing or otherwise correcting driver errors.”) an automated driving vehicle ( James , para [43], “The vehicle, such as the vehicle 100, may be an autonomous vehicle or a semi-autonomous vehicle.”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike in order to communicate with a driving assistance apparatus comprising a controller configured for an automated driving vehicle from James . One of ordinary skill in the art would have been motivated to make this modification in order to “determine a potential future collision between the ego vehicle and an other road user” (James, Description). Masuike does not explicitly teach, but Matsuba teaches: a notification that the video is available for display .( Matsuba , para [195], “ a displayed notification indicating that …video frames 129 are ready for display .”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Matsuba in order to output a notification that the video is available for display. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Regarding claim 10: Masuike in view of James and Matsuba, as shown in the rejection above, discloses the limitations of claim 1. Masuike teaches: and a terminal apparatus . ( Masuike , para [17], “one smartphone 200”) Masuike does not explicitly teach, but James teaches: A system comprising: the driving assistance apparatus according to claim 1; ( James , para [43], “ an autonomous vehicle as used herein should be understood to encompass a vehicle that includes an advanced driver assist system (ADAS) .) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike in order to communicate with a driving assistance apparatus comprising a controller configured for an automated driving vehicle from James . One of ordinary skill in the art would have been motivated to make this modification in order to “determine a potential future collision between the ego vehicle and an other road user” (James, Description) . 07-21-aia AIA Claim (s) 2-3, and 19 are rejected under 35 U.S.C. 103 as being unpatentable over Masuike (US20190221115A1) in view of James (US20230245564A1) and Matsuba (US20220321899A1), further in view of Baker (US20170341611A1), Koji (JP2011134087A) and Sun (CN109017767A) . Regarding claims 2 and 19: Masuike in view of James and Matsuba, as shown in the rejection above, discloses the limitations of claim 1 and 18. Masuike teaches: The driving assistance apparatus according to claim 1, further comprising a communication interface configured to communicate with the terminal apparatus , ( Masuike , para[04], “a communication unit configured to communicate with an other device”) Masuike does not explicitly teach, but Baker teaches: upon accepting an operation by the operator to instruct display of the video , ( Baker , para [137], “ operator to accept a video streaming request … the video data being streamed .”) in response to the request, ( Baker , para [137], “ operator to accept a video streaming request .”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Baker in order to include wherein the terminal apparatus is configured to transmit a request to the driving assistance apparatus upon accepting an operation by the operator to instruct display of the video and the controller is configured to transmit, in response to the request, the video via the communication interface to the terminal apparatus. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Koji teaches: wherein the terminal apparatus is configured to transmit a request to the driving assistance apparatus ( Koji , para [07], “ transmits a … operation request to the driving assist device ”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Koji in order to include wherein the terminal apparatus is configured to transmit a request to the driving assistance apparatus. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Sun teaches: and the controller is configured to transmit… the video via the communication interface to the terminal apparatus ( Sun , para [195], “ the terminal establishes a communication connection with the vehicle auxiliary control equipment and receives at least one of the following from the vehicle auxiliary control equipment located on the vehicle … video”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Sun in order to receive the video from the driving assistance apparatus and the controller is configured to start transmitting the video via the communication interface to the terminal apparatus. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Regarding claim 3: Masuike in view of James and Matsuba, Koji, as shown in the rejection above, discloses the limitations of claim 2. Masuike teaches: and the controller is configured to transmit, via the communication interface to the terminal apparatus, ( Masuike , para[04], “a communication unit configured to communicate with an other device”) upon detecting the pedestrian in the video . ( Masuike , para[60], “The roadside device 1 includes … a camera (detector) 3 that detects information for determining the state of the sidewalk ”, and para [69], “Examples of the state of sidewalk are as follows: … presence or absence of pedestrian ”) Masuike does not explicitly teach, but James teaches: from the driving assistance apparatus, ( James , para [43], “ an autonomous vehicle as used herein should be understood to encompass a vehicle that includes an advanced driver assist system (ADAS) . Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike in order to communicate from a driving assistance apparatus of an automated driving vehicle from James . One of ordinary skill in the art would have been motivated to make this modification in order to “determine a potential future collision between the ego vehicle and an other road user” (James, Description). Masuike does not explicitly teach, but Matsuba teaches: The driving assistance apparatus according to claim 2, wherein the terminal apparatus is configured to output the notification that the video is available for display upon receiving, ( Matsuba , para [195], “ a displayed notification indicating that …video frames 129 are ready for display .”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Matsuba in order to include wherein the terminal apparatus is configured to output the notification that the video is available for display upon receiving. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Baker teaches: a notification that the video is available for transmission, ( Baker , para [137], “ the user device controller 810 is/are configured to receive … notification … the video data being streamed .”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Baker in order to include a notification that the video is available for transmission. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles . 07-21-aia AIA Claim (s) 4-5 and 20 are rejected under 35 U.S.C. 103 as being unpatentable over Masuike (US20190221115A1) in view of James (US20230245564A1) and Matsuba (US20220321899A1), further in view of Baker (US20170341611A1) and Sun (CN109017767A) . Regarding claim 4 and 20: Masuike in view of James and Matsuba, as shown in the rejection above, discloses the limitations of claim 1 and 18. Masuike teaches: The driving assistance apparatus according to claim 1, further comprising a communication interface configured to communicate with the terminal apparatus, ( Masuike , para[04], “a communication unit configured to communicate with an o ther device ”) Masuike does not explicitly teach, but Baker teaches: wherein the terminal apparatus is configured to start displaying the video upon accepting an operation by the operator to instruct display of the video, ( Baker , para [137], “ the user device controller 810 is/are configured to receive the safety event notification and to display an invitation to the user or operator to accept a video streaming request relating to the safety event. … the video data being streamed .”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Baker in order to include wherein the terminal apparatus is configured to start displaying the video upon accepting an operation by the operator to instruct display of the video. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Sun teaches: and the controller is configured to continue transmitting the video via the communication interface to the terminal apparatus, regardless of presence or absence of a request from the terminal apparatus . ( Sun , para [195], “ the terminal establishes a communication connection with the vehicle auxiliary control equipment and receives at least one of the following from the vehicle auxiliary control equipment located on the vehicle … video”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Sun in order to receive the video from the driving assistance apparatus and the controller is configured to start transmitting the video via the communication interface to the terminal apparatus regardless of presence or absence of a request from the terminal apparatus. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Regarding claim 5: Masuike in view of James and Matsuba, as shown in the rejection above, discloses the limitations of claim 4. Masuike teaches: upon detecting the pedestrian in the video . ( Masuike , para[60], “The roadside device 1 includes … a camera (detector) 3 that detects information for determining the state of the sidewalk ”, and para [69], “Examples of the state of sidewalk are as follows: … presence or absence of pedestrian ”) Masuike does not explicitly teach, but Matsuba teaches: The driving assistance apparatus according to claim 4, wherein the terminal apparatus is configured to output the notification that the video is available for display ( Matsuba , para [195], “ a displayed notification indicating that …video frames 129 are ready for display .”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Matsuba in order to output a notification that the video is available for display. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Sun teaches: upon starting to receive the video from the driving assistance apparatus, ( Sun , para [195], “ receives at least one of the following from the vehicle auxiliary control equipment located on the vehicle … video”) and the controller is configured to start transmitting the video via the communication interface to the terminal apparatus, ( Sun , para [195], “ the terminal establishes a communication connection with the vehicle auxiliary control equipment and receives at least one of the following from the vehicle auxiliary control equipment located on the vehicle … video”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Sun in order to receive the video from the driving assistance apparatus and the controller is configured to start transmitting the video via the communication interface to the terminal apparatus. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles . 07-21-aia AIA Claim (s) 6-7, 9 are rejected under 35 U.S.C. 103 as being unpatentable over Masuike (US20190221115A1) in view of James (US20230245564A1) and Matsuba (US20220321899A1), further in view of Baker (US20170341611A1), Sun (CN109017767A), Koyama (US20210027496A1) and Chen (US 20160004915 A1) . Regarding claim 6: Masuike in view of James and Matsuba, as shown in the rejection above, discloses the limitations of claim 1. Masuike teaches: The driving assistance apparatus according to claim 1, further comprising a communication interface configured to communicate with the terminal apparatus, wherein the controller is configured to: ( Masuike , para[04], “a communication unit configured to communicate with an other device”) Masuike does not explicitly teach, but Sun teaches: transmit the video via the communication interface to the terminal apparatus, ( Sun , para [195], “ the terminal establishes a communication connection with the vehicle auxiliary control equipment and receives at least one of the following from the vehicle auxiliary control equipment located on the vehicle … video”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Sun in order to transmit the video via the communication interface to the terminal apparatus. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Baker teaches: in response to a request from the terminal apparatus or regardless of presence or absence of a request from the terminal apparatus; ( Baker , para [137], “ the user device controller 810 is/are configured to receive … a video streaming request relating to the safety event. … the video data being streamed .”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Baker in order to in response to a request from the terminal apparatus or regardless of presence or absence of a request from the terminal apparatus. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Koyama teaches: and end transmission of the video ( Koyama , para [359], “ stop transmission of the video data”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Koyama in order to end transmission of the video. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Chen teaches: when an end condition is met .( Chen , para [37], “vehicles may pass through the camera ”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Chen in order to end transmission of the video when an end condition is met. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Regarding claim 7: Masuike in view of James and Matsuba, Baker, Sun , Koyama and Chen as shown in the rejection above, discloses the limitations of claim 6. Masuike does not explicitly teach, but Chen teaches: The driving assistance apparatus according to claim 6, wherein the end condition includes a condition that the automated driving vehicle has passed by a location in which the camera is installed . ( Chen , para [37], “vehicles may pass through the camera ”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Chen in order to include wherein the end condition includes a condition that the automated driving vehicle has passed by a location in which the camera is installed. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Regarding claim 9: Masuike in view of James and Matsuba, Baker, Sun , Koyama and Chen as shown in the rejection above, discloses the limitations of claim 7. Masuike teaches: The driving assistance apparatus according to claim 7, wherein the location is a crosswalk on the roadway or in a vicinity of the crosswalk. ( Masuike , Fig. 1 depicts a location is a crosswalk on the roadway or in a vicinity of the crosswalk) PNG media_image1.png 676 603 media_image1.png Greyscale 07-21-aia AIA Claim (s) 8 is rejected under 35 U.S.C. 103 as being unpatentable over Masuike (US20190221115A1) in view of James (US20230245564A1) and Matsuba (US20220321899A1), further in view of Baker (US20170341611A1), Sun (CN109017767A), Koyama (US20210027496A1), Chen (US 20160004915 A1) and Stonecypher (US 20050134982 A1) Regarding claim 8: Masuike in view of James and Matsuba, Baker, Sun , Koyama and Chen as shown in the rejection above, discloses the limitations of claim 7. Masuike does not explicitly teach, but Stonecypher teaches: The driving assistance apparatus according to claim 7, wherein the location is a blind spot from the roadway or in a vicinity of the blind spot. (, para [33], “entering into the blind spot area on a roadway ”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Stonecypher in order to include wherein the location is a blind spot from the roadway or in a vicinity of the blind spot. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles . 07-21-aia AIA Claim (s) 11 is rejected under 35 U.S.C. 103 as being unpatentable over Masuike (US20190221115A1) in view of James (US20230245564A1) and Matsuba (US20220321899A1), further in view of Baker (US20170341611A1) . Regarding claim 11: Masuike teaches: A non-transitory computer readable medium storing a program configured to cause a computer to execute operations, the operations comprising ( Masuike , para [06], “A computer -readable non-transitory storage medium storing a control program for controlling a roadside device to execute the steps of detecting information for determining a state of a sidewalk around the roadside device”) the video being obtained by imaging, with a camera, a sidewalk along which a pedestrian passes, the sidewalk bordering on a roadway on which a vehicle travels; ( Masuike , para[63], “the camera constantly photographs images overlooking surroundings of the road on which the roadside device 1 is installed”, Fig. 1 depicts a sidewalk along which a pedestrian passes, the sidewalk bordering on a roadway on which a vehicle travels, and para[63], “the camera constantly photographs images overlooking surroundings of the road on which the roadside device 1 is installed”, para[60], “The roadside device 1 includes … a camera (detector) 3 that detects information for determining the state of the sidewalk ”, and para [69], “Examples of the state of sidewalk are as follows: … presence or absence of pedestrian ”) Masuike does not explicitly teach, but James teaches: an automated driving vehicle ( James , para [43], “The vehicle, such as the vehicle 100, may be an autonomous vehicle or a semi-autonomous vehicle.”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike in order to communicate with a driving assistance apparatus comprising a controller configured for an automated driving vehicle from James . One of ordinary skill in the art would have been motivated to make this modification in order to “determine a potential future collision between the ego vehicle and an other road user” (James, Description). Masuike does not explicitly teach, but Matsuba teaches: outputting a notification that video is available for display, ( Matsuba , para [195], “ a displayed notification indicating that …video frames 129 are ready for display .”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Matsuba in order to output a notification that the video is available for display. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Baker teaches: and displaying the video in response to an operation, by an operator, to instruct display of the video. ( Baker , para [137], “ operator to accept a video streaming request … the video data being streamed .”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Baker in order to display the video in response to an operation, by an operator, to instruct display of the video. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles . 07-21-aia AIA Claim (s) 12 is rejected under 35 U.S.C. 103 as being unpatentable over Masuike (US20190221115A1) in view of James (US20230245564A1) and Matsuba (US20220321899A1), further in view of Baker (US20170341611A1), Koji (JP2011134087A), and Sun (CN109017767A) . Regarding claim 12: Masuike in view of James and Matsuba, Baker, as shown in the rejection above, discloses the limitations of claim 11. Masuike does not explicitly teach, but Koji teaches: The non-transitory computer readable medium according to claim 11, wherein the displaying includes: transmitting a request to a driving assistance apparatus ( Koji , para [07], “ transmits a … operation request to the driving assist device ”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Koji in order to include wherein the terminal apparatus is configured to transmit a request to the driving assistance apparatus. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Baker teaches: upon accepting the operation; ( Baker , para [137], “ accept a video streaming request ”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Baker in order to include upon accepting an operation. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Sun teaches: receiving the video from the driving assistance apparatus; ( Sun , para [195], “ receives at least one of the following from the vehicle auxiliary control equipment … video”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Sun in order to receive the video from the driving assistance apparatus a. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Matsuba teaches: and displaying the received video .(, para [193], “ received from another device to generate the reconstructed video frames 129 for display ”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Matsuba in order to display the received video. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles . 07-21-aia AIA Claim (s) 13 is rejected under 35 U.S.C. 103 as being unpatentable over Masuike (US20190221115A1) in view of James (US20230245564A1) and Matsuba (US20220321899A1), further in view of Baker (US20170341611A1), and Sun (CN109017767A) . Regarding claim 13: Masuike in view of James and Matsuba, Baker, as shown in the rejection above, discloses the limitations of claim 11. Masuike does not explicitly teach, but Sun teaches: The non-transitory computer readable medium according to claim 11, wherein the operations further comprise receiving the video from the driving assistance apparatus, ( Sun , para [195], “ receives at least one of the following from the vehicle auxiliary control equipment … video”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Sun in order to receive the video from the driving assistance apparatus a. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Masuike does not explicitly teach, but Baker teaches: and the displaying includes starting to display the received video upon accepting the operation . ( Baker , para [137], “ the user device controller 810 is/are configured to receive the safety event notification and to display an invitation to the user or operator to accept a video streaming request relating to the safety event. … the video data being streamed .”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Baker in order to display the received video upon accepting the operation. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles . 07-21-aia AIA Claim (s) 14-16 are rejected under 35 U.S.C. 103 as being unpatentable over Masuike (US20190221115A1) in view of James (US20230245564A1) and Matsuba (US20220321899A1), further in view of Baker (US20170341611A1), and Gravina (WO2006127673A1) . Regarding claim 14: Masuike in view of James and Matsuba, Baker, as shown in the rejection above, discloses the limitations of claim 11. Masuike does not explicitly teach, but Gravina teaches: The non-transitory computer readable medium according to claim 11, wherein the notification includes a graphic element to accept the operation . ( Gravina , Fig. 8B depicts that the keys may comprise a touch sensitive display device, or a touch-sensitive area of a multi-purpose display device, that displays button graphics and accepts button presses”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Gravina in order to include a graphic element to accept the operation. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Regarding claim 15: Masuike in view of James and Matsuba, Baker, Gravina as shown in the rejection above, discloses the limitations of claim 14. Masuike does not explicitly teach, but Gravina teaches: The non-transitory computer readable medium according to claim 14, wherein the operation is a tap on the graphic element . ( Gravina , Fig. 8B depicts that the keys may comprise a touch sensitive display device, or a touch-sensitive area of a multi-purpose display device, that displays button graphics and accepts button presses ”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Gravina in order to include wherein the operation is a tap on the graphic element. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles. Regarding claim 16: Masuike in view of James and Matsuba, Baker, Gravina as shown in the rejection above, discloses the limitations of claim 14. Masuike does not explicitly teach, but Gravina teaches: The non-transitory computer readable medium according to claim 14, wherein the graphic element is a button . ( Gravina , Fig. 8B depicts that the keys may comprise a touch sensitive display device, or a touch-sensitive area of a multi-purpose display device, that displays button graphics and accepts button presses ”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Gravina in order to include wherein the graphic element is a button. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles . 07-21-aia AIA Claim (s) 17 is rejected under 35 U.S.C. 103 as being unpatentable over Masuike (US20190221115A1) in view of James (US20230245564A1) and Matsuba (US20220321899A1), further in view of Baker (US20170341611A1), Gravina (WO2006127673A1) and Molin (US20160086033A1) . Regarding claim 17: Masuike in view of James and Matsuba, Baker, Gravina as shown in the rejection above, discloses the limitations of claim 14. Masuike does not explicitly teach, but Molin teaches: The non-transitory computer readable medium according to claim 14, wherein the graphic element is an icon indicating the pedestrian .( Molin , para [32], “generates a graphic representing the pedestrian ”) Therefore, it would have been obvious to one of ordinary skill in the art, before the effective filing date of the claimed invention, to modify road side device from Masuike to include these above teachings from Molin in order to include wherein the graphic element is an icon indicating the pedestrian. One of ordinary skill in the art would have been motivated to make this modification in order to improve safety in the operation of automated driving vehicles . Conclusion 07-96 AIA The prior art made of record and not relied upon is considered pertinent to applicant's disclosure. AOI (US20180229743A1) teaches an automated driving assistance apparatus is an automated driving assistance apparatus for assisting automated driving of a passenger car, and includes a position detection unit and a notification control unit. Takehara (US20220219686A1) teaches a vehicle driving assistance system includes a vehicle side communication system and a base point side communication system. The vehicle driving assistance system is configured so that the video image information from a vehicle can be transmitted according to the situation of driving assistance. Kim (US10780897B2) teaches a method and a device for signaling a current driving intention of an autonomous vehicle to others; and more particularly, to the method and the device for setting a driving plan of the autonomous vehicle by estimating a crosswalking trajectory of a pedestrian crossing a roadway of the autonomous vehicle, and if the pedestrian is not paying attention to the autonomous vehicle, allowing the pedestrian to be aware of a driving intention of the autonomous vehicle via at least one of an external display and an external speaker. Any inquiry concerning this communication or earlier communications from the examiner should be directed to KAI NMN WANG whose telephone number is (571)270-5633. The examiner can normally be reached Mon-Fri 0800-1700. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Rachid Bendidi can be reached on (571) 272-4896. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /KAI NMN WANG/Examiner, Art Unit 3664 /REDHWAN K MAWARI/Primary Examiner, Art Unit 3664 Application/Control Number: 19/001,638 Page 2 Art Unit: 3664 Application/Control Number: 19/001,638 Page 3 Art Unit: 3664 Application/Control Number: 19/001,638 Page 4 Art Unit: 3664 Application/Control Number: 19/001,638 Page 5 Art Unit: 3664 Application/Control Number: 19/001,638 Page 6 Art Unit: 3664 Application/Control Number: 19/001,638 Page 7 Art Unit: 3664 Application/Control Number: 19/001,638 Page 8 Art Unit: 3664 Application/Control Number: 19/001,638 Page 9 Art Unit: 3664 Application/Control Number: 19/001,638 Page 10 Art Unit: 3664 Application/Control Number: 19/001,638 Page 11 Art Unit: 3664 Application/Control Number: 19/001,638 Page 12 Art Unit: 3664 Application/Control Number: 19/001,638 Page 13 Art Unit: 3664 Application/Control Number: 19/001,638 Page 14 Art Unit: 3664 Application/Control Number: 19/001,638 Page 15 Art Unit: 3664 Application/Control Number: 19/001,638 Page 16 Art Unit: 3664 Application/Control Number: 19/001,638 Page 17 Art Unit: 3664 Application/Control Number: 19/001,638 Page 18 Art Unit: 3664 Application/Control Number: 19/001,638 Page 19 Art Unit: 3664 Application/Control Number: 19/001,638 Page 20 Art Unit: 3664 Application/Control Number: 19/001,638 Page 21 Art Unit: 3664 Application/Control Number: 19/001,638 Page 22 Art Unit: 3664 Application/Control Number: 19/001,638 Page 24 Art Unit: 3664 Application/Control Number: 19/001,638 Page 25 Art Unit: 3664 Application/Control Number: 19/001,638 Page 26 Art Unit: 3664 Application/Control Number: 19/001,638 Page 27 Art Unit: 3664 Application/Control Number: 19/001,638 Page 28 Art Unit: 3664 Application/Control Number: 19/001,638 Page 29 Art Unit: 3664 Application/Control Number: 19/001,638 Page 30 Art Unit: 3664 Application/Control Number: 19/001,638 Page 31 Art Unit: 3664 Application/Control Number: 19/001,638 Page 32 Art Unit: 3664 Application/Control Number: 19/001,638 Page 33 Art Unit: 3664
Prosecution Insights