CTNF 18/456,030 CTNF 93954 DETAILED ACTION 07-03-aia AIA 15-10-aia The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA. This action is responsive to the original application filed on 8/25/2023. Claim Objections 07-29-01 AIA Claim s 1-9 and 20 are objected to because of the following informalities: Claims 1 and 20 recite the limitation “perform, using one or more machine learning models, at least a first segment of a task and a second segment of a task corresponding to a robot” (emphasis added). The independent and dependent claims appear to suggest that only one task is performed and not a plurality of tasks. For examination purposes, this limitation will be interpreted to mean “perform, using one or more machine learning models, at least a first segment of a task and a second segment of [[a] the task corresponding to a robot” (emphasis added) so that the claims refer to a singular task. Dependent claims 2-9 depend on objected claim 1 , and are also objected to by virtue of this dependency . Appropriate correction is required. Claim Rejections - 35 USC § 101 07-04-01 AIA 07-04 35 U.S.C. 101 reads as follows: Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of this title. Claims 4-6, 8 and 10-19 are rejected under 35 U.S.C 101 because the claimed invention is directed to an abstract idea without significantly more. The analysis of the claims will follow the 2019 Revised Patent Subject Matter Eligibility Guidance, 84 Fed. Reg. 50 (“2019 PEG”). When considering subject matter eligibility under 35 U.S.C. 101, it must be determined whether the claim is directed to one of the four statutory categories of invention, i.e., process, machine, manufacture, or composition of matter (Step 1). If the claim does fall within one of the statutory categories, the second step in the analysis is to determine whether the claim is directed to a judicial exception (Step 2A). The Step 2A analysis is broken into two prongs. In the first prong (Step 2A, Prong 1), it is determined whether or not the claims recite a judicial exception (e.g., mathematical concepts, mental processes, certain methods of organizing human activity). If it is determined in Step 2A, Prong 1 that the claims recite a judicial exception, the analysis proceeds to the second prong (Step 2A, Prong 2), where it is determined whether or not the claims integrate the judicial exception into a practical application. If it is determined at step 2A, Prong 2 that the claims do not integrate the judicial exception into a practical application, the analysis proceeds to determining whether the claim is a patent-eligible application of the exception (Step 2B). If an abstract idea is present in the claim, any element or combination of elements in the claim must be sufficient to ensure that the claim integrates the judicial exception into a practical application, or else amounts to significantly more than the abstract idea itself. Claim 4 Step 1 : The claim recites a processor; therefore, it is directed to the statutory category of a machine. Step 2A Prong 1 : The claim recites, inter alia: wherein the determination that other than imitation learning was unsuccessful is based at least on the robot being unable to move an object from a first pose to a second pose within a predetermined period of time: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of determining that learning is unsuccessful, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. Step 2A Prong 2, Step 2B : The additional elements of “ one or more circuits to: ” amount to generic computer components used as a tool to perform an existing process. The additional elements of “ perform, using one or more machine learning models, at least a first segment of a task and a second segment of a task corresponding to a robot ” amount to reciting only the idea of a solution or outcome i.e., the claim fails to recite details of how a solution to a problem is accomplished because it is not clear how the generic ML models are used to perform a first and second segment of a task. Thus, the additional elements amount to no more than a recitation of the words "apply it" (or an equivalent) or are more than mere instructions to implement an abstract idea or other exception on a computer ( see MPEP § 2106.05(f)). The additional elements of “ wherein the one or more machine learning models are trained to perform the first segment using imitation learning and the one or more machine learning models are trained to perform the second segment using other than the imitation learning ” and “ wherein the one or more machine learning models are trained to perform the first segment using the imitation learning based at least on a determination that other than the imitation learning was unsuccessful for learning to perform the first segment ” amount to no more than generally linking the use of a judicial exception to a particular technological environment or field of use ( see MPEP § 2106.05(h). Taken alone or in combination, the additional elements of the claim do not provide an inventive concept, integrate the abstract ideas into a practical application, or provide significantly more than the abstract ideas of the claim and thus the claim is subject-matter ineligible. Claim 5 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites, inter alia: wherein the determination that other than imitation learning was unsuccessful is based at least on the robot being unable to move a first object from a first pose to a second pose without contacting a second object: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of determining that learning is unsuccessful, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. Step 2A Prong 2, Step 2B : The claim does not recite any additional elements that are sufficient to integrate the judicial exceptions into a practical application or amount to significantly more than the judicial exception. As such, the claim is ineligible. Claim 6 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites, inter alia: wherein the determination that other than imitation learning was unsuccessful is based at least on the robot being unable to move an object from a first pose to a second pose with a predetermined level of precision: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of determining that learning is unsuccessful, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. Step 2A Prong 2, Step 2B : The claim does not recite any additional elements that are sufficient to integrate the judicial exceptions into a practical application or amount to significantly more than the judicial exception. As such, the claim is ineligible. Claim 8 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites, inter alia: wherein a transition pose is determined between the first segment and the second segment, the transition pose corresponding to an end or a beginning of imitation learning: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of determining a transition pose between segments of a task, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. Step 2A Prong 2, Step 2B : The claim does not recite any additional elements that are sufficient to integrate the judicial exceptions into a practical application or amount to significantly more than the judicial exception. As such, the claim is ineligible. Claim 10 Step 1 : The claim recites a system; therefore, it is directed to the statutory category of a machine. Step 2A Prong 1 : The claim recites, inter alia: segment a task to be performed by a robot into segments: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of segmenting a task, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. For example, one can practically and mentally divide or segment a paragraph into sentences for the task of reading a paragraph. determine a first set of instructions of a plurality of sets of instructions for operating the robot to perform a first objective of a first segment of the segments: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of determining instructions for performing a first objective, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. For example, one can practically and mentally read a sentence of a paragraph, the objective being the reading of the sentence. determine that the plurality of sets of instructions is inadequate to perform a second objective of a second segment of the segments: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of determining that instructions are inadequate to perform an objective, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. For example, one can determine that one cannot read a second sentence of a paragraph because it is in a different language. Step 2A Prong 2 : The claim does not recite any additional limitations which integrate the abstract idea into a practical application. Specifically, the additional elements consist of “ one or more processing units to: ”, “ send to a user device of an operator a request for human demonstration of the second segment ”, “ receive from the user device a second set of instructions for operating the robot for the second segment following an end of the first segment ”, and “ update one or more parameters of a machine learning model for controlling the robot using the second set of instructions for the second segment ”. The additional elements of “ one or more processing units to: ” amount to generic computer components used as a tool to perform an existing process. The additional elements of “ update one or more parameters of a machine learning model for controlling the robot using the second set of instructions for the second segment ” amount to reciting only the idea of a solution or outcome i.e., the claim fails to recite details of how a solution to a problem is accomplished because it is not clear how the generic ML model is broadly updated using second instructions. Thus, the additional elements amount to no more than a recitation of the words "apply it" (or an equivalent) or are more than mere instructions to implement an abstract idea or other exception on a computer ( see MPEP § 2106.05(f)). The additional elements “ send to a user device of an operator a request for human demonstration of the second segment ” and “ receive from the user device a second set of instructions for operating the robot for the second segment following an end of the first segment ” are insignificant extra-solution activities ( see MPEP § 2106.05(g)). Thus, even when viewed individually and as an ordered combination, these additional elements do not integrate the abstract idea into a practical application and the claim is thus directed to the abstract idea. Step 2B : Finally, the claim taken as a whole does not contain an inventive concept which provides significantly more than the abstract idea. The additional elements of “ one or more processing units to: ” amount to generic computer components used as a tool to perform an existing process. The additional elements of “ update one or more parameters of a machine learning model for controlling the robot using the second set of instructions for the second segment ” amount to reciting only the idea of a solution or outcome i.e., the claim fails to recite details of how a solution to a problem is accomplished because it is not clear how the generic ML model is broadly updated using second instructions. Thus, the additional elements amount to no more than a recitation of the words "apply it" (or an equivalent) or are more than mere instructions to implement an abstract idea or other exception on a computer ( see MPEP § 2106.05(f)). The additional elements “ send to a user device of an operator a request for human demonstration of the second segment ” and “ receive from the user device a second set of instructions for operating the robot for the second segment following an end of the first segment ” are insignificant extra-solution activities ( see MPEP § 2106.05(g), that are well-understood, routine, conventional activities ( see MPEP §2106.05(d); “Receiving or transmitting data over a network”). Taken alone or in combination, the additional elements of the claim do not provide an inventive concept and thus the claim is subject-matter ineligible. Claim 11 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites the abstract ideas of the preceding claims from which it depends. Step 2A Prong 2, Step 2B : The additional element of “ wherein the plurality of sets of instructions comprises coordinates and vectors for controlling the robot ” amounts to no more than generally linking the use of a judicial exception to a particular technological environment or field of use ( see MPEP § 2106.05(h). Taken alone or in combination, the additional elements of the claim do not provide an inventive concept, integrate the abstract ideas into a practical application, or provide significantly more than the abstract ideas of the claim and thus the claim is subject-matter ineligible. Claim 12 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites the abstract ideas of the preceding claims from which it depends. Step 2A Prong 2, Step 2B : The additional element of “ wherein the second objective comprises moving an object from a first pose to a second pose ” amounts to no more than generally linking the use of a judicial exception to a particular technological environment or field of use ( see MPEP § 2106.05(h). Taken alone or in combination, the additional elements of the claim do not provide an inventive concept, integrate the abstract ideas into a practical application, or provide significantly more than the abstract ideas of the claim and thus the claim is subject-matter ineligible. Claim 13 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites the abstract ideas of the preceding claims from which it depends. Step 2A Prong 2, Step 2B : The additional elements of “ wherein the plurality of sets of instructions is inadequate to perform the second objective based at least on the plurality of sets of instructions being inadequate to at least one of: control the robot to move the object from the first pose to the second pose within a predetermined period of time; control the robot to move the object from the first pose to the second pose without contacting a second object; or control the robot to move the object from the first pose to the second pose with a predetermined level of precision ” amount to no more than generally linking the use of a judicial exception to a particular technological environment or field of use ( see MPEP § 2106.05(h). Taken alone or in combination, the additional elements of the claim do not provide an inventive concept, integrate the abstract ideas into a practical application, or provide significantly more than the abstract ideas of the claim and thus the claim is subject-matter ineligible. Claim 14 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites, inter alia: wherein the one or more processing units are to send the request for human demonstration of the second segment by adding the second segment to a queue of segments for which demonstration is requested: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of adding a segment to a queue, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. Step 2A Prong 2, Step 2B : The claim does not recite any additional elements that are sufficient to integrate the judicial exceptions into a practical application or amount to significantly more than the judicial exception. As such, the claim is ineligible. Claim 15 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites, inter alia: wherein the one or more processing units are to add the second segment to the queue of segments based at least on an expected throughput of the human operator: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of adding a segment to a queue, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. Step 2A Prong 2, Step 2B : The additional element of “ wherein the queue of segments is associated with a human operator ” amounts to no more than generally linking the use of a judicial exception to a particular technological environment or field of use ( see MPEP § 2106.05(h). Taken alone or in combination, the additional elements of the claim do not provide an inventive concept, integrate the abstract ideas into a practical application, or provide significantly more than the abstract ideas of the claim and thus the claim is subject-matter ineligible. Claim 16 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites the abstract ideas of the preceding claims from which it depends. Step 2A Prong 2, Step 2B : The additional element of “ wherein the first objective of the first segment includes reaching a transition pose for transitioning between the first segment and the second segment ” amounts to no more than generally linking the use of a judicial exception to a particular technological environment or field of use ( see MPEP § 2106.05(h). Taken alone or in combination, the additional elements of the claim do not provide an inventive concept, integrate the abstract ideas into a practical application, or provide significantly more than the abstract ideas of the claim and thus the claim is subject-matter ineligible. Claim 17 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites, inter alia: mapping the segments to a human demonstration of the task: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of mapping task segments to a demonstration, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. identifying one or more poses of the robot at a portion of the human demonstration corresponding to a transition from the first segment to the second segment: Under its broadest reasonable interpretation in light of the specification, this limitation encompasses the mental process of identifying a robot pose, which is an evaluation or observation that is practically capable of being performed in the human mind with the assistance of pen and paper. Step 2A Prong 2, Step 2B : The claim does not recite any additional elements that are sufficient to integrate the judicial exceptions into a practical application or amount to significantly more than the judicial exception. As such, the claim is ineligible. Claim 18 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites the abstract ideas of the preceding claims from which it depends. Step 2A Prong 2, Step 2B : The additional element of “ wherein the segments include a plurality of transition poses for transitioning to segments associated with human demonstrations ” amounts to no more than generally linking the use of a judicial exception to a particular technological environment or field of use ( see MPEP § 2106.05(h). Taken alone or in combination, the additional elements of the claim do not provide an inventive concept, integrate the abstract ideas into a practical application, or provide significantly more than the abstract ideas of the claim and thus the claim is subject-matter ineligible. Claim 19 Step 1 : A machine, as above. Step 2A Prong 1 : The claim recites the abstract ideas of the preceding claims from which it depends. Step 2A Prong 2, Step 2B : The additional elements of “ wherein the system is comprised in at least one of: a control system for an autonomous or semi- autonomous machine; … or a system implemented at least partially using cloud computing resources ” amount to no more than generally linking the use of a judicial exception to a particular technological environment or field of use ( see MPEP § 2106.05(h). Taken alone or in combination, the additional elements of the claim do not provide an inventive concept, integrate the abstract ideas into a practical application, or provide significantly more than the abstract ideas of the claim and thus the claim is subject-matter ineligible. Claim Rejections - 35 USC § 102 07-06 AIA 15-10-15 In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status. 07-07-aia AIA 07-07 The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action: A person shall be entitled to a patent unless – 07-08-aia AIA (a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention. 07-15 AIA Claim s 1, 2, 7, and 20 are rejected under 35 U.S.C. 102( a)(1 ) as being anticipated by Gutzeit et al. (Gutzeit et al., “The BesMan learning platform for Automated Robot Skill learning”, May 31, 2018, Front. Robot. AI 5:43, pp. 1-14, hereinafter “Gutzeit”) . Regarding claim 1 , Gutzeit discloses [a] processor, comprising: one or more circuits to (§2; and §3; the sections implement the experiments of Gutzeit, and these experiments are inherently performed using a processor with circuits ) perform, using one or more machine learning models, at least a first segment of a task and a second segment of a task corresponding to a robot, (Page 2, §2; “The ‘Behavior Segmentation’ will decompose demonstrations into simple behavioral building blocks. Segments that belong to the same type of movement are grouped together to obtain multiple demonstrations for the same motion plan”, which discloses segmenting a robotic task into “behavior building blocks” which are discrete sub-tasks or segments of a task corresponding to the robot’s manipulation behavior ; and §2.2; and §2.3; the section discloses performing a first segment of a task using imitation learning that is implemented by a ML model ; and §2.4; the section discloses performing a second segment of a task using reinforcement learning that is implemented by a ML model ; and §4; the task is a ball throwing scenario ) wherein the one or more machine learning models are trained to perform the first segment using imitation learning and the one or more machine learning models are trained to perform the second segment using other than the imitation learning (Page 2, §2; “For each relevant segment, IL methods are used to represent the recorded trajectory segments as motion plans”, which discloses that the imitation learning module learns a motion plan or policy for each segment from human demonstration data ; and §2.3; and Page 3, §2; “To account for this, the “Motion Plan Refinement” module can use RL (see Section 2.4) to adapt the motion plan”, which discloses that for segments where imitation learning produces an inadequate motion plant, the “Motion Plan Refinement” module applies reinforcement learning (a method other than the imitation learning) to adapt the policy ; and §2.4). Regarding claim 20 , it is a method claim corresponding to the steps of claim 1, and is rejected for the same reasons as claim 1. Regarding claim 2 , the rejection of claim 1 is incorporated and Gutzeit further discloses wherein the first segment of the task and the second segment of the task are performed based at least on coordinates and vectors associated with control of the robot (§2.3; the section describes learning motion plans as trajectory functions over robot joint coordinates ; and §2.4; describes RL optimization over the same coordinate-space motion plans ; and Figure 1). Regarding claim 7 , the rejection of claim 1 is incorporated and Gutzeit further discloses wherein, for the second segment, human demonstration is not requested (§2; “the “Motion Plan Refinement” module can use RL (see Section 2.4) to adapt the motion plan. This requires interaction with the real or simulated target system and the specification of a reward function which tells the learning algorithm how well a motion plan solves the task”, without requesting additional human demonstration for the segment ) . Claim Rejections - 35 USC § 103 07-06 AIA 15-10-15 In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status. 07-20-aia AIA The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action: A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made. Claims 3-6 are rejected under 35 U.S.C. § 103 as being obvious over Gutzeit in view of Zadeh et al. (US 20220297303 A1, hereinafter “Zadeh”). Regarding claim 3 , the rejection of claim 1 is incorporated and Gutzeit further discloses wherein the one or more machine learning models are trained to perform the first segment using the imitation learning (§2, and §2.3; the sections disclose that RL is applied when IL does not produce the same result on the robot and the determination of RL inadequacy triggers the use of different methods for the segment ). Gutzeit fails to explicitly disclose but Zadeh discloses a determination that other than the [[imitation]] learning was unsuccessful for learning to perform the first segment ([0004]; “he given robotic control policy can be further trained to determine whether the given robot will fail in performance of the robotic task” ). Gutzeit and Zadeh are analogous art because both are concerned with imitation learning for refining robot control policies. Before the effective filing date of the claimed invention, it would have been obvious to one skilled in imitation learning and robotic control to combine the failure-triggered human demonstration request of Zadeh with the IL/RL framework of Gutzeit to yield to the predictable result of wherein the one or more machine learning models are trained to perform the first segment using the imitation learning based at least on a determination that other than the imitation learning was unsuccessful for learning to perform the first segment . The motivation for doing so would be to enable robots to perform various real-world tasks (Zadeh; [0001]). Regarding claim 4 , the rejection of claims 1 and 3 are incorporated and Gutzeit fails to explicitly disclose but Zadeh discloses wherein the determination that other than imitation learning was unsuccessful is based at least on the robot being unable to move an object from a first pose to a second pose within a predetermined period of time ([0004]; and Figures 3A-3C and Figure 5). The motivation to combine Gutzeit and Zadeh is the same as discussed above with respect to claim 3. Regarding claim 5 , the rejection of claims 1 and 3 are incorporated and Gutzeit fails to explicitly disclose but Zadeh discloses wherein the determination that other than imitation learning was unsuccessful is based at least on the robot being unable to move a first object from a first pose to a second pose without contacting a second object ([0004]; and [0045-0046]; and Figures 3A-3C and Figure 5). The motivation to combine Gutzeit and Zadeh is the same as discussed above with respect to claim 3. Regarding claim 6 , the rejection of claims 1 and 3 are incorporated and Gutzeit fails to explicitly disclose but Zadeh discloses wherein the determination that other than imitation learning was unsuccessful is based at least on the robot being unable to move an object from a first pose to a second pose with a predetermined level of precision ([0004]; and [0045-0046]; and [0080]; and Figures 3A-3C and Figure 5). The motivation to combine Gutzeit and Zadeh is the same as discussed above with respect to claim 3. Claims 9-15, and 19 are rejected under 35 U.S.C. § 103 as being obvious over Gutzeit in view of Zadeh and further in view of Kolluri et al. (US 20210362332 A1, hereinafter “Kolluri1”). Regarding claim 9 , the rejection of claim 1 is incorporated and Gutzeit fails to explicitly disclose but Kolluri1 further discloses wherein an indication is sent to a computing device to indicate human demonstration is required for the imitation learning based at least on a determination that other than imitation learning was unsuccessful in training the one or more machine learning models to perform the first segment ([0198]; “The system generates a user interface presentation that presents a suggested demonstration based on the respective progress value for each demonstration subtask ( 940 ). As discussed above, the user who is configuring a robot to execute a skill template is not expected to be an expert at machine learning or skill templates. Thus, the user interface presentation is designed to guide the user in collecting enough local demonstration data so that there is a high probability of success in getting the robot to perform the task defined by the skill template”, which discloses sending an indication or suggested demonstration to a computing device through a GUI to user to indicate that human demonstration is required based on progress values that would indicate success or not in training the robot ; and [0288-0296]). Gutzeit, Zadeh, and Kolluri1 are analogous art because all are concerned with imitation learning for refining robot control policies. Before the effective filing date of the claimed invention, it would have been obvious to one skilled in imitation learning and robotic control to combine the indication of Kolluri1 with the IL/RL framework of Gutzeit and Zadeh to yield to the predictable result of wherein an indication is sent to a computing device to indicate human demonstration is required for the imitation learning based at least on a determination that other than imitation learning was unsuccessful in training the one or more machine learning models to perform the first segment . The motivation for doing so would be to present a suggested demonstration to be performed by the user based on a respective progress value for each demonstration subtask (Kolluri1; [0288]). Regarding claim 10 , Gutzeit discloses [a] system comprising: one or more processing units to: (§2; and §3; the sections implement the experiments of Gutzeit, and these experiments are inherently performed using a system with processing units ) segment a task to be performed by a robot into segments; (Page 2, §2; “The “Behavior Segmentation” will decompose demonstrations into simple behavioral building blocks. Segments that belong to the same type of movement are grouped together to obtain multiple demonstrations for the same motion plan.” ) determine a first set of instructions of a plurality of sets of instructions for operating the robot to perform a first objective of a first segment of the segments; (§2.3; the section discloses, for each segment, generating motion plans by the IL module, the plans being a set of instructions, that describe trajectories that the robot executes ). Gutzeit fails to explicitly disclose but Zadeh discloses determine that the plurality of sets of instructions is inadequate to perform a second objective of a second segment of the segments;… ([0004]; “determine whether the given robot will fail in performance of the robotic task” ); and Claim 1). receive from the user device a second set of instructions for operating the robot for the second segment following an end of the first segment; and ([0056]; “In additional or alternative implementations, the user may proactively intervene in performance of the robotic task based on the representation of the sequence of actions visually rendered for presentation to the user” ; and Claim 1) update one or more parameters of a machine learning model for controlling the robot using the second set of instructions for the second segment ([0059]; “In some implementations, and subsequent to performance of the semi-autonomous robotic task 330 , the robotic control policy can be automatically updated based on one or more losses generated based on the interventions” ; and Claim 1). Gutzeit and Zadeh are analogous art because both are concerned with imitation learning for refining robot control policies. Before the effective filing date of the claimed invention, it would have been obvious to one skilled in imitation learning and robotic control to combine the failure-triggered human demonstration request of Zadeh with the IL/RL framework of Gutzeit to yield to the predictable result of determine that the plurality of sets of instructions is inadequate to perform a second objective of a second segment of the segments; … receive from the user device a second set of instructions for operating the robot for the second segment following an end of the first segment; and update one or more parameters of a machine learning model for controlling the robot using the second set of instructions for the second segment . The motivation for doing so would be to enable robots to perform various real-world tasks (Zadeh; [0001]). Gutzeit fails to explicitly disclose but Kolluri1 discloses send to a user device of an operator a request for human demonstration of the second segment; ([0198]; “The system generates a user interface presentation that presents a suggested demonstration based on the respective progress value for each demonstration subtask ( 940 ). As discussed above, the user who is configuring a robot to execute a skill template is not expected to be an expert at machine learning or skill templates. Thus, the user interface presentation is designed to guide the user in collecting enough local demonstration data so that there is a high probability of success in getting the robot to perform the task defined by the skill template”, which discloses sending an indication or suggested demonstration to a computing device through a GUI to user to indicate that human demonstration is required based on progress values that would indicate success or not in training the robot ; and [0288-0296]). Gutzeit, Zadeh, and Kolluri1 are analogous art because all are concerned with imitation learning for refining robot control policies. Before the effective filing date of the claimed invention, it would have been obvious to one skilled in imitation learning and robotic control to combine the indication of Kolluri1 with the IL/RL framework of Gutzeit and Zadeh to yield to the predictable result of send to a user device of an operator a request for human demonstration of the second segment . The motivation for doing so would be to present a suggested demonstration to be performed by the user based on a respective progress value for each demonstration subtask (Kolluri1; [0288]). Regarding claim 11 , the rejection of claim 10 is incorporated and Gutzeit further discloses wherein the plurality of sets of instructions comprises coordinates and vectors for controlling the robot (§2.3; the section describes learning motion plans as trajectory functions over robot joint coordinates ; and §2.4; describes RL optimization over the same coordinate-space motion plans ; and Figure 1). Regarding claim 12 , the rejection of claim 10 is incorporated and Gutzeit further discloses wherein the second objective comprises moving an object from a first pose to a second pose (§3; the section describes throwing with a robotic arm that involves moving an object or ball from an initial position or pose to a second position or pose ). Regarding claim 13 , the rejection of claims 10 and 12 are incorporated and Gutzeit fails to explicitly disclose but Zadeh further discloses wherein the plurality of sets of instructions is inadequate to perform the second objective based at least on the plurality of sets of instructions being inadequate to at least one of: control the robot to move the object from the first pose to the second pose within a predetermined period of time; control the robot to move the object from the first pose to the second pose without contacting a second object; or control the robot to move the object from the first pose to the second pose with a predetermined level of precision ([0004]; and [0045-0046]; and [0080]; and Figures 3A-3C and Figure 5). The motivation to combine Gutzeit and Zadeh is the same as discussed above with respect to claim 10. Regarding claim 14 , the rejection of claims 10 and 12 are incorporated and Gutzeit fails to explicitly disclose but Kolluri1 further discloses wherein the one or more processing units are to send the request for human demonstration of the second segment by adding the second segment to a queue of segments for which demonstration is requested ([0198]; “The system generates a user interface presentation that presents a suggested demonstration based on the respective progress value for each demonstration subtask ( 940 ). As discussed above, the user who is configuring a robot to execute a skill template is not expected to be an expert at machine learning or skill templates. Thus, the user interface presentation is designed to guide the user in collecting enough local demonstration data so that there is a high probability of success in getting the robot to perform the task defined by the skill template”, which discloses sending an indication or suggested demonstration to a computing device through a GUI to user to indicate that human demonstration is required based on progress values that would indicate success or not in training the robot ; and [0288-0296]). The motivation to combine Gutzeit, Zadeh, and Kolluri1 is the same as discussed above with respect to claim 10. Regarding claim 15 , the rejection of claims 10 and 12 are incorporated and Gutzeit fails to explicitly disclose but Zadeh further discloses wherein the queue of segments is associated with a human operator, and wherein the one or more processing units are to add the second segment to the queue of segments based at least on an expected throughput of the human operator ([0004]; and [0045-0046]; and [0080]; and Figures 3A-3C and Figure 5). The motivation to combine Gutzeit and Zadeh is the same as discussed above with respect to claim 10. Regarding claim 19 , the rejection of claim 10 is incorporated and Gutzeit further discloses wherein the system is comprised in at least one of: a control system for an autonomous or semi-autonomous machine; a perception system for an autonomous or semi-autonomous machine; a system for performing simulation operations; a system for performing digital twin operations; a system for performing light transport simulation; a system for performing collaborative content creation for 3D assets; a system for performing deep learning operations; a system for generating or presenting at least one of augmented reality content, virtual reality content, or mixed reality content; a system for hosting one or more real-time streaming applications; a system implemented using an edge device; a system implemented using a robot; a system for performing conversational AI operations; a system implementing one or more language models; a system implementing one or more large language models (LLMs); a system for performing one or more generative AI operations; a system for generating synthetic data; a system incorporating one or more virtual machines (VMs); a system implemented at least partially in a data center; or a system implemented at least partially using cloud computing resources (§1; “Autonomous robotic systems can be deployed in unknown or unpredictable, dynamic environments, e.g., in space, search and rescue, and underwater scenarios” ). Claim 8 is rejected under 35 U.S.C. § 103 as being obvious over Gutzeit in view of Payton et al. (US 20150336268 A1, hereinafter “Payton”). Regarding claim 8 , the rejection of claim 1 is incorporated and Gutzeit fails to explicitly disclose but Payton discloses wherein a transition pose is determined between the first segment and the second segment, the transition pose corresponding to an end or a beginning of imitation learning ([0007]; “Using the collected training data set, the controller next performs a time segmentation process in which a processor of the controller divides a time sequence of the task demonstrations into distinct task segments. That is, the time sequence is analyzed via logic of the controller to identify certain transition events between the segments” ; and Claim 1; and [0024]). Gutzeit and Payton are analogous art because both are concerned with robotic task segmentation and learning. Before the effective filing date of the claimed invention, it would have been obvious to one skilled in robotic task segmentation and learning to combine the transition poses of Payton with the IL/RL framework of Gutzeit to yield to the predictable result of wherein a transition pose is determined between the first segment and the second segment, the transition pose corresponding to an end or a beginning of imitation learning . The motivation for doing so would be to provide for rapid robotic imitation learning of force-torque tasks (Payton; [0001]). Claims 16-18 are rejected under 35 U.S.C. § 103 as being obvious over Gutzeit in view of Zadeh and Kolluri1 and Payton. Regarding claim 16 , the rejection of claim 10 is incorporated and Gutzeit fails to explicitly disclose but Payton discloses wherein the first objective of the first segment includes reaching a transition pose for transitioning between the first segment and the second segment ([0007]; “Using the collected training data set, the controller next performs a time segmentation process in which a processor of the controller divides a time sequence of the task demonstrations into distinct task segments. That is, the time sequence is analyzed via logic of the controller to identify certain transition events between the segments” ; and Claim 1; and [0024]). Gutzeit, Zadeh, Kolluri, and Payton are analogous art because all are concerned with robotic task segmentation and learning. Before the effective filing date of the claimed invention, it would have been obvious to one skilled in robotic task segmentation and learning to combine the transition poses of Payton with the IL/RL framework of Gutzeit, Zadeh, and Kolluri to yield to the predictable result of wherein the first objective of the first segment includes reaching a transition pose for transitioning between the first segment and the second segment . The motivation for doing so would be to provide for rapid robotic imitation learning of force-torque tasks (Payton; [0001]). Regarding claim 17 , the rejection of claims 10 and 16 are incorporated and Gutzeit fails to explicitly disclose but Payton discloses mapping the segments to a human demonstration of the task; and identifying one or more poses of the robot at a portion of the human demonstration corresponding to a transition from the first segment to the second segment ([0007]; “Using the collected training data set, the controller next performs a time segmentation process in which a processor of the controller divides a time sequence of the task demonstrations into distinct task segments. That is, the time sequence is analyzed via logic of the controller to identify certain transition events between the segments” ; and Claim 1; and [0024]). The motivation to combine Gutzeit, Zadeh, Kolluri1, and Payton is the same as discussed above with respect to claim 16. Regarding claim 18 , the rejection of claims 10 and 16 are incorporated and Gutzeit fails to explicitly disclose but Payton discloses wherein the segments include a plurality of transition poses for transitioning to segments associated with human demonstrations ([0007]; “Using the collected training data set, the controller next performs a time segmentation process in which a processor of the controller divides a time sequence of the task demonstrations into distinct task segments. That is, the time sequence is analyzed via logic of the controller to identify certain transition events between the segments” ; and Claim 1; and [0024]; and [0008]). The motivation to combine Gutzeit, Zadeh, and Payton is the same as discussed above with respect to claim 16. Conclusion 07-96 AIA The prior art made of record and not relied upon is considered pertinent to applicant's disclosure : Kolluri et al. (US 20210362331 A1). Any inquiry concerning this communication or earlier communications from the examiner should be directed to Brent Hoover whose telephone number is (303)297-4403. The examiner can normally be reached Monday - Friday 9-5 MST. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Abdullah Kawsar can be reached on 571-270-3169. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /BRENT JOHNSTON HOOVER/Primary Examiner, Art Unit 2127 Application/Control Number: 18/456,030 Page 2 Art Unit: 2127 Application/Control Number: 18/456,030 Page 3 Art Unit: 2127 Application/Control Number: 18/456,030 Page 4 Art Unit: 2127 Application/Control Number: 18/456,030 Page 5 Art Unit: 2127 Application/Control Number: 18/456,030 Page 6 Art Unit: 2127 Application/Control Number: 18/456,030 Page 7 Art Unit: 2127 Application/Control Number: 18/456,030 Page 8 Art Unit: 2127 Application/Control Number: 18/456,030 Page 9 Art Unit: 2127 Application/Control Number: 18/456,030 Page 10 Art Unit: 2127 Application/Control Number: 18/456,030 Page 11 Art Unit: 2127 Application/Control Number: 18/456,030 Page 12 Art Unit: 2127 Application/Control Number: 18/456,030 Page 13 Art Unit: 2127 Application/Control Number: 18/456,030 Page 14 Art Unit: 2127 Application/Control Number: 18/456,030 Page 15 Art Unit: 2127 Application/Control Number: 18/456,030 Page 16 Art Unit: 2127 Application/Control Number: 18/456,030 Page 17 Art Unit: 2127 Application/Control Number: 18/456,030 Page 18 Art Unit: 2127 Application/Control Number: 18/456,030 Page 19 Art Unit: 2127 Application/Control Number: 18/456,030 Page 20 Art Unit: 2127 Application/Control Number: 18/456,030 Page 21 Art Unit: 2127 Application/Control Number: 18/456,030 Page 22 Art Unit: 2127 Application/Control Number: 18/456,030 Page 23 Art Unit: 2127 Application/Control Number: 18/456,030 Page 24 Art Unit: 2127 Application/Control Number: 18/456,030 Page 25 Art Unit: 2127 Application/Control Number: 18/456,030 Page 26 Art Unit: 2127 Application/Control Number: 18/456,030 Page 27 Art Unit: 2127
Prosecution Insights