Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
DETAILED ACTION
This action is responsive to the Application filed on 8/19/2024. Claims 1-12, and 15-22 are pending in the case. Claims 1, 15, and 19 are independent claims.
Claim Rejections - 35 U.S.C. § 101
35 U.S.C. § 101 reads as follows:
Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of this title.
Claims 1-12, and 15-22 are rejected under 35 U.S.C. § 101 because the claimed invention is directed to an abstract idea without significantly more.
When considering subject matter eligibility under 35 U.S.C. 101, it must be determined whether the claim is directed to one of the four statutory categories of invention, i.e., process, machine, manufacture, or composition of matter (Step 1). If the claim does fall within one of the statutory categories, the second step in the analysis is to determine whether the claim is directed to a judicial exception (Step 2A). The Step 2A analysis is broken into two prongs. In the first prong (Step 2A, Prong 1), it is determined whether or not the claims recite a judicial exception (e.g., mathematical concepts, mental processes, certain methods of organizing human activity). If it is determined in Step 2A, Prong 1 that the claims recite a judicial exception, the analysis proceeds to the second prong (Step 2A, Prong 2), where it is determined whether or not the claims integrate the judicial exception into a practical application. If itis determined at step 2A, Prong 2 that the claims do not integrate the judicial exception into a practical application, the analysis proceeds to determining whether the claim is a patent-eligible application of the exception (Step 2B). If an abstract idea is present in the claim, any element or combination of elements in the claim must be sufficient to ensure that the claim integrates the judicial exception into a practical application, or else amounts to significantly more than the abstract idea itself. Applicant is advised to consult the 2019 PEG for more details of the analysis.
Step 1 Analysis: Is the claim to a process, machine, manufacture or composition of matter? See MPEP § 2106.03.
Claims 1-12 are drawn to a method, claims 15-18 are drawn to a system and claims 20-22 are drawn to computer-readable storage media, therefore each of these claim groups falls under one of four categories of statutory subject matter (machine/products/apparatus, process/method, manufactures and compositions of matter; Step 1). Nonetheless, the claims are directed to a judicially recognized exception of an abstract idea without significant more (Step 2A, see below). Independent claims 1, 15 and 19 are non-verbatim but similar in claim construction, hence share the same rationale that the claimed inventions are directed to non-statutory subject matter as follows:
As to claim 1:
Step 2A Prong One Analysis: Does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1).
Yes, the limitation “computing a gradient with respect to the student parameters of a loss function that includes a first term that measures, for each of the modified training inputs, a loss between (i) the student output for the modified training input and (ii) the teacher output for the modified training input; and updating the student parameters using the gradient” is the abstract idea of a mathematical relationship, as directed to “a mathematical relationship is a relationship between variables or numbers. A mathematical relationship may be expressed in words or using mathematical symbols”. See MPEP § 2106.04(a)(2)(I)(A).
Yes, the limitation “processing the training input using … to generate a latent representation of the training input, and generating one or more modified training inputs using the latent representation, wherein generating each of the modified training inputs comprises: generating, from the latent representation of the training input, a modified latent representation; and processing the modified latent representation using … to generate the modified training input;” is the abstract idea of a mental process that can practically be performed in the human mind, with or without the use of a physical aid such as pen and paper (including an observation, evaluation, judgment, opinion). See MPEP § 2106.04(a)(2)(III).
Step 2A Prong Two Analysis: Does the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d).
No, this limitation “an encoder neural network”, “a decoder neural network”, “the student neural network”, “a teacher neural network” are additional elements that amounts to adding the words “apply it” (or an equivalent) with the judicial exception and reciting only the idea of a solution or outcome, i.e., the claim fails to recite details of how a solution to a problem is accomplished because it is unclear how the “an encoder neural network”, “a decoder neural network”, “the student neural network”, “a teacher neural network” are used nor the specification makes it clear how these actions are performed. Thus, these additional elements are recited in a manner that represent no more than mere instructions to apply the judicial exceptions on a computer. See MPEP § 2106.05(f) and § 2106.04(d).
No, this limitation “obtaining a batch comprising one or more training inputs; generating a plurality of modified training inputs, comprising, for each of the one or more training inputs” amounts to mere data gathering. It is necessary to acquire the data in order to use the recited judicial exception to perform “obtaining”. Therefore, the additional limitation is insignificant extra-solution activity to the judicial exception, and as such is deemed insufficient to transform the judicial exception to a patentable invention. See MPEP §§ 2106.04(d), 2106.05(g).
No, This limitation “processing each of the plurality of modified training inputs using … to generate a respective student output for the machine learning task for each of the modified training inputs”, “processing each of the plurality of modified training inputs using … to generate a respective teacher output for the machine learning task for each of the modified training inputs, wherein … has been pre-trained to perform the machine learning task” are merely a post-solution step and as such is an additional element that amounts to adding insignificant extra-solution activity to the judicial exception. See MPEP §§ 2106.04(d), 2106.05(g).
Accordingly, these additional elements do not integrate the abstract idea into a practical application because they do not impose any meaningful limits on practicing the abstract idea when considered as an ordered combination and as a whole.
Step 2B Analysis: Does the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05.
First, the additional elements directed to generally linking the use of a judicial exception to a particular technological environment or field of use are deemed insufficient to transform the judicial exception to a patentable invention because the claimed limitations generally link the judicial exception to the technology environment, see MPEP 2106.05(h). However, they are included below for the sake of completeness.
Second, the additional elements mere application of the abstract idea or mere instructions to implement an abstract idea on a computer are deemed insufficient to transform the judicial exception to a patentable invention because the limitations generally apply the use of a generic computer and/or process with the judicial exception. See MPEP 2106.05(f). However, they are included below for the sake of completeness.
No, this limitation “an encoder neural network”, “a decoder neural network”, “the student neural network”, “a teacher neural network” are additional elements that amounts to adding the words “apply it” (or an equivalent) with the judicial exception and reciting only the idea of a solution or outcome, i.e., the claim fails to recite details of how a solution to a problem is accomplished because it is unclear how the “an encoder neural network”, “a decoder neural network”, “the student neural network”, “a teacher neural network” are used nor the specification makes it clear how these actions are performed. Thus, these additional elements are recited in a manner that represent no more than mere instructions to apply the judicial exceptions on a computer. See MPEP § 2106.05(f) and § 2106.04(d).
No, this limitation “obtaining a batch comprising one or more training inputs; generating a plurality of modified training inputs, comprising, for each of the one or more training inputs” amounts to mere data gathering. It is necessary to acquire the data in order to use the recited judicial exception to perform “obtaining”. Therefore, the additional limitation is insignificant extra-solution activity to the judicial exception, and as such is deemed insufficient to transform the judicial exception to a patentable invention. See MPEP §§ 2106.04(d), 2106.05(g). Furthermore the additional element is directed to receiving or transmitting data over a network / performing repetitive calculations / electronic recordkeeping / storing and retrieving information in memory / electronically scanning or extracting data from a physical document, which the courts have recognized as well‐understood, routine, and conventional when they are claimed in a generic manner. See MPEP § 2106.05(d)(II).
No, This limitation “processing each of the plurality of modified training inputs using … to generate a respective student output for the machine learning task for each of the modified training inputs”, “processing each of the plurality of modified training inputs using … to generate a respective teacher output for the machine learning task for each of the modified training inputs, wherein … has been pre-trained to perform the machine learning task” are merely a post-solution step and as such is an additional element that amounts to adding insignificant extra-solution activity to the judicial exception. See MPEP §§ 2106.04(d), 2106.05(g).
Thus, considering the additional elements individually and in combination and the claims as a whole, the additional elements do not provide significantly more than the abstract idea. The claims are not eligible subject matter.
Therefore, in examining elements as recited by the limitations individually and as an ordered combination, as a whole the independent claim limitations do not recite what have the courts have identified as “significantly more”.
Furthermore, regarding dependent claims 2-12 which are dependent on claim 1, claims 16-18 which are dependent on claim 15, and claims 20-22 which are dependent on claim 19, the claims are directed to a judicial exception without significantly more as highlighted below in the claim limitations by evaluating the claim limitations under Step 2A and 2B:
Dependent claims 2, 16 and 20
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Yes, the limitation “computing a gradient with respect to the student parameters of a loss function that includes a first term that measures, for each of the modified training inputs, a loss between (i) the student output for the modified training input and (ii) the teacher output for the modified training input; and updating the student parameters using the gradient” is the abstract idea of a mathematical relationship, as directed to “a mathematical relationship is a relationship between variables or numbers. A mathematical relationship may be expressed in words or using mathematical symbols”. See MPEP § 2106.04(a)(2)(I)(A).
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) No, This limitation “processing each of the one or more training inputs using the student neural network to generate a respective student output for the machine learning task for each of the one or more training inputs; and processing each of the one or more training inputs using the teacher neural network to generate a respective teacher output for the machine learning task for each of the one or more training inputs” are merely a post-solution step and as such is an additional element that amounts to adding insignificant extra-solution activity to the judicial exception. See MPEP §§ 2106.04(d), 2106.05(g).
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? No, This limitation “processing each of the one or more training inputs using the student neural network to generate a respective student output for the machine learning task for each of the one or more training inputs; and processing each of the one or more training inputs using the teacher neural network to generate a respective teacher output for the machine learning task for each of the one or more training inputs” are merely a post-solution step and as such is an additional element that amounts to adding insignificant extra-solution activity to the judicial exception. See MPEP §§ 2106.04(d), 2106.05(g).
Dependent claims 3, 17 and 21
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Yes, the limitation “obtaining a respective target output for each training input, wherein the loss function includes a third term that measures, for each training input, a loss between (i) the student output for the training input and (ii) the target output for the training input” is the abstract idea of a mathematical relationship, as directed to “a mathematical relationship is a relationship between variables or numbers. A mathematical relationship may be expressed in words or using mathematical symbols”. See MPEP § 2106.04(a)(2)(I)(A).
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) No
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? No.
Dependent claims 4, 18 and 22
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Yes, the limitation “wherein generating, from the latent representation of the training input, a modified latent representation comprises: sampling noise from a noise distribution; and generating the modified latent representation by applying the sampled noise to the latent representation of the training input.” is the abstract idea of a mental process that can practically be performed in the human mind, with or without the use of a physical aid such as pen and paper (including an observation, evaluation, judgment, opinion). See MPEP § 2106.04(a)(2)(III).
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) No.
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? No.
Dependent claim 5
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Yes, the limitation “computing a gradient with respect to the current modified latent representation of a loss between the student output for the updated modified training input and the teacher output for the updated modified training input; and updating the current modified latent representation using the gradient.” is the abstract idea of a mathematical relationship, as directed to “a mathematical relationship is a relationship between variables or numbers. A mathematical relationship may be expressed in words or using mathematical symbols”. See MPEP § 2106.04(a)(2)(I)(A).
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) No, This limitation “processing the current modified latent representation using the decoder neural network to generate an updated modified training input; processing the updated modified training input using the student neural network to generate a student output for the machine learning task for the updated modified training input; processing the updated modified training input using the teacher neural network to generate a teacher output for the machine learning task for the updated modified training input;” are merely a post-solution step and as such is an additional element that amounts to adding insignificant extra-solution activity to the judicial exception. See MPEP §§ 2106.04(d), 2106.05(g).
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? No, This limitation “processing the current modified latent representation using the decoder neural network to generate an updated modified training input; processing the updated modified training input using the student neural network to generate a student output for the machine learning task for the updated modified training input; processing the updated modified training input using the teacher neural network to generate a teacher output for the machine learning task for the updated modified training input;” are merely a post-solution step and as such is an additional element that amounts to adding insignificant extra-solution activity to the judicial exception. See MPEP §§ 2106.04(d), 2106.05(g).
Dependent claim 6
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Yes, the limitation “for a first gradient ascent step, the current modified latent representation is the latent representation of the training input, for each gradient ascent step after the first gradient ascent step, the current modified latent representation is the updated modified latent representation after a preceding gradient ascent step, and the modified latent representation is the updated modified latent representation after the last gradient ascent step.” is the abstract idea of a mental process that can practically be performed in the human mind, with or without the use of a physical aid such as pen and paper (including an observation, evaluation, judgment, opinion). See MPEP § 2106.04(a)(2)(III).
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) No.
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? No.
Dependent claim 7
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Yes, the limitation “wherein computing a gradient with respect to the current modified latent representation of a loss between the student output for the updated modified training input and the teacher output for the updated modified training input comprises: backpropagating gradients through the student neural network” is the abstract idea of a mathematical relationship, as directed to “a mathematical relationship is a relationship between variables or numbers. A mathematical relationship may be expressed in words or using mathematical symbols”. See MPEP § 2106.04(a)(2)(I)(A).
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) No.
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? No.
Dependent claim 8
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Yes, the limitation “wherein the encoder neural network and the decoder neural network have been trained jointly on an objective that includes one or more terms that encourage reconstructions of received inputs to be similar to the corresponding received inputs, wherein each reconstruction is generated by processing the received input using the encoder neural network to generate a latent representation of the received input and processing the latent representation of the received input using the decoder neural network to generate the reconstruction of the received input.” is the abstract idea of a mental process that can practically be performed in the human mind, with or without the use of a physical aid such as pen and paper (including an observation, evaluation, judgment, opinion). See MPEP § 2106.04(a)(2)(III).
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) No.
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? No.
Dependent claim 9
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Incorporates abstract idea of independent claim
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) This limitation “after training the student neural network, deploying the student neural network on an edge device for generating new output for new inputs received at the edge device” is an additional element that generally links the use of the judicial exception to a particular technological environment or field of use, and as such is deemed insufficient to transform the judicial exception to a patentable invention. See MPEP §§ 2106.04(d), 2106.05(h).
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? This limitation “after training the student neural network, deploying the student neural network on an edge device for generating new output for new inputs received at the edge device” is an additional element that generally links the use of the judicial exception to a particular technological environment or field of use, and as such is deemed insufficient to transform the judicial exception to a patentable invention. See MPEP §§ 2106.04(d), 2106.05(h).
Dependent claim 10
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Incorporates abstract idea of independent claim
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) This limitation “wherein the edge device is a mobile device.” is an additional element that generally links the use of the judicial exception to a particular technological environment or field of use, and as such is deemed insufficient to transform the judicial exception to a patentable invention. See MPEP §§ 2106.04(d), 2106.05(h).
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? This limitation “wherein the edge device is a mobile device.” is an additional element that generally links the use of the judicial exception to a particular technological environment or field of use, and as such is deemed insufficient to transform the judicial exception to a patentable invention. See MPEP §§ 2106.04(d), 2106.05(h).
Dependent claim 11
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Incorporates abstract idea of independent claim
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) This limitation “wherein the edge device is embedded within a robot or a vehicle” is an additional element that generally links the use of the judicial exception to a particular technological environment or field of use, and as such is deemed insufficient to transform the judicial exception to a patentable invention. See MPEP §§ 2106.04(d), 2106.05(h).
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? This limitation “wherein the edge device is embedded within a robot or a vehicle” is an additional element that generally links the use of the judicial exception to a particular technological environment or field of use, and as such is deemed insufficient to transform the judicial exception to a patentable invention. See MPEP §§ 2106.04(d), 2106.05(h).
Dependent claim 12
Incorporates the rejection of independent claim
Step 2A Prong 1: does the claim recite an abstract idea, law of nature, or natural phenomenon? See MPEP § 2106.04(II)(A)(1). Yes, incorporate the abstract idea of the independent claim.
Step 2A prong 2: the claim recite additional elements that integrate the judicial exception into a practical application? See MPEP § 2106.04(d) No.
Step 2B: the claim recite additional elements that amount to significantly more than the judicial exception? See MPEP § 2106.05. and Is the additional element recognized as well-understood, routine, and conventional? No.
The dependent claims as analyzed above, do not recite limitations that integrated the judicial exception into a practical application. In addition, the claim limitations do not include additional elements that are sufficient to amount to significantly more than the judicial exception (Step 2B). Therefore, the claims do not recite any limitations, when considered individually or as a whole, that recite what the courts have identified as “significantly more”, see MPEP 2106.05; and therefore, as a whole the claims are not patent eligible.
As shown above, the dependent claims do not provide any additional elements that when considered individually or as an ordered combination, amount to significantly more than the abstract idea identified. Therefore, as a whole the dependent claims do not recite what the courts have identified as “significantly more” than the recited judicial exception.
Therefore, claims 1-2 and 15-22 are rejected under 35 U.S.C. 101 because the claimed invention is directed to a judicial exception and does not recite, when claim elements are examined individually and as a whole, elements that the courts have identified as “significantly more” than the recited judicial exception.
The prior art made of record and not relied upon is considered pertinent to Applicant's disclosure:
Engel et al (US 20220013132 A1): digital signal processing using machine-learned differentiable digital signal processors. For example, embodiments of the present disclosure may include differentiable digital signal processors within the training loop of a machine-learned model (e.g., for gradient-based training). Advantageously, systems and methods of the present disclosure provide high quality signal processing using smaller models than prior systems, thereby reducing energy costs (e.g., storage and/or processing costs) associated with performing digital signal processing.
Applicant is required under 37 C.F.R. § 1.111(c) to consider these references fully when responding to this action.
It is noted that any citation to specific pages, columns, lines, or figures in the prior art references and any interpretation of the references should not be considered to be limiting in any way. A reference is relevant for all it contains and may be relied upon for all that it would have reasonably suggested to one having ordinary skill in the art. In re Heck, 699 F.2d 1331, 1332-33, 216 U.S.P.Q. 1038, 1039 (Fed. Cir. 1983) (quoting In re Lemelson, 397 F.2d 1006, 1009, 158 U.S.P.Q. 275, 277 (C.C.P.A. 1968)).
In the interests of compact prosecution, Applicant is invited to contact the examiner via electronic media pursuant to USPTO policy outlined MPEP § 502.03. All electronic communication must be authorized in writing. Applicant may wish to file an Internet Communications Authorization Form PTO/SB/439. Applicant may wish to request an interview using the Interview Practice website: http://;www.uspto.gov/patent/laws-and-regulations/interview-practice.
Applicant is reminded Internet e-mail may not be used for communication for matters under 35 U.S.C. § 132 or which otherwise require a signature. A reply to an Office action may NOT be communicated by Applicant to the USPTO via Internet e- mail. If such a reply is submitted by Applicant via Internet e-mail, a paper copy will be placed in the appropriate patent application file with an indication that the reply is NOT ENTERED. See MPEP § 502.03(II).
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to HAIMEI JIANG whose telephone number is (571)270-1590. The examiner can normally be reached M-F 9-5pm.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Mariela D Reyes can be reached at 571-270-1006. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/HAIMEI JIANG/Primary Examiner, Art Unit 2142
Prosecution Insights