DETAILED ACTION
Claims 1, 3-5, 7, 9-12, and 15-17 have been examined.
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claim Rejections - 35 U.S.C. § 101
35 U.S.C. § 101 reads as follows:
Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of this title.
The claimed invention is directed to “mental steps” and “mathematical concepts” without significantly more.
The claims recite:
• convert the input data strings into input layer data strings by performing at least one of a first encoding process, a second encoding process and a third encoding process to the input data strings, the first encoding process converting an input data string into an input layer data string which expresses the input data string with one 1-bit and a plurality of 0- bits, the second encoding process letting a bit sequence corresponding to an input data string be an input layer data string, the third encoding process converting a numerical value expressed by an input data string into an input layer data string which is a scalar value (i.e., mathematical steps)
Applicant's Specification recites:
In step 5204, the conversion unit15 executes one or more encoding processes for each of the input data strings generated in step5203 to generate input layer data strings obtained by converting the input data strings. (i.e., mathematical steps)
Specifically, the conversion unit15 performs a plurality of encoding processes from the first encoding process to the third encoding process on each 128-bit input data string to obtain an input layer data string of a fixed length corresponding to 1024 input layer neurons. One element of the input layer data string may be a floating point number or a bit of a binary number (one of two values, 0 and 1). The fixed length is not limited to 1024 and may be set to any value. (i.e., mathematical steps)
The encoding processes include, for example, a single-bit process of converting an input data string into an input layer data string which expresses the input data string with one "1" bit and a plurality of "0" bits (also 15referred to as a fst encoding process), a process of directly letting a bit sequence corresponding to the input data string be an input layer data string without change (also referred to as a second encoding process), and a process of converting a numerical value expressed by the input data string to a single input layer data item which is a scalar value (also referred to as a third encoding process).
• extract a plurality of instructions from binary data of a target file that comprises one or more of a document file, an image file, or an audio file (i.e., mathematical steps)
Applicant's Specification recites:
…extraction unit 13 regards the binary data as a set of instructions and extracts data strings of instructions, each including an operand. As a method of extracting one instruction, a data string of one instruction may be extracted by, for example, executing disassembler processing. Any method may be used as long as a data string of one instruction can be extracted. The "instruction" according to the present embodiment is a concept including an opcode, which means an operator, and an operand, which means an object of an operation. Whether or not the binary data is actually a set of instructions does not matter.
• feature vector of a program including the instructions related to the program (i.e., mathematical expressions)
• process the feature vector of the program (i.e., mathematical steps)
• instructions from binary data (i.e., mental steps)
• input data strings (i.e., mental steps or mathematical expressions)
• padding with a fixed character on data strings of the instructions so that the data strings of the instructions each have a fixed length (i.e., mental steps or mathematical expressions)
• fixed length data (i.e., mental steps or mathematical expressions)
• a classification between programs and non-programs (i.e., mental steps)
• type of function includes in the program (i.e., in the BRI, it is a mathematical function)
Claim 1
Step 1 inquiry: Does this claim fall within a statutory category?
The preamble of the claim recites “1. A discrimination apparatus comprising a processor configured to…” Therefore, it is a “apparatus”, which is a statutory category of invention. Therefore, the answer to the inquiry is: “YES”.
Step 2A (Prong One) inquiry:
Are there limitations in Claim 1 that recite abstract ideas?
YES. The following limitations in Claim 1 recite abstract ideas that fall within at least one of the groupings of abstract ideas enumerated in the 2019 PEG. Specifically, they are “mental steps” and “mathematical concepts”:
The claims recite:
• convert the input data strings into input layer data strings by performing at least one of a first encoding process, a second encoding process and a third encoding process to the input data strings, the first encoding process converting an input data string into an input layer data string which expresses the input data string with one 1-bit and a plurality of 0- bits, the second encoding process letting a bit sequence corresponding to an input data string be an input layer data string, the third encoding process converting a numerical value expressed by an input data string into an input layer data string which is a scalar value (i.e., mathematical steps)
Applicant's Specification recites:
In step 5204, the conversion unit15 executes one or more encoding processes for each of the input data strings generated in step5203 to generate input layer data strings obtained by converting the input data strings. (i.e., mathematical steps)
Specifically, the conversion unit15 performs a plurality of encoding processes from the first encoding process to the third encoding process on each 128-bit input data string to obtain an input layer data string of a fixed length corresponding to 1024 input layer neurons. One element of the input layer data string may be a floating point number or a bit of a binary number (one of two values, 0 and 1). The fixed length is not limited to 1024 and may be set to any value. (i.e., mathematical steps)
The encoding processes include, for example, a single-bit process of converting an input data string into an input layer data string which expresses the input data string with one "1" bit and a plurality of "0" bits (also 15referred to as a fst encoding process), a process of directly letting a bit sequence corresponding to the input data string be an input layer data string without change (also referred to as a second encoding process), and a process of converting a numerical value expressed by the input data string to a single input layer data item which is a scalar value (also referred to as a third encoding process).
• extract a plurality of instructions from binary data of a target file that comprises one or more of a document file, an image file, or an audio file (i.e., mathematical steps)
Applicant's Specification recites:
…extraction unit 13 regards the binary data as a set of instructions and extracts data strings of instructions, each including an operand. As a method of extracting one instruction, a data string of one instruction may be extracted by, for example, executing disassembler processing. Any method may be used as long as a data string of one instruction can be extracted. The "instruction" according to the present embodiment is a concept including an opcode, which means an operator, and an operand, which means an object of an operation. Whether or not the binary data is actually a set of instructions does not matter.
• feature vector of a program including the instructions related to the program (i.e., mathematical expressions)
• process the feature vector of the program (i.e., mathematical steps)
• instructions from binary data (i.e., mental steps)
• input data strings (i.e., mental steps or mathematical expressions)
• padding with a fixed character on data strings of the instructions so that the data strings of the instructions each have a fixed length (i.e., mental steps or mathematical expressions)
• fixed length data (i.e., mental steps or mathematical expressions)
• a classification between programs and non-programs (i.e., mental steps)
• type of function includes in the program (i.e., in the BRI, it is a mathematical function)
Step 2A (Prong Two) inquiry:
Are there additional elements or a combination of elements in the claim that apply, rely on, or use the judicial exception in a manner that imposes a meaningful limit on the judicial exception, such that it is more than a drafting effort designed to monopolize the exception?
Applicant’s claims contain the following “additional elements”:
(1) A processor
(2) A “convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer”
(3) A convolutional layer
(4) A type of program conversion tool
(1) A “processor” is a broad term which is described at a high level and includes general purpose computers. M.P.E.P. § 2106.04(d)(I) recites:
The courts have also identified limitations that did not integrate a judicial exception into a practical application:
• Merely reciting the words “apply it” (or an equivalent) with the judicial exception, or merely including instructions to implement an abstract idea on a computer, or merely using a computer as a tool to perform an abstract idea, as discussed in MPEP § 2106.05(f);
• Adding insignificant extra-solution activity to the judicial exception, as discussed in MPEP § 2106.05(g); and
• Generally linking the use of a judicial exception to a particular technological environment or field of use, as discussed in MPEP § 2106.05(h).
This “processor” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
(2) A “convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05 (f)(2) recites in part:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process.
Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
TLI Communications provides an example of a claim invoking computers and other machinery merely as a tool to perform an existing process. The court stated that the claims describe steps of recording, administration and archiving of digital images, and found them to be directed to the abstract idea of classifying and storing digital images in an organized manner. 823 F.3d at 612, 118 USPQ2d at 1747. The court then turned to the additional elements of performing these functions using a telephone unit and a server and noted that these elements were being used in their ordinary capacity (i.e., the telephone unit is used to make calls and operate as a digital camera including compressing images and transmitting those images, and the server simply receives data, extracts classification information from the received data, and stores the digital images based on the extracted information). 823 F.3d at 612-13, 118 USPQ2d at 1747-48. In other words, the claims invoked the telephone unit and server merely as tools to execute the abstract idea. Thus, the court found that the additional elements did not add significantly more to the abstract idea because they were simply applying the abstract idea on a telephone network without any recitation of details of how to carry out the abstract idea.
This “convolutional neural network”/“convolutional neural network trained using training data” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
(3) A “convolutional layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05 (f)(2) recites in part:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process.
Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
TLI Communications provides an example of a claim invoking computers and other machinery merely as a tool to perform an existing process. The court stated that the claims describe steps of recording, administration and archiving of digital images, and found them to be directed to the abstract idea of classifying and storing digital images in an organized manner. 823 F.3d at 612, 118 USPQ2d at 1747. The court then turned to the additional elements of performing these functions using a telephone unit and a server and noted that these elements were being used in their ordinary capacity (i.e., the telephone unit is used to make calls and operate as a digital camera including compressing images and transmitting those images, and the server simply receives data, extracts classification information from the received data, and stores the digital images based on the extracted information). 823 F.3d at 612-13, 118 USPQ2d at 1747-48. In other words, the claims invoked the telephone unit and server merely as tools to execute the abstract idea. Thus, the court found that the additional elements did not add significantly more to the abstract idea because they were simply applying the abstract idea on a telephone network without any recitation of details of how to carry out the abstract idea.
This “convolutional layer” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
(4) A “type of program conversion tool” is a broad term which is described at a high level. M.P.E.P. § 2106.05(h) recites:
2106.05(h) Field of Use and Technological Environment [R-10.2019]
Another consideration when determining whether a claim integrates the judicial exception into a practical application in Step 2A Prong Two or recites significantly more than a judicial exception in Step 2B is whether the additional elements amount to more than generally linking the use of a judicial exception to a particular technological environment or field of use. As explained by the Supreme Court, a claim directed to a judicial exception cannot be made eligible “simply by having the applicant acquiesce to limiting the reach of the patent for the formula to a particular technological use.” Diamond v. Diehr, 450 U.S. 175, 192 n.14, 209 USPQ 1, 10 n. 14 (1981). Thus, limitations that amount to merely indicating a field of use or technological environment in which to apply a judicial exception do not amount to significantly more than the exception itself, and cannot integrate a judicial exception into a practical application.
The courts often cite to Parker v. Flook as providing a classic example of a field of use limitation. See, e.g., Bilski v. Kappos, 561 U.S. 593, 612, 95 USPQ2d 1001, 1010 (2010) (“Flook established that limiting an abstract idea to one field of use or adding token postsolution components did not make the concept patentable”) (citing Parker v. Flook, 437 U.S. 584, 198 USPQ 193 (1978)). In Flook, the claim recited steps of calculating an updated value for an alarm limit (a numerical limit on a process variable such as temperature, pressure or flow rate) according to a mathematical formula “in a process comprising the catalytic chemical conversion of hydrocarbons.” 437 U.S. at 586, 198 USPQ at 196. Processes for the catalytic chemical conversion of hydrocarbons were used in the petrochemical and oil-refining fields. Id. Although the applicant argued that limiting the use of the formula to the petrochemical and oil-refining fields should make the claim eligible because this limitation ensured that the claim did not preempt all uses of the formula, the Supreme Court disagreed. 437 U.S. at 588-90, 198 USPQ at 197-98. Instead, the additional element in Flook regarding the catalytic chemical conversion of hydrocarbons was not sufficient to make the claim eligible, because it was merely an incidental or token addition to the claim that did not alter or affect how the process steps of calculating the alarm limit value were performed. Further, the Supreme Court found that this limitation did not amount to an inventive concept. 437 U.S. at 588-90, 198 USPQ at 197-98. The Court reasoned that to hold otherwise would “exalt[] form over substance”, because a competent claim drafter could attach a similar type of limitation to almost any mathematical formula. 437 U.S. at 590, 198 USPQ at 197.
In contrast, the additional elements in Diamond v. Diehr as a whole provided eligibility and did not merely recite calculating a cure time using the Arrhenius equation “in a rubber molding process”. Instead, the claim in Diehr recited specific limitations such as monitoring the elapsed time since the mold was closed, constantly measuring the temperature in the mold cavity, repetitively calculating a cure time by inputting the measured temperature into the Arrhenius equation, and opening the press automatically when the calculated cure time and the elapsed time are equivalent. 450 U.S. at 179, 209 USPQ at 5, n. 5. These specific limitations act in concert to transform raw, uncured rubber into cured molded rubber. 450 U.S. at 177-78, 209 USPQ at 4.
This “type of program conversion tool” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
The answer to the inquiry is “NO”, no additional elements integrate the claimed abstract idea into a practical application.
Step 2B inquiry:
Does the claim provide an inventive concept, i.e., does the claim recite additional element(s) or a combination of elements that amount to significantly more than the judicial exception in the claim?
Applicant’s claims contain the following “additional elements”:
(1) A processor
(2) A “convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer”
(3) A convolutional layer
(4) A type of program conversion tool
(1) A “processor” is a broad term which is described at a high level and includes general purpose computers. M.P.E.P. § 2106.05 (I)(A)(i-ii) recites:
Limitations that the courts have found not to be enough to qualify as “significantly more” when recited in a claim with a judicial exception include:
i. Adding the words “apply it” (or an equivalent) with the judicial exception, or mere instructions to implement an abstract idea on a computer, e.g., a limitation indicating that a particular function such as creating and maintaining electronic records is performed by a computer, as discussed in Alice Corp., 573 U.S. at 225-26, 110 USPQ2d at 1984 (see MPEP § 2106.05(f));
ii. Simply appending well-understood, routine, conventional activities previously known to the industry, specified at a high level of generality, to the judicial exception, e.g., a claim to an abstract idea requiring no more than a generic computer to perform generic computer functions that are well-understood, routine and conventional activities previously known to the industry, as discussed in Alice Corp., 573 U.S. at 225, 110 USPQ2d at 1984 (see MPEP § 2106.05(d));
Further, M.P.E.P. § 2016.05(f) recites:
2106.05(f) Mere Instructions To Apply An Exception [R-10.2019]
Another consideration when determining whether a claim integrates a judicial exception into a practical application in Step 2A Prong Two or recites significantly more than a judicial exception in Step 2B is whether the additional elements amount to more than a recitation of the words “apply it” (or an equivalent) or are more than mere instructions to implement an abstract idea or other exception on a computer. As explained by the Supreme Court, in order to make a claim directed to a judicial exception patent-eligible, the additional element or combination of elements must do “‘more than simply stat[e] the [judicial exception] while adding the words ‘apply it’”. Alice Corp. v. CLS Bank, 573 U.S. 208, 221, 110 USPQ2d 1976, 1982-83 (2014) (quoting Mayo Collaborative Servs. V. Prometheus Labs., Inc., 566 U.S. 66, 72, 101 USPQ2d 1961, 1965). Thus, for example, claims that amount to nothing more than an instruction to apply the abstract idea using a generic computer do not render an abstract idea eligible. Alice Corp., 573 U.S. at 223, 110 USPQ2d at 1983. See also 573 U.S. at 224, 110 USPQ2d at 1984 (warning against a § 101 analysis that turns on “the draftsman’s art”).
Further, M.P.E.P. § 2106.05(f)(2) recites:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process.
Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
The processor is well-understood, routine, and conventional. Applicant’s Specification, page 4 recites:
A discrimination apparatus 1 according to the present embodiment includes a storage 11, an acquisition unit 12, an extraction unit 13, a padding unit 14, a conversion unit 15, and a generation unit 16. FIG. 1 shows an example in which the acquisition unit 12, the extraction unit 13, the padding unit 14, the conversion unit 15, and the generation unit 16 are implemented in electronic circuitry 10. The electronic circuitry 10 is configured by a single processing circuit, e.g., such as a central processing unit (CPU) or a graphics processing unit (GPU), or an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The electronic circuitry 10 and the storage 11 are connected to each other via a bus in such a manner that data can be transmitted and received therebetween. The configuration is not limited to this, and each unit may be configured as a single processing circuit or a single integrated circuit.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
(2) A “convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05(f) recites:
For claim limitations that do not amount to more than a recitation of the words “apply it” (or an equivalent), such as mere instructions to implement an abstract idea on a computer, examiners should explain why they do not meaningfully limit the claim in an eligibility rejection. For example, an examiner could explain that implementing an abstract idea on a generic computer, does not integrate the abstract idea into a practical application in Step 2A Prong Two…
Further, M.P.E.P. § 2106.05(f)(2) recites:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process. Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
Applicant's convolutional neural network is well-understood, routine, and conventional. Applicant’s Specification recites:
As the trained CNN, a forward-propagation convolutional neural network is assumed; however, special multilayer CNNs such as so-called ResNet and DenseNet, which are different from common CNNs, are also applicable in a similar manner. Here, a convolution layer included in the trained CNN is designed to perform processing in units of instructions of a program. A training method and utilization method of the trained CNN according to the present embodiment will be described later.
Note that both special purpose and general purpose pretrained neural nets may be used in the claims.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
(3) A “convolutional layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05(f) recites:
For claim limitations that do not amount to more than a recitation of the words “apply it” (or an equivalent), such as mere instructions to implement an abstract idea on a computer, examiners should explain why they do not meaningfully limit the claim in an eligibility rejection. For example, an examiner could explain that implementing an abstract idea on a generic computer, does not integrate the abstract idea into a practical application in Step 2A Prong Two…
Further, M.P.E.P. § 2106.05(f)(2) recites:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process. Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
Applicant's convolutional layer is well-understood, routine and conventional. Applicant’s Specification recites:
As the trained CNN, a forward-propagation convolutional neural network is assumed; however, special multilayer CNNs such as so-called ResNet and DenseNet, which are different from common CNNs, are also applicable in a similar manner. Here, a convolution layer included in the trained CNN is designed to perform processing in units of instructions of a program. A training method and utilization method of the trained CNN according to the present embodiment will be described later.
Note that both special purpose and general purpose pretrained neural nets may be used in the claims.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
(4) A “type of program conversion tool” is a broad term which is described at a high level. M.P.E.P. § 2106.05(h) recites:
2106.05(h) Field of Use and Technological Environment [R-10.2019]
Another consideration when determining whether a claim integrates the judicial exception into a practical application in Step 2A Prong Two or recites significantly more than a judicial exception in Step 2B is whether the additional elements amount to more than generally linking the use of a judicial exception to a particular technological environment or field of use. As explained by the Supreme Court, a claim directed to a judicial exception cannot be made eligible “simply by having the applicant acquiesce to limiting the reach of the patent for the formula to a particular technological use.” Diamond v. Diehr, 450 U.S. 175, 192 n.14, 209 USPQ 1, 10 n. 14 (1981). Thus, limitations that amount to merely indicating a field of use or technological environment in which to apply a judicial exception do not amount to significantly more than the exception itself, and cannot integrate a judicial exception into a practical application.
The courts often cite to Parker v. Flook as providing a classic example of a field of use limitation. See, e.g., Bilski v. Kappos, 561 U.S. 593, 612, 95 USPQ2d 1001, 1010 (2010) (“Flook established that limiting an abstract idea to one field of use or adding token postsolution components did not make the concept patentable”) (citing Parker v. Flook, 437 U.S. 584, 198 USPQ 193 (1978)). In Flook, the claim recited steps of calculating an updated value for an alarm limit (a numerical limit on a process variable such as temperature, pressure or flow rate) according to a mathematical formula “in a process comprising the catalytic chemical conversion of hydrocarbons.” 437 U.S. at 586, 198 USPQ at 196. Processes for the catalytic chemical conversion of hydrocarbons were used in the petrochemical and oil-refining fields. Id. Although the applicant argued that limiting the use of the formula to the petrochemical and oil-refining fields should make the claim eligible because this limitation ensured that the claim did not preempt all uses of the formula, the Supreme Court disagreed. 437 U.S. at 588-90, 198 USPQ at 197-98. Instead, the additional element in Flook regarding the catalytic chemical conversion of hydrocarbons was not sufficient to make the claim eligible, because it was merely an incidental or token addition to the claim that did not alter or affect how the process steps of calculating the alarm limit value were performed. Further, the Supreme Court found that this limitation did not amount to an inventive concept. 437 U.S. at 588-90, 198 USPQ at 197-98. The Court reasoned that to hold otherwise would “exalt[] form over substance”, because a competent claim drafter could attach a similar type of limitation to almost any mathematical formula. 437 U.S. at 590, 198 USPQ at 197.
In contrast, the additional elements in Diamond v. Diehr as a whole provided eligibility and did not merely recite calculating a cure time using the Arrhenius equation “in a rubber molding process”. Instead, the claim in Diehr recited specific limitations such as monitoring the elapsed time since the mold was closed, constantly measuring the temperature in the mold cavity, repetitively calculating a cure time by inputting the measured temperature into the Arrhenius equation, and opening the press automatically when the calculated cure time and the elapsed time are equivalent. 450 U.S. at 179, 209 USPQ at 5, n. 5. These specific limitations act in concert to transform raw, uncured rubber into cured molded rubber. 450 U.S. at 177-78, 209 USPQ at 4.
Applicant’s Specification recites:
The conversion unit 15 generates a plurality of input layer data strings by executing bit encoding processing on the input data strings.
The generation unit 16 generates a feature vector or a classification result of the program based on the input data strings or input layer data strings by using the trained CNN. As the classification result, a result of at least one of classification between programs and non-programs, classification by type of compiler used for generating the program, classification by type of program conversion tool (such as an obfuscator, a packer, and the like) used for generating the program, and classification by type of function included in the program is assumed.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
Therefore, the answer to the inquiry is “NO”, no additional elements provide an inventive concept that is significantly more than the claimed abstract ideas the claimed abstract idea into a practical application.
Claim 1 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 3
Claim 3 recites:
3. The discrimination apparatus according to claim 1, wherein a convolution filter size and stride in the at least one convolution layer are determined so that processing is performed in units of the instructions.
Applicant’s Claim 3 merely teaches parameters of a neural network. It does not integrate the abstract idea to a practical application, nor is it anything significantly more than the abstract idea. (See, 2106.05(a)(II).)
Claim 3 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 4
Claim 4 recites:
4. The discrimination apparatus according to claim 1, wherein the classification result indicates a classification result of at least one of classification between a program and a non-program, classification by type of compiler used for generating the program, classification by type of program conversion tool used for generating the program, and classification by type of function included in the program.
Applicant’s Claim 4 merely teaches a classification result. It does not integrate the abstract idea to a practical application, nor is it anything significantly more than the abstract idea. (See, 2106.05(a)(II).)
Claim 4 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 5
Claim 5 recites:
5. The discrimination apparatus according to claim 1, wherein the processor performs disassembler processing.
Applicant’s Claim 5 merely teaches a disassembler. It does not integrate the abstract idea to a practical application, nor is it anything significantly more than the abstract idea. (See, 2106.05(a)(II).)
Claim 5 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 7
Step 1 inquiry: Does this claim fall within a statutory category?
The preamble of the claim recites “7. A discrimination method comprising…” Therefore, it is a “method” (or, a “process”), which is a statutory category of invention. Therefore, the answer to the inquiry is: “YES”.
Step 2A (Prong One) inquiry:
Are there limitations in Claim 7 that recite abstract ideas?
YES. The following limitations in Claim 7 recite abstract ideas that fall within at least one of the groupings of abstract ideas enumerated in the 2019 PEG. Specifically, they are “mental steps” and “mathematical concepts”:
• instructions from binary data (i.e., mental steps)
• input data strings (i.e., mental steps or mathematical
expressions)
• padding with a fixed character (i.e., mental steps)
• fixed length data (i.e., mental steps or mathematical
expressions)
• feature vector of a program (i.e., mental steps or mathematical
expressions)
• a classification between programs and non-programs (i.e., mental steps)
• type of function includes in the program (i.e., in the BRI, it is a mathematical function)
Step 2A (Prong Two) inquiry:
Are there additional elements or a combination of elements in the claim that apply, rely on, or use the judicial exception in a manner that imposes a meaningful limit on the judicial exception, such that it is more than a drafting effort designed to monopolize the exception?
Applicant’s claims contain the following “additional elements”:
(1) “A convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer”
(2) A convolutional layer
(3) A type of program conversion tool
(1) A “convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05 (f)(2) recites in part:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process.
Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
TLI Communications provides an example of a claim invoking computers and other machinery merely as a tool to perform an existing process. The court stated that the claims describe steps of recording, administration and archiving of digital images, and found them to be directed to the abstract idea of classifying and storing digital images in an organized manner. 823 F.3d at 612, 118 USPQ2d at 1747. The court then turned to the additional elements of performing these functions using a telephone unit and a server and noted that these elements were being used in their ordinary capacity (i.e., the telephone unit is used to make calls and operate as a digital camera including compressing images and transmitting those images, and the server simply receives data, extracts classification information from the received data, and stores the digital images based on the extracted information). 823 F.3d at 612-13, 118 USPQ2d at 1747-48. In other words, the claims invoked the telephone unit and server merely as tools to execute the abstract idea. Thus, the court found that the additional elements did not add significantly more to the abstract idea because they were simply applying the abstract idea on a telephone network without any recitation of details of how to carry out the abstract idea.
This “convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
(2) A “convolutional layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05 (f)(2) recites in part:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process.
Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
TLI Communications provides an example of a claim invoking computers and other machinery merely as a tool to perform an existing process. The court stated that the claims describe steps of recording, administration and archiving of digital images, and found them to be directed to the abstract idea of classifying and storing digital images in an organized manner. 823 F.3d at 612, 118 USPQ2d at 1747. The court then turned to the additional elements of performing these functions using a telephone unit and a server and noted that these elements were being used in their ordinary capacity (i.e., the telephone unit is used to make calls and operate as a digital camera including compressing images and transmitting those images, and the server simply receives data, extracts classification information from the received data, and stores the digital images based on the extracted information). 823 F.3d at 612-13, 118 USPQ2d at 1747-48. In other words, the claims invoked the telephone unit and server merely as tools to execute the abstract idea. Thus, the court found that the additional elements did not add significantly more to the abstract idea because they were simply applying the abstract idea on a telephone network without any recitation of details of how to carry out the abstract idea.
This “convolutional layer” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
(3) A “type of program conversion tool” is a broad term which is described at a high level. M.P.E.P. § 2106.05(h) recites:
2106.05(h) Field of Use and Technological Environment [R-10.2019]
Another consideration when determining whether a claim integrates the judicial exception into a practical application in Step 2A Prong Two or recites significantly more than a judicial exception in Step 2B is whether the additional elements amount to more than generally linking the use of a judicial exception to a particular technological environment or field of use. As explained by the Supreme Court, a claim directed to a judicial exception cannot be made eligible “simply by having the applicant acquiesce to limiting the reach of the patent for the formula to a particular technological use.” Diamond v. Diehr, 450 U.S. 175, 192 n.14, 209 USPQ 1, 10 n. 14 (1981). Thus, limitations that amount to merely indicating a field of use or technological environment in which to apply a judicial exception do not amount to significantly more than the exception itself, and cannot integrate a judicial exception into a practical application.
The courts often cite to Parker v. Flook as providing a classic example of a field of use limitation. See, e.g., Bilski v. Kappos, 561 U.S. 593, 612, 95 USPQ2d 1001, 1010 (2010) (“Flook established that limiting an abstract idea to one field of use or adding token postsolution components did not make the concept patentable”) (citing Parker v. Flook, 437 U.S. 584, 198 USPQ 193 (1978)). In Flook, the claim recited steps of calculating an updated value for an alarm limit (a numerical limit on a process variable such as temperature, pressure or flow rate) according to a mathematical formula “in a process comprising the catalytic chemical conversion of hydrocarbons.” 437 U.S. at 586, 198 USPQ at 196. Processes for the catalytic chemical conversion of hydrocarbons were used in the petrochemical and oil-refining fields. Id. Although the applicant argued that limiting the use of the formula to the petrochemical and oil-refining fields should make the claim eligible because this limitation ensured that the claim did not preempt all uses of the formula, the Supreme Court disagreed. 437 U.S. at 588-90, 198 USPQ at 197-98. Instead, the additional element in Flook regarding the catalytic chemical conversion of hydrocarbons was not sufficient to make the claim eligible, because it was merely an incidental or token addition to the claim that did not alter or affect how the process steps of calculating the alarm limit value were performed. Further, the Supreme Court found that this limitation did not amount to an inventive concept. 437 U.S. at 588-90, 198 USPQ at 197-98. The Court reasoned that to hold otherwise would “exalt[] form over substance”, because a competent claim drafter could attach a similar type of limitation to almost any mathematical formula. 437 U.S. at 590, 198 USPQ at 197.
In contrast, the additional elements in Diamond v. Diehr as a whole provided eligibility and did not merely recite calculating a cure time using the Arrhenius equation “in a rubber molding process”. Instead, the claim in Diehr recited specific limitations such as monitoring the elapsed time since the mold was closed, constantly measuring the temperature in the mold cavity, repetitively calculating a cure time by inputting the measured temperature into the Arrhenius equation, and opening the press automatically when the calculated cure time and the elapsed time are equivalent. 450 U.S. at 179, 209 USPQ at 5, n. 5. These specific limitations act in concert to transform raw, uncured rubber into cured molded rubber. 450 U.S. at 177-78, 209 USPQ at 4.
This “type of program conversion tool” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
The answer to the inquiry is “NO”, no additional elements integrate the claimed abstract idea into a practical application.
Step 2B inquiry:
Does the claim provide an inventive concept, i.e., does the claim recite additional element(s) or a combination of elements that amount to significantly more than the judicial exception in the claim?
Applicant’s claims contain the following “additional elements”:
(1) “A convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer”
(2) A convolutional layer
(3) A type of program conversion tool
(1) A “convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05(f) recites:
For claim limitations that do not amount to more than a recitation of the words “apply it” (or an equivalent), such as mere instructions to implement an abstract idea on a computer, examiners should explain why they do not meaningfully limit the claim in an eligibility rejection. For example, an examiner could explain that implementing an abstract idea on a generic computer, does not integrate the abstract idea into a practical application in Step 2A Prong Two…
Further, M.P.E.P. § 2106.05(f)(2) recites:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process. Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
Applicant's convolutional neural network is well-understood, routine, and conventional. Applicant’s Specification recites:
As the trained CNN, a forward-propagation convolutional neural network is assumed; however, special multilayer CNNs such as so-called ResNet and DenseNet, which are different from common CNNs, are also applicable in a similar manner. Here, a convolution layer included in the trained CNN is designed to perform processing in units of instructions of a program. A training method and utilization method of the trained CNN according to the present embodiment will be described later.
Note that both special purpose and general purpose pretrained neural nets may be used in the claims.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
(2) A “convolutional layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05(f) recites:
For claim limitations that do not amount to more than a recitation of the words “apply it” (or an equivalent), such as mere instructions to implement an abstract idea on a computer, examiners should explain why they do not meaningfully limit the claim in an eligibility rejection. For example, an examiner could explain that implementing an abstract idea on a generic computer, does not integrate the abstract idea into a practical application in Step 2A Prong Two…
Further, M.P.E.P. § 2106.05(f)(2) recites:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process. Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
Applicant's convolutional layer is well-understood, routine, and conventional. Applicant’s Specification recites:
As the trained CNN, a forward-propagation convolutional neural network is assumed; however, special multilayer CNNs such as so-called ResNet and DenseNet, which are different from common CNNs, are also applicable in a similar manner. Here, a convolution layer included in the trained CNN is designed to perform processing in units of instructions of a program. A training method and utilization method of the trained CNN according to the present embodiment will be described later.
Note that both special purpose and general purpose pretrained neural nets may be used in the claims.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
(3) A “type of program conversion tool” is a broad term which is described at a high level. M.P.E.P. § 2106.05(h) recites:
2106.05(h) Field of Use and Technological Environment [R-10.2019]
Another consideration when determining whether a claim integrates the judicial exception into a practical application in Step 2A Prong Two or recites significantly more than a judicial exception in Step 2B is whether the additional elements amount to more than generally linking the use of a judicial exception to a particular technological environment or field of use. As explained by the Supreme Court, a claim directed to a judicial exception cannot be made eligible “simply by having the applicant acquiesce to limiting the reach of the patent for the formula to a particular technological use.” Diamond v. Diehr, 450 U.S. 175, 192 n.14, 209 USPQ 1, 10 n. 14 (1981). Thus, limitations that amount to merely indicating a field of use or technological environment in which to apply a judicial exception do not amount to significantly more than the exception itself, and cannot integrate a judicial exception into a practical application.
The courts often cite to Parker v. Flook as providing a classic example of a field of use limitation. See, e.g., Bilski v. Kappos, 561 U.S. 593, 612, 95 USPQ2d 1001, 1010 (2010) (“Flook established that limiting an abstract idea to one field of use or adding token postsolution components did not make the concept patentable”) (citing Parker v. Flook, 437 U.S. 584, 198 USPQ 193 (1978)). In Flook, the claim recited steps of calculating an updated value for an alarm limit (a numerical limit on a process variable such as temperature, pressure or flow rate) according to a mathematical formula “in a process comprising the catalytic chemical conversion of hydrocarbons.” 437 U.S. at 586, 198 USPQ at 196. Processes for the catalytic chemical conversion of hydrocarbons were used in the petrochemical and oil-refining fields. Id. Although the applicant argued that limiting the use of the formula to the petrochemical and oil-refining fields should make the claim eligible because this limitation ensured that the claim did not preempt all uses of the formula, the Supreme Court disagreed. 437 U.S. at 588-90, 198 USPQ at 197-98. Instead, the additional element in Flook regarding the catalytic chemical conversion of hydrocarbons was not sufficient to make the claim eligible, because it was merely an incidental or token addition to the claim that did not alter or affect how the process steps of calculating the alarm limit value were performed. Further, the Supreme Court found that this limitation did not amount to an inventive concept. 437 U.S. at 588-90, 198 USPQ at 197-98. The Court reasoned that to hold otherwise would “exalt[] form over substance”, because a competent claim drafter could attach a similar type of limitation to almost any mathematical formula. 437 U.S. at 590, 198 USPQ at 197.
In contrast, the additional elements in Diamond v. Diehr as a whole provided eligibility and did not merely recite calculating a cure time using the Arrhenius equation “in a rubber molding process”. Instead, the claim in Diehr recited specific limitations such as monitoring the elapsed time since the mold was closed, constantly measuring the temperature in the mold cavity, repetitively calculating a cure time by inputting the measured temperature into the Arrhenius equation, and opening the press automatically when the calculated cure time and the elapsed time are equivalent. 450 U.S. at 179, 209 USPQ at 5, n. 5. These specific limitations act in concert to transform raw, uncured rubber into cured molded rubber. 450 U.S. at 177-78, 209 USPQ at 4.
Applicant’s Specification recites:
The conversion unit 15 generates a plurality of input layer data strings by executing bit encoding processing on the input data strings.
The generation unit 16 generates a feature vector or a classification result of the program based on the input data strings or input layer data strings by using the trained CNN. As the classification result, a result of at least one of classification between programs and non-programs, classification by type of compiler used for generating the program, classification by type of program conversion tool (such as an obfuscator, a packer, and the like) used for generating the program, and classification by type of function included in the program is assumed.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
Therefore, the answer to the inquiry is “NO”, no additional elements provide an inventive concept that is significantly more than the claimed abstract ideas the claimed abstract idea into a practical application.
Claim 7 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 9
Claim 9 recites:
9. The discrimination method according to claim 7, wherein a convolution filter size and stride in the at least one convolution layer are determined so that processing is performed in units of the instructions.
Applicant’s Claim 9 merely teaches parameters of a neural network. It does not integrate the abstract idea to a practical application, nor is it anything significantly more than the abstract idea. (See, 2106.05(a)(II).)
Claim 9 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 10
Claim 10 recites:
10. The discrimination method according to claim 7, wherein the classification result indicates a classification result of at least one of classification between a program and a non-program, classification by type of compiler used for generating the program, classification by type of program conversion tool used for generating the program, and classification by type of function included in the program.
Applicant’s Claim 10 merely teaches a classification result. It does not integrate the abstract idea to a practical application, nor is it anything significantly more than the abstract idea. (See, 2106.05(a)(II).)
Claim 10 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 11
Claim 11 recites:
11. The discrimination method according to claim 7, wherein the extracting the instructions includes disassembler processing.
Applicant’s Claim 11 merely teaches a disassembler. It does not integrate the abstract idea to a practical application, nor is it anything significantly more than the abstract idea. (See, 2106.05(a)(II).)
Claim 11 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 12
Claim 12 recites:
12. The discrimination method according to claim 7, wherein the program is malware embedded in a target file.
Applicant’s Claim 12 merely teaches malware. It does not integrate the abstract idea to a practical application, nor is it anything significantly more than the abstract idea. (See, 2106.05(a)(II).)
Claim 12 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 15
Step 1 inquiry: Does this claim fall within a statutory category?
The preamble of the claim recites “15. (New) A discrimination apparatus comprising a processor configured to…” Therefore, it is a “apparatus”, which is a statutory category of invention. Therefore, the answer to the inquiry is: “YES”.
Step 2A (Prong One) inquiry:
Are there limitations in Claim 15 that recite abstract ideas?
YES. The following limitations in Claim 15 recite abstract ideas that fall within at least one of the groupings of abstract ideas enumerated in the 2019 PEG. Specifically, they are “mental steps” and “mathematical concepts”:
• convert the input data strings into input layer data strings by performing at least one of a first encoding process, a second encoding process and a third encoding process to the input data strings, the first encoding process converting an input data string into an input layer data string which expresses the input data string with one 1-bit and a plurality of 0- bits, the second encoding process letting a bit sequence corresponding to an input data string be an input layer data string, the third encoding process converting a numerical value expressed by an input data string into an input layer data string which is a scalar value (i.e., mathematical steps)
Applicant's Specification recites:
In step 5204, the conversion unit15 executes one or more encoding processes for each of the input data strings generated in step5203 to generate input layer data strings obtained by converting the input data strings. (i.e., mathematical steps)
Specifically, the conversion unit15 performs a plurality of encoding processes from the first encoding process to the third encoding process on each 128-bit input data string to obtain an input layer data string of a fixed length corresponding to 1024 input layer neurons. One element of the input layer data string may be a floating point number or a bit of a binary number (one of two values, 0 and 1). The fixed length is not limited to 1024 and may be set to any value. (i.e., mathematical steps)
The encoding processes include, for example, a single-bit process of converting an input data string into an input layer data string which expresses the input data string with one "1" bit and a plurality of "0" bits (also 15referred to as a fst encoding process), a process of directly letting a bit sequence corresponding to the input data string be an input layer data string without change (also referred to as a second encoding process), and a process of converting a numerical value expressed by the 20input data string to a single input layer data item which is a scalar value (also referred to as a third encoding process).
• extract a plurality of instructions from binary data of a target file that comprises one or more of a document file, an image file, or an audio file (i.e., mathematical steps)
Applicant's Specification recites:
…extraction unit 13 regards the binary data as a set of instructions and extracts data strings of instructions, each including an operand. As a method of extracting one instruction, a data string of one instruction may be extracted by, for example, executing disassembler processing. Any method may be used as long as a data string of one instruction can be extracted. The "instruction" according to the present embodiment is a concept including an opcode, which means an operator, and an operand, which means an object of an operation. Whether or not the binary data is actually a set of instructions does not matter.
• feature vector of a program including the instructions related to the program (i.e., mathematical steps)
• process the feature vector of the program (i.e., mathematical steps)
• instructions from binary data (i.e., mental steps)
• input data strings (i.e., mental steps)
• padding with a fixed character on data strings of the instructions so that the data strings of the instructions each have a fixed length (i.e., mental steps)
• fixed length data (i.e., mental steps)
• wherein a convolution filter size and stride in the convolution layer are determined so that processing is performed in units of the instructions (i.e., mental steps)
• a classification between programs and non-programs (i.e., mental steps)
• type of function includes in the program (i.e., in the BRI, it is a mathematical function)
Step 2A (Prong Two) inquiry:
Are there additional elements or a combination of elements in the claim that apply, rely on, or use the judicial exception in a manner that imposes a meaningful limit on the judicial exception, such that it is more than a drafting effort designed to monopolize the exception?
Applicant’s claims contain the following “additional elements”:
(1) A processor
(2) A “convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer”
(3) A convolutional layer
(4) A type of program conversion tool
(1) A “processor” is a broad term which is described at a high level and includes general purpose computers. M.P.E.P. § 2106.04(d)(I) recites:
The courts have also identified limitations that did not integrate a judicial exception into a practical application:
• Merely reciting the words “apply it” (or an equivalent) with the judicial exception, or merely including instructions to implement an abstract idea on a computer, or merely using a computer as a tool to perform an abstract idea, as discussed in MPEP § 2106.05(f);
• Adding insignificant extra-solution activity to the judicial exception, as discussed in MPEP § 2106.05(g); and
• Generally linking the use of a judicial exception to a particular technological environment or field of use, as discussed in MPEP § 2106.05(h).
This “processor” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
(2) A “convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05 (f)(2) recites in part:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process.
Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
TLI Communications provides an example of a claim invoking computers and other machinery merely as a tool to perform an existing process. The court stated that the claims describe steps of recording, administration and archiving of digital images, and found them to be directed to the abstract idea of classifying and storing digital images in an organized manner. 823 F.3d at 612, 118 USPQ2d at 1747. The court then turned to the additional elements of performing these functions using a telephone unit and a server and noted that these elements were being used in their ordinary capacity (i.e., the telephone unit is used to make calls and operate as a digital camera including compressing images and transmitting those images, and the server simply receives data, extracts classification information from the received data, and stores the digital images based on the extracted information). 823 F.3d at 612-13, 118 USPQ2d at 1747-48. In other words, the claims invoked the telephone unit and server merely as tools to execute the abstract idea. Thus, the court found that the additional elements did not add significantly more to the abstract idea because they were simply applying the abstract idea on a telephone network without any recitation of details of how to carry out the abstract idea.
This “convolutional neural network”/“convolutional neural network trained using training data”/“at least one connection layer” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
(3) A “convolutional layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05 (f)(2) recites in part:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process.
Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
TLI Communications provides an example of a claim invoking computers and other machinery merely as a tool to perform an existing process. The court stated that the claims describe steps of recording, administration and archiving of digital images, and found them to be directed to the abstract idea of classifying and storing digital images in an organized manner. 823 F.3d at 612, 118 USPQ2d at 1747. The court then turned to the additional elements of performing these functions using a telephone unit and a server and noted that these elements were being used in their ordinary capacity (i.e., the telephone unit is used to make calls and operate as a digital camera including compressing images and transmitting those images, and the server simply receives data, extracts classification information from the received data, and stores the digital images based on the extracted information). 823 F.3d at 612-13, 118 USPQ2d at 1747-48. In other words, the claims invoked the telephone unit and server merely as tools to execute the abstract idea. Thus, the court found that the additional elements did not add significantly more to the abstract idea because they were simply applying the abstract idea on a telephone network without any recitation of details of how to carry out the abstract idea.
This “convolutional layer” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
(4) A “type of program conversion tool” is a broad term which is described at a high level. M.P.E.P. § 2106.05(h) recites:
2106.05(h) Field of Use and Technological Environment [R-10.2019]
Another consideration when determining whether a claim integrates the judicial exception into a practical application in Step 2A Prong Two or recites significantly more than a judicial exception in Step 2B is whether the additional elements amount to more than generally linking the use of a judicial exception to a particular technological environment or field of use. As explained by the Supreme Court, a claim directed to a judicial exception cannot be made eligible “simply by having the applicant acquiesce to limiting the reach of the patent for the formula to a particular technological use.” Diamond v. Diehr, 450 U.S. 175, 192 n.14, 209 USPQ 1, 10 n. 14 (1981). Thus, limitations that amount to merely indicating a field of use or technological environment in which to apply a judicial exception do not amount to significantly more than the exception itself, and cannot integrate a judicial exception into a practical application.
The courts often cite to Parker v. Flook as providing a classic example of a field of use limitation. See, e.g., Bilski v. Kappos, 561 U.S. 593, 612, 95 USPQ2d 1001, 1010 (2010) (“Flook established that limiting an abstract idea to one field of use or adding token postsolution components did not make the concept patentable”) (citing Parker v. Flook, 437 U.S. 584, 198 USPQ 193 (1978)). In Flook, the claim recited steps of calculating an updated value for an alarm limit (a numerical limit on a process variable such as temperature, pressure or flow rate) according to a mathematical formula “in a process comprising the catalytic chemical conversion of hydrocarbons.” 437 U.S. at 586, 198 USPQ at 196. Processes for the catalytic chemical conversion of hydrocarbons were used in the petrochemical and oil-refining fields. Id. Although the applicant argued that limiting the use of the formula to the petrochemical and oil-refining fields should make the claim eligible because this limitation ensured that the claim did not preempt all uses of the formula, the Supreme Court disagreed. 437 U.S. at 588-90, 198 USPQ at 197-98. Instead, the additional element in Flook regarding the catalytic chemical conversion of hydrocarbons was not sufficient to make the claim eligible, because it was merely an incidental or token addition to the claim that did not alter or affect how the process steps of calculating the alarm limit value were performed. Further, the Supreme Court found that this limitation did not amount to an inventive concept. 437 U.S. at 588-90, 198 USPQ at 197-98. The Court reasoned that to hold otherwise would “exalt[] form over substance”, because a competent claim drafter could attach a similar type of limitation to almost any mathematical formula. 437 U.S. at 590, 198 USPQ at 197.
In contrast, the additional elements in Diamond v. Diehr as a whole provided eligibility and did not merely recite calculating a cure time using the Arrhenius equation “in a rubber molding process”. Instead, the claim in Diehr recited specific limitations such as monitoring the elapsed time since the mold was closed, constantly measuring the temperature in the mold cavity, repetitively calculating a cure time by inputting the measured temperature into the Arrhenius equation, and opening the press automatically when the calculated cure time and the elapsed time are equivalent. 450 U.S. at 179, 209 USPQ at 5, n. 5. These specific limitations act in concert to transform raw, uncured rubber into cured molded rubber. 450 U.S. at 177-78, 209 USPQ at 4.
This “type of program conversion tool” limitation does not integrate the additional element into a practical application and represents “insignificant extra-solution activity”. (See, M.P.E.P. § 2106.05(I)(A)).
The answer to the inquiry is “NO”, no additional elements integrate the claimed abstract idea into a practical application.
Step 2B inquiry:
Does the claim provide an inventive concept, i.e., does the claim recite additional element(s) or a combination of elements that amount to significantly more than the judicial exception in the claim?
Applicant’s claims contain the following “additional elements”:
(1) A processor
(2) A convolutional neural network
(3) A convolutional layer
(4) A type of program conversion tool
(1) A “processor” is a broad term which is described at a high level and includes general purpose computers. M.P.E.P. § 2106.05 (I)(A)(i-ii) recites:
Limitations that the courts have found not to be enough to qualify as “significantly more” when recited in a claim with a judicial exception include:
i. Adding the words “apply it” (or an equivalent) with the judicial exception, or mere instructions to implement an abstract idea on a computer, e.g., a limitation indicating that a particular function such as creating and maintaining electronic records is performed by a computer, as discussed in Alice Corp., 573 U.S. at 225-26, 110 USPQ2d at 1984 (see MPEP § 2106.05(f));
ii. Simply appending well-understood, routine, conventional activities previously known to the industry, specified at a high level of generality, to the judicial exception, e.g., a claim to an abstract idea requiring no more than a generic computer to perform generic computer functions that are well-understood, routine and conventional activities previously known to the industry, as discussed in Alice Corp., 573 U.S. at 225, 110 USPQ2d at 1984 (see MPEP § 2106.05(d));
Further, M.P.E.P. § 2016.05(f) recites:
2106.05(f) Mere Instructions To Apply An Exception [R-10.2019]
Another consideration when determining whether a claim integrates a judicial exception into a practical application in Step 2A Prong Two or recites significantly more than a judicial exception in Step 2B is whether the additional elements amount to more than a recitation of the words “apply it” (or an equivalent) or are more than mere instructions to implement an abstract idea or other exception on a computer. As explained by the Supreme Court, in order to make a claim directed to a judicial exception patent-eligible, the additional element or combination of elements must do “‘more than simply stat[e] the [judicial exception] while adding the words ‘apply it’”. Alice Corp. v. CLS Bank, 573 U.S. 208, 221, 110 USPQ2d 1976, 1982-83 (2014) (quoting Mayo Collaborative Servs. V. Prometheus Labs., Inc., 566 U.S. 66, 72, 101 USPQ2d 1961, 1965). Thus, for example, claims that amount to nothing more than an instruction to apply the abstract idea using a generic computer do not render an abstract idea eligible. Alice Corp., 573 U.S. at 223, 110 USPQ2d at 1983. See also 573 U.S. at 224, 110 USPQ2d at 1984 (warning against a § 101 analysis that turns on “the draftsman’s art”).
Further, M.P.E.P. § 2106.05(f)(2) recites:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process.
Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
The processor is well-understood, routine, and conventional. Applicant’s Specification, page 4 recites:
A discrimination apparatus 1 according to the present embodiment includes a storage 11, an acquisition unit 12, an extraction unit 13, a padding unit 14, a conversion unit 15, and a generation unit 16. FIG. 1 shows an example in which the acquisition unit 12, the extraction unit 13, the padding unit 14, the conversion unit 15, and the generation unit 16 are implemented in electronic circuitry 10. The electronic circuitry 10 is configured by a single processing circuit, e.g., such as a central processing unit (CPU) or a graphics processing unit (GPU), or an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The electronic circuitry 10 and the storage 11 are connected to each other via a bus in such a manner that data can be transmitted and received therebetween. The configuration is not limited to this, and each unit may be configured as a single processing circuit or a single integrated circuit.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
(2) A “convolutional neural network” is a broad term which is described at a high level. M.P.E.P. § 2106.05(f) recites:
For claim limitations that do not amount to more than a recitation of the words “apply it” (or an equivalent), such as mere instructions to implement an abstract idea on a computer, examiners should explain why they do not meaningfully limit the claim in an eligibility rejection. For example, an examiner could explain that implementing an abstract idea on a generic computer, does not integrate the abstract idea into a practical application in Step 2A Prong Two…
Further, M.P.E.P. § 2106.05(f)(2) recites:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process. Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
Applicant's convolutional neural network is well-understood, routine, and conventional. Applicant’s Specification recites:
As the trained CNN, a forward-propagation convolutional neural network is assumed; however, special multilayer CNNs such as so-called ResNet and DenseNet, which are different from common CNNs, are also applicable in a similar manner. Here, a convolution layer included in the trained CNN is designed to perform processing in units of instructions of a program. A training method and utilization method of the trained CNN according to the present embodiment will be described later.
Note that both special purpose and general purpose pretrained neural nets may be used in the claims.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
(3) A “convolutional layer” is a broad term which is described at a high level. M.P.E.P. § 2106.05(f) recites:
For claim limitations that do not amount to more than a recitation of the words “apply it” (or an equivalent), such as mere instructions to implement an abstract idea on a computer, examiners should explain why they do not meaningfully limit the claim in an eligibility rejection. For example, an examiner could explain that implementing an abstract idea on a generic computer, does not integrate the abstract idea into a practical application in Step 2A Prong Two…
Further, M.P.E.P. § 2106.05(f)(2) recites:
(2) Whether the claim invokes computers or other machinery merely as a tool to perform an existing process. Use of a computer or other machinery in its ordinary capacity for economic or other tasks (e.g., to receive, store, or transmit data) or simply adding a general purpose computer or computer components after the fact to an abstract idea (e.g., a fundamental economic practice or mathematical equation) does not integrate a judicial exception into a practical application or provide significantly more. See Affinity Labs v. DirecTV, 838 F.3d 1253, 1262, 120 USPQ2d 1201, 1207 (Fed. Cir. 2016) (cellular telephone); TLI Communications LLC v. AV Auto, LLC, 823 F.3d 607, 613, 118 USPQ2d 1744, 1748 (Fed. Cir. 2016) (computer server and telephone unit). Similarly, “claiming the improved speed or efficiency inherent with applying the abstract idea on a computer” does not integrate a judicial exception into a practical application or provide an inventive concept. Intellectual Ventures I LLC v. Capital One Bank (USA), 792 F.3d 1363, 1367, 115 USPQ2d 1636, 1639 (Fed. Cir. 2015). In contrast, a claim that purports to improve computer capabilities or to improve an existing technology may integrate a judicial exception into a practical application or provide significantly more. McRO, Inc. v. Bandai Namco Games Am. Inc., 837 F.3d 1299, 1314-15, 120 USPQ2d 1091, 1101-02 (Fed. Cir. 2016); Enfish, LLC v. Microsoft Corp., 822 F.3d 1327, 1335-36, 118 USPQ2d 1684, 1688-89 (Fed. Cir. 2016). See MPEP §§ 2106.04(d)(1) and 2106.05(a) for a discussion of improvements to the functioning of a computer or to another technology or technical field.
Applicant's convolutional layer is well-understood, routine and conventional. Applicant’s Specification recites:
As the trained CNN, a forward-propagation convolutional neural network is assumed; however, special multilayer CNNs such as so-called ResNet and DenseNet, which are different from common CNNs, are also applicable in a similar manner. Here, a convolution layer included in the trained CNN is designed to perform processing in units of instructions of a program. A training method and utilization method of the trained CNN according to the present embodiment will be described later.
Note that both special purpose and general purpose pretrained neural nets may be used in the claims.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
(4) A “type of program conversion tool” is a broad term which is described at a high level. M.P.E.P. § 2106.05(h) recites:
2106.05(h) Field of Use and Technological Environment [R-10.2019]
Another consideration when determining whether a claim integrates the judicial exception into a practical application in Step 2A Prong Two or recites significantly more than a judicial exception in Step 2B is whether the additional elements amount to more than generally linking the use of a judicial exception to a particular technological environment or field of use. As explained by the Supreme Court, a claim directed to a judicial exception cannot be made eligible “simply by having the applicant acquiesce to limiting the reach of the patent for the formula to a particular technological use.” Diamond v. Diehr, 450 U.S. 175, 192 n.14, 209 USPQ 1, 10 n. 14 (1981). Thus, limitations that amount to merely indicating a field of use or technological environment in which to apply a judicial exception do not amount to significantly more than the exception itself, and cannot integrate a judicial exception into a practical application.
The courts often cite to Parker v. Flook as providing a classic example of a field of use limitation. See, e.g., Bilski v. Kappos, 561 U.S. 593, 612, 95 USPQ2d 1001, 1010 (2010) (“Flook established that limiting an abstract idea to one field of use or adding token postsolution components did not make the concept patentable”) (citing Parker v. Flook, 437 U.S. 584, 198 USPQ 193 (1978)). In Flook, the claim recited steps of calculating an updated value for an alarm limit (a numerical limit on a process variable such as temperature, pressure or flow rate) according to a mathematical formula “in a process comprising the catalytic chemical conversion of hydrocarbons.” 437 U.S. at 586, 198 USPQ at 196. Processes for the catalytic chemical conversion of hydrocarbons were used in the petrochemical and oil-refining fields. Id. Although the applicant argued that limiting the use of the formula to the petrochemical and oil-refining fields should make the claim eligible because this limitation ensured that the claim did not preempt all uses of the formula, the Supreme Court disagreed. 437 U.S. at 588-90, 198 USPQ at 197-98. Instead, the additional element in Flook regarding the catalytic chemical conversion of hydrocarbons was not sufficient to make the claim eligible, because it was merely an incidental or token addition to the claim that did not alter or affect how the process steps of calculating the alarm limit value were performed. Further, the Supreme Court found that this limitation did not amount to an inventive concept. 437 U.S. at 588-90, 198 USPQ at 197-98. The Court reasoned that to hold otherwise would “exalt[] form over substance”, because a competent claim drafter could attach a similar type of limitation to almost any mathematical formula. 437 U.S. at 590, 198 USPQ at 197.
In contrast, the additional elements in Diamond v. Diehr as a whole provided eligibility and did not merely recite calculating a cure time using the Arrhenius equation “in a rubber molding process”. Instead, the claim in Diehr recited specific limitations such as monitoring the elapsed time since the mold was closed, constantly measuring the temperature in the mold cavity, repetitively calculating a cure time by inputting the measured temperature into the Arrhenius equation, and opening the press automatically when the calculated cure time and the elapsed time are equivalent. 450 U.S. at 179, 209 USPQ at 5, n. 5. These specific limitations act in concert to transform raw, uncured rubber into cured molded rubber. 450 U.S. at 177-78, 209 USPQ at 4.
Applicant’s Specification recites:
The conversion unit 15 generates a plurality of input layer data strings by executing bit encoding processing on the input data strings.
The generation unit 16 generates a feature vector or a classification result of the program based on the input data strings or input layer data strings by using the trained CNN. As the classification result, a result of at least one of classification between programs and non-programs, classification by type of compiler used for generating the program, classification by type of program conversion tool (such as an obfuscator, a packer, and the like) used for generating the program, and classification by type of function included in the program is assumed.
Therefore, the claim as a whole does not amount to significantly more than the exception itself (i.e., there is no inventive concept in the claim). (See, M.P.E.P. § 2106.05(II)).
Therefore, the answer to the inquiry is “NO”, no additional elements provide an inventive concept that is significantly more than the claimed abstract ideas the claimed abstract idea into a practical application.
Claim 15 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 16
Claim 16 recites:
16. The discrimination apparatus according to claim 15, wherein the classification result indicates a classification result of at least one of classification between a program and a non- program, classification by type of compiler used for generating the program, classification by type of program conversion tool used for generating the program, and classification by type of function included in the program.
Applicant’s Claim 16 merely teaches the result of a “classification” step (i.e., a mental step). It does not integrate the abstract idea to a practical application, nor is it anything significantly more than the abstract idea. (See, 2106.05(a)(II).)
Claim 16 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Claim 17
Claim 17 recites:
17. The discrimination apparatus according to claim 15, wherein the processor performs disassembler processing.
Applicant’s Claim 17 merely teaches a well-understood, routine, and conventional disassembler. The Reverse-Engineering-Network, The Art Of Disassembly, ALPHA Release, 18 NOV 2003, pp. 1-119 recites:
13.2 Final Words
This chapter was the last part of the Intel Instruction Format. We should by now know everything (at least most of the knowledge) about the Intel Instruction Format. In the next chapter we’ll cover some few things that we didn’t mention, about the Intel Instruction Format. After the next chapter, we’ll go into an amazing journey, making our disassembler. We’ll have a great time coding our disassembler, and watching how it really decodes the bytes :) But as a suggestion from me, please don’t go on before you understand the previous chapters. If you do have some questions that the previous chapters couldn’t answer, you know where to ask us questions.
It does not integrate the abstract idea to a practical application, nor is it anything significantly more than the abstract idea. (See, 2106.05(a)(II).)
Claim 17 is, therefore, NOT ELIGIBLE subject matter under 35 U.S.C. § 101.
Response to Arguments
Applicant's arguments filed 01 JUL 2026 have been fully considered but they are not persuasive. Specifically, Applicant argues:
Argument 1
Even of the claims are directed to an abstract idea as argued in the Office Action, Applicant respectfully submits that the claims integrate the abstract idea into a practical application. Applicant's specification provides at least in paragraphs [0025] and [0058] that disclosed embodiments execute specific encoding SO that the instructions extracted from binary data have fixed length and process the fixed length data with a trained convolutional neural network to detect at least one of type of complier, a classification between programs and non-programs, a type of program conversion tool, and a type of function. This provides clear technical improvements, including automation and enhanced accuracy of analysis, to the technical fields (i.e., “fields of use”) of cybersecurity and digital forensics and enables identification of the infection position and development environment of malware with high accuracy.
The limitations of amended claim 1, including processing fixed length and encoded binary data by a convolutional neural network specifically trained for the detection of "at least one of a type of compiler, a classification between programs and non-programs, a type of program conversion tool, or a type of function includes in the program" and outputting the infection position of malware, are not a mere application of a general computer science algorithm. Rather, amended claim 1 recites a practical application that improves the malware analysis technology itself.
Applicant argues that the clamed invention improves “technical fields,” which are actually “fields of use,” rather than an improved technology.
Further, Applicant argues that the “processing” of “binary data” with a generic “convolutional neural network” improves these “technical fields” and recites a practical application. The mere processing of mathematical data through a generic neural network does not improve a “technology,” nor does it recite any practical application.
Lastly, the argued “outputting the infection position” is merely the outputting (presumably from the convolutional neural network, rather than the computer) of data, which may be purely mathematical. There is no specific use of this data, analogous to the use of the output of the Arrhenius equation to automatically open a rubber kiln door, as in Diamond v. Diehr.
Applicant’s argument is unpersuasive.
The rejections stand.
Argument 2
In addition, the specification discloses transfer learning by which the weights of at least one trained convolutional layer remain fixed rather than retrained during training of subsequent convolutional neural network layers. Specification, paragraphs [0064]-[0066]. Such reuse of previously learned features provides an improvement over conventional backpropagation that updates all layers during training. As explained in Ex parte Desjardins, these types of improvements to machine learning technology are patent eligible. See Advance Notice of Change to the MPEP in light of Ex Parte Desjardins, available at <https://www.uspto.gov/sites/default/files/documents/memo-desiardins.pdf>
Accordingly, amended claim 1 solves a specific technical problem and achieves technical improvements and, as a result, is patent eligible.
The elements Applicant argues are not claimed (neither the specific limitations, such as fixing of weights, nor the overall name “transfer learning” is in the claim), but are taught in Specification, paragraphs [0064]-[0066]. Even if it were in the claim, one of ordinary skill in the art would have little trouble finding evidence that “transfer learning” is well-understood, routine, and conventional.
Applicant’s argument is unpersuasive.
The rejections stand.
Argument 3
Applicant also respectfully submits that amended claims 7 and 15 are patent eligible for similar reasons. In addition, Applicant respectfully submits that the dependent claims are patent eligible for at least the foregoing reasons and also because of the recitation of additional patentable limitations.
For at least these reasons, Applicant respectfully requests withdrawal of the rejections under § 101.
Similar arguments for similar clams are similarly unpersuasive.
The rejections stand.
Argument 4
Dependent Claims
Although Applicant has not addressed all the issues of the dependent claims, Applicant respectfully submits that Applicant does not necessarily agree with the characterization and assessments of the dependent claims made by the Examiner, and Applicant believes that each claim is patentable on its own merits. Applicant respectfully submits that the dependent claims incorporate by reference all the limitations of the claim to which they refer and include their own patentable features and are therefore in condition for allowance. Therefore, Applicant respectfully requests the withdrawal of all claim rejections and prompts allowance of the claims.
Applicant's arguments regarding the independent claims were
unpersuasive. Therefore, there is no eligible matter in the independent
claims that may be incorporated by reference to the dependent claims.
The rejections stand.
Conclusion
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiries concerning this communication or earlier communications from the examiner should be directed to Wilbert L. Starks, Jr., who may be reached Monday through Friday, between 8:00 a.m. and 5:00 p.m. EST. or via telephone at (571) 272-3691 or email: Wilbert.Starks@uspto.gov.
If you need to send an Official facsimile transmission, please send it to (571) 273-8300.
If attempts to reach the examiner are unsuccessful the Examiner’s Supervisor (SPE), Kakali Chaki, may be reached at (571) 272-3719.
Hand-delivered responses should be delivered to the Receptionist @ (Customer Service Window Randolph Building 401 Dulany Street, Alexandria, VA 22313), located on the first floor of the south side of the Randolph Building.
Finally, information regarding the status of an application may be obtained from the Patent Application Information Retrieval (PAIR) system. Moreover, status information for published applications may be obtained from either Private PAIR or Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you have any questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) toll-free @ 1-866-217-9197.
/WILBERT L STARKS/
Primary Examiner, Art Unit 2122
WLS
10 SEP 2026