Prosecution Insights
Last updated: July 17, 2026
Application No. 18/957,620

DATA SET AND ALGORITHM VALIDATION, BIAS CHARACTERIZATION, AND VALUATION

Final Rejection §101
Filed
Nov 22, 2024
Priority
Oct 28, 2015 — CIP of 14/925,974 +45 more
Examiner
DIVELBISS, MATTHEW H
Art Unit
3624
Tech Center
3600 — Transportation & Electronic Commerce
Assignee
Qomplx LLC
OA Round
2 (Final)
23%
Grant Probability
At Risk
3-4
OA Rounds
2y 2m
Est. Remaining
47%
With Interview

Examiner Intelligence

Grants only 23% of cases
23%
Career Allowance Rate
88 granted / 380 resolved
-28.8% vs TC avg
Strong +24% interview lift
Without
With
+23.6%
Interview Lift
resolved cases with interview
Typical timeline
3y 10m
Avg Prosecution
42 currently pending
Career history
426
Total Applications
across all art units

Statute-Specific Performance

§101
34.3%
-5.7% vs TC avg
§103
59.6%
+19.6% vs TC avg
§102
4.9%
-35.1% vs TC avg
§112
0.7%
-39.3% vs TC avg
Black line = Tech Center average estimate • Based on career data from 380 resolved cases

Office Action

§101
DETAILED ACTION The following is a Final Office action. In response to Examiner’s communication of 1/21/26, Applicant, on 4/21/2026, amended claims 1, 3, 5, 6, and 10. Claims 1-10 are now pending and have been rejected as indicated below. Notice of Pre-AIA or AIA Status The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA . Response to Amendment Applicant’s amendments are acknowledged. The 35 USC 101 rejections of claims 1-10 regarding abstract ideas are still applied in light of Applicant’s amendments and explanations. Claim Rejections - 35 USC§ 101 35 U.S.C. 101 reads as follows: Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of this title. Claims 1-10 are rejected under 35 U.S.C. 101 because the claimed invention is directed to a judicial exception (i.e., a law of nature, a natural phenomenon, or an abstract idea) without significantly more. Here, under considerations of the broadest reasonable interpretation of the claimed invention, Examiner finds that the Applicant invented a method and system for data set validation to facilitate data set and algorithm bias certification and scoring. Examiner formulates an abstract idea analysis, following the framework described in the MPEP as follows: Step 1: The claims are directed to a statutory category, namely a "method" (claims 6-10) and "system" (claims 1-5). Step 2A - Prong 1: The claims are found to recite limitations that set forth the abstract idea(s), namely, regarding claim 1: … pass the first data set through a series of filters to reduce the first data set to its core information content; analyze the core information content to determine an information gain obtained by filtering the first data set based on an information entropy of the core information content; certify the data set if the information gain exceeds a threshold; create a certified model …; use the certified model to generate a baseline output using the first data set as input; and … use the second data set as an input to the certified model to generate a set output; perform a bias characterization analysis by comparing the baseline output to the set output; generate a bias characterization score from the bias characterization analysis; … score the second data set based on a plurality of scoring metrics, which includes the bias characterization score and a provenance score, wherein the provenance score is determined by analyzing a plurality of provenance metrics comprising at least one of persistence failures, regulatory violations, and chain of custody inconsistencies; and create and store a data set value score as a weighted combination of the scores of the plurality of scoring metrics wherein the data set value score is stored as metadata of the second data set Independent claim 6 recite substantially similar claim language. Dependent claims 2-5, and 7-10 recite the same or similar abstract idea(s) as independent claims 1 and 6 with merely a further narrowing of the abstract idea(s) to particular data characterization and/or additional data analyses performed as part of the abstract idea. The limitations in claims 1-10 above falling well-within the groupings of subject matter identified by the courts as being abstract concepts, specifically the claims are found to correspond to the category of: "Certain methods of organizing human activity- fundamental economic principles or practices (including hedging, insurance, mitigating risk); commercial or legal interactions (including agreements in the form of contracts; legal obligations; advertising, marketing or sales activities or behaviors; business relations); managing personal behavior or relationships or interactions between people (including social activities, teaching, and following rules or instructions)" as the limitations identified above are directed to data set validation to facilitate data set and algorithm bias certification and scoring and thus is a method of organizing human activity including at least commercial or business interactions or relations and/or a management of user personal behavior Step 2A - Prong 2: Claims 1-20 are found to clearly be directed to the abstract idea identified above because the claims, as a whole, fail to integrate the claimed judicial exception into a practical application, specifically the claims recite the additional elements of: " A system for data set validation, bias characterization, and valuation, comprising: a computing device comprising a memory, a processor, and a non-volatile data storage device; a plurality of programming instructions that, when operating on the processor, cause the computing device to: retrieve a first data set from the non-volatile data storage device;… store the certified data set, the certified model, and the baseline output in the non-volatile data storage device; and receive a second data set; … and store the bias characterization score in the non-volatile data storage device" (claims 1 and 6); “by training a machine learning algorithm with the certified data set,” (claims 1 and 6); “provide a data provider access portal to receive queries to retrieve data sets, wherein the data provider access portal populates results based on the metadata corresponding to the data set value score for each data set,” (claims 1 and 6) however the aforementioned elements merely amount to generic components of a general purpose computer used to "apply" the abstract idea (MPEP 2106.0S(f)) and thus fails to integrate the recited abstract idea into a practical application, furthermore the high-level recitation of receiving data from a generic "system" is at most an attempt to limit the abstract to a particular field of use (MPEP 2106.0S(h), e.g.: "For instance, a data gathering step that is limited to a particular data source (such as the Internet) or a particular type of data (such as power grid data or XML tags) could be considered to be both insignificant extra-solution activity and a field of use limitation. See, e.g., Ultramercial, 772 F.3d at 716, 112 USPQ2d at 1755 (limiting use of abstract idea to the Internet); Electric Power, 830 F.3d at 1354, 119 USPQ2d at 1742 (limiting application of abstract idea to power grid data); Intellectual Ventures I LLC v. Erie lndem. Co., 850 F.3d 1315, 1328-29, 121 USPQ2d 1928, 1939 (Fed. Cir. 2017) (limiting use of abstract idea to use with XML tags).") and/or merely insignificant extra-solution activity (MPE 2106.05(g)) and thus further fails to integrate the abstract idea into a practical application; Step 2B: Claims 1-10 do not include additional elements that are sufficient to amount to significantly more than the judicial exception because the additional elements as described above with respect to Step 2A Prong 2 merely amount to a general purpose computer that attempts to apply the abstract idea in a technological environment (MPEP 2106.0S(f)), including merely limiting the abstract idea to a particular field of use of data set validation to facilitate data set and algorithm bias certification and scoring as explained above, and/or performs insignificant extra-solution activity, e.g. data gathering or output, (MPEP 2106.0S(g)), as identified above, which is further found under step 2B to be merely well-understood, routine, and conventional activities as evidenced by MPEP 2106.0S(d)(II) (describing conventional activities that include transmitting and receiving data over a network, electronic recordkeeping, storing and retrieving information from memory, electronically scanning or extracting data from a physical document, and a web browser's back and forward button functionality). Therefore, similarly the combination and arrangement of the above identified additional elements when analyzed under Step 2B also fails to necessitate a conclusion that the claims amount to significantly more than the abstract idea directed to data set validation to facilitate data set and algorithm bias certification and scoring. Claims 1-10 are accordingly rejected under 35 USC§ 101 because the claimed invention is directed to a judicial exception (i.e., a law of nature, a natural phenomenon, or an abstract idea(s)) without significantly more. Note: The analysis above applies to all statutory categories of invention. As such, the presentment of any claim otherwise styled as a machine or manufacture, for example, would be subject to the same analysis. For further authority and guidance, see: MPEP § 2106 https://www.uspto.gov/patents/laws/examination-policy/subject-matter-eligibility Subject Matter Overcoming Prior Art Claims 1-10 are found to be provisionally allowable. The claims would be found to be allowable if they overcame the 35 USC 101 rejection. Reasons for Overcoming the Prior Art It appears that the instant invention is beyond the skill of one of ordinary skill in the art. Accordingly the invention would NOT have been obvious because one of ordinary skill could not have been expected to achieve it, NOR would they have been able to predict the results, and as such, they would have had no capability of expecting success. The following is an examiner's statement of features not found in the prior art of record: Claims 1-10 overcome the prior art of record and are found to be provisionally allowable. The following limitations of claim 1, … retrieve a first data set from the non-volatile data storage device; pass the first data set through a series of filters to reduce the first data set to its core information content; analyze the core information content to determine an information gain obtained by filtering the first data set based on an information entropy of the core information content; certify the data set if the information gain exceeds a threshold; create a certified model by training a machine learning algorithm with the certified data set; use the certified model to generate a baseline output using the first data set as input; … receive a second data set; retrieve the certified model and the baseline output from the non-volatile data storage device; use the second data set as an input to the certified model to generate a set output; perform a bias characterization analysis by comparing the baseline output to the set output; generate a bias characterization score from the bias characterization analysis; … score the second data set based on a plurality of scoring metrics, which includes the bias characterization score and a provenance score, wherein the provenance score is determined by analyzing a plurality of provenance metrics comprising at least one of persistence failures, regulatory violations, and chain of custody inconsistencies; … in combination with the remainder of the claim limitations are neither taught nor suggested, singularly or in combination, by the prior art of record. Furthermore, neither the prior art, the nature of the problem, nor knowledge of a person having ordinary skill in the art provides for any predictable or reasonable rationale to combine prior art teachings. Independent claim 6, and dependent claims 2-5 and 7-10 are likewise provisionally allowable. Any comments considered necessary by applicant must be submitted no later than the payment of the issue fee and, to avoid processing delays, should preferably accompany the issue fee. Such submissions should be clearly labeled “Comments on Statement of Reasons for Allowance.” The closest prior art of record is described as follows: Chandramouli et al. (U.S. Patent Application Publication Number 2012/0254333) - The abstract provides for the following: A method and apparatus for automatically identifying harmful electronic messages, such as those presented in emails, on Craigslist or on Twitter, Facebook and other social media websites, features methodology for discriminating unwanted garbage communications (spam) and unwanted deceptive messages (scam) from wanted, truthful communications based upon patterns discernable from samples of each type of electronic communication. Methods are proposed that enable discrimination of wanted from unwanted communications in short electronic messages, such as on Twitter and for multilingual application. Myslinski (U.S. Patent Application Publication Number 2014/0188461) - The abstract provides for the following: A fact checking system is able to verify the correctness of information and/or characterize information by comparing the information with one or more sources. The fact checking system automatically monitors, processes, fact checks information and indicates a status of the information. Fact checking results are able to be validated by re-fact checking the fact check results. Myslinski (U.S. Patent Application Publication Number 2013/0151240) - The abstract provides for the following: A fact checking system is able to verify the correctness of information and/or characterize information by comparing the information with one or more sources. The fact checking system automatically monitors, processes, fact checks information and indicates a status of the information. The fact checking system is able to be interactive with a user, so that a user is able to respond to a fact check result and receive additional information. Hoffberg (U.S. Patent Number 9818136) - The abstract provides for the following: A system and method providing for communication and resolution of utility functions between participants, wherein the utility function is evaluated based on local information at the recipient to determine a cost value thereof. A user interface having express representation of both information elements, and associated reliability of the information. An automated system for optimally conveying information based on relevance and reliability. Rashid Hussain Khokhar et al. “Enabling Secure Trustworthiness Assessment and Privacy Protection in Integrating Data for Trading Person-Specific Information.” The abstract provides for the following: With increasing adoption of cloud services in the e-market, collaboration between stakeholders is easier than ever. Consumer stakeholders demand data from various sources to analyze trends and improve customer services. Data-as-a-service enables data integration to serve the demands of data consumers. However, the data must be of good quality and trustful for accurate analysis and effective decision making. In addition, a data custodian or provider must conform to privacy policies to avoid potential penalties for privacy breaches. To address these challenges, we propose a twofold solution: 1) we present the first information entropy-based trust computation algorithm, IEB_Trust, that allows a semitrusted arbitrator to detect the covert behavior of a dishonest data provider and chooses the qualified providers for a data mashup and 2) we incorporate the Vickrey–Clarke–Groves (VCG) auction mechanism for the valuation of data providers’ attributes into the data mashup process. Experiments on real-life data demonstrate the robustness of our approach in restricting dishonest providers from participation in the data mashup and improving the efficiency in comparison to provenance-based approaches. Furthermore, we derive the monetary shares for the chosen providers from their information utility and trust scores over the differentially private release of the integrated dataset under their joint privacy requirements. Overman et al. (WO Patent Application Publication Number WO/2010/042936) - The abstract provides for the following: One embodiment of the present invention relates to a system for measurement and verification of data related to at least one financial derivative instrument, wherein the data related to the at least one financial derivative instrument is associated with at least a first financial institution and a second financial institution, and wherein the first financial institution and the second financial institution are different from one another. Response to Arguments Applicant’s arguments filed 4/21/2026 have been fully considered but they are not persuasive. Applicant argues that the claims are eligible under 35 USC 101. (See Applicant’s Remarks, 4/21/2026, pgs. 7-12). Examiner respectfully disagrees. As noted in the 35 USC 101 analysis presented above, the claims recite an abstract concept that is encapsulated by decision making analogous to a method of organizing human activity. Examiner notes that each of the limitations that encapsulate the abstract concepts are recited in the above 35 USC 101. Additionally, the claims do not recite a practical application of the abstract concepts in that there is no specific use or application of the method steps other than to make conclusory determinations and provide for direction for either a person or machine to follow at some future time or to make calculations that are mathematical operations. The claims do not recite any particular use for these determinations and directions that improve upon the underlying computer technology (in this instance the computer software, processor, and memory). Instead, Examiner asserts that the additional elements in the claim language are only used as implementation of the abstract concepts utilizing technology. The concepts described in the limitations when taken both as a whole and individually are not meaningfully different than those found by the courts to be abstract ideas and are similarly considered to be certain methods of organizing human activity such as managing personal behavior or relationships or interactions between people, including social activities, teaching, and following rules or instructions or to make calculations that are mathematical operations. The steps are then encapsulated into a particular technological environment by executing these steps upon a computer processor and utilizing features such as a computer interface or sending and receiving data over a network or displaying information via a computerized graphical user interface. However, sending and receiving of information over a network and execution of algorithms on a computer are utilized only to facilitate the abstract concepts (i.e. selecting data on an interface, publishing/displaying information, etc.). As such, Examiner asserts that the implementation of the abstract concepts recited by the claims utilize computer technology in a way that is considered to be generally linking the use of the judicial exception to a particular technological environment or field of use (See MPEP 2106.05(h)). Accordingly, Examiner does not find that the claims recite a practical application of the abstract concepts recited by the claims. Conclusion Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the date of this final action. Any inquiry concerning this communication or earlier communications from the examiner should be directed to MATTHEW H. DIVELBISS whose telephone number is (571) 270-0166. The fax phone number is 571-483-7110. The examiner can normally be reached on M-Th, 7:00 - 5:00. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Jerry O'Connor can be reached on (571) 272-6787. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /M. H. D./ Examiner, Art Unit 3624 /Jerry O'Connor/Supervisory Patent Examiner,Group Art Unit 3624
Read full office action

Prosecution Timeline

Nov 22, 2024
Application Filed
Jan 21, 2026
Non-Final Rejection mailed — §101
Apr 21, 2026
Response Filed
May 11, 2026
Final Rejection mailed — §101 (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12675760
PREDICTING PERFORMANCE STATISTICS OF A PLAYER USING MACHINE-LEARNING TECHNIQUES
4y 3m to grant Granted Jul 07, 2026
Patent 12664506
METHOD AND SYSTEM FOR GENERATING KEY PERFORMANCE INDICATOR PREDICTION MODEL FOR MULTI-CLOUD APPLICATIONS
2y 8m to grant Granted Jun 23, 2026
Patent 12626206
DETERMINING RELATIVE RISK IN A NETWORK SYSTEM
3y 10m to grant Granted May 12, 2026
Patent 12572889
Optimization of Large-scale Industrial Value Chains
3y 10m to grant Granted Mar 10, 2026
Patent 12503000
OPTIMIZATION PROCEDURE FOR THE ENERGY MANAGEMENT OF A SOLAR ENERGY INSTALLATION WITH STORAGE MEANS IN COMBINATION WITH THE CHARGING OF AN ELECTRIC VEHICLE AND SYSTEM
1y 4m to grant Granted Dec 23, 2025
Study what changed to get past this examiner. Based on 5 most recent grants.

Strategy Recommendation AI-generated — please review before filing

Get a prosecution strategy drawn from examiner precedents, rejection analysis, and claim mapping.
Typically takes 5-10 seconds — AI-generated, attorney review required before filing

Prosecution Projections

3-4
Expected OA Rounds
23%
Grant Probability
47%
With Interview (+23.6%)
3y 10m (~2y 2m remaining)
Median Time to Grant
Moderate
PTA Risk
Based on 380 resolved cases by this examiner. Grant probability derived from career allowance rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month