Prosecution Insights
Last updated: July 17, 2026
Application No. 19/188,056

GENERATIVE MODEL-DRIVEN SAMPLING FOR ADAPTIVE SPARSE MULTIMODAL SENSING OF USER ENVIRONMENT AND INTENT

Non-Final OA §102§103
Filed
Apr 24, 2025
Priority
Apr 26, 2024 — provisional 63/639,176
Examiner
RAYAN, MIHIR K
Art Unit
2622
Tech Center
2600 — Communications
Assignee
Meta Platforms Technologies LLC
OA Round
1 (Non-Final)
85%
Grant Probability
Favorable
1-2
OA Rounds
1y 1m
Est. Remaining
96%
With Interview

Examiner Intelligence

Grants 85% — above average
85%
Career Allowance Rate
509 granted / 598 resolved
+23.1% vs TC avg
Moderate +11% lift
Without
With
+10.9%
Interview Lift
resolved cases with interview
Typical timeline
2y 4m
Avg Prosecution
20 currently pending
Career history
620
Total Applications
across all art units

Statute-Specific Performance

§101
0.5%
-39.5% vs TC avg
§103
85.8%
+45.8% vs TC avg
§102
4.5%
-35.5% vs TC avg
§112
3.6%
-36.4% vs TC avg
Black line = Tech Center average estimate • Based on career data from 598 resolved cases

Office Action

§102 §103
DETAILED ACTION Notice of Pre-AIA or AIA Status The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA . Information Disclosure Statement Acknowledgment is made of information disclosure statement filed 22 July 2025. Claim Rejections - 35 USC § 102 In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action: A person shall be entitled to a patent unless – (a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention. Claim(s) 1 – 12 and 14 - 20 is/are rejected under 35 U.S.C. 102(a)(1) as being anticipated by GRUHLKE et al; (Publication number: US 2022/0124242 A1), hereafter GRUHKLE. Regarding claim 1: GRUHKLE discloses a computer-implemented method (GRUHKLE [0007] “aspects generally include a method, apparatus, system …”), comprising: predicting a user state, wherein the user state is measurable via a plurality of different sensor sampling modes (GRUHKLE [0051] … the camera is configured for gaze analysis. For example, the camera may provide, in a high-power mode, images to the controller that can be analyzed to determine a gaze direction of the eyes of the user. Within the context of claim 1 there is no difference between “predicting” and “determining” wherein “a gaze direction” defines the user state.); determining a level of uncertainty associated with the predicted user state (GRUHKLE [0055] … the motion analysis module detects eye activity associated with the user being able to optically interpret the media on the display …”; the determination of the user’s eye activity data is the level of uncertainty, as claimed. This includes the determination that the user is able to/not able to interpret media on the display); and selecting, from the plurality of different sensor sampling modes, a sampling mode to measure the user state (GRUHKLE Figure 4B 440/450, [0053] … the motion analysis module detects eye activity associated with the user being unable to optically interpret…; The method judges based on the eye movement data (corresponds to the user state), if a user is able to visually perceive elements (corresponds to the level of uncertainty), and adjusts the power level of the sensors accordingly)., wherein selecting the sampling mode comprises: selecting a first sampling mode in response to determining that the level of uncertainty is at or above a threshold (GRUHKLE [0054] … the controller deactivates the camera and/or reduces capability of the camera. For example, the controller may shut the camera down and/or reduce an amount of power being supplied to the camera … the controller may deactivate the gaze analysis module and/or cease to analyze a gaze of the user… ; [0049] camera is the sensor which measures user state, as claimed. The sampling mode, as claimed, is based on output of analysis module which determines whether user is able to interpret media on the display; [0055] [0058]); or selecting a second sampling mode in response to determining that the level of uncertainty is below the threshold (GRUHKLE [0056] … the controller reactivates the camera and/or improves a capability of the camera; [0049] camera is the sensor which measures user state, as claimed. The sampling mode, as claimed, is based on output of analysis module which determines whether user is able/not able to interpret media on the display; [0055] [0058]). Regarding claim 2: GRUHKLE discloses the computer-implemented method of claim 1, wherein the user state comprises at least one of: a user behavior; a user biometric; or an environmental state relating to a user (GRUHKLE [0051]; user state includes a gaze analysis). Regarding claim 3: GRUHKLE discloses the computer-implemented method of claim 2, wherein the user behavior comprises a user ocular behavior (GRUHKLE [0051]). Regarding claim 4: GRUHKLE discloses the computer-implemented method of claim 3, wherein the user ocular behavior comprises movement of at least one of a user pupil position or a user gaze (GRUHKLE [0051] [0055] user movement may include saccade in which movement of pupil position and gaze is changed). Regarding claim 5: GRUHKLE discloses the computer-implemented method of claim 3, wherein: the first sampling mode comprises sampling the user ocular behavior using a first type of sensor; and the second sampling mode comprises sampling the user ocular behavior using a second type of sensor (GRUHKLE [0037 – 0040] vision sensor 305 and camera 315). Regarding claim 6: GRUHKLE discloses the computer-implemented method of claim 5, wherein: the first type of sensor is different than the second type of the sensor (GRUHKLE [0037 – 0040] vision sensor 305 is a first sensor and camera 315 is a second sensor); and at least one of the first type of sensor or the second type of sensor comprises at least one of: an ultrasound detector; a camera; a self-mixing interferometry sensor; or a scanning-based eye-tracking sensor (GRUHKLE [0037 – 0040]; camera 315). Regarding claim 7: GRUHKLE discloses the computer-implemented method of claim 6, wherein the camera comprises at least one of: a waveguide-based camera; an infrared camera; a near-infrared camera; a video-based eye tracking camera; or a stereo camera (GRUHKLE [0054 – 0056] motion analysis performed using the camera corresponds to video-based eye tracking camera, as claimed). Regarding claim 8: GRUHKLE discloses the computer-implemented method of claim 3, wherein: the first sampling mode comprises capturing image data at a high-frame rate that is high relative to a low-frame rate; and the second sampling mode comprises image data at the low-frame rate (GRUHKLE [0054 – 0055] camera reduces frame rate of the camera). Regarding claim 9: GRUHKLE discloses the computer-implemented method of claim 1, wherein the first sampling mode is associated with a power consumption requirement that is high relative to a power consumption requirement associated with the second sample mode (GRUHKLE [0037 -0040] first sampling mode corresponds to high power camera sensing while low sensing mode corresponds to low power vision sensing). Regarding claim 10: GRUHKLE discloses the computer-implemented method of claim 1, wherein: the first sampling mode comprises the use of at least one always-on sensor; and the second sampling mode comprises the use of at least one on-demand sensor (GRUHKLE [0039] [0041] vision sensor always-on; camera enabled based selectively or on-demand). Regarding claim 11: GRUHKLE does not disclose the computer-implemented method of claim 1, wherein at least one of the predicting the user state and the determining the level of uncertainty comprises using a model that is pretrained based on past user behaviors and sensor measurements (Miller [0009] machine learning model is trained with commands resulting from eye gazing techniques). Regarding claim 12: GRUHKLE discloses the computer-implemented method of claim 1, wherein the predicting the user state comprises determining a physical location of the user (GRUHKLE [0029] input unit include GPS positioning system). Regarding claim 14: GRUHKLE discloses the computer-implemented method of claim 12, wherein the determining the physical location of the user comprises determining a physical location of the user using geolocation (GRUHKLE [0029] input unit include GPS positioning system). Regarding claim 15: GRUHKLE discloses the computer-implemented method of claim 1, wherein the predicting, the determining, and the selecting steps are each performed by at least one computation location of a plurality of locations, the plurality of locations comprises: a headset; a user computing device; and a cloud-based network (GRUHKLE Figure 4C headset; [0045] the headset which is worn by the user and moveable provides a plurality of computation locations during use. The primary location being an instant location of the user) Regarding claim 16: GRUHKLE discloses the computer-implement method of claim 15, further comprising selecting, from the plurality of computation locations, a primary computation location for performing each of the predicting, the determining, and the selecting steps (GRUHKLE Figure 4C headset; [0045] the headset which is worn by the user and moveable provides a plurality of computation locations during use. The primary location being an instant location of the user). Regarding claim 17: GRUHKLE discloses a system (GRUHKLE [0007] “aspects generally include a method, apparatus, system …”), comprising: a mode-selection subsystem configured to select sampling modes to measure user states (GRUHKLE Figure 4B/4C controller corresponds to claimed mode-selection subsystem), wherein the user states are each measurable via a plurality of different sensor sample modes (GRUHKLE Figure 6 630 and 660); a headset comprising a plurality of sensors (GRUHKLE [0045] wearable user device include VR/AR headset); at least one physical processor (GRUHKLE Figure 2 processor 210); and physical memory comprising computer-executable instruction that, when executed by the physical processor (GRUHKLE [0027] memory 215 includes instructions), cause the physical processor to: predict a user state (GRUHKLE [0051] … the camera is configured for gaze analysis. For example, the camera may provide, in a high-power mode, images to the controller that can be analyzed to determine a gaze direction of the eyes of the user. Within the context of claim 1 there is no difference between “predicting” and “determining” wherein “a gaze direction” defines the user state.); determine a level of uncertainty associated with the predicted user state (GRUHKLE [0055] … the motion analysis module detects eye activity associated with the user being able to optically interpret the media on the display …”; the determination of the user’s eye activity data is the level of uncertainty, as claimed. This includes the determination that the user is able to/not able to interpret media on the display); and select, from the plurality of different sensor sampling modes, a sampling mode to measure the user state (GRUHKLE Figure 4B 440/450, [0053] … the motion analysis module detects eye activity associated with the user being unable to optically interpret…; The method judges based on the eye movement data (corresponds to the user state), if a user is able to visually perceive elements (corresponds to the level of uncertainty), and adjusts the power level of the sensors accordingly), wherein the selecting the sampling mode comprises: selecting a first sampling mode in response to determining that the level of uncertainty is at or above a first threshold (GRUHKLE [0054] … the controller deactivates the camera and/or reduces capability of the camera. For example, the controller may shut the camera down and/or reduce an amount of power being supplied to the camera … the controller may deactivate the gaze analysis module and/or cease to analyze a gaze of the user… ; [0049] camera is the sensor which measures user state, as claimed. The sampling mode, as claimed, is based on output of analysis module which determines whether user is able to interpret media on the display; [0055] [0058]); or selecting a second sampling mode in response to determining that the level of uncertainty is blow the threshold (GRUHKLE [0056] … the controller reactivates the camera and/or improves a capability of the camera; [0049] camera is the sensor which measures user state, as claimed. The sampling mode, as claimed, is based on output of analysis module which determines whether user is able/not able to interpret media on the display; [0055] [0058]). Regarding claim 18: Claim 18 is similarly rejected for those reasons discussed above in claim 11. Regarding claim 19: Claim 19 is similarly rejected for those reasons discussed above in claim 6. Regarding claim 20: Claim 20 is similarly rejected for those reasons discussed above in claim 1 (and additionally [0027] memory with instructions). Claim Rejections - 35 USC § 103 In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status. The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action: A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made. The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows: 1. Determining the scope and contents of the prior art. 2. Ascertaining the differences between the prior art and the claims at issue. 3. Resolving the level of ordinary skill in the pertinent art. 4. Considering objective evidence present in the application indicating obviousness or nonobviousness. This application currently names joint inventors. In considering patentability of the claims the examiner presumes that the subject matter of the various claims was commonly owned as of the effective filing date of the claimed invention(s) absent any evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1.56 to point out the inventor and effective filing dates of each claim that was not commonly owned as of the effective filing date of the later invention in order for the examiner to consider the applicability of 35 U.S.C. 102(b)(2)(C) for any potential 35 U.S.C. 102(a)(2) prior art against the later invention. Claim(s) 13 is/are rejected under 35 U.S.C. 103 as being unpatentable over GRUHKLE in view of Vengroff et al; (publication number: US 2009/0005987 A1), hereafter Vengroff. Regarding claim 13: GRUHKLE does not disclose the computer-implemented method of claim 12, wherein the predicting the user state further comprises: determining that information related to the physical location is not currently stored in a reference database for the user; and obtaining additional information about the physical location from at least one external database. However, Vengroff discloses determining locations of interest based on user visits. More particularly, Vengroff discloses: determining that information related to the physical location is not currently stored in a reference database for the user (Vengroff [0052] anonymous location corresponds to determined locations for which corresponding point of interest has not been identified; see also Figure 11 memory 1145 includes interest identifiers 1152, 1154, 1156); and obtaining additional information about the physical location from at least one external database (Vengroff [0014] “… if the determined location of interest is an anonymous location without a known identification (e.g., without an identification of one or more points of interest at that location), the techniques may in some embodiments include identifying one or more points of interest (e.g., businesses, parks, schools, landmarks, etc.) that are located at or otherwise correspond to the determined location of interest.”; [0087] … “ The system 1150 may also obtain other types of information of interest, such as commercial map database information or other location information about possible POIs, from various sources, such as data sources 1188 and/or the third-party computing systems 1190.”). It would have been obvious to modify GRUHKLE to include: determining that information related to the physical location is not currently stored in a reference database for the user; and obtaining additional information about the physical location from at least one external database, as claimed. Those skilled in the art would appreciate the ability to provide location information from an otherwise sparse dataset. Conclusion Any inquiry concerning this communication or earlier communications from the examiner should be directed to MIHIR K RAYAN whose telephone number is (571)270-5719. The examiner can normally be reached Monday - Friday 9 - 5pm (EST). Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Patrick Edouard can be reached at 571-272-7063. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /MIHIR K RAYAN/ 11 May 2026Primary Examiner, Art Unit 2622
Read full office action

Prosecution Timeline

Apr 24, 2025
Application Filed
May 13, 2026
Non-Final Rejection mailed — §102, §103 (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12681576
WEARABLE MATERIAL DESIGNED TO MAINTAIN CHARACTERISTIC IMPEDANCE LEVELS WITHIN DESIRED RANGE, AND SYSTEMS AND METHODS OF USE THEREOF
1y 9m to grant Granted Jul 14, 2026
Patent 12669865
DISPLAY SYSTEM AND USER INTERFACE
1y 9m to grant Granted Jun 30, 2026
Patent 12670842
DISPLAY DEVICE
1y 6m to grant Granted Jun 30, 2026
Patent 12663874
Integration of Artificial Reality Interaction Modes
1y 9m to grant Granted Jun 23, 2026
Patent 12663857
HEAD MOUNTED DISPLAY APPARATUS
1y 6m to grant Granted Jun 23, 2026
Study what changed to get past this examiner. Based on 5 most recent grants.

Strategy Recommendation AI-generated — please review before filing

Get a prosecution strategy drawn from examiner precedents, rejection analysis, and claim mapping.
Typically takes 5-10 seconds — AI-generated, attorney review required before filing

Prosecution Projections

1-2
Expected OA Rounds
85%
Grant Probability
96%
With Interview (+10.9%)
2y 4m (~1y 1m remaining)
Median Time to Grant
Low
PTA Risk
Based on 598 resolved cases by this examiner. Grant probability derived from career allowance rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month