Prosecution Insights
Last updated: April 19, 2026
Application No. 19/067,789

TECHNIQUES FOR COORDINATING ARTIFICIAL-REALITY INTERACTIONS USING AUGMENTED-REALITY INTERACTION GUIDES FOR PERFORMING INTERACTIONS WITH PHYSICAL OBJECTS WITHIN A USER'S PHYSICAL SURROUNDINGS, AND SYSTEMS AND METHODS FOR USING SUCH TECHNIQUES

Non-Final OA §102
Filed
Feb 28, 2025
Examiner
BALAOING, ARIEL A
Art Unit
2624
Tech Center
2600 — Communications
Assignee
Meta Platforms Technologies, LLC
OA Round
1 (Non-Final)
79%
Grant Probability
Favorable
1-2
OA Rounds
2y 10m
To Grant
86%
With Interview

Examiner Intelligence

Grants 79% — above average
79%
Career Allow Rate
594 granted / 749 resolved
+17.3% vs TC avg
Moderate +7% lift
Without
With
+6.7%
Interview Lift
resolved cases with interview
Typical timeline
2y 10m
Avg Prosecution
17 currently pending
Career history
766
Total Applications
across all art units

Statute-Specific Performance

§101
4.3%
-35.7% vs TC avg
§103
56.1%
+16.1% vs TC avg
§102
24.0%
-16.0% vs TC avg
§112
11.3%
-28.7% vs TC avg
Black line = Tech Center average estimate • Based on career data from 749 resolved cases

Office Action

§102
DETAILED ACTION Notice of Pre-AIA or AIA Status The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA . Claim Rejections - 35 USC § 102 The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action: A person shall be entitled to a patent unless – (a)(2) the claimed invention was described in a patent issued under section 151, or in an application for patent published or deemed published under section 122(b), in which the patent or application, as the case may be, names another inventor and was effectively filed before the effective filing date of the claimed invention. Claim(s) 1-20 is/are rejected under 35 U.S.C. 102(a)(2) as being anticipated by HERMAN et al (US 12,154,236). Regarding claim 1, HERMAN discloses a non-transitory computer-readable storage medium including instructions that (abstract; col. 9, line 55-63), when executed by one or more processors of an augmented-reality headset 100, cause the augmented- reality headset to perform: responsive to receiving, at an artificial-reality (AR) headset, a user input requesting an augmented-reality-assisted interaction to be directed to a physical surface 320: presenting, via the AR headset, an augmented-reality interaction guide 314,402,502,512,602,604,702,902 that is (i) co-located with the physical surface, and (ii) presented with a first orientation relative to an orientation of the AR headset (col. 11, line 27-32; col. 12, line 47-67; col. 17, line 23-53; col. 22, line 7-37; presentation of graphical overlay on chosen surface); obtaining data, via the AR headset, indicating that a user interaction has been performed that causes a modification to the physical surface (col. 12, line 40-46; col. 22, line 46-67); and responsive to obtaining additional data, via the AR headset, indicating movement of the physical surface relative to the orientation of the AR headset: presenting, via the AR headset, the augmented-reality interaction guide so that it appears at the physical surface with a second orientation relative to the orientation of the AR headset, different than the first orientation, wherein the second orientation is determined based on: the modification to the physical surface caused by the user interaction at the physical surface, and the movement of the physical surface relative to the orientation of the AR headset (col. 13, line 23-45; col. 21, line 36-57; col. 22, line 7-37, 46-67; col. 42, line 13-23; anchoring and re-anchoring based on pose and detected markings). Regarding claim 2, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein the instructions, when executed by the one or more processors of the augmented-reality headset, further cause the augmented-reality headset to perform: before presenting the augmented-reality interaction guide: obtaining object data about the physical surface and/or a physical object having the physical surface (col. 22, line 7-36; col. 39, line 18-33; col. 45, line 45-col. 46, line 8); and identifying the augmented-reality interaction guide based on the object data about the physical surface and/or the physical object (col. 21, line 23-36; col. 22, line 7-36; col. 39, line 18-33; col. 45, line 45-col. 46, line 8). Regarding claim 3, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein the instructions, when executed by the one or more processors of the augmented-reality headset, further cause the augmented-reality headset to perform: after identifying the augmented-reality interaction guide based on the object data: presenting, via the AR headset, an interaction guide selector user interface element that includes the augmented-reality interaction guide (col. 22, line 7-37, 46-67; col. 42, line 13-23). Regarding claim 4, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein the instructions, when executed by the one or more processors of the augmented-reality headset, further cause the augmented-reality headset to perform: responsive to another user input, directed to the physical surface, to cause a different augmented-reality-assisted interaction to be directed to the physical surface: determining that the physical surface is unsuitable for the different augmented- reality-assisted interaction (col. 19, line 15-52; col. 22, line 37-45; col. 39, line 19-26); and based on determining that the physical surface is unsuitable for the different augmented- reality interaction, forgoing causing the different augmented-reality-assisted interaction to be directed to the physical surface (col. 19, line 15-52; col. 22, line 37-45; col. 39, line 19-26). Regarding claim 5, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein forgoing causing the different augmented-reality-assisted interaction to be performed at the physical surface includes forgoing presenting a respective augmented-reality interaction guide, corresponding to the different augmented-reality interaction, to appear at the physical surface (col. 19, line 37-51; col. 22, line 37-45). Regarding claim 6, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein the instructions, when executed by the one or more processors of the augmented-reality headset, further cause the augmented-reality headset to perform: in accordance with forgoing presenting the respective augmented-reality interaction guide based on determining that the physical surface is unsuitable for of the physical surface for the different augmented-reality-assisted interaction: presenting an indication that the physical surface is unsuitable for the different augmented-reality-assisted interaction (col. 19, line 37-51; col. 22, line 37-45). Regarding claim 7, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein the augmented-reality-assisted interaction includes one or more of: (i) painting, (ii) calligraphy, (iii) graffiti, and/or (iv) cut-out patterns (col. 12, line 33-47; col. 2, line 1-16). Regarding claim 8, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein the instructions, when executed by the one or more processors of the augmented-reality headset, further cause the augmented-reality headset to perform: determining, based on obtaining additional surface data about the physical surface, that a portion of the augmented-reality-assisted interaction facilitated by the augmented-reality interaction guide has been completed (col. 3, line 3-66; col. 14, line 1-14; col. 29, line 46-61); and based on determining that the portion of the augmented-reality-assisted interaction has been completed, adjusting the presenting of the augmented-reality interaction guide to present respective visual elements corresponding to a different portion of the augmented-reality interaction guide (col. 3, line 3-66; col. 14, line 1-14; col. 29, line 46-61). Regarding claim 9, HERMAN discloses a method (abstract), comprising: responsive to receiving, at an artificial-reality (AR) headset, a user input requesting an augmented-reality-assisted interaction to be directed to a physical surface 320: presenting, via the AR headset, an augmented-reality interaction guide 314,402,502,512,602,604,702,902 that is (i) co-located with the physical surface, and (ii) presented with a first orientation relative to an orientation of the AR headset (col. 11, line 27-32; col. 12, line 47-67; col. 17, line 23-53; col. 22, line 7-37; presentation of graphical overlay on chosen surface); obtaining data, via the AR headset, indicating that a user interaction has been performed that causes a modification to the physical surface (col. 12, line 40-46; col. 22, line 46-67); and responsive to obtaining additional data, via the AR headset, indicating movement of the physical surface relative to the orientation of the AR headset: presenting, via the AR headset, the augmented-reality interaction guide so that it appears at the physical surface with a second orientation relative to the orientation of the AR headset, different than the first orientation, wherein the second orientation is determined based on: the modification to the physical surface caused by the user interaction at the physical surface, and the movement of the physical surface relative to the orientation of the AR headset (col. 13, line 23-45; col. 21, line 36-57; col. 22, line 7-37, 46-67; col. 42, line 13-23; anchoring and re-anchoring based on pose and detected markings). Regarding claim 10, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses before presenting the augmented-reality interaction guide: obtaining object data about the physical surface and/or a physical object having the physical surface (col. 22, line 7-36; col. 39, line 18-33; col. 45, line 45-col. 46, line 8); and identifying the augmented-reality interaction guide based on the object data about the physical surface and/or the physical object (col. 21, line 23-36; col. 22, line 7-36; col. 39, line 18-33; col. 45, line 45-col. 46, line 8). Regarding claim 11, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses after identifying the augmented-reality interaction guide based on the object data: presenting, via the AR headset, an interaction guide selector user interface element that includes the augmented-reality interaction guide (col. 22, line 7-37, 46-67; col. 42, line 13-23). Regarding claim 12, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses responsive to another user input, directed to the physical surface, to cause a different augmented-reality-assisted interaction to be directed to the physical surface: determining that the physical surface is unsuitable for the different augmented- reality-assisted interaction (col. 19, line 15-52; col. 22, line 37-45; col. 39, line 19-26); and based on determining that the physical surface is unsuitable for the different augmented- reality interaction, forgoing causing the different augmented-reality-assisted interaction to be directed to the physical surface (col. 19, line 15-52; col. 22, line 37-45; col. 39, line 19-26). Regarding claim 13, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein forgoing causing the different augmented-reality-assisted interaction to be performed at the physical surface includes forgoing presenting a respective augmented-reality interaction guide, corresponding to the different augmented-reality interaction, to appear at the physical surface (col. 19, line 37-51; col. 22, line 37-45). Regarding claim 14, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses in accordance with forgoing presenting the respective augmented-reality interaction guide based on determining that the physical surface is unsuitable for of the physical surface for the different augmented-reality-assisted interaction: presenting an indication that the physical surface is unsuitable for the different augmented-reality-assisted interaction (col. 19, line 37-51; col. 22, line 37-45). Regarding claim 15, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein the augmented-reality-assisted interaction includes one or more of: (i) painting, (ii) calligraphy, (iii) graffiti, and/or (iv) cut-out patterns (col. 12, line 33-47; col. 2, line 1-16). Regarding claim 16, HERMAN discloses a system (abstract), comprising an augmented-reality headset, comprising one or more processors and memory, the memory comprising instructions which, when executed by the one or more processors, cause performance of: responsive to receiving, at an artificial-reality (AR) headset, a user input requesting an augmented-reality-assisted interaction to be directed to a physical surface 320: presenting, via the AR headset, an augmented-reality interaction guide 314,402,502,512,602,604,702,902 that is (i) co-located with the physical surface, and (ii) presented with a first orientation relative to an orientation of the AR headset (col. 11, line 27-32; col. 12, line 47-67; col. 17, line 23-53; col. 22, line 7-37; presentation of graphical overlay on chosen surface); obtaining data, via the AR headset, indicating that a user interaction has been performed that causes a modification to the physical surface (col. 12, line 40-46; col. 22, line 46-67); and responsive to obtaining additional data, via the AR headset, indicating movement of the physical surface relative to the orientation of the AR headset: presenting, via the AR headset, the augmented-reality interaction guide so that it appears at the physical surface with a second orientation relative to the orientation of the AR headset, different than the first orientation, wherein the second orientation is determined based on: the modification to the physical surface caused by the user interaction at the physical surface, and the movement of the physical surface relative to the orientation of the AR headset (col. 13, line 23-45; col. 21, line 36-57; col. 22, line 7-37, 46-67; col. 42, line 13-23; anchoring and re-anchoring based on pose and detected markings). Regarding claim 17, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein the instructions, when executed by the one or more processors of the augmented-reality headset, further cause the augmented-reality headset to perform: before presenting the augmented-reality interaction guide: obtaining object data about the physical surface and/or a physical object having the physical surface (col. 22, line 7-36; col. 39, line 18-33; col. 45, line 45-col. 46, line 8); and identifying the augmented-reality interaction guide based on the object data about the physical surface and/or the physical object (col. 21, line 23-36; col. 22, line 7-36; col. 39, line 18-33; col. 45, line 45-col. 46, line 8). Regarding claim 18, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein the instructions, when executed by the one or more processors of the augmented-reality headset, further cause the augmented-reality headset to perform: after identifying the augmented-reality interaction guide based on the object data: presenting, via the AR headset, an interaction guide selector user interface element that includes the augmented-reality interaction guide (col. 22, line 7-37, 46-67; col. 42, line 13-23). Regarding claim 19, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein the instructions, when executed by the one or more processors of the augmented-reality headset, further cause the augmented-reality headset to perform: responsive to another user input, directed to the physical surface, to cause a different augmented-reality-assisted interaction to be directed to the physical surface: determining that the physical surface is unsuitable for the different augmented- reality-assisted interaction (col. 19, line 15-52; col. 22, line 37-45; col. 39, line 19-26); and based on determining that the physical surface is unsuitable for the different augmented- reality interaction, forgoing causing the different augmented-reality-assisted interaction to be directed to the physical surface (col. 19, line 15-52; col. 22, line 37-45; col. 39, line 19-26). Regarding claim 20, see the rejections of the parent claim concerning the subject matter this claim is dependent upon. HERMAN further discloses wherein forgoing causing the different augmented-reality-assisted interaction to be performed at the physical surface includes forgoing presenting a respective augmented-reality interaction guide, corresponding to the different augmented-reality interaction, to appear at the physical surface (col. 19, line 37-51; col. 22, line 37-45). Conclusion Any inquiry concerning this communication or earlier communications from the examiner should be directed to ARIEL A BALAOING whose telephone number is (571)272-7317. The examiner can normally be reached 8AM-4AM M-F. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Matthew Eason can be reached at (571) 270-7230. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /ARIEL A BALAOING/ Primary Examiner, Art Unit 2624
Read full office action

Prosecution Timeline

Feb 28, 2025
Application Filed
Jan 20, 2026
Non-Final Rejection — §102 (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12591316
ACCESSORY BODY AND ACCESSORY
2y 5m to grant Granted Mar 31, 2026
Patent 12585308
FLEXIBLE DISPLAY DEVICE INCLUDING TOUCH SENSOR
2y 5m to grant Granted Mar 24, 2026
Patent 12585346
DOUBLE-WHEEL ASSEMBLY
2y 5m to grant Granted Mar 24, 2026
Patent 12585347
USER INTERFACE DEVICE AND METHOD OF CONTROLLING TACTILE PRESENTATION
2y 5m to grant Granted Mar 24, 2026
Patent 12578581
Head-Mounted Display With Facial Interface For Sensing Physiological Conditions
2y 5m to grant Granted Mar 17, 2026
Study what changed to get past this examiner. Based on 5 most recent grants.

AI Strategy Recommendation

Get an AI-powered prosecution strategy using examiner precedents, rejection analysis, and claim mapping.
Powered by AI — typically takes 5-10 seconds

Prosecution Projections

1-2
Expected OA Rounds
79%
Grant Probability
86%
With Interview (+6.7%)
2y 10m
Median Time to Grant
Low
PTA Risk
Based on 749 resolved cases by this examiner. Grant probability derived from career allow rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month