Prosecution Insights
Last updated: October 01, 2026
Application No. 19/033,911

Dynamic Mixed Reality Content In Virtual Reality

Non-Final OA §101§112§DP
Filed
Jan 22, 2025
Priority
Jun 02, 2021 — continuation of 11/676,348 +1 more
Examiner
TSENG, CHARLES
Art Unit
Tech Center
Assignee
Meta Platforms Technologies LLC
OA Round
1 (Non-Final)
79%
Grant Probability
Favorable
1-2
OA Rounds
10m
Est. Remaining
99%
With Interview

Examiner Intelligence

Grants 79% — above average
79%
Career Allowance Rate
560 granted / 708 resolved
+19.1% vs TC avg
Strong +31% interview lift
Without
With
+31.3%
Interview Lift
resolved cases with interview
Typical timeline
2y 6m
Avg Prosecution
17 currently pending
Career history
720
Total Applications
across all art units

Statute-Specific Performance

§101
13.5%
-26.5% vs TC avg
§103
53.4%
+13.4% vs TC avg
§102
6.2%
-33.8% vs TC avg
§112
14.1%
-25.9% vs TC avg
Black line = Tech Center average estimate • Based on career data from 708 resolved cases

Office Action

§101 §112 §DP
DETAILED ACTION Notice of Pre-AIA or AIA Status The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA . Claim Objections Claims 1-10 and 13-20 are objected to because of the following informalities: For claim 1, Examiner believes this claim should be amended in the following manner: A method comprising: capturing one or more images of a user wearing an artificial reality (XR) display device; receiving, from the XR display device, a first rendering of an environment, wherein the first rendering is from [[the]] a perspective of a capture device with respect to the XR display device; generating, responsive to capturing the one or more images, a second rendering depicting the user in the environment, wherein the second rendering is based on a compositing of the one or more images and the first rendering; receiving an indication of a change in the environment; and generating, responsive to the indication of the change, a third rendering depicting the user in the environment and the change in the environment. For claim 2, Examiner believes this claim should be amended in the following manner: The method of claim 1, further comprising: receiving one or more anchor points, in the For claim 3, Examiner believes this claim should be amended in the following manner: The method of claim 2, further comprising: determining a pose of the capture device with respect to the XR display device based on one or more of the one or more anchor points. For claim 4, Examiner believes this claim should be amended in the following manner: The method of claim 3, further comprising: detecting the capture device has moved; determining an updated pose of the capture device with respect to the XR display device based on one or more of the one or more anchor points; and generating, responsive to detecting the capture device has moved, a fourth rendering of the user in the environment, wherein the fourth rendering of the user is based on the updated pose of the capture device with respect to the XR display device. For claim 5, Examiner believes this claim should be amended in the following manner: The method of claim 3, wherein the pose of the capture device with respect to the XR display device is determined based on a triangulation between one or more of the one or more anchor points, [[the]] one or more cameras of the capture device, and the XR display device. For claim 6, Examiner believes this claim should be amended in the following manner: The method of claim 2, wherein the one or more anchor points are fixed objects in the For claim 7, Examiner believes this claim should be amended in the following manner: The method of claim 1, further comprising: toggling between: an XR rendering of the environment from [[the]] a perspective of the user, and a rendering of the user in the environment from the perspective of the capture device with respect to the XR display device. For claim 8, Examiner believes this claim should be amended in the following manner: The method of claim 1, further comprising: transmitting the second rendering or the third rendering of the user in the environment to an online social network for live display to one or more additional users. For claim 9, Examiner believes this claim should be amended in the following manner: The method of claim 1, further comprising: segmenting a representation of the user from the one or more images; and identifying, using a segmentation algorithm, a body of the user within each of the one or more images, wherein the second rendering or the third rendering of the user is based on a compositing of the segmented one or more images of the user and the first rendering. For claim 10, Examiner believes this claim should be amended in the following manner: The method of claim 1, further comprising: receiving an indication the user has activated a particular XR application; and presenting, responsive to the received [[indication]] activation, a notification that the user wearing the XR display device has started the particular XR application. For claim 13, Examiner believes this claim should be amended in the following manner: A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to: capture one or more images of a user wearing an artificial reality (XR) display device; receive, from the XR display device, a first rendering of an environment, wherein the first rendering is from [[the]] a perspective of a capture device with respect to the XR display device; generate, responsive to capturing the one or more images, a second rendering depicting the user in the environment, wherein the second rendering is based on a compositing of the one or more images and the first rendering; receive an indication of a change in the environment; and generate, responsive to the indication of the change, a third rendering depicting the user in the environment and the change in the environment. For claim 14, Examiner believes this claim should be amended in the following manner: The computer-readable storage medium of claim 13, wherein the instructions, when executed, further cause the computing system to: receive one or more anchor points, in the For claim 15, Examiner believes this claim should be amended in the following manner: The computer-readable storage medium of claim 14, wherein the instructions, when executed, further cause the computing system to: determine a pose of the capture device with respect to the XR display device based on one or more of the one or more anchor points. For claim 16, Examiner believes this claim should be amended in the following manner: The computer-readable storage medium of claim 15, wherein the instructions, when executed, further case the computing system to: detect the capture device has moved; determine an updated pose of the capture device with respect to the XR display device based on one or more of the one or more anchor points; and generate, responsive to detecting the capture device has moved, a fourth rendering of the user in the environment, wherein the fourth rendering of the user is based on the updated pose of the capture device with respect to the XR display device. For claim 17, Examiner believes this claim should be amended in the following manner: The computer-readable storage medium of claim 15, wherein the pose of the capture device with respect to the XR display device is determined based on a triangulation between one or more of the anchor points, [[the]] one or more cameras of the capture device, and the XR display device. For claim 18, Examiner believes this claim should be amended in the following manner: The computer-readable storage medium of claim 13, wherein the instructions, when executed, further case the computing system to: transmit the second rendering or the third rendering of the user in the environment to an online social network for live display to one or more additional users. For claim 19, Examiner believes this claim should be amended in the following manner: The computer-readable storage medium of claim 13, wherein the instructions, when executed, further case the computing system to: segment a representation of the user from the one or more images; and identify, using a segmentation algorithm, a body of the user within each of the one or more images, wherein the second rendering or the third rendering of the user is based on a compositing of the segmented one or more images of the user and the first rendering. For claim 20, Examiner believes this claim should be amended in the following manner: A computing system comprising: one or more processors; and one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to: capture one or more images of a user wearing an artificial reality (XR) display device; receive, from the XR display device, a first rendering of an environment, wherein the first rendering is from [[the]] a perspective of a capture device with respect to the XR display device; generate, responsive to capturing the one or more images, a second rendering depicting the user in the environment, wherein the second rendering is based on a compositing of the one or more images and the first rendering; receive an indication of a change in the environment; and generate, responsive to the indication of the change, a third rendering depicting the user in the environment and the change in the environment. Appropriate correction is required. Claim Rejections - 35 USC § 101 35 U.S.C. 101 reads as follows: Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of this title. Claims 13-19 are rejected under 35 U.S.C. 101 because they encompass nonstatutory subject matter. For claims 13-19, these claims are directed to a computer-readable storage medium. Applicants’ Specification does not specifically describe what forms a “computer-readable storage medium” may take. Furthermore, Applicants’ Specification describes its invention may be implemented across multiple computer systems in communication with each another and distributed across a network (Specification at par. 77). Thus, “computer-readable storage medium” may be broadly interpreted to cover signals, carrier waves and other transitory communication media that are ineligible subject matter. Therefore, claims 13-19 are rejected under 35 U.S.C. 101 for encompassing nonstatutory subject matter. Claim Rejections - 35 USC § 112 The following is a quotation of 35 U.S.C. 112(b): (b) CONCLUSION.—The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the inventor or a joint inventor regards as the invention. The following is a quotation of 35 U.S.C. 112 (pre-AIA ), second paragraph: The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the applicant regards as his invention. Claim 10 is rejected under 35 U.S.C. 112(b) or 35 U.S.C. 112 (pre-AIA ), second paragraph, as being indefinite for failing to particularly point out and distinctly claim the subject matter which the inventor or a joint inventor (or for applications subject to pre-AIA 35 U.S.C. 112, the applicant), regards as the invention. For dependent claim 10, parent claim 1 establishes a first “an indication” that is received and claim 10 establishes a second “an indication” that is received. Claim 10 goes on to recite the phrase “the received indication” and it is unclear and ambiguous to which of the first “indication” and second “indication” is being referenced by the phrase “the received indication”. Examiner has suggested amendments in the claim objections discussed above to resolve the ambiguities. Appropriate correction is required. Double Patenting The nonstatutory double patenting rejection is based on a judicially created doctrine grounded in public policy (a policy reflected in the statute) so as to prevent the unjustified or improper timewise extension of the “right to exclude” granted by a patent and to prevent possible harassment by multiple assignees. A nonstatutory double patenting rejection is appropriate where the conflicting claims are not identical, but at least one examined application claim is not patentably distinct from the reference claim(s) because the examined application claim is either anticipated by, or would have been obvious over, the reference claim(s). See, e.g., In re Berg, 140 F.3d 1428, 46 USPQ2d 1226 (Fed. Cir. 1998); In re Goodman, 11 F.3d 1046, 29 USPQ2d 2010 (Fed. Cir. 1993); In re Longi, 759 F.2d 887, 225 USPQ 645 (Fed. Cir. 1985); In re Van Ornum, 686 F.2d 937, 214 USPQ 761 (CCPA 1982); In re Vogel, 422 F.2d 438, 164 USPQ 619 (CCPA 1970); In re Thorington, 418 F.2d 528, 163 USPQ 644 (CCPA 1969). A timely filed terminal disclaimer in compliance with 37 CFR 1.321(c) or 1.321(d) may be used to overcome an actual or provisional rejection based on nonstatutory double patenting provided the reference application or patent either is shown to be commonly owned with the examined application, or claims an invention made as a result of activities undertaken within the scope of a joint research agreement. See MPEP § 717.02 for applications subject to examination under the first inventor to file provisions of the AIA as explained in MPEP § 2159. See MPEP §§ 706.02(l)(1) - 706.02(l)(3) for applications not subject to examination under the first inventor to file provisions of the AIA . A terminal disclaimer must be signed in compliance with 37 CFR 1.321(b). The USPTO Internet website contains terminal disclaimer forms which may be used. Please visit www.uspto.gov/patent/patents-forms. The filing date of the application in which the form is filed determines what form (e.g., PTO/SB/25, PTO/SB/26, PTO/AIA /25, or PTO/AIA /26) should be used. A web-based eTerminal Disclaimer may be filled out completely online using web-screens. An eTerminal Disclaimer that meets all requirements is auto-processed and approved immediately upon submission. For more information about eTerminal Disclaimers, refer to www.uspto.gov/patents/process/file/efs/guidance/eTD-info-I.jsp. Claims 1-20 are rejected on the ground of nonstatutory double patenting as being unpatentable over claims 1-12 of U.S. Patent 11,676,348 in view of Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1) (made of record of the IDS submitted 1/22/2025). The following is a claim comparison of claims 1-20 of the instant application and claims 1-12 of U.S. Patent 11,676,348. Application No. 19/033,911 U.S. Patent No. 11,676,348 1. A method comprising: capturing one or more images of a user wearing an artificial reality (XR) display device; receiving, from the XR display device, a first rendering of an environment, wherein the first rendering is from the perspective of a capture device with respect to the XR display device; generating, responsive to capturing the one or more images, a second rendering depicting the user in the environment, wherein the second rendering is based on a compositing of the one or more images and the first rendering; receiving an indication of a change in the environment; and generating, responsive to the indication of the change, a third rendering depicting the user in the environment and the change in the environment. 1. A method comprising, by a mobile computing device: capturing, using one or more cameras of the mobile computing device, one or more images of a first user wearing a virtual reality (VR) display device in a real-world environment, wherein the VR display device is displaying a first VR rendering of a VR environment, and wherein the first VR rendering is from the perspective of the VR display device; transmitting, from the mobile computing device, a pose of the mobile computing device with respect to the VR display device to a VR system of the VR display device; receiving, at the mobile computing device and from the VR system, a second VR rendering of the VR environment, wherein the second VR rendering is from the perspective of the mobile computing device with respect to the VR display device; segmenting the first user from the one or more images; and generating, at the mobile computing device in real-time responsive to capturing the one or more images, a mixed reality (MR) rendering of the first user in the VR environment, wherein the MR rendering of the first user is based on a compositing of the segmented one or more images of the first user and the second VR rendering. 11. The method of claim 1, wherein the mobile computing device can be used to interact with the VR environment via the MR rendering. 12. The method of claim 11, wherein interacting with the VR environment comprises one or more of: modifying a VR object in the VR environment, creating a VR object in the VR environment, modifying a MR object in the VR environment, creating a MR object in the VR environment, modifying one or more attributes of VR environment, changing the VR environment from a first VR environment to a second VR environment, changing a VR application, recording the MR rendering, or streaming the MR rendering. 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 10 11 11 12 12 13. A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to: capture one or more images of a user wearing an artificial reality (XR) display device; receive, from the XR display device, a first rendering of an environment, wherein the first rendering is from the perspective of a capture device with respect to the XR display device; generate, responsive to capturing the one or more images, a second rendering depicting the user in the environment, wherein the second rendering is based on a compositing of the one or more images and the first rendering; receive an indication of a change in the environment; and generate, responsive to the indication of the change, a third rendering depicting the user in the environment and the change in the environment. 1. A method comprising, by a mobile computing device: capturing, using one or more cameras of the mobile computing device, one or more images of a first user wearing a virtual reality (VR) display device in a real-world environment, wherein the VR display device is displaying a first VR rendering of a VR environment, and wherein the first VR rendering is from the perspective of the VR display device; transmitting, from the mobile computing device, a pose of the mobile computing device with respect to the VR display device to a VR system of the VR display device; receiving, at the mobile computing device and from the VR system, a second VR rendering of the VR environment, wherein the second VR rendering is from the perspective of the mobile computing device with respect to the VR display device; segmenting the first user from the one or more images; and generating, at the mobile computing device in real-time responsive to capturing the one or more images, a mixed reality (MR) rendering of the first user in the VR environment, wherein the MR rendering of the first user is based on a compositing of the segmented one or more images of the first user and the second VR rendering. 11. The method of claim 1, wherein the mobile computing device can be used to interact with the VR environment via the MR rendering. 12. The method of claim 11, wherein interacting with the VR environment comprises one or more of: modifying a VR object in the VR environment, creating a VR object in the VR environment, modifying a MR object in the VR environment, creating a MR object in the VR environment, modifying one or more attributes of VR environment, changing the VR environment from a first VR environment to a second VR environment, changing a VR application, recording the MR rendering, or streaming the MR rendering. 14 2 15 3 16 4 17 5 18 8 19 9 20. A computing system comprising: one or more processors; and one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to: capture one or more images of a user wearing an artificial reality (XR) display device; receive, from the XR display device, a first rendering of an environment, wherein the first rendering is from the perspective of a capture device with respect to the XR display device; generate, responsive to capturing the one or more images, a second rendering depicting the user in the environment, wherein the second rendering is based on a compositing of the one or more images and the first rendering; receive an indication of a change in the environment; and generate, responsive to the indication of the change, a third rendering depicting the user in the environment and the change in the environment. 1. A method comprising, by a mobile computing device: capturing, using one or more cameras of the mobile computing device, one or more images of a first user wearing a virtual reality (VR) display device in a real-world environment, wherein the VR display device is displaying a first VR rendering of a VR environment, and wherein the first VR rendering is from the perspective of the VR display device; transmitting, from the mobile computing device, a pose of the mobile computing device with respect to the VR display device to a VR system of the VR display device; receiving, at the mobile computing device and from the VR system, a second VR rendering of the VR environment, wherein the second VR rendering is from the perspective of the mobile computing device with respect to the VR display device; segmenting the first user from the one or more images; and generating, at the mobile computing device in real-time responsive to capturing the one or more images, a mixed reality (MR) rendering of the first user in the VR environment, wherein the MR rendering of the first user is based on a compositing of the segmented one or more images of the first user and the second VR rendering. 11. The method of claim 1, wherein the mobile computing device can be used to interact with the VR environment via the MR rendering. 12. The method of claim 11, wherein interacting with the VR environment comprises one or more of: modifying a VR object in the VR environment, creating a VR object in the VR environment, modifying a MR object in the VR environment, creating a MR object in the VR environment, modifying one or more attributes of VR environment, changing the VR environment from a first VR environment to a second VR environment, changing a VR application, recording the MR rendering, or streaming the MR rendering. Claims 1-20 are rejected on the ground of nonstatutory double patenting as being unpatentable over claims 1-12 of U.S. Patent 11,676,348 in view of Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1) (made of record of the IDS submitted 1/22/2025). For claim 1, claims 1, 11 and 12 of U.S. Patent 11,676,348 do not disclose receiving a rendering from an artificial reality display device. However, these limitations are well-known in the art as disclosed in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). It would have been obvious to apply the receipt of a rendering from an artificial reality display device to appropriately display the rendering on a capturing device with respect to the artificial reality device (Fig. 6; par. 68-70) as taught in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). Claims 1, 11 and 12 of U.S. Patent 11,676,348 otherwise discloses the same limitations of claim 1 of the instant application as shown in the claim chart above. Therefore, claim 1 is not patentably distinct from claims 1, 11 and 12 of U.S. Patent 11,676,348. For dependent claims 2-12, claims 2-12 of U.S. Patent 11,676,348 mirror and recite the same limitations of claims 2-12 as shown in the claim chart above. Therefore, claims 2-12 are not patentably distinct from claims 2-12 of U.S. Patent 11,676,348. For claim 13, claims 1, 11 and 12 of U.S. Patent 11,676,348 do not disclose a computer-readable storage medium storing instructions and receiving a rendering from an artificial reality display device. However, these limitations are well-known in the art as disclosed in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). It would have been obvious to apply the use of a memory as a computer-readable storage medium for storing instructions and the receipt of a rendering from an artificial reality display device to appropriately display the rendering on a capturing device with respect to the artificial reality device (Fig. 6; par. 68-70) as taught in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). Claims 1, 11 and 12 of U.S. Patent 11,676,348 otherwise discloses the same limitations of claim 13 of the instant application as shown in the claim chart above. Therefore, claim 13 is not patentably distinct from claims 1, 11 and 12 of U.S. Patent 11,676,348. For dependent claims 14-19, claims 2-5, 8 and 9 of U.S. Patent 11,676,348 mirror and recite the same limitations of claims 14-19 as shown in the claim chart above. Therefore, claims 14-19 are not patentably distinct from claims 2-5, 8 and 9 of U.S. Patent 11,676,348. For claim 20, claims 1, 11 and 12 of U.S. Patent 11,676,348 do not disclose computing system comprising one or more processors and one or more memories storing instructions; and receiving a rendering from an artificial reality display device. However, these limitations are well-known in the art as disclosed in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). It would have been obvious to apply the use of a computer system comprising a processor and a memory storing instructions and the receipt of a rendering from an artificial reality display device to appropriately display the rendering on a capturing device with respect to the artificial reality device (Fig. 6; par. 68-70) as taught in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). Claims 1, 11 and 12 of U.S. Patent 11,676,348 otherwise discloses the same limitations of claim 20 of the instant application as shown in the claim chart above. Therefore, claim 20 is not patentably distinct from claims 1, 11 and 12 of U.S. Patent 11,676,348. Claims 1-17 and 20 are rejected on the ground of nonstatutory double patenting as being unpatentable over claims 1-12, 14-18 and 20 of U.S. Patent 12,272,012 in view of Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). The following is a claim comparison of claims 1-17 and 20 of the instant application and claims 1-12, 14-18 and 20 of U.S. Patent 12,272,012. Application No. 19/033,911 U.S. Patent No. 12,272,012 1. A method comprising: capturing one or more images of a user wearing an artificial reality (XR) display device; receiving, from the XR display device, a first rendering of an environment, wherein the first rendering is from the perspective of a capture device with respect to the XR display device; generating, responsive to capturing the one or more images, a second rendering depicting the user in the environment, wherein the second rendering is based on a compositing of the one or more images and the first rendering; receiving an indication of a change in the environment; and generating, responsive to the indication of the change, a third rendering depicting the user in the environment and the change in the environment. 1. A method comprising, by a mobile computing device: capturing one or more images of a first user wearing a virtual reality (VR) display device in a real-world environment; receiving, from a VR system of the VR display device, a VR rendering of a VR environment, wherein the VR rendering is from the perspective of the mobile computing device with respect to the VR display device; generating, in real-time responsive to capturing the one or more images, a first mixed reality (MR) rendering of the first user in the VR environment, wherein the first MR rendering of the first user is based on a compositing of the one or more images of the first user and the VR rendering; receiving, by the mobile computing device, an indication of a user interaction with one or more elements of the VR environment in the first MR rendering; and generating, in real-time responsive to the indication of the user interaction with the one or more elements, a second MR rendering of the first user in the VR environment, wherein the one or more elements have been modified according to the user interaction. 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 10 11 11 12 12 13. A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to: capture one or more images of a user wearing an artificial reality (XR) display device; receive, from the XR display device, a first rendering of an environment, wherein the first rendering is from the perspective of a capture device with respect to the XR display device; generate, responsive to capturing the one or more images, a second rendering depicting the user in the environment, wherein the second rendering is based on a compositing of the one or more images and the first rendering; receive an indication of a change in the environment; and generate, responsive to the indication of the change, a third rendering depicting the user in the environment and the change in the environment. 14. One or more computer-readable non-transitory storage media embodying software that is operable when executed by a mobile computing device to: capture one or more images of a first user wearing a virtual reality (VR) display device in a real-world environment; receive, from a VR system of the VR display device, a VR rendering of a VR environment, wherein the VR rendering is from the perspective of the mobile computing device with respect to the VR display device; generate, in real-time responsive to capturing the one or more images, a first mixed reality (MR) rendering of the first user in the VR environment, wherein the first MR rendering of the first user is based on a compositing of the one or more images of the first user and the VR rendering; receive, by the mobile computing device, an indication of a user interaction with one or more elements of the VR environment in the first MR rendering; and generate, in real-time responsive to the indication of the user interaction with the one or more elements, a second MR rendering of the first user in the VR environment, wherein the one or more elements have been modified according to the user interaction. 14 15 15 16 16 17 17 18 20. A computing system comprising: one or more processors; and one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to: capture one or more images of a user wearing an artificial reality (XR) display device; receive, from the XR display device, a first rendering of an environment, wherein the first rendering is from the perspective of a capture device with respect to the XR display device; generate, responsive to capturing the one or more images, a second rendering depicting the user in the environment, wherein the second rendering is based on a compositing of the one or more images and the first rendering; receive an indication of a change in the environment; and generate, responsive to the indication of the change, a third rendering depicting the user in the environment and the change in the environment. 20. A mobile computing device comprising: one or more processors; and a non-transitory memory coupled to the one or more processors comprising instructions executable by the one or more processors, the one or more processors operable when executing the instructions to: capture one or more images of a first user wearing a virtual reality (VR) display device in a real-world environment; receive, from a VR system of the VR display device, a VR rendering of a VR environment, wherein the VR rendering is from the perspective of the mobile computing device with respect to the VR display device; generate, in real-time responsive to capturing the one or more images, a first mixed reality (MR) rendering of the first user in the VR environment, wherein the first MR rendering of the first user is based on a compositing of the one or more images of the first user and the VR rendering; receive, by the mobile computing device, an indication of a user interaction with one or more elements of the VR environment in the first MR rendering; and generate, in real-time responsive to the indication of the user interaction with the one or more elements, a second MR rendering of the first user in the VR environment, wherein the one or more elements have been modified according to the user interaction. Claims 1-17 and 20 are rejected on the ground of nonstatutory double patenting as being unpatentable over claims 1-12, 14-18 and 20 of U.S. Patent 12,272,012 in view of Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1) For claim 1, claim 1 of U.S. Patent 12,272,012 does not disclose receiving a rendering from an artificial reality display device. However, these limitations are well-known in the art as disclosed in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). It would have been obvious to apply the receipt of a rendering from an artificial reality display device to appropriately display the rendering on a capturing device with respect to the artificial reality device (Fig. 6; par. 68-70) as taught in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). Claim 1 of U.S. Patent 12,272,012 otherwise discloses the same limitations of claim 1 of the instant application as shown in the claim chart above. Therefore, claim 1 is not patentably distinct from claim 1 of U.S. Patent 12,272,012. For dependent claims 2-12, claims 2-12 of U.S. Patent 12,272,012 mirror and recite the same limitations of claims 2-12 as shown in the claim chart above. Therefore, claims 2-12 are not patentably distinct from claims 2-12 of U.S. Patent 12,272,012. For claim 13, claim 14 of U.S. Patent 12,272,012 does not disclose receiving a rendering from an artificial reality display device. However, these limitations are well-known in the art as disclosed in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). It would have been obvious to apply the receipt of a rendering from an artificial reality display device to appropriately display the rendering on a capturing device with respect to the artificial reality device (Fig. 6; par. 68-70) as taught in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). Claim 14 of U.S. Patent 12,272,012 otherwise discloses the same limitations of claim 13 of the instant application as shown in the claim chart above. Therefore, claim 13 is not patentably distinct from claim 14 of U.S. Patent 12,272,012. For dependent claims 14-17, claims 15-18 of U.S. Patent 12,272,012 mirror and recite the same limitations of claims 14-17 as shown in the claim chart above. Therefore, claims 14-17 are not patentably distinct from claims 15-18 of U.S. Patent 12,272,012. For claim 20, claim 20 of U.S. Patent 12,272,012 does not disclose receiving a rendering from an artificial reality display device. However, these limitations are well-known in the art as disclosed in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). It would have been obvious to apply the receipt of a rendering from an artificial reality display device to appropriately display the rendering on a capturing device with respect to the artificial reality device (Fig. 6; par. 68-70) as taught in Pahud et al. (U.S. Patent Application Publication 2018/0314484 A1). Claim 20 of U.S. Patent 12,272,012 otherwise discloses the same limitations of claim 20 of the instant application as shown in the claim chart above. Therefore, claim 20 is not patentably distinct from claim 20 of U.S. Patent 12,272,012. Conclusion Any inquiry concerning this communication or earlier communications from the examiner should be directed to CHARLES TSENG whose telephone number is (571)270-3857. The examiner can normally be reached 8-5. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Xiao Wu can be reached at (571) 272-7761. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /CHARLES TSENG/ Primary Examiner, Art Unit 2613
Read full office action

Prosecution Timeline

Jan 22, 2025
Application Filed
Sep 23, 2026
Non-Final Rejection mailed — §101, §112, §DP (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12743814
SIGNALING ZERO COEFFICIENTS FOR DISPLACEMENT CODING
2y 5m to grant Granted Sep 22, 2026
Patent 12737973
3D MODEL GENERATION USING MULTIPLE TEXTURES
2y 9m to grant Granted Sep 15, 2026
Patent 12737997
GENERATING LIP SYNC AUGMENTED REALITY EFFECTS
2y 6m to grant Granted Sep 15, 2026
Patent 12737998
PROCESS FOR THE ALIGNMENT OF VIRTUAL CONTENT IN PHYSICAL ENVIRONMENTS
1y 9m to grant Granted Sep 15, 2026
Patent 12731338
FAST FEATURE RECOGNITION AND MESH GENERATION IN STRUCTURAL DESIGN
2y 1m to grant Granted Sep 08, 2026
Study what changed to get past this examiner. Based on 5 most recent grants.

Strategy Recommendation AI-generated — please review before filing

Get a prosecution strategy drawn from examiner precedents, rejection analysis, and claim mapping.
Typically takes 5-10 seconds — AI-generated, attorney review required before filing

Prosecution Projections

1-2
Expected OA Rounds
79%
Grant Probability
99%
With Interview (+31.3%)
2y 6m (~10m remaining)
Median Time to Grant
Low
PTA Risk
Based on 708 resolved cases by this examiner. Grant probability derived from career allowance rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month