Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Priority
Acknowledgment is made of applicant’s claim for foreign priority under 35 U.S.C. 119 (a)-(d). The certified copy has been filed on 5 February, 2024.
Election/Restrictions
Applicant’s election without traverse of Group III (claims 2, 3, and 6 - 8 and 12, 13, and 16 – 18) in the reply filed on 18 March, 2026 is acknowledged.
Information Disclosure Statement
The information disclosure statements (IDS) submitted on 5 February, 2024 and 24 February, 2026 are in compliance with the provisions of 37 CFR 1.97. Accordingly, the information disclosure statements are being considered by the examiner.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 2, 3, 6 - 8, and 12, 13, and 16 – 18 are rejected under 35 U.S.C. 103 as being unpatentable over WO2022226502 A1 Bouazizi et al (employed using the provided machine translation, hereinafter “Bouazizi”) in view of WO2020122361 A1 Oh et al (employed using the provided machine translation, hereinafter “Oh”).
Regarding claim 2, Bouazizi teaches a method performed by a user equipment, the method comprising:
identifying pose information of a user (¶ 0142: In some examples, camera 308 may detect light emitted from devices coupled to client device 300, such as infrared light boxes, which may be used to determine the location and orientation of a user in the real world presentation environment…. Similarly, sensors 310 may be gyroscopes and/or other sensors for detecting posture, location, and/or orientation information of a user in the real-world presentation environment.);
obtaining a 360 video or a 360 viewport of the 360 video, based on the pose information of the user (¶ 0006: In general, this disclosure describes techniques for streaming and presenting immersive media content, e.g., for augmented reality (AR), virtual reality (VR), or mixed reality (MR) content. Such content may generally be referred to as extended reality (XR) content. In general, XR content may include a virtual scene including one or more virtual objects. The virtual scene may be presented to a user as three- dimensional (3D) and navigable media content.; ¶ 146: Transformation unit 334 may transform the virtual scene to match the real-world presentation environment. For example, transformation unit 334 may determine an orientation of the virtual scene and an orientation of the real-world presentation environment, then transform the virtual scene such that the orientations of the virtual scene and the real-world presentation environment are aligned. That is, scene graph 324 may include data representing a transformation of a scene coordinate system into a real- world coordinate system of the real-world presentation environment. Such transformation may include a rotation and/or translation.);
obtaining a scene object in which at least one 3 dimensional (3D) object is placed or a scene viewport of the scene object (¶ 0147: After aligning the virtual scene anchor point with the real-world anchor point and making any necessary transformations, presentation unit 330 may present media data 322 via display 314. For example, media data 322 may include data defining virtual objects, textures, colors, and locations for the virtual objects.); and
composing a 3D scene by incorporating, based on the pose information of the user and metadata, the 360 video with the scene object or the 360 viewport with the scene viewport (¶ 0147: Presentation unit 330 may present the virtual objects at the corresponding locations, relative to the user' s virtual camera orientation (determined from data received from camera 308 and sensors 310). Presentation unit 330 may update the presentation according to user movements detected from user interface devices 306, camera 308, and/or sensors 310, and/or based on updated to scene graph 324.),
wherein the metadata includes information indicating relation between coordinates of the 360 video and the scene object (¶ 0124: The scene description, including scene graph 262 and scene graph updates 264, as discussed above, acts as the entry point in a set of data for consuming immersive media data. The scene description describes all virtual objects of the scene and their spatial and temporal relationships. Currently, the scene description (and no other element) describes relationships between virtual objects of a scene and objects in the real-world, in order to support AR and MR applications, however, this disclosure recognizes the necessity of describing such relationships between virtual objects and real-world objects.; ¶ 0127: The scene description may indicate a transformation of the scene coordinate system into the anchor XR space. For example, rotation, translation, and scaling of the origin of the scene description coordinate space may he performed to align to the XR space. In the absence of any transform, the coordinate system of the scene description is aligned with that of the anchor space.).
Bouazizi does not explicitly teach a 360 video or a 360 viewport of the 360 video.
However, Oh does teach a 360 video or a 360 viewport of the 360 video (¶ 50: 360-degree video may mean video or image content that is required to provide VR and is simultaneously captured or reproduced in all directions (360 degrees). Hereinafter, the term 360-degree video may mean a 360-degree video. The 360-degree video may refer to a video or image displayed on various types of 3D spaces according to a 3D model, and for example, a 360-degree video may be displayed on a spherical surface. 360 audio is also audio content for providing VR, and may mean spatial audio content that can be recognized as being located in a specific three-dimensional space.).
Bouazizi and Oh are considered to be analogous art as both pertain to immersive video processing for XR applications. Therefore, it would have been obvious to one of ordinary skill in the art to combine the anchoring scene description to a user for streaming immersive media content (as taught by Bouazizi) and method for displaying 360-degree video (as taught by Oh) before the effective filing date of the claimed invention. The motivation for this combination of references would be the method of Oh incorporates a process of correcting distortion of the 360 degree video during a stitching and/or rendering process to improve image quality (See ¶ 181).
This motivation for the combination of Bouazizi and Oh is supported by KSR exemplary rationale (G) Some teaching, suggestion, or motivation in the prior art that would have led one of ordinary skill to modify the prior art reference or to combine prior art reference teachings to arrive at the claimed invention. MPEP 2141 (III).
Regarding claim 3, the Bouazizi and Oh combination teaches the method of claim 2.
Additionally, Oh teaches wherein obtaining the 360 video comprises selecting the 360 video among a plurality of 360 videos based on a user position indicated by the pose information of the user (¶ 53: The capture process may mean a process of capturing an image or video for each of a plurality of viewpoints through one or more cameras. Image/video data such as 110 of FIG. 1 may be generated by the capture process. Each plane of 110 of FIG. 1 may mean an image/video for each viewpoint.; ¶ 56: First, each image/video may go through a stitching process. The stitching process may be a process of making one panoramic image/video or a spherical image/video by connecting each of the captured images/videos.; ¶ 67: The head orientation information may refer to information on the position, angle, and movement of the user's head. Based on this information, information on an area that the user is currently viewing in the 360-degree video, that is, viewport information may be calculated.).
Additionally Oh teaches a 360 video (¶ 50: 360-degree video may mean video or image content that is required to provide VR and is simultaneously captured or reproduced in all directions (360 degrees). Hereinafter, the term 360-degree video may mean a 360-degree video. The 360-degree video may refer to a video or image displayed on various types of 3D spaces according to a 3D model, and for example, a 360-degree video may be displayed on a spherical surface. 360 audio is also audio content for providing VR, and may mean spatial audio content that can be recognized as being located in a specific three-dimensional space.).
Regarding claim 6, the Bouazizi and Oh combination teaches the method of claim 2.
Additionally, Bouazizi teaches wherein the information indicating the relation between the coordinates of the 360 video and the scene object includes coordinates of a reference point in the scene object which corresponds to an origin defined in the 360 video (¶ 0124: The scene description, including scene graph 262 and scene graph updates 264, as discussed above, acts as the entry point in a set of data for consuming immersive media data. The scene description describes all virtual objects of the scene and their spatial and temporal relationships.; ¶ 0127: The scene description may indicate a transformation of the scene coordinate system into the anchor XR space. For example, rotation, translation, and scaling of the origin of the scene description coordinate space may he performed to align to the XR space. In the absence of any transform, the coordinate system of the scene description is aligned with that of the anchor space.).
Regarding claim 7, the Bouazizi and Oh combination teaches the method of claim 2.
Additionally Bouazizi teaches wherein the (¶ 0093: A scene description usually includes a scene graph, which is a directed acyclic graph, typically a plain tree-structure, that represents an object-based hierarchy of the geometry of a scene.; ¶ 0113: In this example, the MPEG-I Scene Description architecture includes local camera 250, local microphone 252, controller device 254, sensors 256, scene graph 262, scene graph updates 264, 2D/3D media data 258, and presentation engine 260. 2D/3D media data 258 may include data for rendering a virtual scene (emphasis added).; Examiner’s note: Examiner believes it would be beneficial for prosecution to detail what a screen description is in the claim to help make clear the bounds of the term and how it contains scene objects and the 360 video. As written, “scene description” is broad and could comprise any supplemental data that is used in creating the scene.).
Regarding claim 8, the Bouazizi and Oh combination teaches the method of claim 7.
Additionally Bouazizi teaches wherein the metadata further includes at least one of YUV data or depth data (¶ 0113: 2D/3D media data 258 may include data for rendering a virtual scene, e.g., one or more virtual objects, including walls, floor, ceiling, chairs, tables, or any other virtual object, as well as locations of the objects within the virtual scene. (emphasis added)).
Regarding claim 12, claim 12 has been analyzed with regard to claim 2 and is rejected for the same reasons of obviousness as used above as well as in accordance with Bouazizi’s further teaching on:
A user equipment comprising:
A transceiver (¶ 0066: Output interface 32 may comprise, for example, a transmitter, a transceiver…); and
At least one processor coupled with the transceiver and configured to (¶ 0134: Hardware may
include one or more processing circuits, such as one or more digital signal processors (DSPs), general purpose microprocessors, application specific integrated circuits (ASICs), field programmable logic arrays (FPGAs), or other equivalent integrated or discrete logic circuitry.)…
Regarding claim 13, claim 13 has been analyzed with regard to respective claim 3 and is rejected for the same reasons of obviousness as used above.
Regarding claim 16, claim 16 has been analyzed with regard to respective claim 6 and is rejected for the same reasons of obviousness as used above.
Regarding claim 17, claim 17 has been analyzed with regard to respective claim 7 and is rejected for the same reasons of obviousness as used above.
Regarding claim 18, claim 18 has been analyzed with regard to respective claim 8 and is rejected for the same reasons of obviousness as used above.
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to ANDREW JONES whose telephone number is (703)756-4573. The examiner can normally be reached Monday - Friday 8:00-5:00 EST, off Every Other Friday.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Matthew Bella can be reached at (571) 272-7778. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/ANDREW B. JONES/Examiner, Art Unit 2667 /MATTHEW C BELLA/Supervisory Patent Examiner, Art Unit 2667
Prosecution Insights