DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Response to Arguments
Applicant's arguments filed 17 February 2026 have been fully considered but they are not persuasive. Applicant states the prior art of Stauber fails to teach the limitation,
“receiving perception information responsive to a verification that a condition relating to the first device and the second device is established, the verification of the condition being based on the one or more measurements indicative of the motion or the position of the first device and the one or more measurements indicative of the motion or the position of the second device, the perception information comprising a type of environment of the second device, a position of the second device, an orientation of the second device, image data, or a combination thereof.”.
The Examiner disagrees.
Applicant’s specification [0080] cites,
the relative position of the wearable device 404 relative to the UE 402 can be estimated based on a spatial anchor, e.g., known distance to other objects in the environment or known size of the object (e.g., a UE rendered in an image with x number of pixels may correspond to a distance of y). The UE 402 and the wearable device 404 may share a common set of identified objects or visual features.
The prior art of Stauber’s paragraph [0016] (cited in previous office action) describes two devices to identify a mutually recognized object and a state of affairs or relationship between the two devices are established because the object within the environment must be chosen by both devices prior to obtaining perception information (e.g. the verification of the condition being based on the one or more measurements indicative of the motion or the position of the first device… the position of the second device).
[0016] In the inter-object variant of the method S100, the system can prompt each user of the pair of devices to identify two mutually recognized reference objects in the 3D environment so that each device can construct a reference vector between the two reference objects.
Stauber further teaches the obviousness improvement as the reference is searching for a valid common reference frame which is identical between the two paired devices ([0018][0019]) (e.g. the perception information…position of the first device…position of the second device).
In an effort to further clarify and provide further evidence, the examiner has presented [0072] (previously shown in claim 11) where it further elaborates the verification process of a first device and second device using an object, and thereafter receiving perception information (i.e. common reference vectors):
([0072] In one implementation, a first device in the pair of devices can interface with a second device in the pair of devices in order to verify that both devices are identifying the same reference objects before each device calculates a reference vector…Upon receiving remote object signatures calculated by the second device, the first device can compare the received object signatures to its own local object signatures. In response to a substantial match between the received remote object signatures and the first device's local object signatures, the first device can proceed in calculating a reference vector between the reference objects or between the reference object and the device.
With the notion of Applicant’s specification teaching the spatial anchor, it is readily apparent that Stauber teaches this limitation of “receiving perception information responsive to a verification that a condition relating to the first device and the second device is established,…”
The prior art clearly shows a verification step that at least a pair of devices must first communicate about a specific object in order to proceed to the next step of sharing perception information. Applicant’s specification has an example of this principle and the prior art teaches this limitation.
Therefore, (i) a "condition," i.e., a state of affairs or relationship between the two devices, and (ii) a "verification," i.e., a determination of whether that state of affairs exists is clearly taught by Stauber. Moreover, the conditional dependency is readily present with the teachings of Stauber.
Applicant further states the motivation to combine is conclusory. However, when viewing the reference of Stauber, one ordinarily skilled would see that Stauber would ultimately speed up the time of finding both devices based on an object (e.g. reduce response delay between both devices) and would further ensure accuracy of the perception data because the invention relies on object detection to quickly find perception information based on the object.
Hence, Applicant's arguments do not comply with 37 CFR 1.111(c) because they do not clearly point out the patentable novelty which he or she thinks the claims present in view of the state of the art disclosed by the references cited or the objections made. Further, they do not show how the amendments avoid such references or objections.
Therefore, Huang in view of Stauber are obvious over the invention of claims 1, 16, 26 and 29.
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claim(s) 1-5,7,8,10-13,16-18,21,22,24-27,29 and 30 are rejected under 35 U.S.C. 103 as being unpatentable over Huang (CN-111078003-A) in view of Stauber (US 20200074739 A1).
Claim 1. Huang teaches a method of sharing perception information between a first device and a second device, the method comprising:
obtaining one or more measurements indicative of a motion or a position of the first device
(Page 8- calculating the pose data of the first device. wherein the pose data for characterizing the first device at the first device position and posture corresponding to the space coordinate system, such as position may be represented by spatial coordinates, posture can be represented by using a rotation angle. mode, of course,);
obtaining one or more measurements indicative of a motion or a position of the second device
(Page 13- determining the map content corresponding to the characteristic information, and then obtaining the pose data of the second device, position and pose data of the second device,);
the perception information comprising a type of environment of the second device, a position of the second device, an orientation of the second device, image data, or a combination thereof
(Page 2- The image, constructing a map corresponding to the first real scene, obtaining map data, the map data is transmitted to the second device, the map data used for indicating said second device according to said map data and second object relocation, (e.g. image data and position),
Page 18- In some embodiments, the data processing device 400 may also include a content module, which is used for the transmitting the map is transmitted to the second device, when receiving the indication information to the second device, to control the first device in the first real scene superimposing virtual object, wherein, said indication information is used for indicating the second device re-orientation success, a content display module for displaying the virtual object. (e.g. orientation)).
Huang further discloses the process of determining the location of the first and second device using a shared position system (Page 4- need to share a common coordinate system) but does not specifically disclose receiving perception information responsive to a verification that a condition relating to the first device and the second device is established, the verification of the condition being based on the one or more measurements indicative of the motion or the position of the first device and the one or more measurements indicative of the motion or the position of the second device.
However, Stauber teaches receiving perception information responsive to a verification that a condition relating to the first device and the second device is established, the verification of the condition being based on the one or more measurements indicative of the motion or the position of the first device and the one or more measurements indicative of the motion or the position of the second device
([0016][0018] Once a device has calculated a reference vector, the device can access a concurrent second reference vector (e.g., via a direct wireless connection between the pair of devices or over a local or wide area network) calculated at the second device in order to calculate a rotation and offset between the reference frames of the two devices. The system can then choose a single common reference frame for the pair of devices, which can include a reference frame of one of the devices or a third reference frame defined relative to the
reference vectors.
[0019] Upon establishing a common reference frame for the pair of devices, each device can: record odometry data to track its position in the reference frame...
[0072] In one implementation, a first device in the pair of devices can interface with a second device in the pair of devices in order to verify that both devices are identifying the same reference objects before each device calculates a reference vector... Upon receiving remote object signatures calculated by the second device, the first device can compare the received object signatures to its own local object signatures. In response to a substantial match between the received remote object signatures and the first device's local object signatures, the first device can proceed in calculating a reference vector between the reference objects or between the reference object and the device.
(e.g., the first and second device perform the verification that both devices are in position with an a reference object verification then vectors are determined)
[0022] For example, a device can define a reference frame based on its position and orientation upon initiating an augmented reality session...(e.g. position and orientation are used to determine the vectors (reference frames of each device))).
Therefore, it would have been obvious to one ordinarily skilled in the art before the effective filing date of invention to use a verification that a condition relating to the first device and the second device is established as taught by Stauber within the system of Huang for the purpose of ensuring accuracy of the perception data with use of an identified object and reduce response delay between both devices.
Claim 2. Huang and Stauber teach the method of claim 1, wherein the first device comprises a user equipment (UE), the second device comprises a wearable device, and the condition comprises a positional relationship between the UE and the wearable device
(Huang Page 5- In some embodiments, the electronic device may be a head-mounted display device, also can be mobile phone, tablet computer and mobile device. electronic device is a head-mounted display device, headmounted display device can be a whole head mounted display device. electronic device also can be a smart terminal such as mobile phone and external connected/connectable head-mounted display device, that is, electronic device can be used as processing and storage device of the head-mounted display device,).
Claim 3. Huang and Stauber teach the method of claim 2, wherein the wearable device comprises a head- mounted display, a heads-up display, a wrist-worn device, or a finger-worn device
(Huang Page 5- In some embodiments, the electronic device may be a head-mounted display device, also can be mobile phone, tablet computer and mobile device. electronic device is a head-mounted display device, headmounted display device can be a whole head mounted display device.).
Claim 4. Huang and Stauber teach the method of claim 2, the positional relationship comprises a position of the first device relative to the position of the second device, a proximity between the first device and the second device, a co-location of the first device and the second device, an orientation of the first device relative to the orientation of the second device, or a combination thereof
(Stauber[0023] the device tracks all locations and orientations in terms of its current reference frame. Therefore, in order to facilitate a shared augmented reality session between two or more devices, each device participating in the session adopts a common reference frame such that objects located relative to the common reference frame can be located by all devices that have adopted the common reference frame.
[0032] 2D spatial proximity).
Claim 5. Huang and Stauber teach the method of claim 4, further comprising determining the position of the first device relative to the position of the second device based on an optical image obtained using the second device, an inertial measurement of the first device, or a combination thereof
(Huang Page 8 - the first device may comprises a first object according to the collected, and data (movement data) collected by the inertia measuring unit (Inertial measurement unit, IMU), c).
Claim 7. Huang and Stauber teach the method of claim 4, further comprising determining the proximity between the first device and the second device based on at least one ranging measurement between the first device and the second device
(Huang Page 2- The execution subject of the communication method may be a control device or a first device. Wherein, the first device and the second device are both ultra-wideband devices, and both the first device and the second device are in the target area...the first device can locate the second device to obtain the position information of the second device, and the first device can interact with the second device to obtain the field of view of the second device).
Claim 8. Huang and Stauber teach the method of claim 4, further comprising determining the co-location of the first device and the second device based on a correlation of one or more inertial measurements of the first device and one or more inertial measurements of the second device
(Huang Page 8 - the first device may comprises a first object according to the collected, and data (movement data) collected by the inertia measuring unit (Inertial measurement unit, IMU)).
Claim 10. Huang and Stauber teach the method of claim 1, wherein :obtaining the one or more measurements indicative of the motion of the second device comprises receiving the one or more measurements indicative of the motion of the second device from the second device; and
receiving the perception information comprises receiving the perception information from the second device
(Stauber [0026] For example, the device can: access a series of 2D images recorded by a camera integrated into the device; implement visual-inertial odometry, structure from motion,
[0072] Upon receiving remote object signatures calculated by the second device, the first device can compare the received object signatures to its own local object signatures.).
Claim 11. Huang and Stauber teach the method of claim 10, further comprising sending a request for the perception information to the second device; wherein the receiving the perception information is responsive to the request
(Stauber [0072] In one implementation, a first device in the pair of devices can interface with a second device in the pair of devices in order to verify that both devices are identifying the same reference objects before each device calculates a reference vector... In response to a mismatch between the local and remote object signatures, the device can prompt the user to identify new reference objects and/or verbally verify that the users of both devices in the pair of devices have identified the same reference objects in the 3D environment.).
Claim 12. Huang and Stauber teach the method of claim 1, further comprising performing an application using the received perception information, the application comprising switching from a first wireless communication protocol to a second wireless communication protocol, selecting an access point from a plurality of access points, selecting a beam from a plurality for beams associated with one or more base stations, or performing a position- based operation using the received perception information
(Page 12- In addition, when obtaining the re-location success indication information for indicating the second device, generating a virtual object and to display, then the pose data of the virtual object and the display data transmitted to the second device so that the second device to synchronously display the virtual object to realize the synchronous display of multi-person in the AR.
Page 13 - can analyze the position relationship between the first device and the second device, and according to the position relation, can determine the conversion relation between space coordinate space coordinate system corresponding to the first equipment and the second equipment corresponding to, so as to realize the alignment of the coordinate system. also to finish the re-location. e.g. position based operation).
Claim 13. Huang and Stauber teach the method of claim 1, wherein the type of the environment comprises an indoor environment or an outdoor environment, the type of the environment detected using one or more sensors of the second device
(Stauber [0104] In one implementation, the device can detect its absolute geographic location based on its location in the common reference frame and can download contextual information corresponding to its geographic location for display to the user. For example, if the device detects that it is located at a particular stage of a music festival, the device can download the set list for the stage and display the list to the user. ).
Claim 16. Huang teaches an apparatus comprising:
one or more wireless communication interfaces
(Page 20- electronic device 100...a modem is used for processing wireless communication);
one or more memory
(Page 20- memory 120)
one or more sensors
(Page 6- the image collecting device / page 8 inertia measuring unit (Inertial measurement unit, IMU));
; and one or more processors coupled to the one or more wireless communication interfaces
(processor 110)
, the one or more sensors, and the one or more memory, and configured to:
obtain one or more measurements indicative of a motion or a position of a first device
(Page 13- determining the map content corresponding to the characteristic information, and then obtaining the pose data of the second device, position and pose data of the second device,);
obtain one or more measurements indicative of a motion or a position of a second device
(Page 13- determining the map content corresponding to the characteristic information, and then obtaining the pose data of the second device, position and pose data of the second device,);
and the perception information comprising a type of environment of the second device, a position of the second device, an orientation of the second device, image data, or a combination thereof
(Page 2- The image, constructing a map corresponding to the first real scene, obtaining map data, the map data is transmitted to the second device, the map data used for indicating said second device according to said map data and second object relocation, (e.g. image data and position),
Page 18- In some embodiments, the data processing device 400 may also include a content module, which is used for the transmitting the map is transmitted to the second device, when receiving the indication information to the second device, to control the first device in the first real scene superimposing virtual object, wherein, said indication information is used for indicating the second device re-orientation success, a content display module for displaying the virtual object. (e.g. orientation)).
Huang further discloses the process of determining the location of the first and second device using a shared position system (Page 4- need to share a common coordinate system) but does not specifically disclose receive perception information responsive to a verification that a condition relating to the first device and the second device is established, the verification of the condition being based on the one or more measurements indicative of the motion or the position of the first device and the one or more measurements indicative of the motion or the position of the second device.
However, Stauber teaches receiving perception information responsive to a verification that a condition relating to the first device and the second device is established, the verification of the condition being based on the one or more measurements indicative of the motion or the position of the first device and the one or more measurements indicative of the motion or the position of the second device
([0016][0018] Once a device has calculated a reference vector, the device can access a concurrent second reference vector (e.g., via a direct wireless connection between the pair of devices or over a local or wide area network) calculated at the second device in order to calculate a rotation and offset between the reference frames of the two devices. The system can then choose a single common reference frame for the pair of devices, which can include a reference frame of one of the devices or a third reference frame defined relative to the reference vectors. (e.g. verification of a common reference frame based on vectors)
[0019] Upon establishing a common reference frame for the pair of devices, each device can: record odometry data to track its position in the reference frame...
[0072] In one implementation, a first device in the pair of devices can interface with a second device in the pair of devices in order to verify that both devices are identifying the same reference objects before each device calculates a reference vector...Upon receiving remote object signatures calculated by the second device, the first device can compare the received object signatures to its own local object signatures. In response to a substantial match between the received remote object signatures and the first device's local object signatures, the first device can proceed in calculating a reference vector between the reference objects or between the reference object and the device.
(e.g., the first and second device perform the verification that both devices are in position with an a reference object verification then vectors are determined).
Therefore, it would have been obvious to one ordinarily skilled in the art before the effective filing date of invention to use a verification that a condition relating to the first device and the second device is established as taught by Stauber within the system of Huang for the purpose of ensuring accuracy of the perception data with use of an identified object and reduce response delay between both devices.
Claim 17. Huang and Stauber teach the apparatus of claim 16, wherein the apparatus comprises the first device or the second device; and wherein the first device comprises a user equipment (UE), the second device comprises a wearable device, and the condition comprises a positional relationship between the UE and the wearable device
(Huang Page 5- In some embodiments, the electronic device may be a head-mounted display device, also can be mobile phone, tablet computer and mobile device. electronic device is a head-mounted display device, headmounted display device can be a whole head mounted display device.).
Claim 18. Huang and Stauber teach the apparatus of claim 17, wherein the positional relationship comprises a position of the first device relative to the position of the second device, a proximity between the first device and the second device, a co-location of the first device and the second device, an orientation of the first device relative to the orientation of the second device, or a combination thereof
((Stauber[0023] the device tracks all locations and orientations in terms of its current reference frame. Therefore, in order to facilitate a shared augmented reality session between two or more devices, each device participating in the session adopts a common reference frame such that objects located relative to the common reference frame can be located by all devices that have adopted the common reference frame.
[0032] 2D spatial proximity)).
Claim 19. Huang and Stauber teach the apparatus of claim 18, wherein the one or more processors are further configured to determine the position of the first device relative to the position of the second device based on an optical image obtained using the second device, an inertial measurement of the first device, or a combination thereof
(Huang Page 8 - the first device may comprises a first object according to the collected, and data (movement data) collected by the inertia measuring unit (Inertial measurement unit, IMU), c).
Claim 21. Huang and Stauber teach the apparatus of claim 18, wherein the one or more processors are further configured to determine the proximity between the first device and the second device based on at least one ranging measurement between the first device and the second device
(Huang Page 2- The execution subject of the communication method may be a control device or a first device. Wherein, the first device and the second device are both ultra-wideband devices, and both the first device and the second device are in the target area...the first device can locate the second device to obtain the position information of the second device, and the first device can interact with the second device to obtain the field of view of the second device).
Claim 22. Huang and Stauber teach the apparatus of claim 18, wherein the one or more processors are further configured to determine the co-location of the first device and the second device based on a correlation of one or more inertial measurements of the first device and one or more inertial measurements of the second device
(Huang Page 8 - the first device may comprises a first object according to the collected, and data (movement data) collected by the inertia measuring unit (Inertial measurement unit, IMU))..
Claim 24. Huang and Stauber teach the apparatus of claim 16, wherein:
obtaining the one or more measurements indicative of the motion of the second device comprises receiving the one or more measurements indicative of the motion of the second device from the second device; and receiving the perception information comprises receiving the perception information from the second device
(Stauber [0026] For example, the device can: access a series of 2D images recorded by a camera integrated into the device; implement visual-inertial odometry, structure from motion,
[0072] Upon receiving remote object signatures calculated by the second device, the first device can compare the received object signatures to its own local object signatures.).
Claim 25. Huang and Stauber teach the apparatus of claim 16, wherein the one or more processors are further configured to perform an application using the received perception information, the application comprising switching from a first wireless communication protocol to a second wireless communication protocol, selecting an access point from a plurality of access points, selecting a beam from a plurality for beams associated with one or more base stations, or performing a position-based operation using the received perception information
(Huang Page 12- In addition, when obtaining the re-location success indication information for indicating the second device, generating a virtual object and to display, then the pose data of the virtual object and the display data transmitted to the second device so that the second device to synchronously display the virtual object to realize the synchronous display of multi-person in the AR.
Page 13 - can analyze the position relationship between the first device and the second device, and according to the position relation, can determine the conversion relation between space coordinate space coordinate system corresponding to the first equipment and the second equipment corresponding to, so as to realize the alignment of the coordinate system. also to finish the re-location. e.g. position based operation).
Claim 26. Huang teaches a non-transitory computer-readable apparatus comprising a storage medium, the storage medium comprising a plurality of instructions configured to, when executed by one or more processors, cause the one or more processors to:
obtain one or more measurements indicative of a motion or a position of a first device
(Page 8- calculating the pose data of the first device. wherein the pose data for characterizing the first device at the first device position and posture corresponding to the space coordinate system, such as position may be represented by spatial coordinates, posture can be represented by using a rotation angle. mode, of course,);
obtain one or more measurements indicative of a motion or a position of a second device
(Page 13- determining the map content corresponding to the characteristic information, and then obtaining the pose data of the second device, position and pose data of the second device,);
; and the perception information comprising a type of environment of the second device, a position of the second device, an orientation of the second device, image data, or a combination thereof
(Page 2- The image, constructing a map corresponding to the first real scene, obtaining map data, the map data is transmitted to the second device, the map data used for indicating said second device according to said map data and second object relocation, (e.g. image data and position),
Page 18- In some embodiments, the data processing device 400 may also include a content module, which is used for the transmitting the map is transmitted to the second device, when receiving the indication information to the second device, to control the first device in the first real scene superimposing virtual object, wherein, said indication information is used for indicating the second device re-orientation success, a content display module for displaying the virtual object. (e.g. orientation)).
Huang further discloses the process of determining the location of the first and second device using a shared position system (Page 4- need to share a common coordinate system) but does not specifically disclose receive perception information responsive to a verification that a condition relating to the first device and the second device is established, the verification of the condition being based on the one or more measurements indicative of the motion or the position of the first device and the one or more measurements indicative of the motion or the position of the second device.
However, Bai teaches receiving perception information responsive to a verification that a condition relating to the first device and the second device is established, the verification of the condition being based on the one or more measurements indicative of the motion or the position of the first device and the one or more measurements indicative of the motion or the position of the second device
([0016][0018] Once a device has calculated a reference vector, the device can access a concurrent second reference vector (e.g., via a direct wireless connection between the pair of devices or over a local or wide area network) calculated at the second device in order to calculate a rotation and offset between the reference frames of the two devices. The system can then choose a single common reference frame for the pair of devices, which can include a reference frame of one of the devices or a third reference frame defined relative to the reference vectors. (e.g. verification of a common reference frame based on vectors)
[0019] Upon establishing a common reference frame for the pair of devices, each device can: record odometry data to track its position in the reference frame...
[0072] In one implementation, a first device in the pair of devices can interface with a second device in the pair of devices in order to verify that both devices are identifying the same reference objects before each device calculates a reference vector...Upon receiving remote object signatures calculated by the second device, the first device can compare the received object signatures to its own local object signatures. In response to a substantial match between the received remote object signatures and the first device's local object signatures, the first device can proceed in calculating a reference vector between the reference objects or between the reference object and the device.
(e.g., the first and second device perform the verification that both devices are in position with an a reference object verification then vectors are determined).
Therefore, it would have been obvious to one ordinarily skilled in the art before the effective filing date of invention to use a verification that a condition relating to the first device and the second device is established as taught by Stauber within the system of Huang for the purpose of ensuring accuracy of the perception data with use of an identified object and reduce response delay between both devices.
Claim 27. Huang and Stauber teach the non-transitory computer-readable apparatus of claim 26, wherein the condition comprises a positional relationship between the first device and the second device; and the positional relationship comprises a position of the first device relative to the position of the second device, a proximity between the first device and the second device, a co-location of the first device and the second device, an orientation of the first device relative to the orientation of the second device, or a combination thereof
((Huang Page 5- In some embodiments, the electronic device may be a head-mounted display device, also can be mobile phone, tablet computer and mobile device. electronic device is a head-mounted display device, headmounted display device can be a whole head mounted display device. electronic device also can be a smart terminal such as mobile phone and external connected/connectable head-mounted display device, that is, electronic device can be used as processing and storage device of the head-mounted display device,).
Stauber[0023] the device tracks all locations and orientations in terms of its current reference frame. Therefore, in order to facilitate a shared augmented reality session between two or more devices, each device participating in the session adopts a common reference frame such that objects located relative to the common reference frame can be located by all devices that have adopted the common reference frame. [0032] 2D spatial proximity))).
Claim 29. Huang teaches an apparatus comprising:
means for obtaining one or more measurements indicative of a motion or a position of a first device
(Page 8- calculating the pose data of the first device. wherein the pose data for characterizing the first device at the first device position and posture corresponding to the space coordinate system, such as position may be represented by spatial coordinates, posture can be represented by using a rotation angle. mode, of course,);
means for obtaining one or more measurements indicative of a motion or a position of a second device
(Page 13- determining the map content corresponding to the characteristic information, and then obtaining the pose data of the second device, position and pose data of the second device,);
the perception information comprising a type of environment of the second device, a position of the second device, an orientation of the second device, image data, or a combination thereof
(Page 2- The image, constructing a map corresponding to the first real scene, obtaining map data, the map data is transmitted to the second device, the map data used for indicating said second device according to said map data and second object relocation, (e.g. image data and position),
Page 18- In some embodiments, the data processing device 400 may also include a content module, which is used for the transmitting the map is transmitted to the second device, when receiving the indication information to the second device, to control the first device in the first real scene superimposing virtual object, wherein, said indication information is used for indicating the second device re-orientation success, a content display module for displaying the virtual object. (e.g. orientation)).
Huang further discloses the process of determining the location of the first and second device using a shared position system (Page 4- need to share a common coordinate system) but does not specifically disclose means for receiving perception information responsive to a verification that a condition relating to the first device and the second device is established, the verification of the condition being based on the one or more measurements indicative of the motion or the position of the first device and the one or more measurements indicative of the motion or the position of the second device.
However, Stauber teaches means for receiving perception information responsive to a verification that a condition relating to the first device and the second device is established, the verification of the condition being based on the one or more measurements indicative of the motion or the position of the first device and the one or more measurements indicative of the motion or the position of the second device
([0016][0018] Once a device has calculated a reference vector, the device can access a concurrent second reference vector (e.g., via a direct wireless connection between the pair of devices or over a local or wide area network) calculated at the second device in order to calculate a rotation and offset between the reference frames of the two devices. The system can then choose a single common reference frame for the pair of devices, which can include a reference frame of one of the devices or a third reference frame defined relative to the reference vectors. (e.g. verification of a common reference frame based on vectors)
[0019] Upon establishing a common reference frame for the pair of devices, each device can: record odometry data to track its position in the reference frame...
[0072] In one implementation, a first device in the pair of devices can interface with a second device in the pair of devices in order to verify that both devices are identifying the same reference objects before each device calculates a reference vector...Upon receiving remote object signatures calculated by the second device, the first device can compare the received object signatures to its own local object signatures. In response to a substantial match between the received remote object signatures and the first device's local object signatures, the first device can proceed in calculating a reference vector between the reference objects or between the reference object and the device.
(e.g., the first and second device perform the verification that both devices are in position with an a reference object verification then vectors are determined).
Therefore, it would have been obvious to one ordinarily skilled in the art before the effective filing date of invention to use a verification that a condition relating to the first device and the second device is established as taught by Stauber within the system of Huang for the purpose of ensuring accuracy of the perception data with use of an identified object and reduce response delay between both devices.
Claim 30. Huang and Stauber teach the apparatus of claim 29, wherein the condition comprises a positional relationship between the first device and the second device; and the positional relationship comprises a position of the first device relative to the position of the second device, a proximity between the first device and the second device, a co-location of the first device and the second device, an orientation of the first device relative to the orientation of the second device, or a combination thereof
(Huang Page 5- In some embodiments, the electronic device may be a head-mounted display device, also can be mobile phone, tablet computer and mobile device. electronic device is a head-mounted display device, headmounted display device can be a whole head mounted display device. electronic device also can be a smart terminal such as mobile phone and external connected/connectable head-mounted display device, that is, electronic device can be used as processing and storage device of the head-mounted display device,).
Stauber[0023] the device tracks all locations and orientations in terms of its current reference frame. Therefore, in order to facilitate a shared augmented reality session between two or more devices, each device participating in the session adopts a common reference frame such that objects located relative to the common reference frame can be located by all devices that have adopted the common reference frame. [0032] 2D spatial proximity)).
Claim(s) 6, 20 and 28 are rejected under 35 U.S.C. 103 as being unpatentable over Huang and Stauber and further in view of Bai (WO 2022135026 A1).
Claim 6. Huang and Stauber teach the method of claim 4, and further discloses the position of devices using field angles and signal strength reflections but do not specifically disclose determining the orientation of the first device relative to the orientation of the second device based on an angle of arrival or an angle of departure of a radio frequency (RF) signal between the first device and the second device.
However, Bai teaches determining the orientation of the first device relative to the orientation of the second device based on an angle of arrival or an angle of departure of a radio frequency (RF) signal between the first device and the second device.
(Page 14- Step 1. The first device sends configuration information of the sensing signal to the second device, including at least one of information such as time-frequency resource location, angle of departure (AoD), and waveform.).
Therefore, it would have been obvious to one ordinarily skilled in the art before the effective filing date of invention to use an angle of arrival or an angle of departure of a radio frequency (RF) signal between the first device and the second device as taught by Bai within the system of Huang for the purpose of quickly determining the location of the device based on a phase change of the transmitted signal.
Claim 20. Huang and Bai teach the apparatus of claim 18, and further discloses the position of devices using field angles and signal strength reflections but do not specifically disclose wherein the one or more processors are further configured to determine the orientation of the first device relative to the orientation of the second device based on an angle of arrival or an angle of departure of a radio frequency (RF) signal between the first device and the second device.
However, Bai teaches wherein the one or more processors are further configured to determine the orientation of the first device relative to the orientation of the second device based on an angle of arrival or an angle of departure of a radio frequency (RF) signal between the first device and the second device
(Page 14- Step 1. The first device sends configuration information of the sensing signal to the second device, including at least one of information such as time-frequency resource location, angle of departure (AoD), and waveform.).
Therefore, it would have been obvious to one ordinarily skilled in the art before the effective filing date of invention to use an angle of arrival or an angle of departure of a radio frequency (RF) signal between the first device and the second device as taught by Bai within the system of Huang for the purpose of quickly determining the location of the device based on a phase change of the transmitted signal.
Claim 28. Huang and Stauber teach the non-transitory computer-readable apparatus of claim 27, wherein the plurality of instructions are further configured to, when executed by the one or more processors, cause the one or more processors to:
determine the position of the first device relative to the position of the second device based on an optical image obtained using the second device, an inertial measurement of the first device, or a combination thereof
(Huang Page 8 - the first device may comprises a first object according to the collected, and data (movement data) collected by the inertia measuring unit (Inertial measurement unit, IMU), c);
determine the proximity between the first device and the second device based on at least one ranging measurement between the first device and the second device
(Huang Page 2- The execution subject of the communication method may be a control device or a first device. Wherein, the first device and the second device are both ultra-wideband devices, and both the first device and the second device are in the target area...the first device can locate the second device to obtain the position information of the second device, and the first device can interact with the second device to obtain the field of view of the second device
Bai Page 18- For example, the control device may gradually move the position of the second device toward the direction of the radar coverage blind area in the target area, so as to ensure that the first radar coverage and the second radar coverage overlap, so that the second device New radar coverage covers radar coverage blind spots. (e.g. proximity));
determine the co-location of the first device and the second device based on a correlation of one or more inertial measurements of the first device and one or more inertial measurements of the second device; or a combination thereof
(Stauber [0023] the device tracks all locations and orientations in terms of its current reference frame. Therefore, in order to facilitate a shared augmented reality session between two or more devices, each device participating in the session adopts a common reference frame such that objects located relative to the common reference frame can be located by all devices that have adopted the common reference frame. [0032] 2D spatial proximity))).
Huang and Stauber further discloses the position of devices using field angles and signal strength reflections but do not specifically disclose determine the orientation of the first device relative to the orientation of the second device based on an angle of arrival or an angle of departure of a radio frequency (RF) signal between the first device and the second device;
However, Bai teaches determining the orientation of the first device relative to the orientation of the second device based on an angle of arrival or an angle of departure of a radio frequency (RF) signal between the first device and the second device.
(Page 14- Step 1. The first device sends configuration information of the sensing signal to the second device, including at least one of information such as time-frequency resource location, angle of departure (AoD), and waveform.).
Therefore, it would have been obvious to one ordinarily skilled in the art before the effective filing date of invention to use an angle of arrival or an angle of departure of a radio frequency (RF) signal between the first device and the second device as taught by Bai within the system of Huang for the purpose of quickly determining the location of the device based on a phase change of the transmitted signal.
Claim(s) 9 and 23 are rejected under 35 U.S.C. 103 as being unpatentable over Huang and Stauber and further In view of Qiu (US 20130102324 A1).
Claim 9. Huang and Stauber teach the method of claim 1, wherein: obtaining the one or more measurements indicative of the motion of the first device comprises obtaining one or more first measurements comprising an acceleration measurement, a rotation measurement, or a combination thereof, the one or more first measurements measured using at least one inertial sensor of the first device
(Huang Page 8- the inertia measuring unit (Inertial measurement unit, IMU)...as position may be represented by Spatial coordinates, posture can be represented by using a rotation angle. mode, of course);
obtaining the one or more measurements indicative of the motion of the second device comprises obtaining one or more second measurements comprising an acceleration measurement, a rotation measurement, or a combination thereof, the one or more second measurements measured using at least one inertial sensor of the second device
(Huang Page 13- determining the map content corresponding to the characteristic information, and then obtaining the pose data of the second device, position and pose data of the second device,)
but do not specifically disclose the verification of the condition is based on a correlation of one or more first measurements and the one or more second measurements.
However, Qiu teaches the verification of the condition is based on a correlation of one or more first measurements and the one or more second measurements
([0025] The location information may include data, such as a rotation matrix from the accelerometer, gyroscope, and/or the digital compass. [0043] the localized signal(s) 110 sent by the first device 102 and the second device 104 respectively may exhibit low cross correlation, which is lower than a threshold, and high auto correlation, which is higher than another threshold, such that if the two localized signal(s) 110 overlap, they can still be easily detected.).
Therefore, it would have been obvious to one ordinarily skilled in the art before the effective filing date of invention to use a correlation of one or more first measurements and the one or more second measurements as taught by Qiu within the system of Huang for the purpose of determining whether the locations of the devices are close enough to receive perception data with less errors.
Claim 23. Huang and Stauber teach the apparatus of claim 16, wherein:
obtaining the one or more measurements indicative of the motion of the first device comprises obtaining one or more first measurements comprising an acceleration measurement, a rotation measurement, or a combination thereof, the one or more first measurements measured using at least one inertial sensor of the first device
(Huang Page 8- the inertia measuring unit (Inertial measurement unit, IMU)...as position may be represented by Spatial coordinates, posture can be represented by using a rotation angle. mode, of course);
obtaining the one or more measurements indicative of the motion of the second device comprises obtaining one or more second measurements comprising an acceleration measurement, a rotation measurement, or a combination thereof, the one or more second measurements measured using at least one inertial sensor of the second device
(Huang Page 13- determining the map content corresponding to the characteristic information, and then obtaining the pose data of the second device, position and pose data of the second device,);
but do not specifically disclose the verification of the condition is based on a correlation of one or more first measurements and the one or more second measurements.
However, Qiu teaches the verification of the condition is based on a correlation of one or more first measurements and the one or more second measurements
([0025] The location information may include data, such as a rotation matrix from the accelerometer, gyroscope, and/or the digital compass. [0043] the localized signal(s) 110 sent by the first device 102 and the second device 104 respectively may exhibit low cross correlation, which is lower than a threshold, and high auto correlation, which is higher than another threshold, such that if the two localized signal(s) 110 overlap, they can still be easily detected.).
Therefore, it would have been obvious to one ordinarily skilled in the art before the effective filing date of invention to use a correlation of one or more first measurements and the one or more second measurements as taught by Qiu within the system of Huang for the purpose of determining whether the locations of the devices are close enough to receive perception data with less errors.
Claim(s) 14 and 15 are rejected under 35 U.S.C. 103 as being unpatentable over Huang and Stauber and further in view of Cui (WO 2022028314 A1).
Claim 14. Huang and Stauber teach the method of claim 1, further comprising:
And discloses the process of obtaining perception by a device but do not specifically disclose receiving information about one or more types of perception information that is capable of being shared; sending a request for at least one of the one or more types of perception information; and initiating the verification of the condition responsive to a request to initiate the verification of the condition.
However, Cui teaches receiving information about one or more types of perception information that is capable of being shared
(Page 15- In S182 of FIG. 18 , the electronic device 1600 receives the sensing capability sent by the sensing electronic device.);
sending a request for at least one of the one or more types of perception information
(Page 15- In S181 of FIG. 18 , the electronic device 1600 requests the sensing electronic device for the sensing capability of the sensing electronic device in the form of unicast.)
; and
initiating the verification of the condition responsive to a request to initiate the verification of the condition
(Page 15- In S183 of FIG. 18 , when the electronic device 1600 confirms that the sensing electronic device can sense predetermined situation sensing information based on the received sensing capability, the electronic device 1600 establishes communication with the sensing electronic device in the form of unicast. In S184 of FIG. 18 , the sensing electronic device transmits predetermined situation sensing information to the electronic device 1600 .).
Therefore, it would have been obvious to one ordinarily skilled in the art before the effective filing date of invention to use receiving information about one or more types of perception information that is capable of being shared, sending a request and initiating the verification of the condition responsive to a request to initiate the verification of the condition as taught by Cui within the system of Huang for the purpose of selecting devices having certain abilities to effectively send environment related data required by the user.
Claim 15. Huang, Stauber and Cui teach the method of claim 14, further comprising receiving a user input configured to confirm the initiating of the verification of the condition
(Stauber [0072] In response to a mismatch between the local and remote object signatures, the device can prompt the user to identify new reference objects and/or verbally verify that the users of both devices in the pair of devices have identified the same reference objects in the 3D environment.).
Conclusion
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to RUFUS C POINT whose telephone number is (571)270-7510. The examiner can normally be reached 9am-5pm.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Davetta Goins can be reached at 571-272-2957. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/RUFUS C POINT/Primary Examiner, Art Unit 2689
Prosecution Insights