DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claim Objections
Claim(s) 1 objected to because of the following informalities: Introduction of "another real measurement point" but "other real measurement point was referenced", the term "another" should be used in place of the "other". Appropriate correction is required.
Claim(s) 1, 5, 6, 7, 9 objected to because of the following informalities: "other virtual measurement point" had not been properly introduced. Appropriate correction is required.
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claim(s) 1-6 is/are rejected under 35 U.S.C. 103 as being unpatentable over Robinson (U.S. Pub. No. 20190170510) in view of Dryer et al. (U.S. Pub. No. 20240011764).
Regarding claim 1, Robinson discloses a method for measuring a dimension by using an augmented reality space generated by superimposing a virtual space on a real space (para 1, “Virtual reality (VR) and augmented reality (AR) visualization systems are starting to enter the mainstream consumer electronics marketplace. AR Head-Mounted Display (HMD) devices are one promising use of such technology. These devices may include transparent display elements that enable a user to see virtual content transposed over the user's view of the real-world. Virtual content that appears to be superimposed over the user's real-world view is commonly referred to as AR content. Displayed AR objects are often referred to as "holographic" objects.”; also, para 2, “AR systems may be used for measuring real-world structures, however, improvements in AR measurement systems may be desired.”; also, para 26, “The present disclosure relates to using fiducial markers on a measurement tool to directly identify a measurement, and/or to validate and/or improve an accuracy of a dimension of a real-world object measured by an AR system, such as an HMD device.”), the augmented reality space being generated by processing a video taken by a camera by a processing unit and displaying the video on a transparent screen (para 29, “In this example, the HMD device 20 includes a headband 21, by which the HMD device 20 can be worn on a user's head. Attached to the headband 21 (directly or indirectly) is a transparent protective visor 22 that encloses one or more transparent AR display devices 23, each of which can overlay holographic images on the user's view of his real-world environment, for one or both eyes (e.g., by projecting light into the user's eyes).”; also, para 30, “one or more visible spectrum video cameras 30 for use in capturing standard video of what the user sees.”; also, para 78, “the functional components of the HMD device 20 include one or more instance of each of the following: a main processor 121, memory 122, transparent display device 123, depth camera controller 124, head tracking cameras controller 125, video camera controller 126, communication device 127, and audio subsystem 128, all coupled together (directly or indirectly) by an interconnect 129.”), the dimension being measured by measuring a distance between one real measurement point and another real measurement point by using a gauge including a first probe that is brought into abutment against the one real measurement point and a second probe that is brought into abutment against the other real measurement point (para 26, “The measurement tool may include a first tool member having a first plurality of fiducial markers that indicate a position of a first point in space relative to the first tool member, and a second tool member movable relative to the first tool member and having a second plurality of fiducial markers. Each of the second plurality of fiducial markers indicates a respective position of one of a plurality of second points in space relative to the second tool member.”; also, para 36, “Additionally, each measurement tool 100 and 101 may include a corner or point 306. The point 306 is used to identify particular position or location to generate a particular vertex in the digital space. When the point 306 is placed on a real-world location, the HMD device 20 includes programming to generate a digital vertex (e.g., a vertex of a holographic image) at that location.”; also, para 59, “the user may place the first tool member 102 along the step 904, and align the tip or point 306 of the first tool member 102 with a top surface 910 of the step 904 to measure the height 908 of the step 806. Specifically, the coordinates of the vertex identified by the point 306 of the first tool member 102, as determined based on identification of one or more of the first set of fiducial markers 108, may be used to calculate the height 908, e.g., relative to a corresponding point on the top of the step 902 and/or relative to a line or plane corresponding to the top of the step 902.”), in the virtual space, one virtual measurement point corresponding to the real measurement point, another virtual measurement point corresponding to the other real measurement point, a virtual first probe corresponding to the first probe in the real space, and (para 70, “Referring to FIG. 13, an image 1300 represents at least a portion of a holographic schematic 114 is overlaid on the real-world structure 106. In this case, the real-world structure 106 is a staircase. Overlaid on top of the staircase is a holographic schematic 114 including a number of virtual vertices 40, virtual edges 42 connecting virtual vertices 40, and virtual surfaces 44 bounded by the virtual edges 42.”; also, para 36, “When the point 306 is placed on a real-world location, the HMD device 20 includes programming to generate a digital vertex (e.g., a vertex of a holographic image) at that location.”), virtual second probe corresponding to the second probe in the real space, the method comprising: a first step of determine whether the virtual first probe is in contact with the one virtual measurement point; and a second step of determine whether the virtual second probe is in contact with the other virtual measurement point.
However, in a similar field of endeavor, Dryer discloses a virtual second probe corresponding to the second probe in the real space (para 236, “User interface 5006 includes a live preview of the field of view of at least one of one or more cameras of device 100”; also, para 236, “At least one camera continuously provides a live preview of contents that are within the field of view the camera, which may include one or more physical objects in physical space 5000 (e.g., table 5002).”; also, para 237, “In some embodiments, user interface 5006 includes one or more user interface elements for user interaction with the augmented reality environment. For example, in FIG. 5A, user interface 5006 includes reticle 5010 that indicates an area for user interaction with the augmented reality environment. In some embodiments, reticle 5010 includes focus point 5012 that indicates a particular point for user interaction. In some embodiments, user interface 5006 includes measurement addition button 5014 that is used for adding new measurements (e.g., new measurement points, new measurement segments, and/or new measurement regions) to user interface 5006 (e.g., as described in more detail herein). In some embodiments, reticle 5010 and focus point 5012 together form a measurement-point-creation indicator that indicates a location at which a new measurement will be added in response to activation of measurement addition button 5014.”), the method comprising: a first step of determine whether the virtual first probe is in contact with the one virtual measurement point (para 380, “While displaying the representation of the field of view (806), the electronic device determines (808) an anchor point at a location in the representation of the field of view that corresponds to a first location in the three-dimensional space. In some embodiments, the electronic device determines a plurality of anchor points that correspond to a plurality of locations in the three-dimensional space, such as a corner of a physical object in the three-dimensional space, points along an edge of a physical object in the three-dimensional space, or the like.”; also, para 381, “While displaying the representation of the field of view (806), as at least one of the one or more cameras move, and while the measurement-point-creation indicator (or at least a portion thereof) is over (or proximate to) the anchor point, the electronic device changes (810) a visual appearance of the measurement-point-creation indicator to indicate that a (virtual) measurement point will be added at the anchor point if a touch input meets first criteria”); and a second step of determine whether the virtual second probe is in contact with the other virtual measurement point (para 250, “In response to the movement of device 100 such that reticle 5010 and focus point 5012 are positioned over a different location in physical space 5000, measurement segment 5048 is displayed between measurement point 5042 (the most-recently-added measurement point) and focus point 5012. Measurement segment 5048 is displayed with label 5049 that indicates a distance between the point in physical space 5000 corresponding to measurement point 5042 and the point in physical space 5000 corresponding to focus point 5012 (e.g., "3 ft")”; also, para 251, “In response to the activation of measurement addition button 5014, device 100 adds and displays (virtual) measurement point 5054 in user interface 5006 at a current location of focus point 5012 and as the second endpoint of measurement segment 5048.”).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Robinson's invention of an augmented reality head-mounted display that overlays a holographic schematic on a real-world structure being measured by a two-tool-member fiducial-marker measurement tool with the features of Dryer's invention of displaying a measurement-point-creation indicator over the live preview of the field of view and determining whether the indicator is over an anchor point at a location in the representation that corresponds to a real-world point before committing a measurement. One of ordinary skill in the art would have been motivated to make this combination for the following reasons. First, Dryer expressly teaches that the measurement-point-creation indicator displayed over the field of view indicates "a location at which a new measurement will be added in response to activation of measurement addition button 5014," which addresses the unresolved issue in Robinson's head-mounted display that when the user brings a point 306 of a tool member into abutment with a real surface, no virtual element shown to the user confirms which real point the head-mounted display has registered as a virtual measurement point. Second, Dryer expressly teaches that while "the measurement-point-creation indicator (or at least a portion thereof) is over (or proximate to) the anchor point, the electronic device changes (810) a visual appearance of the measurement-point-creation indicator to indicate that a (virtual) measurement point will be added at the anchor point," which provides an in-augmented reality cue that the contact between the virtual probe and the virtual measurement point has been recognized by the system, reducing user input errors when placing measurement vertices on Robinson's holographic schematic. Third, Dryer expressly teaches a two-endpoint workflow in which a first measurement point and a second measurement point are placed sequentially and "measurement segment 5048" is displayed connecting them, which matches the dimension-between-two-probes measurement model already used by Robinson's measurement tool 100 with first tool member 102 and second tool member 104 and provides a natural visualization of the measured distance.
Regarding claim 2, Robinson as modified by Dryer discloses the method for measuring a dimension by using an augmented reality space according to claim 1, wherein the gauge includes a first gauge portion including the first probe, a first marker portion included in the first gauge portion, a second gauge portion including the second probe, and a second marker portion included in the second gauge portion (Robinson: para 28, “each of the first and second tool members 102 and 104 includes a respective set of fiducial markers 108 and 110, where combinations of fiducial markers or individual fiducial markers correspond to one or more points or edges each having a known position on the first and second tool members 102 and 104.”; also, para 34, “each measurement tool 100 and 101 includes first tool member 102 having the first set of fiducial markers 108 for determining a position used in a measurement, and relatively movable second tool member 104 having the second set of fiducial markers 110, one or more of which correspond to a known measurement value (e.g., a distance or angle) relative to a point or edge of the second tool member 104”), and in the virtual space, the virtual first probe is displayed based on information on the first marker portion, and the virtual second probe is displayed based on information on the second marker portion (Robinson: para 35, “Further common features may include, for example, each measurement tool 100 or 101 having a number of fiducial markers 302. Each of the fiducial markers 302 may be unique such that the HMD device 20 is able to identify an orientation and/or a position of the respective first or second tool member 102 and 104 of the respective measurement tool 100 or 101 from recognition of relatively few (e.g., 5) or even a single one of the fiducial markers 302.”; also, para 36, “When the point 306 is placed on a real-world location, the HMD device 20 includes programming to generate a digital vertex (e.g., a vertex of a holographic image) at that location.”; also, para 70, “Referring to FIG. 13, an image 1300 represents at least a portion of a holographic schematic 114 is overlaid on the real-world structure 106. In this case, the real-world structure 106 is a staircase. Overlaid on top of the staircase is a holographic schematic 114 including a number of virtual vertices 40, virtual edges 42 connecting virtual vertices 40, and virtual surfaces 44 bounded by the virtual edges 42.”).
Regarding claim 3, Robinson as modified by Dryer discloses the method for measuring a dimension by using an augmented reality space according to claim 1, one virtual measurement point is in contact with the virtual first probe, a size of the one virtual measurement point displayed is gradually reduced in the virtual space.
However, in a similar field of endeavor, Dryer discloses wherein, when the one virtual measurement point is in contact with the virtual first probe, a size of the one virtual measurement point displayed is gradually reduced in the virtual space (para 245, “the visual appearances of reticle 5010 and focus point 5012 are changed. In particular, focus point 5012 has been moved (e.g., vertically downward) to, or "snapped" to, a point along edge 5030. In addition, a size of reticle 5010 is reduced to indicate that focus point 5012 has snapped to a detected feature in the live preview. In some embodiments, reticle 5010 is displayed at the size shown in FIG. 5H whenever focus point 5012 is snapped to a detected feature in the live preview. In some embodiments, the visual appearances of reticle 5010 and focus point 5012 are changed when focus point 5012 snaps to a detected feature in the live preview that corresponds to an edge or a corner of a physical object in the field of view of the camera.”; also, para 247, “The size of reticle 5010 is decreased to indicate the snapping behavior (e.g., to the same size shown in and described above with reference to FIG. 5H).”).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Robinson's invention of an augmented reality measurement workflow that overlays virtual vertices at real-world contact points with the features of Dryer's invention of reducing the displayed size of an augmented reality element when the measurement-point-creation indicator has snapped to a detected feature in the live preview. One of ordinary skill in the art would have been motivated to make this combination for the following reasons. First, Dryer expressly teaches that "a size of reticle 5010 is reduced to indicate that focus point 5012 has snapped to a detected feature in the live preview," which is a known visual-feedback mechanism for confirming, in real time, that the system has recognized contact between an indicator and a target point in an augmented reality measurement interface. Second, the size reduction is gradual rather than abrupt because Dryer expressly teaches that "the size at which reticle 5010 is displayed is based on a distance between device 100 and the location in physical space 5000 over which reticle 5010 is displayed, optionally subject to a predefined minimum size (used for distances greater than a predefined maximum distance) and a predefined maximum size (used for distances less than a predefined minimum distance)," and applying this distance-dependent sizing during the approach of the virtual probe to the virtual measurement point produces a gradually decreasing displayed size as the contact condition is met. Third, providing this gradual size reduction feedback at the virtual measurement point side of the contact pair, rather than at the indicator side as in Dryer, is the predictable design choice that signals to the user which measurement point is being engaged, which is particularly useful in Robinson's workflow where the user is placing successive vertices at distinct real-world locations on a structure.
Regarding claim 4, Robinson as modified by Dryer discloses the method for measuring a dimension by using an augmented reality space according to claim 3, first step includes determining, when the one virtual measurement point reduced in size to a predetermined size is in contact with the virtual first probe, that contact between the virtual first probe and the one virtual measurement point is complete.
However, in a similar field of endeavor, Dryer discloses wherein the first step includes determining, when the one virtual measurement point reduced in size to a predetermined size is in contact with the virtual first probe, that contact between the virtual first probe and the one virtual measurement point is complete (para 9, “in accordance with a determination that a first distance between the electronic device and the physical object is less than a first threshold distance, the first label is displayed at a first threshold size; in accordance with a determination that the first distance between the electronic device and the physical object is greater than a second threshold distance that is greater than the first threshold distance, the first label is displayed at a second threshold size that is smaller than the first threshold size; and in accordance with a determination that the first distance between the electronic device and the physical object is between the first threshold distance and the second threshold distance, the first label is displayed at a size, between the first threshold size and the second threshold size, that depends on the first distance between the electronic device and the physical object.”; also, para “In response to the activation of measurement addition button 5014, device 100 adds and displays (virtual) measurement point 5042 to user interface 5006 at a current location of focus point 5012.”).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Robinson's invention of an augmented reality workflow that generates a digital vertex at a real-world contact location with the features of Dryer's invention of using a threshold-based size criterion to gate a measurement-point-related state determination in an augmented reality measurement interface. One of ordinary skill in the art would have been motivated to make this combination for the following reasons. First, Dryer expressly teaches that the displayed size of an augmented reality overlay element is set "in accordance with a determination that a first distance between the electronic device and the physical object is less than a first threshold distance," demonstrating that distance-driven threshold size criteria are an accepted control mechanism in augmented reality measurement interfaces, and substituting that threshold size as the gating condition for declaring the contact complete in the first step of the modified system is no more than the predictable application of a known control technique. Second, gating the completion determination on a reduced-to-predetermined-size criterion implements a dwell-style confirmation that the user has held the virtual first probe over the one virtual measurement point long enough for the gradual size reduction of the virtual measurement point to reach the predetermined size, which prevents accidental commit when the user only momentarily passes the virtual first probe over the virtual measurement point. Third, the predetermined-size criterion provides an explicit, deterministic completion condition that Robinson's system would otherwise lack, because Robinson's existing workflow registers a vertex on real-probe contact alone and does not inform the user when an augmented reality contact between the virtual probe and the virtual measurement point should be treated as complete.
Regarding claim 5, Robinson as modified by the method for measuring a dimension by using an augment reality space according to claim 1, other virtual measurement point is in contact with the virtual second probe, a size of the other virtual measurement point displayed is gradually reduced in the virtual space.
However, in a similar field of endeavor, Dryer discloses wherein, when the other virtual measurement point is in contact with the virtual second probe, a size of the other virtual measurement point displayed is gradually reduced in the virtual space (para 245, “the visual appearances of reticle 5010 and focus point 5012 are changed. In particular, focus point 5012 has been moved (e.g., vertically downward) to, or "snapped" to, a point along edge 5030. In addition, a size of reticle 5010 is reduced to indicate that focus point 5012 has snapped to a detected feature in the live preview.”, also, para 251, “In response to the activation of measurement addition button 5014, device 100 adds and displays (virtual) measurement point 5054 in user interface 5006 at a current location of focus point 5012 and as the second endpoint of measurement segment 5048.”).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Robinson's invention of generating a second virtual vertex at a second real-world contact location with the features of Dryer's invention of reducing the displayed size of an augmented reality overlay element when the measurement-point-creation indicator snaps to a detected feature, applied symmetrically to the second endpoint of the two-endpoint measurement workflow. One of ordinary skill in the art would have been motivated to make this combination for the following reasons. First, Dryer expressly teaches that the same indicator-over-anchor visual feedback behavior governs the placement of both the first and second endpoints, as confirmed by Dryer's recital that "device 100 adds and displays (virtual) measurement point 5054 in user interface 5006 at a current location of focus point 5012 and as the second endpoint of measurement segment 5048," and applying the same size-reduction feedback to the second virtual measurement point is the natural and symmetric extension of the same technique applied to the first virtual measurement point. Second, providing symmetric feedback at both endpoints means the user does not have to switch between two different mental models for confirming each endpoint, which directly addresses Dryer's express concern that conventional augmented reality measurement methods "are cumbersome, inefficient, and limited." Third, the size-reduction operation is a standard graphics-pipeline operation already supported by the holographic rendering pipeline that Robinson's head-mounted display uses to draw virtual vertices 40 onto the holographic schematic 114, so applying it to the second virtual measurement point requires no architectural change.
Regarding claim 6, Robinson as modified by Dryer discloses the method for measuring a dimension by using an augmented reality space according to claim 5, second step includes determining, when the other virtual measurement point reduced in size to a predetermined size is in contact with the virtual second probe, that contact between the virtual second probe and the other virtual measurement point is complete.
However, in a similar field of endeavor, Dryer discloses wherein the second step includes determining, when the other virtual measurement point reduced in size to a predetermined size is in contact with the virtual second probe, that contact between the virtual second probe and the other virtual measurement point is complete (para 9, “in accordance with a determination that a first distance between the electronic device and the physical object is less than a first threshold distance, the first label is displayed at a first threshold size.”; also, para 251, “In response to the activation of measurement addition button 5014, device 100 adds and displays (virtual) measurement point 5054 in user interface 5006 at a current location of focus point 5012 and as the second endpoint of measurement segment 5048.”).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Robinson's invention of generating a second virtual vertex at a second real-world contact location with the features of Dryer's invention of using a threshold-based size criterion to gate a measurement-point-related state determination, applied symmetrically to the second endpoint of the two-endpoint measurement workflow. One of ordinary skill in the art would have been motivated to make this combination for the following reasons. First, Dryer expressly teaches the threshold-size control of an augmented reality overlay element at "less than a first threshold distance, the first label is displayed at a first threshold size," and applying that threshold criterion to the second-step completion determination yields a deterministic, symmetric confirmation mechanism for the second endpoint that matches the same threshold-size completion mechanism applied at the first endpoint. Second, symmetric dwell-style confirmation at the second endpoint prevents the same kind of accidental commit at the second virtual measurement point that the threshold criterion prevents at the first virtual measurement point, which is necessary because Dryer's workflow places the first and second endpoints sequentially using the same user-input mechanism. Third, Robinson's head-mounted display device 20 already maintains the holographic schematic 114 over the real-world structure 106 and updates the virtual vertices 40 in real time, so adding a per-vertex completion determination based on a size threshold is consistent with the existing rendering and tracking architecture.
Claim(s) 7-9 is/are rejected under 35 U.S.C. 103 as being unpatentable over Robinson (U.S. Pub. No. 20190170510) in view of Dryer et al. (U.S. Pub. No. 20240011764) further in view of Seibold et al. (U.S. Pub. No. 20130014579).
Regarding claim 7, Robinson as modified by Dryer discloses the method for measuring a dimension by using an augmented reality space according to claim 1, wherein gauge includes a display unit configured to display a dimension between the first probe and the second probe, the method further comprising: a third step of acquiring dimension data obtained by the gauge from the display unit through the camera, after it has been determined in the first step that the contact between the virtual first probe and the one virtual measurement point is complete and it has been determined in the second step that the contact between the virtual second probe and the other virtual measurement point is complete.
However, in a similar field of endeavor, Seibold discloses the gauge includes a display unit configured to display a dimension between the first probe and the second probe (para 2, “The measuring arrangement may include a display or another indicating device on which the measured value corresponding to the measuring signal may be provided for the operator.”; also, para 19, “the measuring circuit is connected to the display device 15 via a communication interface 18. The display device 15 is, for example, a monochromatic liquid crystal display (LCD), in particular a so-called TN-LCD, i.e., twisted nematic LCD or HTN-LCD, i.e., high twisted nematic LCD.”; also, para 21, “The measuring arrangement 10 maybe different from the sensor shown herein--and be in the form of a measuring slide, such as a caliper, or a measuring screw, such as a micrometer”), Dryer discloses the method further comprising: a third step of acquiring dimension data obtained by the gauge from the display unit through the camera, after it has been determined in the first step that the contact between the virtual first probe and the one virtual measurement point is complete and it has been determined in the second step that the contact between the virtual second probe and the other virtual measurement point is complete (para 381, “While displaying the representation of the field of view (806), as at least one of the one or more cameras move, and while the measurement-point-creation indicator (or at least a portion thereof) is over (or proximate to) the anchor point, the electronic device changes (810) a visual appearance of the measurement-point-creation indicator to indicate that a (virtual) measurement point will be added at the anchor point if a touch input meets first criteria.”; also, para 251, “In response to the activation of measurement addition button 5014, device 100 adds and displays (virtual) measurement point 5054 in user interface 5006 at a current location of focus point 5012 and as the second endpoint of measurement segment 5048.”).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Robinson's invention as modified by Dryer of an augmented reality dimension-measurement workflow that registers virtual measurement points upon contact-determination with the features of Seibold's invention of a caliper-form measurement gauge having an LCD display device mounted on its housing showing the measurement value, so that the head-mounted display's video cameras acquire the displayed dimension value from the gauge through camera-based reading after the augmented reality contact-determinations for both probes have completed. One of ordinary skill in the art would have been motivated to make this combination for the following reasons. First, Seibold expressly teaches that "the measuring arrangement may include a display or another indicating device on which the measured value corresponding to the measuring signal may be provided for the operator," and an LCD-equipped caliper of the kind Seibold describes is exactly the form factor that Robinson's two-tool-member measurement tool 100 is most naturally extended into when the dimension itself is to be read off the gauge rather than reconstructed solely from fiducial-marker positions. Second, Robinson already uses the head-mounted display's video cameras 30 to read information in the user's real-world field of view, capturing "standard video of what the user sees," and Robinson further demonstrates that the head-mounted display captures images of a window region in the measurement tool, identifies fiducial markers within that window, and calculates a numerical dimension value from the captured image, so extending those same video cameras to read the numerical dimension shown on Seibold's LCD display is a natural use of an already-available imaging capability. Third, Dryer expressly teaches gating the commit of a measurement point on the indicator-over-anchor determination, and gating the camera-based read of Seibold's LCD display until after both augmented reality contact-determinations between each virtual probe and its corresponding virtual measurement point have completed prevents the modified system from recording a dimension value before the user has finished positioning both probes, which directly addresses Dryer's expressly identified concern that conventional augmented reality measurement methods "are cumbersome, inefficient, and limited."
Regarding claim 8, Robinson as modified by Dryer and Seibold discloses the method for measuring a dimension by using an augmented reality space according to claim 7, further comprising a fourth step of performing image processing and storing a resultant in a recording unit as a measurement value after the dimension data displayed on the display unit has been acquired by the camera in the third step (Robinson: para 30, “The HMD device 20 also includes circuitry (not shown), which may be contained within the visor 22, to control at least some of the aforementioned elements and perform associated data processing functions (e.g., speech and gesture recognition and display generation).”; also, para 78, “the functional components of the HMD device 20 include one or more instance of each of the following: a main processor 121, memory 122, transparent display device 123, depth camera controller 124, head tracking cameras controller 125, video camera controller 126, communication device 127, and audio subsystem 128, all coupled together (directly or indirectly) by an interconnect 129.”, also, para 80, “Data and instructions (code) 130 that configure the processor(s) 121 to execute aspects of the technique introduced here can be stored in the one or more memories 122. Each memory 122 can be or include one or more physical storage devices, which may be in the form of random access memory (RAM), read-only memory (ROM) (which may be erasable and programmable), flash memory, miniature hard disk drive, conventional hard disk drive, or other suitable type of storage device, or a combination of such devices.”).
Regard claim 9, Robinson as modified by Dryer and Seibold discloses the method for measuring a dimension by using an augmented reality space according to claim 1, method further comprising: a gauge includes a transmission unit configured to transmit a measurement result of a dimension between the first probe and the second probe, and the method further comprising: a third step of acquiring dimension data that is obtained by the gauge and is transmitted by the transmission unit, after it has been determined in the first step that the contact between the virtual first probe and the one virtual measurement point is complete and it has been determined in the second step that the contact between the virtual second probe and the other virtual measurement point is complete.
However, in a similar field of endeavor, Seibold discloses wherein the gauge includes a transmission unit configured to transmit a measurement result of a dimension between the first probe and the second probe (para 22, “the measuring circuit 14 is electrically connected to a transmission circuit 19. The communication interface 18 provides for a transmission of the measuring signal M from the measuring circuit 14 to the transmission circuit 19 (FIG. 2). The transmission circuit 19 serves as wireless interface of the measuring arrangement 10 to a central unit 20. The transmission circuit 19 generates on the basis of the measuring signal M, a transmission signal 11, which is transmitted to the central unit 20 in a wireless way.”; also, para 11, “The transmission circuit transmits preferably at a frequency of 2.4 GHz which makes a license-free operating of the measuring arrangement possible.”; also, para 39, “Via a measuring value sensor 12 at the housing 11 a measurement value is detected, is converted by the measurement circuit 14 to an electrical measurement signal M and is transmitted wirelessly via the transmission circuit 19 to an external central unit 20.”), while Dryer discloses the method further comprising: a third step of acquiring dimension data that is obtained by the gauge and is transmitted by the transmission unit, after it has been determined in the first step that the contact between the virtual first probe and the one virtual measurement point is complete and it has been determined in the second step that the contact between the virtual second probe and the other virtual measurement point is complete (para 381, “While displaying the representation of the field of view (806), as at least one of the one or more cameras move, and while the measurement-point-creation indicator (or at least a portion thereof) is over (or proximate to) the anchor point, the electronic device changes (810) a visual appearance of the measurement-point-creation indicator to indicate that a (virtual) measurement point will be added at the anchor point if a touch input meets first criteria.”, also, para 251, “In response to the activation of measurement addition button 5014, device 100 adds and displays (virtual) measurement point 5054 in user interface 5006 at a current location of focus point 5012 and as the second endpoint of measurement segment 5048.”).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Robinson's invention as modified by Dryer of an augmented reality dimension-measurement workflow that registers virtual measurement points upon contact-determination with the features of Seibold's invention of a measurement arrangement whose housing contains a transmission circuit that wirelessly transmits the measurement signal to an external central unit, so that the head-mounted display acquires the dimension data via wireless transmission from the gauge after the augmented reality contact-determinations for both probes have completed. One of ordinary skill in the art would have been motivated to make this combination for the following reasons. First, Seibold expressly teaches that the measurement value is "transmitted wirelessly via the transmission circuit 19 to an external central unit 20," and Robinson's head-mounted display device 20 already includes a communication device 127 capable of receiving wireless data, so configuring Robinson's head-mounted display as the receiving central unit for Seibold's transmission circuit is a direct and predictable application of two already-paired wireless capabilities. Second, Seibold expressly teaches that the wireless transmission operates "at a frequency of 2.4 GHz which makes a license-free operating of the measuring arrangement possible," which means the wireless path does not require additional spectrum licensing or specialized hardware, making it readily integrable into the head-mounted display-and-gauge workflow without regulatory or cost burden. Third, gating the wireless acquisition on the augmented reality contact-determinations between each virtual probe and its corresponding virtual measurement point ensures that the head-mounted display only records measurements that the user has confirmed via the augmented reality contact workflow, which directly addresses Dryer's expressly identified concern that conventional augmented reality measurement methods "are cumbersome, inefficient, and limited," and which also avoids the alternative situation in which the gauge's wireless transmission would constantly stream dimension values that the head-mounted display has no way to associate with a particular user-confirmed measurement event.
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to Jai Li whose telephone number is (571)272-1170. The examiner can normally be reached Mon-Thu between 06:00-16:00 EST.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Xiao Wu can be reached at (571)272-7761. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/JAI W LI/Junior Examiner, Art Unit 2613
/XIAO M WU/Supervisory Patent Examiner, Art Unit 2613
Prosecution Insights