DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claim Rejections - 35 USC § 102
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention.
Claims 1 and 3-15 are rejected under 35 U.S.C. 102(a)(1) as being anticipated by Musgrave et al. (US 2015/0277566).
Regarding claims 1 and 7
Musgrave et al. shows the sensor arrangement and electronic device, for at least partial touchless control of a computer device and/or of at least one actuator, in particular for at least partial touchless control of a computer device comprising a display means and/or being at least communicatively coupled to a display means and/or to one or more actuators of an object, in particular for at least partial touchless control of a laptop, a tablet, a personal computer, a TV device, an info- and/or entertainment system, in particular of a car, and/or a smartphone:,
wherein the sensor arrangement (370 and 371) is configured for observing an interaction space in which user interaction is intended to occur for controlling the computer device and/or the at least one actuator (see Figs. 3 and 4, and para. 0015 and 0045-0046, that describes that the motion sensor technologies includes vision systems that may include a gesture detection camera or multiple sensors such as an image sensor and a camera to detect gestures as with the present disclosures. It is substantially beneficial to implement integrated vision sensor systems in an information handling system to provide an alternative input interface to existing input hardware or, alternatively, eliminate or reduce input hardware needed with the information handling system. Utilization of this vision sensor technology including gesture detection camera and image sensor with depth calibration as disclosed herein will enable free space gestures. The image sensor with depth calibration may comprise a second camera for detecting a virtual detection plane in a comfortable spot selected by the user. In particular, the free space gestures may be those similar to mouse or track pad gestures for cursor control or graphical user interface element selection or manipulation. This optimal utilization camera sensors and image sensor and variations on those provide benefits for compactness and thin architecture of information handling systems),
wherein the sensor arrangement comprises at least a first sensor group (370 and 371), in particular a first sensor array (taken to be part of the sensor 371, see Fig. 3), comprising at least one sensor device (371), the first sensor group having a first array field of view and being capable of observing a first spatial array detection area encompassing at least a part of the interaction space (see para. 0017, that describes that the virtual gesture detection plane may be projected onto a surface such as a table top, counter, or other working surface as the location for gestures to be detected by the vision sensors including the camera system in some embodiments. An actual projected surface via a laser projection system or LED light projection integrated into the information handling system or even integrated with the camera may be used to project delineation of the two dimensional gesture detection plane onto a working surface of the user. In certain embodiments, a camera and depth sensor are located on the side of the information handling system for the purpose of detecting the free space gestures. Additionally, a laser or LED projection system may similarly be mounted on the side of the information handling system for projection to a delineate a gesture detection plane boundary. Two and three dimensional gesture detection and processing are described in further detail below by way of several embodiments of the same),
wherein the sensor arrangement is configured for capturing sensor data, in particular depth sensor data, of a user's hand and/or of at least one or more parts of a user's hand while the user mimics, at least partially within the interaction space, a use of a physical input device (see para. 0019, that describe a system and method for locating an integrated camera, depth sensor and detection plane projection system along a side of an information handling system. Inputs from several sensors including the camera, depth sensor, and orientations sensors determine the gesture detection plane. Such a gesture detection plane is determined based on detection of key components of a user indication device such as a user's hand, fingers, or a stylus. The gesture detection plane will also depend on the gesture mode classification selected. And interpreting gestures by as user mimicking input operations, see para. 0035-0036).
Regarding claim 3
Musgrave et al. further shows,
wherein the sensor arrangement is configured for observing a rectangular or cuboid interaction space, the interaction space, in particular the rectangular or cuboid interaction space, comprising a spatial expansion and/or having a geometry adapted to a spatial expansion required for mimicking the use of a defined physical input device (taken to be detection area shown in Fig. 6, rectangular area 631),
wherein the interaction space is encompassed completely by the spatial total detection area (see para. 0062).
Regarding claim 4
Musgrave et al. further shows,
wherein the sensor arrangement is further configured also for touch control of a computer device and/or at least one actuator, and further comprises at least one touch sensitive sensor device (taken to be a virtual touch mode for controlling an object, which inherently include any object that may or may not have an actuator, see para. 0015, 0020 and 0066).
Regarding claim 5
Musgrave et al. further shows,
wherein the sensor arrangement is configured for being integrated into an electronic device, in particular in an electronic device comprising a display screen (125) and/or a keyboard (0002 and 0015), preferably in a computer device comprising a display screen and/or a keyboard (see para. 0023).
Regarding claim 6
Musgrave et al. further shows, the sensor arrangement for at least partial touchless control of a computer device and/or of at least one actuator, in particular for at least partial touchless control of a computer device comprising a display means and/or being at least communicatively coupled to a display means and/or to one or more actuators of an object, in particular for at least partial touchless control of a laptop, a tablet, a personal computer, a TV device, an info- and/or entertainment system, in particular of a car, and/or a smartphone:,
wherein the sensor arrangement (370 and 371) is configured for observing an interaction space in which user interaction is intended to occur for controlling the computer device and/or the at least one actuator (see Figs. 3 and 4, and para. 0015 and 0045-0046, that describes that the motion sensor technologies includes vision systems that may include a gesture detection camera or multiple sensors such as an image sensor and a camera to detect gestures as with the present disclosures. It is substantially beneficial to implement integrated vision sensor systems in an information handling system to provide an alternative input interface to existing input hardware or, alternatively, eliminate or reduce input hardware needed with the information handling system. Utilization of this vision sensor technology including gesture detection camera and image sensor with depth calibration as disclosed herein will enable free space gestures. The image sensor with depth calibration may comprise a second camera for detecting a virtual detection plane in a comfortable spot selected by the user. In particular, the free space gestures may be those similar to mouse or track pad gestures for cursor control or graphical user interface element selection or manipulation. This optimal utilization camera sensors and image sensor and variations on those provide benefits for compactness and thin architecture of information handling systems),
wherein the sensor arrangement comprises at least a first sensor group (370 and 371), in particular a first sensor array (taken to be part of the sensor 371, see Fig. 3), comprising at least one sensor device (371), the first sensor group having a first array field of view and being capable of observing a first spatial array detection area encompassing at least a part of the interaction space (see para. 0017, that describes that the virtual gesture detection plane may be projected onto a surface such as a table top, counter, or other working surface as the location for gestures to be detected by the vision sensors including the camera system in some embodiments. An actual projected surface via a laser projection system or LED light projection integrated into the information handling system or even integrated with the camera may be used to project delineation of the two dimensional gesture detection plane onto a working surface of the user. In certain embodiments, a camera and depth sensor are located on the side of the information handling system for the purpose of detecting the free space gestures. Additionally, a laser or LED projection system may similarly be mounted on the side of the information handling system for projection to a delineate a gesture detection plane boundary. Two and three dimensional gesture detection and processing are described in further detail below by way of several embodiments of the same),
wherein the sensor arrangement is configured for capturing sensor data, in particular depth sensor data, of a user's hand and/or of at least one or more parts of a user's hand while the user mimics, at least partially within the interaction space, a use of a physical input device (see para. 0019 that describe a system and method for locating an integrated camera, depth sensor and detection plane projection system along a side of an information handling system. Inputs from several sensors including the camera, depth sensor, and orientations sensors determine the gesture detection plane. Such a gesture detection plane is determined based on detection of key components of a user indication device such as a user's hand, fingers, or a stylus. The gesture detection plane will also depend on the gesture mode classification selected),
wherein the sensor system is configured for:
determining, based at least partially on sensor data captured using the sensor arrangement, at least one characteristic of a user's hand while the user mimics use of a physical input device at least partially within the interaction space (taken to be mimicking the user of a pen/pencil/stylus on a virtual touch pad as an actual touchpad technology, see para. 0035), and
generating at least one control command that corresponds to an input command that would have been generated if the user would have used the physical input device, at least based on the at least one determined characteristic of the user's hand (taken to be initiating the command or control based the detected mimicking operation or gesture, see para. 0035-0037).
Regarding claim 8
Musgrave et al. further shows,
wherein at least one sensor device, in particular at least one sensor array, is arranged such that an interaction space can be observed in which user interaction is intended to occur for at least partial touchless control of a computer device and/or of at least one actuator, in particular for touchless control of the electronic device itself, when a user mimics use of a defined physical input device for control (see para. 0035), and
wherein the defined physical input device which can be mimicked is one of a mouse, a stylus, a pen, a trackball, a trackpad, a touchpad, a keyboard, a joystick, a graphic tablet, a steering wheel, a remote control, a laser pointer and/or any other physical input device (see para. 0035-0036).
Regarding claim 9
Musgrave et al. further shows,
wherein the electronic device comprises a display screen (125) for displaying a scene (see Figs. 1, 3 and 4), and
wherein at least one sensor device (370 or 470), in particular at least one sensor array, is arranged in an outer edge area on the front side of the display screen (taken to be edge of the device 310 or 410).
Regarding claim 10
Musgrave et al. further shows,
wherein at least one sensor device and/or at least one sensor array is arranged such that a field of view of the sensor device and/or the sensor array is extending at least partly across the display, in particular at least partly diagonally (taken to be the field of view of the user hand 327 or 427, see Figs. 3 and 4).
Regarding claim 11
Musgrave et al. further shows,
wherein at least one sensor array is arranged in an upper left corner area and/or in an upper right corner area of the display screen with respect to a user's view during use (taken to be a corner of the device 410, which can be oriented different ways, see Fig. 4 and para. 0046).
Regarding claim 12
Musgrave et al. further shows,
wherein at least one sensor array comprises at least two sensor devices (370 and 371) and/or at least one sensor device (371and at least one emitter device (taken to be IR motion sensor module and laser projection module, see para. 0046),
wherein one device of the sensor array arranged in the upper left corner area is located in a left vertical edge adjacent to the upper left corner or in a right vertical edge adjacent to the upper right corner of the display screen (taken to be a corner of the device 410, which can be oriented different ways, see Fig. 4 and para. 0046), and
wherein one device is located in a horizontal edge adjacent to the upper left corner and the upper right corner of the display screen (taken to the two corners edges of the device 410, see Fig. 4).
Regarding claim 13
Musgrave et al. further shows
wherein the electronic device comprises a keyboard (see para. 0023), and
wherein at least one sensor device (370 or 371), in particular at least one sensor array, is arranged on, in or near the keyboard (taken to be the keyboard area of the laptop 310, see Fig. 3), in particular adjacent, near or within the keyboard area, preferably essentially within a keyboard plane (see Fig. 13).
Regarding claim 14
Musgrave et al. further shows,
wherein at least one sensor device is arranged such that the sensor device is protruding from a circumferential surface in at least one state of operation of the electronic device, in particular, when arranged in an outer edge area on a front side of a display of the electronic device, and, optionally, for being levelled to the circumferential surface at least in a second state of operation of the electronic device (taken to be edge of the device 310 or 410).
Regarding claim 15
Musgrave et al. further shows,
wherein the electronic device further comprises:
means for voice control, in particular a voice control device, and/or is being configured for being communicatively coupled to voice control means, in particular to a voice control device (taken to be voice communication, see para. 0022 and 0075), and/or
means for visual control aid, in particular a visual control aid device, in particular for visualization of the interaction space, and/or is configured for being coupled to a visual control (taken to be visual input interface, see para. 0015 and 0067-0068)
Allowable Subject Matter
Claim 2 is objected to as being dependent upon a rejected base claim, but would be allowable if rewritten in independent form including all of the limitations of the base claim and any intervening claims.
The following is an Examiner's Statement of Reasons for Allowance:
Regarding claim 2
The prior art of record, including Musgrave et al. (US 2015/0277566), taken to be the closest prior art noted in the above rejection to the claims, taken alone or in combination does not teach, suggest or render obvious the
sensor arrangement for at least partial touchless control of a computer device and/or of at least one actuator, in particular for at least partial touchless control of a computer device comprising a display means, as recited in claim 1, having the combination of elements, along with having the further limitations which include:
wherein the sensor arrangement further comprises at least one further sensor group, in particular at least one further sensor array, comprising at least one sensor device, the at least one further sensor group having a further array field of view and being capable of observing a further spatial array detection area encompassing at least a part of the interaction space,
wherein the first sensor group and the at least one further second sensor group are arranged spaced apart from each other, and
such that the first spatial array detection area and the at least one further spatial array detection area define a continuous spatial total detection area, and
such that the first spatial array detection area and the at least one further spatial array detection area are overlapping partially, as recited in claim 2.
Further, even though Musgrave et al. shows the invention substantially as claimed, as discussed in the above rejections, it does not specifically show or render obvious the limitations of claim 2, noted above.
Also, none of the prior art of record teaches having the sensor arrangement further comprises at least one further sensor group, in particular at least one further sensor array, comprising at least one sensor device, the at least one further sensor group having a further array field of view and being capable of observing a further spatial array detection area encompassing at least a part of the interaction space,
wherein the first sensor group and the at least one further second sensor group are arranged spaced apart from each other, and
such that the first spatial array detection area and the at least one further spatial array detection area define a continuous spatial total detection area, and
such that the first spatial array detection area and the at least one further spatial array detection area are overlapping partially, as recited in claim 2.
Therefore, it is believed that one of ordinary skilled in the art at the time the invention was filed, would not consider it obvious to modify Musgrave et al., with any of the prior art of record, to include the limitations as recited in claim 2.
Conclusion
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure.
Nikovski et al. (US 2022/0324676), shows a display device having the ability of proving control to the device using touchless gesture by a user (see the abstract, Figs. 1 and 4A-10, and para. 0047-0052).
Gupta et al. (US 2014/0368422), shows a display device having the ability of proving control to the device using touchless gesture by a user (see the abstract, Figs. 1 and 3-11, and para. 0043-0045 and 0047).
Any inquiry concerning this communication or earlier communications from the examiner should be directed to MUHAMMAD N EDUN whose telephone number is (571)272-7617. The examiner can normally be reached Mon-Fri 10:00-6:30.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, BENJAMIN C. LEE can be reached on (571) 272-2963. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/MUHAMMAD N. EDUN/
Primary Patent Examiner
Art Unit 2629
/MUHAMMAD N EDUN/ Primary Examiner, Art Unit 2629
Prosecution Insights