DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claim Objections
Claims 1, 10, and 19 are objected to because of the following informalities: “activate, in a state of projecting the screen receiving an identification of a contact point on a surface at a displaying area formed by the projection assembly,”. Run-on limitation - difficult to understand. Appropriate correction is required.
Claim Rejections - 35 USC § 112
The following is a quotation of 35 U.S.C. 112(b):
(b) CONCLUSION.—The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the inventor or a joint inventor regards as the invention.
The following is a quotation of 35 U.S.C. 112 (pre-AIA ), second paragraph:
The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the applicant regards as his invention.
Claims 5-8 and 14-17 are rejected under 35 U.S.C. 112(b) or 35 U.S.C. 112 (pre-AIA ), second paragraph, as being indefinite for failing to particularly point out and distinctly claim the subject matter which the inventor or a joint inventor (or for applications subject to pre-AIA 35 U.S.C. 112, the applicant), regards as the invention. Claims 5 and 14 recite “execute a second software application different from a first software application to project the screen; and project a first screen associated with the first software application and a second screen associated with the second software application”. It is unclear whether “the screen” refers to a different screen than “the first screen”.
Since claims 6-8 depend on claim 5 and claims 15-17 depend on claim 14, claims 6-8 and 15-17 are rejected under 35 U.S.C. 112(b) as well.
Claim Rejections - 35 USC § 102
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention.
Claims 1-8, 10-17, 19, and 20 are rejected under 35 U.S.C. 102(a)(1) as being anticipated by Raja (US 2016/0209928 A1).
Instant Claim 1: An electronic device comprising: an interface; (“Referring to FIG. 2, a virtual input device 1000 according to an embodiment of the present disclosure may include a sensor group 100 which includes a first sensor 110 and a second sensor 120, a processor 200, a projector 300, and a memory 400.” (Raja, paragraph 54) The virtual device 1000 of Raja corresponds to the electronic device of the claim. The communication bus among the first sensor 110, second sensor 120, processor 200, projector 300, and memory 400 corresponds to the interface of the claim.)
a camera; (“The first sensor 110 (fig 2) and the second sensor 120 may be respectively implemented with at least one or more of an image sensor (e.g., a camera) which detects an image of a user hand,” (Raja, paragraph 57))
a projection assembly; (Referring to fig 2 of Raja, projector 300 corresponds to the projection assembly of the claim.)
memory comprising one or more storage media storing instructions; and at least one processor comprising processing circuitry, wherein the instructions, when executed by the at least one processor individually or collectively, (“instructions stored in a non-transitory computer-readable storage media in the form of a program module. The instruction, when executed by a processor (e.g., a processor 200 (fig 2)), may cause the processor to perform a function corresponding to the instruction. The non-transitory computer-readable storage media, for example, may be the memory 400.” (Raja, paragraph 141))
cause the electronic device to: project, by controlling the projection assembly, a screen obtained through the interface; (“Since the detected user hand 56 (fig 5B) is relatively small and the finger of the detected user hand 56 is relatively thin, the processor 200 (fig 2) may set an area of a key small or may set a spacing between keys narrow, the key(s) included in a virtual input layout 55 which is projected on a user input plane 57 from the virtual input device 1000.” (Raja, paragraph 86) The virtual input layout 55 of Raja corresponds to the screen of the claim.)
activate, in a state of projecting the screen receiving an identification of a contact point on a surface at a displaying area formed by the projection assembly, the camera positioned toward a second direction different from a first direction of the projection assembly; (“Referring to FIG. 5A, the first sensor 110 may detect a user hand 52 or a finger included in the user hand 52.” (Raja, paragraph 85) The first sensor 110 of Raja is a camera. The direction the sensor 110 is positioned toward corresponds to the second direction of the claim.)
and based on identifying an external object from information obtained using the activated camera, change a size of the screen based on a location of the external object with respect to the surface. (“Since the detected user hand 52 (fig 5A) is relatively large and the finger of the detected user hand 52 is relatively thick, the processor 200 (fig 2) may set an area of a key to be large or may set a spacing between keys to be wide, the key(s) included in a virtual input layout 51 which is to be projected on a user input plane 53 from the virtual input device 1000.” (Raja, paragraph 85) The user hand 52 of Raja corresponds to the external object of the claim. Referring to figs 5A and 5B of Raja, the size of the virtual input layout 51 is larger in fig 5A.)
Instant Claim 2: The electronic device of claim 1, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to identify, using the camera, an input of the external object with respect to the screen. (“In operation 307 (fig 3), the second sensor 120 (fig 2) may detect a user input from the virtual input layout projected on the user input plane.” (Raja, paragraph 79))
Instant Claim 3: The electronic device of claim 2, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: identify, using the camera, a distance between a portion of the external object and the surface; and based on identifying the distance, identify the contact point. (“For example, the virtual input device 10 (fig 1A) may detect a size, a location, or the number of user hands (or fingers) or a gesture by the user hand.” (Raja, paragraph 46) When the virtual input device 10 of Raja detects the location of the user’s hand, the distance between the user’s hand and the surface is detected.)
Instant Claim 4: The electronic device of claim 1, further comprising a gyro sensor, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to, identify, using the gyro sensor, the state in which the screen requiring the identification of the contact point is projected. (“According to various embodiments of the present disclosure, the electronic devices may include at least one of … gyrocompasses)
Instant Claim 5: The electronic device of claim 1, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: based on identifying a preset motion of the external object, execute a second software application different from a first software application to project the screen; and project a first screen associated with the first software application and a second screen associated with the second software application. (“Furthermore, if the first sensor 110 (fig 2) detects a specific gesture, the processor 200 may determine to project a virtual input layout corresponding to the detected specific gesture.” (Raja, paragraph 61) The specific gesture of Raja corresponds to the preset motion of the claim.)
Instant Claim 6: The electronic device of claim 5, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to based on identifying a distance shorter than a preset threshold distance between the external object and the surface in a state of projecting the first screen and the second screen, project visual objects associated with a termination of the first software application and the second software application. (“Furthermore, the virtual input device 1000 (fig 2) may automatically detect the characteristics of the user body, the location of the body, and the like and may provide a virtual input layout corresponding to the detection result.” (Raja, paragraph 138) When the virtual input device 1000 of Raja detects the location of the user’s body, the distance between the user’s body and the surface is detected.)
Instant Claim 7: The electronic device of claim 6, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to based on identifying a distance longer than or equal to the preset threshold distance between the external object and the surface, cease to project the visual objects associated with the termination of the first software application and the second software application. (“Furthermore, the virtual input device 1000 (fig 2) may automatically detect the characteristics of the user body, the location of the body, and the like and may provide a virtual input layout corresponding to the detection result.” (Raja, paragraph 138) When the virtual input device 1000 of Raja detects the location of the user’s body, the distance between the user’s body and the surface is detected.)
Instant Claim 8: The electronic device of claim 5, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to adjust, based on a border line between the first screen and the second screen, a first size of the first screen and a second size of the second screen. (“The processor 200 (fig 2) may determine to project a split keyboard layout 111 (fig 11) as a virtual input layout to be projected.” (Raja, paragraph 118) Referring to fig 11 of Raja, the left half of the split keyboard and the right half of the split keyboard are each screens.)
Instant Claim 10: (Method claim 10 and apparatus claim 1 are related as apparatus and the method of using same, with each claimed element’s function corresponding to the claimed method step. Accordingly, claim 10 is similarly rejected under the same rationale as applied above with respect to apparatus claim 1.)
Instant Claim 11: (Claim 11 is substantially identical to claim 2, and thus, is rejected under similar rationale.)
Instant Claim 12: (Claim 12 is substantially identical to claim 3, and thus, is rejected under similar rationale.)
Instant Claim 13: (Claim 13 is substantially identical to claim 4, and thus, is rejected under similar rationale.)
Instant Claim 14: (Claim 14 is substantially identical to claim 5, and thus, is rejected under similar rationale.)
Instant Claim 15: (Claim 15 is substantially identical to claim 6, and thus, is rejected under similar rationale.)
Instant Claim 16: (Claim 16 is substantially identical to claim 7, and thus, is rejected under similar rationale.)
Instant Claim 17: (Claim 17 is substantially identical to claim 8, and thus, is rejected under similar rationale.)
Instant Claim 19: (Claim 19 is substantially identical to claim 1, and thus, is rejected under similar rationale. The memory and instructions of claim 1 correspond to the non-transitory computer readable storage media and programs of claim 19, respectively.)
Instant Claim 20: (Claim 20 is substantially identical to claim 2, and thus, is rejected under similar rationale.)
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claims 9 and 18 are rejected under 35 U.S.C. 103 as being unpatentable over Raja in view of Yoon (US 2021/0314538 A1).
Instant Claim 9: The electronic device of claim 1, further comprising: a gyro sensor; and a time-of-flight (ToF) sensor, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to identify, in a second state different from the state which is a first state, the external object, using the ToF sensor, based on the first direction of the projection assembly identified by the gyro sensor. (Raja teaches the virtual device in accordance with claim 1, but does not explicitly disclose the combined use of a gyro sensor and a time-of-flight sensor. However, in the same field of endeavor, Yoon teaches the combined use of these sensors for an image projecting apparatus: “In this case, the image projecting apparatus 100 (fig 2) may include one or more sensors such as an acceleration sensor, a gyro sensor, and the like for detecting location, detecting position or direction, or detecting external impact or movement.” (Yoon, paragraph 102)
“The sensing unit 120 (fig 1) may include a plurality of sensors. The plurality of sensors may each correspond to an ultrasonic sensor, a proximate sensor, a time-of-flight (TOF) sensor, or the like.” (Yoon, paragraph 46))
Before the effective filing date of the claimed invention, it would have been obvious to a person of ordinary skill in the art to combine the virtual device as taught by Raja, wherein a projected image is presented; with the image projecting apparatus as taught by Yoon, wherein a gyro sensor and a time-of-flight sensor are used for operating the projection of an image. Such a combination involves incorporating known sensors (Yoon) into a known device in order to yield the predictable result of reliable and effective sensing of data used for precise image projections.
Instant Claim 18: (Claim 18 is substantially identical to claim 9, and thus, is rejected under similar rationale.)
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to Yaron Cohen whose telephone number is (571)270-7995. The examiner can normally be reached Monday - Friday 8:30 AM to 5:00 PM.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Temesghen Ghebretinsae can be reached at 571-272-3017. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/YARON COHEN/Examiner, Art Unit 2626
Prosecution Insights