DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Election/Restrictions
Applicant’s election without traverse of 08/25/2026 in the reply filed on group II (claims 10-15) is acknowledged.
Drawings
The drawings are objected to under 37 CFR 1.83(a). The drawings must show every feature of the invention specified in the claims. Therefore, the feature “adjust(ing) image brightness and contrast based on ambient lighting conditions detected in the real environment” must be shown or the feature(s) canceled from the claim(s). No new matter should be entered.
Corrected drawing sheets in compliance with 37 CFR 1.121(d) are required in reply to the Office action to avoid abandonment of the application. Any amended replacement drawing sheet should include all of the figures appearing on the immediate prior version of the sheet, even if only one figure is being amended. The figure or figure number of an amended drawing should not be labeled as “amended.” If a drawing figure is to be canceled, the appropriate figure must be removed from the replacement sheet, and where necessary, the remaining figures must be renumbered and appropriate changes made to the brief description of the several views of the drawings for consistency. Additional replacement sheets may be necessary to show the renumbering of the remaining figures. Each drawing sheet submitted after the filing date of an application must be labeled in the top margin as either “Replacement Sheet” or “New Sheet” pursuant to 37 CFR 1.121(d). If the changes are not accepted by the examiner, the applicant will be notified and informed of any required corrective action in the next Office action. The objection to the drawings will not be held in abeyance.
Claim Interpretation
The following is a quotation of 35 U.S.C. 112(f):
(f) Element in Claim for a Combination. – An element in a claim for a combination may be expressed as a means or step for performing a specified function without the recital of structure, material, or acts in support thereof, and such claim shall be construed to cover the corresponding structure, material, or acts described in the specification and equivalents thereof.
The following is a quotation of pre-AIA 35 U.S.C. 112, sixth paragraph:
An element in a claim for a combination may be expressed as a means or step for performing a specified function without the recital of structure, material, or acts in support thereof, and such claim shall be construed to cover the corresponding structure, material, or acts described in the specification and equivalents thereof.
This application includes one or more claim limitations that do not use the word “means,” but are nonetheless being interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, because the claim limitation(s) uses a generic placeholder that is coupled with functional language without reciting sufficient structure to perform the recited function and the generic placeholder is not preceded by a structural modifier. Such claim limitation(s) is/are: “software framework configured to… ”, “an algorithm set for …“, “latency compensation mechanism that…” , “an image compositing module…“ in claim 10.
Because this/these claim limitation(s) is/are being interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, it/they is/are being interpreted to cover the corresponding structure described in the specification as performing the claimed function, and equivalents thereof.
If applicant does not intend to have this/these limitation(s) interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph, applicant may: (1) amend the claim limitation(s) to avoid it/them being interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph (e.g., by reciting sufficient structure to perform the claimed function); or (2) present a sufficient showing that the claim limitation(s) recite(s) sufficient structure to perform the claimed function so as to avoid it/them being interpreted under 35 U.S.C. 112(f) or pre-AIA 35 U.S.C. 112, sixth paragraph.
Claim Rejections - 35 USC § 112
The following is a quotation of the first paragraph of 35 U.S.C. 112(a):
(a) IN GENERAL.—The specification shall contain a written description of the invention, and of the manner and process of making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it pertains, or with which it is most nearly connected, to make and use the same, and shall set forth the best mode contemplated by the inventor or joint inventor of carrying out the invention.
The following is a quotation of the first paragraph of pre-AIA 35 U.S.C. 112:
The specification shall contain a written description of the invention, and of the manner and process of making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it pertains, or with which it is most nearly connected, to make and use the same, and shall set forth the best mode contemplated by the inventor of carrying out his invention.
The following is a quotation of 35 U.S.C. 112(b):
(b) CONCLUSION.—The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the inventor or a joint inventor regards as the invention.
The following is a quotation of 35 U.S.C. 112 (pre-AIA ), second paragraph:
The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the applicant regards as his invention.
Claims 10-15 are rejected under 35 U.S.C. 112(b) or 35 U.S.C. 112 (pre-AIA ), second paragraph, as being indefinite for failing to particularly point out and distinctly claim the subject matter which the inventor or a joint inventor (or for applications subject to pre-AIA 35 U.S.C. 112, the applicant), regards as the invention. The limitation of claim 10 requires computer implemented method that was interpreted under 35 U.S.C 112(f) for the following “an algorithm set for optimizing color dynamic range, image debayering, denoising, and sharpening in video streams of the VR headset”, “ a latency compensation mechanism that utilizes direct memory access of the computer hardware system to reduce processing delays” and “an image compositing module that combines VR environment data and processed video streams to create a mixed reality output”. However, the current specification is silent on the algorithm necessary for “an algorithm set for optimizing color dynamic range, image debayering, denoising, and sharpening in video streams of the VR headset”. For example, paragraph 14 and 55 of the specification provides a disclosure of “The MSA integrates video feeds from the VR headset's stereo camera module with advanced algorithms on the FPGA that perform image enhancements, including dynamic color range adjustment, sharpening, and debayering”. However, this disclosure does not raise to the requirement of providing algorithm (or structure) needed to transform the general purpose computer or microprocessor disclosed in the specification. Aristocrat, 521 F.3d at 1333, 86 USPQ2d at 1239; Finisar Corp. v. DirecTV Group, Inc., 523 F.3d 1323, 1340, 86 USPQ2d 1609, 1623 (Fed. Cir. 2008); WMS Gaming, Inc. v. Int’l Game Tech., 184 F.3d 1339, 1349, 51 USPQ2d 1385, 1391 (Fed. Cir. 1999); Rain Computing, Inc. v. Samsung Electronics America Co., 989 F.3d 1002, 1007-8, 2021 USPQ2d 284 (Fed. Cir. 2021). Instead, the applicant’s specification only provides the results of the claimed algorithm. Under the interpretation under 35 U.S.C 112(f) the specification must disclose an algorithm for performing the claimed specific computer function, or else the claim is indefinite under 35 U.S.C. 112(b) [see MPEP 2181]. Since, the specification fails to provide a teaching of “an algorithm set for optimizing color dynamic range, image debayering, denoising, and sharpening in video streams of the VR headset”; the limitation of claim 10 is rejected under 35 U.S.C 112(b).
Similarly, the specification also fails to provide necessary description of algorithm or structure for the limitation “a latency compensation mechanism that utilizes direct memory access of the computer hardware system to reduce processing delays”. For example, the specification only provides teaching that this function is performed by the FPGA and GPUs (see paragraph 53-55). However, the specification is silent on how to program the FPGA and GPUs to perform the function of “a latency compensation mechanism that utilizes direct memory access of the computer hardware system to reduce processing delays”. As stated previously, an interpretation under 35 U.S.C 112(f) the specification must disclose an algorithm for performing the claimed specific computer function, or else the claim is indefinite under 35 U.S.C. 112(b) [see MPEP 2181].
The limitation of “an image compositing module that combines VR environment data and processed video streams to create a mixed reality output” are also rejected under the same rationale since the specification fails to provide the necessary description for the claimed limitations. Instead, the specification only provides a broad description that an FPGA or GPU can be programmed to achieve the function (see paragraph 14 and 53).
Similarly, claims 12-15 are also rejected since the specification fails to provide the necessary algorithm or mechanism to the limitation “adjustable time-warping algorithm which modifies, image rendering timing to accommodate user head movement and reduce perceive lag”, “apply virtual overlays corresponding to cockpit controls or instrumentation in response to the user interactions detected by the VR headset”, “color correction algorithm calibrated for various lightning condition”. For example, paragraph 99 only provides a brief description of time warping algorithm effect rather than providing the necessary algorithm necessary to perform the claimed function. Similarly paragraph 38, 94 only provide a brief description of “apply virtual overlays corresponding to cockpit controls or instrumentation in response to the user interactions detected by the VR headset” and paragraph 63 only provide a brief description of the color colorrection algorithm.
Regarding claim 15, the phrase "such as" renders the claim indefinite because it is unclear whether the limitations following the phrase are part of the claimed invention. See MPEP § 2173.05(d).
Claims 10-15 are rejected under 35 U.S.C. 112(a) or 35 U.S.C. 112 (pre-AIA ), first paragraph, as failing to comply with the written description requirement. The claim(s) contains subject matter which was not described in the specification in such a way as to reasonably convey to one skilled in the relevant art that the inventor or a joint inventor, or for applications subject to pre-AIA 35 U.S.C. 112, the inventor(s), at the time the application was filed, had possession of the claimed invention. The limitation of claim 10 are interpreted to be computer implemented means plus function. When a claim containing a computer-implemented 35 U.S.C. 112(f) claim limitation is found to be indefinite under 35 U.S.C. 112(b) for failure to disclose sufficient corresponding structure (e.g., the computer and the algorithm) in the specification that performs the entire claimed function, it will also lack written description under 35 U.S.C. 112(a). See MPEP § 2163.03, subsection VI. Accordingly, claims 10 are also rejected under 35 U.S.C 112(a).
The limitation of claim 12 require real-time feedback sensors embedded within the VR headset, configured to adjust image brightness and contrast based on ambient lighting conditions detected in the real environment. However, a review of the specification is silent on a plurality real time feedback sensors that is embedded within the VR headset. While paragraph 56 of the specification provides a teaching of hardware sensors that is embedded within the VR/MR headset; it is silent on how such sensors is used to adjust image brightness and contrast based on ambient lighting conditions detected in the real environment. Instead, these sensors are used to adjust for the head movement of the user instead of the necessary disclosure of “adjust(ing) image brightness and contrast based on ambient lighting conditions detected in the real environment”.
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claim 15 is rejected under 35 U.S.C. 103 as being unpatentable over Booth US 20200090406 and in view of Pinhasov US 20220060619
Claim 15: A mixed reality simulation architecture (see abstract) comprising:
a computer hardware system configured to run a mixed-reality simulation (see paragraph 25 “console 250”);
a virtual reality (VR) headset equipped with a stereo camera module (see paragraph 55 “outward facing stereoscopic camera mounted on the HMD”).
a software framework configured to process real-time video streams captured by the VR headset and render virtual environments using a graphical processing unit (GPU) of the computer hardware system (see paragraph 47 and 50 generating mixed reality environment)
a latency compensation mechanism that utilizes direct memory access of the computer hardware system to reduce processing delays (see paragraph 47 latency reduction mechanism); and
an image compositing module that combines VR environment data and processed video streams to create a mixed reality output (see paragraph 56).
The Booth reference is silent on the teaching of an algorithm set for optimizing color dynamic range, image debayering, denoising, and sharpening in video streams of the VR headset.
However, the Pinhasov reference provides a teaching of algorithm set for optimizing color dynamic range, image debayering, denoising, (see paragraph 143 color correction, bayer color correction and denoising respectively) and sharpening in video streams of the VR headset (see paragraph 97 sharpening module).
Therefore, it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified the Booth reference with the feature of an algorithm set for optimizing color dynamic range, image debayering, denoising, and sharpening in video streams of the VR headset, as taught by the Pinhasov reference, in order to improve the image quality of the camera (see paragraph 76).
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to ROBERT J UTAMA whose telephone number is (571)272-1676. The examiner can normally be reached 9:00 - 17:30 Monday - Friday.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Kang Hu can be reached at (571)270-1344. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/ROBERT J UTAMA/Primary Examiner, Art Unit 3715