DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Continued Examination Under 37 CFR 1.114
A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 6/16/2026 has been entered.
Information Disclosure Statement
The information disclosure statement (IDS) filed on 6/17/2026 was considered and placed on the file of record by the examiner.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claims 1-19 are rejected under 35 U.S.C. 103 as being unpatentable over Freeman et al. (US 2019/0385342) in view of Chu et al. (US 2021/0358093) in view of Seki (US 2014/0111672).
Regarding claim 1, Freeman teaches a head-mounted electronic vision aid device, comprising a user input unit, a storage unit, a processing unit and a display unit, wherein
the display unit is configured to movably display a grid/grid group (see para. 0116, 0229, Freeman discusses displaying a plurality of cells arranged in a grid),
the user input unit is configured to select one or more to-be-corrected parts in the grid/grid group according to real-time image feedback information viewed by a user (see figure 18, figure 20, Freeman discusses providing user feedback; see claim 2, para. 0101, 0225, 0246, Freeman discusses the user can view the grid and use a fiducial marker to identify edge regions and manipulate the edge regions),
wherein for each of the one or more to-be-corrected parts, the user input unit sends a correction control signal for performing image correction on the to-be-corrected part in a coordinate system where the grid/grid group is currently located to the processing unit (see para. 0116, Freeman discusses FOY data may include a plurality of cells arranged in a grid; see para. 0236, 0249, Freeman discusses performing image distortion on a FOV grid mapping test; see para. 0269, 0273-0274, Freeman discusses indicating the region to be corrected),
the processing unit performs calculation processing on the correction control signal to obtain variations of the to-be-corrected part before and after correction in the coordinate system (see para. 0229, 0232, Freeman discusses correction control signal that are coordinate transformation values applied to transform the initial image data to after correction image data in the coordinate system; see para. 0248-0249, 0286, Freeman discusses a FOV grid mapping test to view variations on the coordinate grid), and
and for at least one of one or more to-be-corrected parts, the user input sends a further correction control signal for performing image correction on the to-be-corrected part in the coordinate system where the grid/grid group after being moved to the processing unit, the processing unit performs calculation processing on the further correction control signal to obtain variations of the to-be-corrected part before and after correction in the coordinate system (see para. 0229, 0232, Freeman discusses correction control signal that are coordinate transformation values applied to transform the initial image data to after correction image data in the coordinate system; see para. 0248-0249, 0286, Freeman discusses a FOV grid mapping test to view variations on the coordinate grid),
the storage unit is configured to store one or more combinations of the variations obtained for the one or more to-be-corrected parts (see para. 0105, 0109, Freeman discusses database for storing visual model of users; see para. 0229-0232, Freeman discusses a database that stores a retinal map that boundary data of area to be corrected in the visual grid), and
the display unit is configured to display an image after visual distortion correction that applies the one or more combinations of the variations stored in the storage unit to the image (see para. 0232, Freeman discusses once coordinate transformation values are established, the retinal map may be stored in the database and transferred to the display controller. In use, the retinal map may then be used to transform the image(s) received from the camera and generate the corrected image(s). The corrected image(s) may then be displayed in real-time via the display unit; see para. 0249, 0253, 0256, 0269, 0272-0273, Freeman discusses generating and displaying the corrected digital FOV grid model and storing the model in a database).
Freeman does not expressly disclose the image correction of the to-be-corrected part adjusts a deformed shape of the to-be-corrected part to be straight within the grid/grid group according to the user. However, Chu teaches the image correction of the to-be-corrected part adjusts a deformed shape of the to-be-corrected part to be straight within the grid/grid group according to the user (see para. 0098, 0106, Chu discusses performing image distortion correction on to-be-adjusted grid points that are adjusted to straighten the grid line shape according to a user’s vision).
Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman with Chu to derive at the invention of claim 1. The result would have been expected, routine, and predictable in order to perform image distortion correction.
The determination of obviousness is predicated upon the following: One skilled in the art would have been motivated to modify Freeman in this manner in order to improve image distortion correction by applying image correction to transform a deformed image region into a straight line. Furthermore, the prior art collectively includes each element claimed (though not all in the same reference), and one of ordinary skill in the art could have combined the elements in this manner explained using known engineering design, interface and/or programming techniques, without changing a fundamental operating principle of Freeman, while the teaching of Chu continues to perform the same function as originally taught prior to being combined, in order to produce the repeatable and predictable result of transforming a deformed image region to a straight line on an image grid to properly correct deformed images. The Freeman and Chu systems perform image correction, therefore one of ordinary skill in the art would have reasonable expectation of success in the combination. It is for at least the aforementioned reasons that the examiner has reached a conclusion of obviousness with respect to the claim in question.
Freeman and Chu do not expressly disclose wherein the grid/grid group displayed by the display unit is moved within a maximum interval range of any adjacent grid lines in the grid/grid group.
However, Seki teaches wherein the grid/grid group displayed by the display unit is moved within a maximum interval range of any adjacent grid lines in the grid/grid group (see figure 5A-C, figure 6A-C para. 0064, Seki discusses coordinate calculation unit calculates a vertical correction range, the minimum value Ymin and the maximum value Ymax of vertical coordinates).
Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 1. The result would have been expected, routine, and predictable in order to perform image distortion correction.
The determination of obviousness is predicated upon the following: One skilled in the art would have been motivated to modify Freeman and Chu in this manner in order to improve image distortion correction by applying image correction to transform a deformed image region into a straight line. Furthermore, the prior art collectively includes each element claimed (though not all in the same reference), and one of ordinary skill in the art could have combined the elements in this manner explained using known engineering design, interface and/or programming techniques, without changing a fundamental operating principle of Freeman and Chu, while the teaching of Seki continues to perform the same function as originally taught prior to being combined, in order to produce the repeatable and predictable result of transforming a deformed image region to a straight line on an image grid to properly correct deformed images. The Freeman, Chu, and Seki systems perform image correction, therefore one of ordinary skill in the art would have reasonable expectation of success in the combination. It is for at least the aforementioned reasons that the examiner has reached a conclusion of obviousness with respect to the claim in question.
Regarding claim 2, Seki teaches wherein the processing unit is configured to control the grid/grid group of the coordinate system to automatically move a set stepping distance within the maximum interval range of any adjacent grid lines in the grid/grid group (see figure 5A-C, figure 6A-C para. 0159, Seki discusses distance movement amount within the maximum vertical and horizontal ranges; see para. 0071, Seki discusses the distance movement amount of a pixel is a difference between the coordinate value of an output pixel and the coordinate value of an input pixel necessary for generating that output pixel).
The same motivation of claim 1 is applied to claim 2. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 2. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Regarding claim 3, Freeman teaches wherein the user input unit sends a movement control signal that causes the moving of the grid/grid group in the coordinate system to the processing unit (see claim 16, para. 0096, Freeman discusses user input to provide grid data for moving grid points producing image correction).
The same motivation of claim 1 is applied to claim 3. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 3. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Regarding claim 4, Freeman teaches further comprising: an eye-tracking unit configured to detect a change in a gazing target of the user, the coordinate system is displaced synchronously following the gazing target of the user, and wherein the display unit is configured to apply the one or more combinations of the variations stored in the storage unit on the coordinate system after the synchronous displacement, and the display unit displays the image after visual distortion correction (see para. 0160, Freeman discusses eye-tracking information may be correlated with the buffered information about the person's eye visual defect such that when the manipulated image is displayed, it is in sync with the user's gaze. The user's eye gaze so that the buffered hole and the user's defect align and remain in sync).
The same motivation of claim 1 is applied to claim 4. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 4. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Regarding claim 5, Freeman teaches wherein the user input unit is one of a mouse, a remote controller, a button, a gesture recognition device, or a voice recognition device (see para. 0246, Freeman discusses user feedback device, such as a PC with a mouse, tablet, and mobile phone), and the variations are a plurality of coordinate variable arrays (see para. 0229, 0232, Freeman discusses correction control signal that are coordinate transformation values applied to transform the image data).
The same motivation of claim 1 is applied to claim 5. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 5. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Regarding claim 6, Chu teaches wherein the correction control signal comprises for at least one of the one or more to-be-corrected parts, a signal for causing one or more sides of the to-be-corrected part to bend, elongate, or tilt to correct the to-be-corrected part in the coordinate system (see para. 0106, Chu discusses correction image distortion on to-be-adjusted grid points are adjusted to straighten the grid lines). Seki teaches the bend, elongate, or tilt making the one or more sides straight (see figure 5A-C, figure 6A-C, figure 7, Seki discusses correcting the distorted grid shape by bending the curved lines to be straight).
The same motivation of claim 1 is applied to claim 6. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 6. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Regarding claim 7, Freeman teaches wherein a distance between adjacent grid lines in the grid/grid group is adjustable on demand (see para. 0118, Freeman discusses adjusting pixels/rays based on the distance of the specific pixel or ray from the border of the defect).
The same motivation of claim 1 is applied to claim 7. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 7. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Claim 8 is rejected as applied to claim 1 as pertaining to a corresponding method.
Claim 9 is rejected as applied to claim 2 as pertaining to a corresponding method.
Claim 10 is rejected as applied to claim 3 as pertaining to a corresponding method.
Claim 11 is rejected as applied to claim 4 as pertaining to a corresponding method.
Claim 12 is rejected as applied to claim 5 as pertaining to a corresponding method.
Regarding claim 13, Freeman teaches further comprising after the user input unit sending the correction control signal and prior to the processing unit performing the calculation processing: confirming by the user of the correction control signal (see figure 18, figure 21, para. 0249, Freeman discusses user feedback to confirm correction on image data).
The same motivation of claim 1 is applied to claim 13. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 13. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Claim 14 is rejected as applied to claim 6 as pertaining to a corresponding method.
Claim 15 is rejected as applied to claim 7 as pertaining to a corresponding method.
Regarding claim 16, Freeman teaches wherein the storing of the one or more combinations by the storage unit stores the one or more combinations of the variations of the one or more to-be corrected parts of different users or of the same user at different time points, and repeating the selecting of one or more to-be-corrected parts, the sending of the correction control signal, obtaining the variations according to the to-be-corrected parts, and the storing of the combination of the variations, on a basis of calling the one or more combinations (see para. 0232, Freeman discusses coordinate transformation values are established, the retinal map may be stored in the database and transferred to the display controller 16. In use, the retinal map may then be used to transform the image(s) received from the camera and generate the corrected image. The database stores data to repeat the correction process).
The same motivation of claim 1 is applied to claim 16. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 16. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Regarding claim 17, Freeman teaches wherein the grid/grid group is a grid formed of intersecting horizontal grid lines and vertical grid lines (see para. 0224, 0229, Freeman discusses Amsler grid with horizontal and vertical lines may have been included in the software to be projected; see para. 0225, Freeman discusses the visual grid, and mapping routine performed on a Amsler grid or moving objects to check the UFOY, or both, utilizing an existing FOY map to modify and optimize).
The same motivation of claim 1 is applied to claim 17. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 17. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Regarding claim 18, Freeman teaches wherein the one or more combinations of the variations obtained for the one or more to-be-corrected parts correspond to corrections of the to-be-corrected parts to be straight in the grid/grid group as viewed by the user (see para. 0229-0231, Freeman discusses Amsler grid with horizontal and vertical lines are transformation; see figure 22, para. 0224, 0232-0233, Freeman discusses a grid with normal straight grid lines, therefore corrected parts are straightened).
The same motivation of claim 1 is applied to claim 18. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 18. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Regarding claim 19, Freeman teaches wherein the applying the one or more combinations of the variations stored in the storage unit to the image is configured to correct a visual distortion in the image as viewed by the user (see para. 0253, 0257, Freeman discusses corrected (for that user) version is also displayed onto a portion of the glasses or lenses, where only the portion of the field of view which needs to be adjusted is modified; see para. 0272, Freeman discusses a display unit may be coupled to the display controller and configured to receive the corrected image to present the corrected image to the eye of the user).
The same motivation of claim 1 is applied to claim 19. Motivation to combine may be gleaned from the prior art considered. It would have been obvious before the effective filing date of the claimed invention to one of ordinary skill in the art to modify the invention of Freeman and Chu with Seki to derive at the invention of claim 19. The result would have been expected, routine, and predictable in order to perform image distortion correction.
Conclusion
Contact Information
Any inquiry concerning this communication or earlier communications from the examiner should be directed to KENNY A CESE whose telephone number is (571) 270-1896. The examiner can normally be reached on Monday – Friday, 9am – 4pm.
If attempts to reach the primary examiner by telephone are unsuccessful, the examiner’s supervisor, Gregory Morse can be reached on (571) 272-3838. The fax phone number for the organization where this application or proceeding is assigned is (571) 273-8300.
Information regarding the status of an application may be obtained from the Patent Application Information Retrieval (PAIR) system. Status information for published applications may be obtained from either Private PAIR or Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative or access to the automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/Kenny A Cese/
Primary Examiner, Art Unit 2663
Prosecution Insights