DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Information Disclosure Statement
The information disclosure statement (IDS) submitted on 08/26/2025 and 10/27/2025 are in compliance with the provisions of 37 CFR 1.97. Accordingly, the information disclosure statement is being considered by the Examiner.
Claim Rejections - 35 USC § 102
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention.
Claims 1 and 8 are rejected under 35 U.S.C. § 102(a)(1) as being anticipated over Kim (KR 20150092989, of record, Examiner has provided a machine translation).
Regarding claim 1, Kim discloses a system comprising: tracking means (Examiner notes that 300, control unit and associated eye detection components constitute the tracking means); a display unit (Figure 4 and 11) mounted on a dashboard of a vehicle ([0041] discloses: head-up device installed in a narrow space between a vehicles cluster and windshield, therefore considered to be mounted on a dashboard of a vehicle), wherein a light-emitting surface of the display unit is curved (Figures 4 and 11 depict: 100, display unit); an optical combiner (Figures 4 and 11 depict: W, windshield) arranged on an optical path of the display unit (Figures 4 and 11 depict: W, windshield, arranged on optical path) and on an optical path of real-world light emanating from a real-world environment (Examiner notes that the windshield is considered to combine the light from the display unit and the environment in front of the windshield); and at least one processor ([0075] discloses: 300, control unit) configured to: utilize the tracking means to determine a relative location of eyes of at least one user with respect to the optical combiner ([0075] discloses: control unit may correct the driving information image based on the drivers eye height detection result); generate a display image (Figures 4 and 11 depict: V, virtual image), based on a curvature of the light-emitting surface of the display unit ([0039] discloses: virtual image, by forming the display area of the display unit into a curved surface), a relative location of the optical combiner with respect to the display unit ([0038] discloses: 110, display area of 100, display unit, may be variously changed depending on the curvature of the windshield, the optical distance from the display unit to the windshield or the size of the virtual image), and the relative location of the eyes of the at least one user with respect to the optical combiner ([0075] discloses: control unit may correct the driving information image based on the drivers eye height detection result); and display the display image via the display unit ([0039] discloses: virtual image, by forming the display area of the display unit into a curved surface), wherein the optical combiner is employed to reflect light emanating from the light-emitting surface of the display unit towards the eyes of the at least one user (Figures 4 and 11 depict: combined light from real world and 100, display unit, toward the eyes of the user at 400), whilst optically combining said light with the real-world light ([0005] discloses: a displayed virtual image and the driver maintains forward visibility while driving; therefore considered to optically combine the virtual image with real-world light).
Regarding claim 8, Kim discloses a method comprising: utilizing tracking means (Examiner notes that 300, control unit and associated eye detection components constitute the tracking means) to determine a relative location of eyes of at least one user with respect to an optical combiner (Figures 4 and 11 depict: W, windshield; [0075] discloses: control unit may correct the driving information image based on the drivers eye height detection result), wherein the optical combiner is arranged on an optical path of a display unit (Figures 4 and 11 depict: W, windshield, arranged on optical path) and on an optical path of real-world light emanating from a real-world environment (Examiner notes that the windshield is considered to combine the light from the display unit and the environment in front of the windshield); generate a display image (Figures 4 and 11 depict: V, virtual image), based on a curvature of a light-emitting surface of the display unit, a relative location of the optical combiner with respect to the display unit ([0039] discloses: virtual image, by forming the display area of the display unit into a curved surface), and the relative location of the eyes of the at least one user with respect to the optical combiner ([0075] discloses: control unit may correct the driving information image based on the drivers eye height detection result); and display the display image via the display unit ([0039] discloses: virtual image, by forming the display area of the display unit into a curved surface), wherein the optical combiner is employed to reflect light emanating from the light-emitting surface of the display unit towards the eyes of the at least one user (Figures 4 and 11 depict: combined light from real world and 100, display unit, toward the eyes of the user at 400), whilst optically combining said light with the real-world light ([0005] discloses: a displayed virtual image and the driver maintains forward visibility while driving; therefore considered to optically combine the virtual image with real-world light).
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 2 and 9 are rejected under 35 U.S.C. § 103 as being unpatentable over Kim (KR 20150092989, of record), as applied to claims 1 and 8 above, in view of Pala et al. (US 2019/0031027).
Regarding claim 2, Kim discloses the system of claim 1, wherein a reflective surface of the optical combiner is curved (Figures 4 and 11 depict: W, windshield; Examiner notes that a windshield is curved).
Kim fails to disclose a system wherein the display image is generated further based on a curvature of the reflective surface of the optical combiner. Kim and Pala are related because both disclose optical systems.
Pala teaches a system wherein the display image is generated further based on a curvature of the reflective surface of the optical combiner ([0025] teaches: the image modification module can change the RGB of the image based on the curvature of the windshield).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Pala and provide a system wherein the display image is generated further based on a curvature of the reflective surface of the optical combiner. Doing so would allow for the image displayed to not be distorted (Pala: 0025), thereby improving the overall functionality and performance of the optical system.
Regarding claim 9, Kim discloses the method of claim 8.
Kim fails to disclose a method wherein a reflective surface of the optical combiner is curved, wherein the display image is generated further based on a curvature of the reflective surface of the optical combiner. Kim and Pala are related because both disclose optical systems.
Pala teaches a method wherein the display image is generated further based on a curvature of the reflective surface of the optical combiner ([0025] teaches: the image modification module can change the RGB of the image based on the curvature of the windshield).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Pala and provide a method wherein the display image is generated further based on a curvature of the reflective surface of the optical combiner. Doing so would allow for the image displayed to not be distorted (Pala: 0025), thereby improving the overall functionality and performance of the optical system.
Claims 3 and 10 are rejected under 35 U.S.C. § 103 as being unpatentable over Kim (KR 20150092989, of record), as applied to claims 1 and 8 above, in view of Karafin et al. (US 2020/0290513).
Regarding claim 3, Kim discloses the system of claim 1.
Kim fails to disclose a system wherein the display unit comprises a plurality of sub-display units that are arranged in a tiled manner, the light-emitting surface of the display unit being formed by respective light-emitting surfaces of the plurality of sub-display units. Kim and Karafin are related because both disclose optical systems.
Karafin teaches a system wherein the display unit comprises a plurality of sub-display units that are arranged in a tiled manner, the light-emitting surface of the display unit being formed by respective light-emitting surfaces of the plurality of sub-display units ([0002] teaches: the present disclosure related to light field display systems for vehicular augmentation; Examiner notes that a light field display is a display unit comprised of sub-display units that are arranged in a tiled manner).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Karafin and provide a system wherein the display unit comprises a plurality of sub-display units that are arranged in a tiled manner, the light-emitting surface of the display unit being formed by respective light-emitting surfaces of the plurality of sub-display units. Doing so would allow for better angular resolution and systematic characterization and optimization, thereby improving the overall quality and efficiency of the optical system.
Regarding claim 10, Kim discloses the method of claim 8.
Kim fails to disclose a method wherein the display unit comprises a plurality of sub-display units that are arranged in a tiled manner, the light-emitting surface of the display unit being formed by respective light-emitting surfaces of the plurality of sub-display units. Kim and Karafin are related because both disclose optical systems.
Karafin teaches a method wherein the display unit comprises a plurality of sub-display units that are arranged in a tiled manner, the light-emitting surface of the display unit being formed by respective light-emitting surfaces of the plurality of sub-display units ([0002] teaches: the present disclosure related to light field display systems for vehicular augmentation; Examiner notes that a light field display is a display unit comprised of sub-display units that are arranged in a tiled manner).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Karafin and provide a method wherein the display unit comprises a plurality of sub-display units that are arranged in a tiled manner, the light-emitting surface of the display unit being formed by respective light-emitting surfaces of the plurality of sub-display units. Doing so would allow for better angular resolution and systematic characterization and optimization, thereby improving the overall quality and efficiency of the optical system.
Claims 4-5 and 11-12 are rejected under 35 U.S.C. § 103 as being unpatentable over Kim (KR 20150092989, of record), as applied to claims 1 and 8 above, in view of Kweon et al. (US 2025/0298242).
Regarding claim 4, Kim discloses the system of claim 1.
Kim fails to disclose a system further comprising an optical correcting element that is arranged on an optical path of the light-emitting surface of the display unit, wherein different portions of the optical correcting element have different optical powers. Kim and Kweon are related because both disclose optical systems.
Kweon teaches a system a system further comprising an optical correcting element that is arranged on an optical path of the light-emitting surface of the display unit ([0006] teaches: display unit that may adjust optical path), wherein different portions of the optical correcting element have different optical powers ([0095] teaches: Fresnel lens, may have a plurality of lens units; [0051] teaches: plurality of lenses including a Fresnel lens; Examiner notes that different portions of the lenses and the Fresnel lens are considered to have different optical powers).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Kewon and provide a system further comprising an optical correcting element that is arranged on an optical path of the light-emitting surface of the display unit, wherein different portions of the optical correcting element have different optical powers. Doing so would allow for better resolution, and aberration correction, thereby improving the overall performance of the optical system.
Regarding claim 5, Kim discloses the system of claim 1.
Kim fails to disclose a system further comprising an optical element that is employed to direct the light emanating from the light-emitting surface of the display unit towards the optical combiner. Kim and Kweon are related because both disclose optical systems.
Kweon teaches a system further comprising an optical element that is employed to direct the light emanating from the light-emitting surface of the display unit towards the optical combiner (Figure 1 depicts: 21, flat mirror, that directs light from 1, image generation device to 3 windshield, the optical combiner).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Kewon and provide a system further comprising an optical element that is employed to direct the light emanating from the light-emitting surface of the display unit towards the optical combiner. Doing so would allow for better resolution, and aberration correction, thereby improving the overall performance of the optical system.
Regarding claim 11, Kim discloses the method of claim 8.
Kim fails to disclose a method wherein an optical correcting element is arranged on an optical path of the light-emitting surface of the display unit, wherein different portions of the optical correcting element have different optical powers. Kim and Kweon are related because both disclose optical systems.
Kweon teaches a method a system further comprising an optical correcting element that is arranged on an optical path of the light-emitting surface of the display unit ([0006] teaches: display unit that may adjust optical path), wherein different portions of the optical correcting element have different optical powers ([0095] teaches: Fresnel lens, may have a plurality of lens units; [0051] teaches: plurality of lenses including a Fresnel lens; Examiner notes that different portions of the lenses and the Fresnel lens are considered to have different optical powers).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Kewon and provide a method further comprising an optical correcting element that is arranged on an optical path of the light-emitting surface of the display unit, wherein different portions of the optical correcting element have different optical powers. Doing so would allow for better resolution, and aberration correction, thereby improving the overall performance of the optical system.
Regarding claim 12, Kim discloses the method of claim 8.
Kim fails to disclose a method wherein an optical element is employed to direct the light emanating from the light-emitting surface of the display unit towards the optical combiner. Kim and Kweon are related because both disclose optical systems.
Kweon teaches a system further comprising an optical element that is employed to direct the light emanating from the light-emitting surface of the display unit towards the optical combiner (Figure 1 depicts: 21, flat mirror, that directs light from 1, image generation device to 3 windshield, the optical combiner).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Kewon and provide a system further comprising an optical element that is employed to direct the light emanating from the light-emitting surface of the display unit towards the optical combiner. Doing so would allow for better resolution, and aberration correction, thereby improving the overall performance of the optical system.
Claims 6-7 and 13-14 are rejected under 35 U.S.C. § 103 as being unpatentable over Kim (KR 20150092989, of record), as applied to claims 1 and 8 above, in view of Karafin et al. (US 2020/0290513) in view of Kasazumi et al. (US 10,182,221, of record)
Regarding claim 6, Kim discloses the system of claim 1.
Kim fails to disclose a system wherein the display unit is a light field display unit, the display image being a light field image. and wherein a first set of pixels and a second set of pixels of the light field image are generated based on a relative location of a first eye and of a second eye of the at least one user with respect to the optical combiner, respectively, wherein the optical combiner is employed to reflect a first part and a second part of the synthetic light field towards the first eye and the second eye of the at least one user, respectively, whilst optically combining the first part and the second part of the synthetic light field with the real-world light. Kim and Karafin are related because both disclose optical systems.
Karafin teaches a system wherein the display unit is a light field display unit, the display image being a light field image ([0002] teaches: the present disclosure related to light field display systems for vehicular augmentation) the light emanating from the light-emitting surface being a synthetic light field (Examiner notes that Karafin teaches a synthetic light field).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Karafin and provide a system wherein the display unit is a light field display unit, the display image being a light field image the light emanating from the light-emitting surface being a synthetic light field. Doing so would allow for better resolution and systematic characterization and optimization, thereby improving the overall quality and efficiency of the optical system.
Kim fails to disclose a system wherein a first set of pixels and a second set of pixels of the light field image are generated based on a relative location of a first eye and of a second eye of the at least one user with respect to the optical combiner, respectively, wherein the optical combiner is employed to reflect a first part and a second part of the synthetic light field towards the first eye and the second eye of the at least one user, respectively, whilst optically combining the first part and the second part of the synthetic light field with the real-world light. Kim and Kasazumi are related because both disclose optical systems.
Kasazumi teaches a system wherein a first set of pixels and a second set of pixels of the light field image are generated based on a relative location of a first eye and of a second eye of the at least one user with respect to the optical combiner (Col. 3, lines 38-55 teach: pixel row of image for left and right eye, to the surface of the windshield), respectively, wherein the optical combiner is employed to reflect a first part and a second part of the synthetic light field towards the first eye and the second eye of the at least one user, respectively (Col. 3, lines 38-55 teach: image for left and right eye), whilst optically combining the first part and the second part of the synthetic light field (Col. 3, lines 38-55 teach: three-dimensional display, therefore considered analogous to the synthetic light field) with the real-world light (Figure 1A depicts: combining light of display and real world light through windshield, the optical combiner and viewed by the user).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Kasazumi and provide a system wherein a first set of pixels and a second set of pixels of the light field image are generated based on a relative location of a first eye and of a second eye of the at least one user with respect to the optical combiner, respectively, wherein the optical combiner is employed to reflect a first part and a second part of the synthetic light field towards the first eye and the second eye of the at least one user, respectively, whilst optically combining the first part and the second part of the synthetic light field with the real-world light. Doing so would allow for better resolution, systematic characterization and optimization, thereby improving the overall quality and efficiency of the optical system.
Regarding claim 7, Kim discloses the system of claim 1.
Kim fails to disclose a system wherein the light-emitting surface of the display unit comprises a plurality of photo-emitting cells, wherein, when generating the display image, the at least one processor is configured to apply a distortion correction by: (i) calculating an incoming direction vector for a given photo-emitting cell of the display unit, based on a curvature of a portion of the light-emitting surface where the given photo-emitting cell is located, the relative location of the optical combiner with respect to the display unit, a relative location of a given eye of a given user with respect to the optical combiner, wherein the incoming direction vector represents a direction along which light emanating from the given photo-emitting cell travels after being reflected by the optical combiner ; (ii) determining a pixel location in a virtual image that is presented to the user upon display of the display image, based on the incoming direction vector; (iii) fetching, from an input image, a value of a given pixel that is located at the determined pixel location in the input image; and (iv) using the fetched value of the given pixel of the input image as a value of a corresponding pixel of the display image, wherein the corresponding pixel of the display image is located based on a location of the given photo-emitting cell in the light-emitting surface. Kim and Kasazumi are related because both disclose optical systems.
Kasazumi teaches a system wherein the light-emitting surface of the display unit comprises a plurality of photo-emitting cells (Col. 3, lines 43-55 teach: 110, display having pixels, therefore considered photo-emitting cells), wherein, when generating the display image (in at least abstract teaches: display image), the at least one processor is configured to apply a distortion correction by: (i) calculating an incoming direction vector for a given photo-emitting cell of the display unit (Col. 5, lines 7-30 teach: x,y,z left and right eye coordinates; Examiner notes that determining the reflection region and applying coordinate corrections based on viewpoint coordinates necessarily requires determining a direction and magnitude along which light travels from the display pixel to the eye via the windshield), based on a curvature of a portion of the light-emitting surface where the given photo-emitting cell is located (Col. 5, lines 7-30 teach: correction patterns for each sample point are created according to distortion with respect to 201, windshield glass), the relative location of the optical combiner with respect to the display unit (Examiner notes that the windshield glass functions as the optical combiner and correction patterns are created relative to the curve of the windshield and the location of the windshield with respect to the display unit), a relative location of a given eye of a given user with respect to the optical combiner (Col. 5, lines 7-30 teach: x,y,z left and right eye coordinates and applying correction amount to coordinates), wherein the incoming direction vector represents a direction along which light emanating from the given photo-emitting cell travels after being reflected by the optical combiner (Col. 5, lines 7-30 teach: x,y,z left and right eye coordinates and corrections, patterned onto the left and right eyes; Examiner notes that because the reflection region is determined based on viewpoint coordinates and windshield curvature, the correction pattern necessarily corresponds to the direction of the reflected light traveling from the display pixel to the users eye); (ii) determining a pixel location in a virtual image that is presented to the user upon display of the display image, based on the incoming direction vector (Col. 5, lines 7-30 teach: x,y,z left and right eye coordinates and applying correction amount to coordinates to display an image to the user, see Figure 1A); (iii) fetching, from an input image, a value of a given pixel that is located at the determined pixel location in the input image (Col. 5, lines 31-53 teach: pattern corrector of left and right eye coordinates to create corrected pattern, store and display image to user); and (iv) using the fetched value of the given pixel of the input image as a value of a corresponding pixel of the display image (Col. 4, lines 56-60 teach: 32, display image, created from corrector to display to right and left eye and reflected from windshield as virtual image), wherein the corresponding pixel of the display image is located based on a location of the given photo-emitting cell in the light-emitting surface (Figure 1A depicts: display image located on windshield, based on location of light emitting surface of display pixels).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Kasazumi and provide a system wherein the light-emitting surface of the display unit comprises a plurality of photo-emitting cells, wherein, when generating the display image, the at least one processor is configured to apply a distortion correction by: (i) calculating an incoming direction vector for a given photo-emitting cell of the display unit, based on a curvature of a portion of the light-emitting surface where the given photo-emitting cell is located, the relative location of the optical combiner with respect to the display unit, a relative location of a given eye of a given user with respect to the optical combiner, wherein the incoming direction vector represents a direction along which light emanating from the given photo-emitting cell travels after being reflected by the optical combiner ; (ii) determining a pixel location in a virtual image that is presented to the user upon display of the display image, based on the incoming direction vector; (iii) fetching, from an input image, a value of a given pixel that is located at the determined pixel location in the input image; and (iv) using the fetched value of the given pixel of the input image as a value of a corresponding pixel of the display image, wherein the corresponding pixel of the display image is located based on a location of the given photo-emitting cell in the light-emitting surface. Doing so would allow for better resolution, systematic characterization and optimization, thereby improving the overall quality and efficiency of the optical system.
Regarding claim 13, Kim discloses the method of claim 8.
Kim fails to disclose a method wherein the display unit is a light field display unit, the display image being a light field image, wherein a first set of pixels and a second set of pixels of the light field image are generated based on a relative location of a first eye and of a second eye of the at least one user with respect to the optical combiner, respectively, the light emanating from the light-emitting surface being a synthetic light field, wherein the optical combiner is employed to reflect a first part and a second part of the synthetic light field towards the first eye and the second eye of the at least one user, respectively, whilst optically combining the first part and the second part of the synthetic light field with the real-world light. Kim and Karafin are related because both disclose optical systems.
Karafin teaches a method wherein the display unit is a light field display unit, the display image being a light field image ([0002] teaches: the present disclosure related to light field display systems for vehicular augmentation) the light emanating from the light-emitting surface being a synthetic light field (Examiner notes that Karafin teaches a synthetic light field).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Karafin and provide a system wherein the display unit is a light field display unit, the display image being a light field image the light emanating from the light-emitting surface being a synthetic light field. Doing so would allow for better resolution and systematic characterization and optimization, thereby improving the overall quality and efficiency of the optical system.
Kim fails to disclose a method wherein a first set of pixels and a second set of pixels of the light field image are generated based on a relative location of a first eye and of a second eye of the at least one user with respect to the optical combiner, respectively, wherein the optical combiner is employed to reflect a first part and a second part of the synthetic light field towards the first eye and the second eye of the at least one user, respectively, whilst optically combining the first part and the second part of the synthetic light field with the real-world light. Kim and Kasazumi are related because both disclose optical systems.
Kasazumi teaches a method wherein a first set of pixels and a second set of pixels of the light field image are generated based on a relative location of a first eye and of a second eye of the at least one user with respect to the optical combiner (Col. 3, lines 38-55 teach: pixel row of image for left and right eye, to the surface of the windshield), respectively, wherein the optical combiner is employed to reflect a first part and a second part of the synthetic light field towards the first eye and the second eye of the at least one user, respectively (Col. 3, lines 38-55 teach: image for left and right eye), whilst optically combining the first part and the second part of the synthetic light field (Col. 3, lines 38-55 teach: three-dimensional display, therefore considered analogous to the synthetic light field) with the real-world light (Figure 1A depicts: combining light of display and real world light through windshield, the optical combiner and viewed by the user).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Kasazumi and provide a system wherein a first set of pixels and a second set of pixels of the light field image are generated based on a relative location of a first eye and of a second eye of the at least one user with respect to the optical combiner, respectively, wherein the optical combiner is employed to reflect a first part and a second part of the synthetic light field towards the first eye and the second eye of the at least one user, respectively, whilst optically combining the first part and the second part of the synthetic light field with the real-world light. Doing so would allow for better resolution, systematic characterization and optimization, thereby improving the overall quality and efficiency of the optical system.
Regarding claim 14, Kim discloses the method of claim 8.
Kim fails to disclose a method wherein the light-emitting surface of the display unit comprises a plurality of photo-emitting cells, wherein the step of generating the display image comprises applying a distortion correction by: (i) calculating an incoming direction vector for a given photo-emitting cell of the display unit, based on a curvature of a portion of the light-emitting surface where the given photo-emitting cell is located, the relative location of the optical combiner with respect to the display unit, a relative location of a given eye of a given user with respect to the optical combiner, wherein the incoming direction vector represents a direction along which light emanating from the given photo-emitting cell travels after being reflected by the optical combiner; (ii) determining a pixel location in a virtual image that is presented to the user upon display of the display image, based on the incoming direction vector; (iii) fetching, from an input image, a value of a given pixel that is located at the determined pixel location in the input image; and (iv) using the fetched value of the given pixel of the input image as a value of a corresponding pixel of the display image, wherein the corresponding pixel of the display image is located based on a location of the given photo-emitting cell in the light-emitting surface. Kim and Kasazumi are related because both disclose optical systems.
Kasazumi teaches a method wherein the light-emitting surface of the display unit comprises a plurality of photo-emitting cells (Col. 3, lines 43-55 teach: 110, display having pixels, therefore considered photo-emitting cells), wherein, when generating the display image (in at least abstract teaches: display image), the at least one processor is configured to apply a distortion correction by: (i) calculating an incoming direction vector for a given photo-emitting cell of the display unit (Col. 5, lines 7-30 teach: x,y,z left and right eye coordinates; Examiner notes that determining the reflection region and applying coordinate corrections based on viewpoint coordinates necessarily requires determining a direction and magnitude along which light travels from the display pixel to the eye via the windshield), based on a curvature of a portion of the light-emitting surface where the given photo-emitting cell is located (Col. 5, lines 7-30 teach: correction patterns for each sample point are created according to distortion with respect to 201, windshield glass), the relative location of the optical combiner with respect to the display unit (Examiner notes that the windshield glass functions as the optical combiner and correction patterns are created relative to the curve of the windshield and the location of the windshield with respect to the display unit), a relative location of a given eye of a given user with respect to the optical combiner (Col. 5, lines 7-30 teach: x,y,z left and right eye coordinates and applying correction amount to coordinates), wherein the incoming direction vector represents a direction along which light emanating from the given photo-emitting cell travels after being reflected by the optical combiner (Col. 5, lines 7-30 teach: x,y,z left and right eye coordinates and corrections, patterned onto the left and right eyes; Examiner notes that because the reflection region is determined based on viewpoint coordinates and windshield curvature, the correction pattern necessarily corresponds to the direction of the reflected light traveling from the display pixel to the users eye); (ii) determining a pixel location in a virtual image that is presented to the user upon display of the display image, based on the incoming direction vector (Col. 5, lines 7-30 teach: x,y,z left and right eye coordinates and applying correction amount to coordinates to display an image to the user, see Figure 1A); (iii) fetching, from an input image, a value of a given pixel that is located at the determined pixel location in the input image (Col. 5, lines 31-53 teach: pattern corrector of left and right eye coordinates to create corrected pattern, store and display image to user); and (iv) using the fetched value of the given pixel of the input image as a value of a corresponding pixel of the display image (Col. 4, lines 56-60 teach: 32, display image, created from corrector to display to right and left eye and reflected from windshield as virtual image), wherein the corresponding pixel of the display image is located based on a location of the given photo-emitting cell in the light-emitting surface (Figure 1A depicts: display image located on windshield, based on location of light emitting surface of display pixels).
It would have been obvious to one having ordinary skill in the art before the effective filing date of the claimed invention to have modified the invention of Kim to incorporate the teachings of Kasazumi and provide a method wherein the light-emitting surface of the display unit comprises a plurality of photo-emitting cells, wherein, when generating the display image, the at least one processor is configured to apply a distortion correction by: (i) calculating an incoming direction vector for a given photo-emitting cell of the display unit, based on a curvature of a portion of the light-emitting surface where the given photo-emitting cell is located, the relative location of the optical combiner with respect to the display unit, a relative location of a given eye of a given user with respect to the optical combiner, wherein the incoming direction vector represents a direction along which light emanating from the given photo-emitting cell travels after being reflected by the optical combiner ; (ii) determining a pixel location in a virtual image that is presented to the user upon display of the display image, based on the incoming direction vector; (iii) fetching, from an input image, a value of a given pixel that is located at the determined pixel location in the input image; and (iv) using the fetched value of the given pixel of the input image as a value of a corresponding pixel of the display image, wherein the corresponding pixel of the display image is located based on a location of the given photo-emitting cell in the light-emitting surface. Doing so would allow for better resolution, systematic characterization and optimization, thereby improving the overall quality and efficiency of the optical system.
Conclusion
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure: Varonos (US 2019/0116316) and Kasaoki (US 2015/0092989) both disclose relevant optical systems.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to John Sipes whose telephone number is (703)756-1372. The examiner can normally be reached Monday - Thursday 6:00 - 11:00 and 1:00 - 6:00.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Bumsuk Won can be reached at (571) 272-2713. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/J.C.S./Examiner, Art Unit 2872
/BUMSUK WON/Supervisory Patent Examiner, Art Unit 2872