DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Response to Arguments
Applicant’s arguments, see p. 8-9, filed April 22, 2026, with respect to the 35 U.S.C. 101 rejections have been fully considered and are persuasive. The 35 U.S.C. 101 rejections of Claims 1 and 9-18 have been withdrawn.
Applicant’s arguments with respect to claim(s) 1-19 have been considered but are moot because new grounds of rejection are made in view of Du (US 20190213778A1).
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claim(s) 1, 2, 9, 10, and 17-19 is/are rejected under 35 U.S.C. 103 as being unpatentable over Badichi (US 20220193548A1) and Du (US 20190213778A1).
As per Claim 1, Badichi teaches a method for determining viewability of an object by a user in a virtual environment (determine the viewability of the CG objects, drawn within the viewport, in the eyes of the viewer, [0004], in Virtual Reality (VR) the scene is displayed to the viewer via two screens, in VR, viewport 100 may be the two screens, [0093]), the method comprising: determining that a presentation of the object within the virtual environment meets a set of viewability conditions (viewability determination system 200 can be configured to calculate a viewability score of an object to be displayed in a viewport 100, [0110], the viewability determination system 200 may be configured to determine a first value indicative of a relative portion of the object from viewport 100, the viewability determination system 200 can determine a plurality, of points discretely distributed on the object, and for each point of the points if the point is visible to a user viewing the viewport 100, the first value can be determined by dividing the size of the sections represented by a corresponding point of the points determined to be visible, by viewport’s 100 size, [0111]); capturing a two-dimensional projection of the object as presented in the virtual environment (scene may include various Computer Graphic (GC) objects, CG objects are drawn within viewport 100, CG objects may be two-dimensional objects, [0089], viewport 100 may refer to a two-dimensional polygon onto which the three-dimensional scene is projected, [0091], [0093]); determining that the two-dimensional projection of the object matches a reference version of the object based on a comparison of an average color of features of the reference version of the object and the average color of the features in the two-dimensional projection of the object (viewability determination system 200 may be configured to determine a third value indicative of color resemblance between colors of corresponding sections of the object and desired colors for the corresponding sections, [0127], object 910, having desired colors and of scene 920 that is viewed in viewport 100 showing object 910 with the actual colors as viewed by the viewer, the color resemblance determination method includes identifying segments of object 910 with dominating desired colors, dominating desired colors is determined by calculating the average Red Green Blue (RGB) values of the pixels within each segment, and determine if all RGB values of the pixels in the segment are within a threshold distance from the average RGB values, [0129], the actual colors of segments 930, 940, and 950 (determined to have dominating desired colors) as displayed in viewport 100 are then determined and compared to the corresponding desired colors of each of the segments determined to have dominating desired colors, [0131]); and classifying presentation of the object in the virtual environment based on whether the two-dimensional projection of the object matches the reference version of the object (the measure of resemblance for the expected and actual colors for each segment is the basis for the calculation of the third value, an example may be that the actual colors of object 910 as displayed in the viewport 100 are different than the expected colors of object 910 when object 910 is rendered in scene 920 in darker colors when viewed in a night time occurring scene, [0132], in the illustrated example, the actual colors of segments 930 and 940 as seen within the viewport 100, substantially resemble the expected colors, whereas the actual colors of segment 950 as seen within the viewport 100 do not resemble the expected colors, due to a flame of the explosion that took place in the scene 920 within the area covered by segment 950, [0133]), including: in response to determining that the two-dimensional projection of the object matches the reference version of the object, classifying the presentation of the object within the virtual environment as viewable rendering of the object (if upon the third value being higher than a third high threshold, the viewability score will be calculated based on a third over-threshold-value indicative of the third value being over the third high threshold, the third over-threshold-value is one, [0136], if a specific object’s color resemblance value is more than 60% with respect to the desired colors of the specific object, the specific object may be considered to be color resembling to the desired colors, the third over-threshold-value that will be used in the viewability score calculation for the specific object will be one, [0137]); and in response to determining that the two-dimensional projection of the object does not match the reference version of the object classifying the presentation of the object within the virtual environment as a non-viewable rendering of the object (third value is calculated for objects within the viewport 100, being indicative the color resemblance of each object with respect to the desired colors of the respective object, if the third value being lower than a third low threshold, the viewability score will be calculated based on a third under-threshold-value indicative of the third value being under the third low threshold, the third under-threshold-value is zero, [0134], if a specific object’s color resemblance value is lower than 20% with respect to the desired colors of the specific object, the specific object may be considered not to be color resembling to the desired colors, the third under-threshold-value that will be used in the viewability score calculation for the specific object will be zero, [0135]).
However, Badichi does not teach wherein the set of viewability conditions includes a sequence of two or more independent viewability checks, the determining comprising: sequentially performing the sequence of the two or more independent viewability checks in increasing order of computational complexity. However, Du teaches wherein the set of viewability conditions includes a sequence of two or more independent viewability checks, the determining comprising: sequentially performing the sequence of the two or more independent viewability checks in increasing order of computational complexity (for the visibility test, a point can be marked as not visible if the color values of corresponding locations in different texture maps are not sufficiently uniform, for this part of the test, uses a multi-level, majority voting strategy, searches from coarse to fine levels, sampled color in a texture map is trusted if color values of texture maps from at least half of the visible views for the point are within a threshold of similarity in the Lab color space, [0098]; visibility test using a coarse-to-fine multi-level majority voting strategy, [0095]).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi so that the set of viewability conditions includes sequence of two or more independent viewability checks, determining comprising: sequentially performing the sequence of the two or more independent viewability checks in increasing order of computational complexity because Du suggests that this way, if it fails to meet the viewability check at the lower level of computational complexity, then the viewability check at the higher level of computation complexity does not have to be performed on it [0095, 0098].
As per Claim 2, Badichi teaches wherein the set of viewability conditions comprises: validating, from one or more processors, a rendering confirmation for the object within the virtual environment (CG objects are computer-generated images, rendered by a computer, and presented to a viewer, CG objects are drawn within viewport 100, [0089], three-dimensional video game viewed on a game console display, viewport 100 is the player’s game console display, [0092], [0093]).
As per Claim 9, Badichi teaches wherein the set of viewability conditions comprises: determining an average luminance of the object meets a threshold luminance (object 910, having desired colors and of scene 920 that is viewed in viewport 100 showing object 910 with the actual colors as viewed by the viewer, the color resemblance determination method includes identifying segments of object 910 with dominating desired colors, dominating desired color is determined by calculating the average RGB values of the pixels within each segment, and determine if all RGB values of the pixels in the segment are within a threshold distance from the average RGB values, wherever RGB is referred, any other color encoding scheme may be used, including YUV (luminance, chroma, violet), [0129]).
As per Claim 10, Badichi teaches wherein determining the average luminance of the object meets the threshold luminance comprises: calculating an average luminance of pixels including the object; converting the average luminance to a representative value; and comparing the representative value to a threshold luminance value [0129].
As per Claim 17, Claim 17 is similar in scope to Claim 1, except that Claim 17 is directed to one or more non-transitory computer storage media encoded with computer program instructions that when executed by one or more computers cause the one or more computers to perform the method of Claim 1. Badichi teaches one or more non-transitory computer storage media encoded with computer program instructions that when executed by one or more computers cause the one or more computers to perform the method (the operations in accordance with the teachings herein may be performed by a general-purpose computer specifically configured for the desired purpose by a computer program stored in a non-transitory computer readable storage medium, [0080]). Thus, Claim 17 is rejected under the same rationale as Claim 1.
As per Claim 18, Claim 18 is similar in scope to Claim 17, and therefore is rejected under the same rationale.
As per Claim 19, Badichi does not teach comprising determining that a second presentation of the object within the virtual environment fails to meet at least one viewability condition among the set of viewability conditions, wherein the at least one viewability condition has a given level of computational complexity; and in response to determining that the second presentation of the object within the virtual environment fails to meet the at least one viewability condition, terminating analysis of the second presentation of the object before performance of an additional viewability condition having a higher level of computational complexity than the at least one viewability condition; and determining that the second presentation of the object is not viewable based on the second presentation of the object within the virtual environment failing to meet the at least one viewability condition. However, Du teaches comprising determining that a second presentation of the object within the virtual environment fails to meet at least one viewability condition among the set of viewability conditions, wherein the at least one viewability condition has a given level of computational complexity; and in response to determining that the second presentation of the object within the virtual environment fails to meet the at least one viewability condition, terminating analysis of the second presentation of the object before performance of an additional viewability condition having a higher level of computational complexity than the at least one viewability condition; and determining that the second presentation of the object is not viewable based on the second presentation of the object within the virtual environment failing to meet the at least one viewability condition (for the visibility test, a point can be marked as not visible if the color values of corresponding locations in different texture maps are not sufficiently uniform, for this part of the test, uses a multi-level, majority voting strategy, searches from coarse to fine levels, sampled color in a texture map is trusted if color values of texture maps from at least half of the visible views for the point are within a threshold of similarity in the Lab color space, [0098]; visibility test using a coarse-to-fine multi-level majority voting strategy, [0095]).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi to include determining that a second presentation of the object within the virtual environment fails to meet at least one viewability condition among the set of viewability conditions, wherein the at least one viewability condition has a given level of computational complexity; and in response to determining that the second presentation of the object within the virtual environment fails to meet the at least one viewability condition, terminating analysis of the second presentation of the object before performance of an additional viewability condition having a higher level of computational complexity than the at least one viewability condition; and determining that the second presentation of the object is not viewable based on the second presentation of the object within the virtual environment failing to meet the at least one viewability condition because Du suggests that this reduces the computational requirement of performing the viewability analysis, since the viewability determination at the higher level of computational complexity is not performed if it failed the viewability determination at the lower level of computational complexity [0095, 0098].
Claim(s) 3 is/are rejected under 35 U.S.C. 103 as being unpatentable over Badichi (US 20220193548A1) and Du (US 20190213778A1) in view of Borovikov (US010987579B1).
Badichi and Du are relied upon for the teachings as discussed above relative to Claim 2.
However, Badichi and Du do not expressly teach wherein the set of viewability conditions comprises: determining a viewing angle of the object within a field of view of the user in the virtual environment meets a threshold angle criterion with respect to a surface normal of the object in the virtual environment with respect to the field of view of the user. However, Borovikov teaches wherein the set of viewability conditions comprises: determining a viewing angle of the object within a field of view of the user in the virtual environment meets a threshold angle criterion with respect to a surface normal of the object in the virtual environment with respect to the field of view of the user (predict that an object in the 3D environment may come within a FoV based on an object’s position within a threshold angle of a FoV, col. 8, lines 26-29; virtual environment, col. 1, lines 27-28).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi and Du so that the set of viewability conditions comprises: determining a viewing angle of the object within a field of view of the user in the virtual environment meets a threshold angle criterion with respect to a surface normal of the object in the virtual environment with respect to the field of view of the user because Borovikov suggests that this is needed in order to determine whether an object is viewable by the user (col. 8, lines 26-29).
Claim(s) 4 is/are rejected under 35 U.S.C. 103 as being unpatentable over Badichi (US 20220193548A1), Du (US 20190213778A1), and Borovikov (US010987579B1) in view of Salter (US010955665B2).
Badichi, Du, and Borovikov are relied upon for the teachings as discussed above relative to Claim 3.
However, Badichi, Du, and Borovikov do not expressly teach wherein the set of viewability conditions comprises: determining that object pixels comprising the object comprise coordinates coinciding with the field of view of the user within the virtual environment. However, Salter teaches wherein the set of viewability conditions comprises: determining that object pixels comprising the object comprise coordinates coinciding with the field of view of the user within the virtual environment (determining field of view for a group of users in a coordinate system shared by the group of users, determining a common viewing location for the at least one commonly viewed virtual object within the coordinate system shared by the group of users, col. 20, lines 33-44; each pixel in the 2-D pixel area may represent a depth value of an object, col. 9, lines 32-35; optimal viewing location and perspective for shared-view virtual objects rendered for multiple users sharing a common virtual environment, col. 2, lines 52-56).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi, Du, and Borovikov so that the set of viewability conditions comprises: determining that object pixels comprising the object comprise coordinates coinciding with the field of view of the user within the virtual environment because Salter suggests that this is needed in order to determine wither an object is viewable by the user (col. 20, lines 33-44).
Claim(s) 5-6 is/are rejected under 35 U.S.C. 103 as being unpatentable over Badichi (US 20220193548A1), Du (US 20190213778A1), Borovikov (US010987579B1), and Salter (US010955665B2) in view of Lanier (US 20160370855A1).
As per Claim 5, Badichi, Du, Borovikov, and Salter are relied upon for the teachings as discussed above relative to Claim 4.
However, Badichi, Du, Borovikov, and Salter do not expressly teach wherein the set of viewability conditions comprises: determining that one or more features of the object within the field of view of the user are not occluded by one or more other objects. However, Lanier teaches wherein the set of viewability conditions comprises: determining that one or more features of the object within the field of view of the user are not occluded by one or more other objects (if the virtual object is within the first field of view, the method proceeds to determine if the transparency of the virtual object is above a threshold, the transparency of the virtual object may indicate whether the object is to be used to occlude a portion of the real-world environment, the threshold may correspond to a transparency level below which an object will substantially occlude the real-world environment located at the location of the object as viewed through the display system, transparency levels above the threshold may allow the real-world environment to remain viewable through the virtual object when viewed through the display system, which may not allow the virtual object to occlude the real-world environment, if the transparency of the virtual object is not above the threshold, the display may not be capable of presenting the virtual object with sufficient occlusive abilities, [0042]).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi, Du, Borovikov, and Salter so that the set of viewability conditions comprises: determining that one or more features of the object within the field of view of the user are not occluded by one or more other objects because Lanier suggests that this way, if the transparency level of the virtual object is above the threshold, this allows the user to view the virtual object and also any object behind the virtual object [0042].
As per Claim 6, Badichi, Du, Borovikov, and Salter do not teach wherein determining that the one or more features of the object within the field of view of the user are not occluded by one or more other objects comprises determining a transparency threshold is met for the one or more other objects determined to be located between the field of view of the user and the one or more features of the object. However, Lanier teaches wherein determining that the one or more features of the object within the field of view of the user are not occluded by one or more other objects comprises determining a transparency threshold is met for the one or more other objects determined to be located between the field of view of the user and the one or more features of the object (if the virtual object is within the first field of view, the method proceeds to determine if the transparency of the virtual object is above a threshold, the transparency of the virtual object may indicate whether the object is to be used to occlude a portion of the real-world environment, the threshold may correspond to a transparency level below which an object will substantially occlude the real-world environment located at the location of the object as viewed through the display system, transparency levels above the threshold may allow the real-world environment to remain viewable through the virtual object when viewed through the display system, which may not allow the virtual object to occlude the real-world environment, if the transparency of the virtual object is not above the threshold, the display may not be capable of presenting the virtual object with sufficient occlusive abilities, [0042]). This would be obvious for the reasons given in the rejection for Claim 5.
Claim(s) 7 is/are rejected under 35 U.S.C. 103 as being unpatentable over Badichi (US 20220193548A1), Du (US 20190213778A1), Borovikov (US010987579B1), Salter (US010955665B2), and Lanier (US 20160370855A1) in view of Ito (US 20190132529A1).
Badichi, Du, Borovikov, Salter, and Lanier are relied upon for the teachings as discussed above relative to Claim 6.
However, Badichi, Du, Borovikov, Salter, and Lanier do not expressly teach wherein the one or more features of the object comprise at least one corner feature of the object and a center feature of the object. However, Ito teaches wherein the one or more features of the object comprise all features of the object (calculates the coordinate range of an image-capturing position at which a target object is not occluded by other objects and the entire object can be captured, [0065]). Since Ito teaches all features of the object, this means that it includes one corner feature of the object and a center feature of the object. Thus, Ito teaches wherein the one or more features of the object comprise at least one corner feature of the object and a center feature of the object [0065].
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi, Du, Borovikov, Salter, and Lanier so that the one or more features of the object comprise at least one corner feature of the object and a center feature of the object because Ito suggests that this ensures that the entire object is viewable [0065].
Claim(s) 8 is/are rejected under 35 U.S.C. 103 as being unpatentable over Badichi (US 20220193548A1), Du (US 20190213778A1), Borovikov (US010987579B1), and Salter (US010955665B2) in view of Lamontagne (WO 2020157738).
Badichi, Du, Borovikov, and Salter are relied upon for the teachings as discussed above relative to Claim 4.
However, Badichi, Du, Borovikov, and Salter do not teach wherein the set of viewability conditions comprises: validating a dimensionality of the object meets a threshold dimensionality comprising: determining a pixel ratio of the object pixels to on-screen pixels meets a threshold value; determining a threshold number of object pixels comprise onscreen pixels. However, Lamontagne teaches wherein the set of viewability conditions comprises: validating a dimensionality of the object meets a threshold dimensionality comprising: determining a pixel ratio of the object pixels to on-screen pixels meets a threshold value; determining a threshold number of object pixels comprise onscreen pixels (screen coverage metric means a measure related to screen coverage of a multidimensional object, on a viewport of a graphical interface, in a multidimensional digital environment, the metric can be represented as a ratio, screen coverage means a span ratio of a multidimensional object relative to the viewport displaying the multidimensional digital environment, viewport is an area that is expressed in coordinates specific to a rendering device, viewport of a graphical interface displayed on a screen would be the pixels of the screen, and the viewability of an object would be the ratio an object spans (in pixels) relative to the viewport, [0038], visibility metric means a measure related to the visibility of a multidimensional object on a viewport of a graphical interface, in a multidimensional digital environment, visibility metric means a measure of visibility of the multidimensional object on the viewport, the metric can be determined as a ratio, visibility of an object means a ratio of a multidimensional object that is visible to a user of the viewport of the multidimensional digital environment, [0039], screen coverage metric determination module 110 can be configured to determine a total number of pixels representing the objects of interest as well as total number of pixels in the viewport, module 110 can determine the screen coverage metric by dividing the number of pixels used by the object of interest by the total number of pixels in the viewport, this ratio can represent the metric of screen coverage by the object of interest, [0049], visibility metric determination module 112 that can be configured to determine the ratio of the object of interest on the view port, module 112 can determine the visibility metric by dividing the screen coverage metric by the GAP, [0050], GAP provides an estimate of the hypothetical screen area for the object of interest’s projection on the viewport, visibility metric can represent the ratio between the actual size of the object of interest that is visible on the screen and its hypothetical maximum, the visibility metric reflects not only parts of the object of interest that are obscured by other objects, but also the part of the object that is not visible on the viewport, a ratio by module 112, related to visibility of the object of interest can be determined by dividing the ratio of screen coverage by the object of interest by the calculated GAP of the object of interest, the ratio determined by module 112 can represent the visibility metric, [0051], objects of interest 302 and 304 each render 3,000 pixels of viewport 202 while object 306 renders 1,380 pixels, since the view of object of interest 304 is partially obscured by object 306, object of interest 304 renders 3,000 – 1,380 = 1,620 pixels of viewport 202, thus, if it is presumed viewport 202 renders 10,000 pixels in total, screen coverage ratio, V1, of object of interest can be determined as, [0062], V1 = pixels of object of interest ÷ total number of pixels in viewport, [0063], V1(object 302) = 3,000 ÷ 10,000 = 0.300, [0064], V1(object 304) = 1,620 ÷ 10,000 = 0.162, [0065], the metric of screen coverage can be determined as 0.3 for object of interest 302 and 0.162 for object 304, set the metric of screen coverage to be zero if the actual calculated screen coverage ratio is below a predetermined threshold, [0066]).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi, Du, Borovikov, and Salter so that the set of viewability conditions comprises: validating a dimensionality of the object meets a threshold dimensionality comprising: determining a pixel ratio of the object pixels to on-screen pixels meets a threshold value; determining a threshold number of object pixels comprise onscreen pixels because Lamontagne suggests that this way, it can accurately collect data related to visibility of the multidimensional digital object within the multidimensional digital environment [0003].
Claim(s) 11 is/are rejected under 35 U.S.C. 103 as being unpatentable over Badichi (US 20220193548A1) and Du (US 20190213778A1) in view of Hays (US 20080102947A1).
Badichi and Du are relied upon for the teachings as discussed above relative to Claim 1.
However, Badichi and Du do not teach wherein classifying presentation of the object in the virtual environment further comprises: in response to classifying the presentation of the object within the virtual environment as the viewable rendering of the object, incrementing a count of viewability of the object; determining that a number of sequential incrementations of the count of viewability of the object meets a threshold viewability count; and registering the presentation of the object. However, Hays teaches wherein classifying presentation of the object in the virtual environment further comprises: in response to classifying the presentation of the object within the virtual environment as the viewable rendering of the object, incrementing a count of viewability of the object; determining that a number of sequential incrementations of the count of viewability of the object meets a threshold viewability count; and registering the presentation of the object (track the length of time an image appears on screen even if it does not constitute an impression and aggregate the total time the gamer has been exposed to the image, thereby implementing the idea that multiple insufficient views can add up to an impression, if a player drives a car around a racetrack several times and each time sees a billboard for three seconds at the threshold angle and size, after five laps the cumulative impressions viewed by the gamer equals fifteen seconds, in this case, one impression cycle is counted, and the advertisement server is reset to start recording the next impression cycle, a Jumbotron is periodically rotating through several advertisements, as the advertisements are rotated, an impression is counted: for Advertisement A after three rotations, for Advertisement B after five rotations, and for Advertisement C after 1.5 rotations, [0086]).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi and Du so that classifying presentation of the object in the virtual environment further comprises: in response to classifying the presentation of the object within the virtual environment as the viewable rendering of the object, incrementing a count of viewability of the object; determining that a number of sequential incrementations of the count of viewability of the object meets a threshold viewability count; and registering the presentation of the object because Hays suggests that this way, the advertisers will know whether the advertisement was viewed enough times to make an impression [0083, 0086].
Claim(s) 12 is/are rejected under 35 U.S.C. 103 as being unpatentable over Badichi (US 20220193548A1) and Du (US 20190213778A1) in view of Dunn (US 20140201673A1) and Fram (US008610746B2).
Badichi and Du are relied upon for the teachings as discussed above relative to Claim 1.
However, Badichi and Du do not teach wherein classifying presentation of the object in the virtual environment further comprises: in response to classifying the presentation of the object within the virtual environment as a non-viewable rendering of the object, incrementing a count of non-viewability of the object; determining that a number of sequential incrementations of the count of non-viewability meets a threshold non-viewability count. However, Dunn teaches wherein classifying presentation of the object in the virtual environment further comprises: in response to classifying the presentation of the object within the virtual environment as a non-viewable rendering of the object, incrementing a count of non-viewability of the object; determining that a number of sequential incrementations of the count of non-viewability meets a threshold non-viewability count (predetermined thresholds may include a count of the tiles into which the images of the non-visible UI elements are drawn, [0013]).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi and Du so that classifying presentation of the object in the virtual environment further comprises: in response to classifying the presentation of the object within the virtual environment as a non-viewable rendering of the object, incrementing a count of non-viewability of the object; determining that a number of sequential incrementations of the count of non-viewability meets a threshold non-viewability count because Dunn suggests that this reduces the delay in showing the content [0039].
However, Badichi, Du, and Dunn do not teach providing an alert regarding the non-viewability of the object. However, Fram teaches in response to classifying the presentation of the object as non-viewable rendering of the object; and providing an alert regarding the non-viewability of the object (triggers certain warnings if all voxels have not been displayed or if at least a predetermined portion of the voxels have not been displayed with a certain display method (such as brightness, or other parameters), col. 6, lines 31-37).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi, Du, and Dunn to include providing an alert regarding the non-viewability of the object because Fram suggests that this way, the user knows that the image had not been displayed with a certain display method, so that the image can be adjusted to be displayed with the certain display method (col. 6, lines 31-37).
Claim(s) 13-15 is/are rejected under 35 U.S.C. 103 as being unpatentable over Badichi (US 20220193548A1) and Du (US 20190213778A1) in view of Seidemann (US 20230237479A1).
As per Claim 13, Badichi and Du are relied upon for the teachings as discussed above relative to Claim 1.
However, Badichi and Du do not teach wherein determining that the two-dimensional projection of the object matches the reference version of the object comprises: computing a hash of the two-dimensional projection; and comparing the hash of the two-dimensional projection to the hash of the reference version of the object. However, Seidemann teaches wherein determining that the two-dimensional projection of the object matches the reference version of the object comprises: computing a hash of the two-dimensional projection; and comparing the hash of the two-dimensional projection to the hash of the reference version of the object (scanning the second digital RGB image and determining the number of respectively colored pixels of the secondary color space on the substrate, by converting the determined number of respectively colored pixels for each primary color to hexadecimal numerals, by comparing the hexadecimal numerals with the hexadecimal numeral of the hash value printed on the substrate, [0087], the number of respectively colored pixels for each primary color of the authentication image may be determined, may be transformed into hexadecimal numerals and may be compared to the one-time verification number (which is the hash value), if both hexadecimal numerals are identical the authentication image is considered not to be manipulated, [0156]).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi and Du so that determining that the two-dimensional projection of the object matches the reference version of the object comprises: computing a hash of the two-dimensional projection; and comparing the hash of the two-dimensional projection to the hash of the reference version of the object because Seidemann suggests that this ensures that image matches the reference image [0087, 0165].
As per Claim 14, Badichi teaches determining that the two-dimensional projection of the object matches a reference version of the object based on a comparison of an average color of features of the reference version of the object and the average color of the features in the two-dimensional projection of the object, as discussed in the rejection for Claim 1.
However, Badichi and Du do not teach wherein computing the hash of the two-dimensional projection and of the reference version of the object comprises computing an average hash comprising: computing an average color value of at least a portion of the two-dimensional projection; encoding each pixel of the two-dimensional projection based on whether a color value of the pixel is at least the average color value; creating a bit string based on the encoded pixels; and converting the bit string to a hex value. However, Seidemann teaches wherein computing the hash of the two-dimensional projection and of the reference version of the object comprises: creating a bit string based on the encoded pixels; converting the bit string to a hex value; wherein determining that the two-dimensional projection of the object matches a reference version of the object comprises determining a difference between the hex value and a reference hex value representing the reference version of the object [0087, 0156]. Since Badichi teaches determining that the two-dimensional projection of the object matches a reference version of the object based on a comparison of an average color of features of the reference version of the object and the average color of the features in the two-dimensional projection of the object, as discussed in the rejection for Claim 1, this teaching of the hash and the hex values from Seidemann can be implemented into the device of Badichi so that computing the hash of the two-dimensional projection and of the reference version of the object comprises computing an average hash comprising: computing an average color value of at least a portion of the two-dimensional projection; encoding each pixel of the two-dimensional projection based on whether a color value of the pixel is at least the average color value; creating a bit string based on the encoded pixels; and converting the bit string to a hex value. This would be obvious for the reasons given in the rejection for Claim 13.
27. As per Claim 15, Badichi and Du do not teach wherein determining that the two-dimensional projection of the object matches a reference version of the object comprises determining a difference between the hex value and a reference hex value representing the reference version of the object. However, Seidemann teaches wherein determining that the two-dimensional projection of the object matches a reference version of the object comprises determining a difference between the hex value and a reference hex value representing the reference version of the object [0087, 0156]. This would be obvious for the reasons given in the rejection for Claim 13.
28. Claim(s) 16 is/are rejected under 35 U.S.C. 103 as being unpatentable over Badichi (US 20220193548A1), Du (US 20190213778A1), Dunn (US 20140201673A1), and Fram (US008610746B2) in view of Heikkinen (US 20070024527A1).
Badichi, Du, Dunn, and Fram are relied upon for the teachings as discussed above relative to Claim 12.
However, Badichi, Du, Dunn, and Fram do not teach wherein determining that the two-dimensional projection of the object matches a reference version of the object comprises: identifying locations of a set of edges in the reference version of the object; searching for the locations of the set of edges in the two-dimensional projection; and comparing an average color of pixels of the locations of the edges in the two-dimensional projection to the average color of pixels of the locations of the edges in the reference version of the object. However, Heikkinen teaches wherein determining that the two-dimensional projection of the object matches a reference version of the object comprises: identifying locations of a set of edges in the reference version of the object; searching for the locations of the set of edges in the two-dimensional projection; and comparing an average color of pixels of the locations of the edges in the two-dimensional projection to the average color of pixels of the locations of the edges in the reference version of the object (matching the camera image with the reference image, [0090], the analysis algorithms could be based on comparing features like edges, average color of the whole image, certain regions, and so on, [0091], pick the matching criteria to be used, the criteria can include: pattern matching of certain features like edges, colors may be used as matching criteria, and not the whole image, [0099]).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Badichi, Du, Dunn, and Fram so that determining that the two-dimensional projection of the object matches a reference version of the object comprises: identifying locations of a set of edges in the reference version of the object; searching for the locations of the set of edges in the two-dimensional projection; and comparing an average color of pixels of the locations of the edges in the two-dimensional projection to the average color of pixels of the locations of the edges in the reference version of the object because Heikkinen suggests that this is an efficient way to determine that the image matches the reference image [0090, 0091, 0099].
Conclusion
Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to JONI HSU whose telephone number is (571)272-7785. The examiner can normally be reached M-F 10am-6:30pm.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Kee Tung can be reached at (571)272-7794. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
JH
/JONI HSU/Primary Examiner, Art Unit 2611
Prosecution Insights