DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Status of the Claims
Currently, claims 1-25 and 27-31 are pending in the application. Claim 13 is amended. Claim 26 is cancelled. Claim 31 is added.
Response to Arguments / Amendments
Applicant’s arguments have been fully considered, but they are not persuasive, see discussion below.
Rejections under 35 U.S.C. § 102 (a)(1):
The applicant argued that Pfaff do not disclose or suggest that a position of a sample is in any way used to select a filter for that sample” and "selecting a filter for the sample according to a shape of the current block and a position of the sample," per Applicant's claim 1.
As to the above argument, Pfaff discloses generating a prediction block for a current block of the video data using a sample position-dependent intra-prediction mode with sample position-dependent intra-prediction mode including Angular Intra Prediction, Wide-Angle Intra Prediction (WAIP) , Position Dependent Prediction Combination (PDPC) , Multiple Reference Line (MRL) Matrix-Based Intra Prediction (MIP) (Section II) and selecting a filter for the sample according to a shape of the current block and a position of the sample applying Matrix-Based Intra Prediction (MIP): The intra prediction samples can be generated by modes which perform a downsampling of the reference samples, a matrix vector multiplication and an upsampling of the result; Section IV.G. Sub Section 4, Each matrix Ak occurring in (9) is uniquely determined by mipSizeId and by the MIP-mode k – dependence of the shape using different blocks in the image with the MIP modes (Section IV.G, FIG. 6);
PNG
media_image1.png
293
830
media_image1.png
Greyscale
It should be further noted that Applicant has not presented any specific arguments with regards to the rejections of the dependent claims.
Accordingly, Examiner maintains the rejection with regards to above arguments.
Claim Rejections - 35 USC § 102
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale or otherwise available to the public before the effective filing date of the claimed invention.
Claims 1-14, 17-25 & 27-30 are rejected under 35 U.S.C. 102(a) (1) as being anticipated by J. Pfaff et al. ("Intra Prediction and Mode Coding in VVC," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 10, pp. 3834-3847, Oct. 2021, hereinafter Pfaff)
Regarding Claim 1, Pfaff discloses a method of decoding video data, the method comprising:
generating a prediction block for a current block of the video data using a sample position-dependent intra-prediction mode, including, for one or more samples of the prediction block (Section II, sample position-dependent intra-prediction mode including Angular Intra Prediction, Wide-Angle Intra Prediction (WAIP) , Position Dependent Prediction Combination (PDPC) , Multiple Reference Line (MRL) Matrix-Based Intra Prediction (MIP)):
selecting a filter for the sample according to a shape of the current block and a position of the sample (Section IV.G, FIG. 6, Matrix-Based Intra Prediction (MIP): The intra prediction samples can be generated by modes which perform a downsampling of the reference samples, a matrix vector multiplication and an upsampling of the result; Section IV.G. Sub Section 4, Each matrix Ak occurring in (9) is uniquely determined by mipSizeId and by the MIP-mode k – dependence of the shape using different blocks in the image with the MIP modes); and
PNG
media_image1.png
293
830
media_image1.png
Greyscale
predicting the sample using the selected filter (Section IV.G. Sub Section 2, a reduced prediction signal predMip of size predSize⋅predSize is generated by matrix-vector multiplication out of the reduced boundary: where predSize(W,H)=4 , if mipSizeId(W,H)∈{0,1} and predSize(W,H)=8 , otherwise. )
decoding a residual block for the current block of the video data; and combining the prediction block with the residual block to decode the current block of the video data (Section II, decoding a residual block for the current block combining the prediction block using Angular Intra Prediction, Wide-Angle Intra Prediction (WAIP) , Position Dependent Prediction Combination (PDPC) , Multiple Reference Line (MRL) Matrix-Based Intra Prediction (MIP)).
Regarding Claim 2, Pfaff discloses the method of claim 1, wherein the filter comprises a matrix of coefficients, and wherein predicting the sample comprises multiplying the matrix of coefficients by a causal template of samples neighboring the current block (Section IV.G, FIG. 6, Matrix-Based Intra Prediction (MIP): The intra prediction samples can be generated by modes which perform a downsampling of the reference samples, a matrix vector multiplication and an upsampling of the result).
Regarding Claim 3, Pfaff discloses the method of claim 2, further comprising selecting the matrix of coefficients from a set of available matrices according to one or more of a direction of the intra- prediction or a size of the current block (Section IV.G. Sub Section 4, Each matrix Ak occurring in (9) is uniquely determined by mipSizeId and by the MIP-mode k – dependence of the shape using different blocks in the image with the MIP modes).
Regarding Claim 4, Pfaff discloses the method of claim 2, wherein multiplying the matrix of coefficients by the causal template comprises subsampling the matrix of coefficients using a first subsampling factor and subsampling the causal template using a second subsampling factor to generate an intermediate prediction block (Section IV.G. Sub Section 1, Averaging: the top and left boundary samples refT and refL are reduced to smaller boundaries redT and redL of size boundarySize=2 for 4×4 blocks and of size boundarySize=4 for all other blocks).
Regarding Claim 5, Pfaff discloses the method of claim 4, wherein at least one of the first subsampling factor or the second subsampling factor corresponds to one or more of a direction of the intra- prediction, the shape of the current block, or a size of the current block (Section IV.G. Sub Section 4, Each matrix Ak occurring in (9) is uniquely determined by mipSizeId and by the MIP-mode k – dependence of the shape using different blocks in the image with the MIP modes).
Regarding Claim 6, Pfaff discloses the method of claim 1, further comprising determining to use the sample position-dependent intra-prediction mode based on a size of the current block being below a threshold (Section IV.G. Sub Section 4, Each matrix Ak occurring in (9) is uniquely determined by mipSizeId and by the MIP-mode k – dependence of the shape using different blocks in the image with the MIP modes).
Regarding Claim 7, Pfaff discloses the method of claim 6, wherein the size corresponds to one of an area of the current block, a width of the current block, or a height of the current block (Section IV.G. Sub Section 4, Each matrix Ak occurring in (9) is uniquely determined by mipSizeId and by the MIP-mode k – dependence of the shape using different blocks in the image with the MIP modes).
Regarding Claim 8, Pfaff discloses the method of claim 1, further comprising determining to use the sample position-dependent intra-prediction mode based on an aspect-ratio for the current block (Section IV.G. Sub Section 4, Each matrix Ak occurring in (9) is uniquely determined by mipSizeId and by the MIP-mode k – dependence of the shape using different blocks in the image with the MIP modes).
Regarding Claim 9, Pfaff discloses the method of claim 1, further comprising determining to use the sample position-dependent intra-prediction mode when:
a width of the current block is less than 32, a height of the current block is less than 32, and a signaled angular intra prediction mode for the current block has an index value of one of 0, 1, or (2+2*k) where k is an integer value between 0 and 32; or
the width of the current block is greater than or equal to 32 or the height of the current block is greater than or equal to 32, and the signed angular intra prediction mode for the current block has the index value of 0, 1, or (2+4*k) where k is an integer value between 0 and 16 (Section II, FIG. 3, Filtering with spatially varying weights is applied to blocks that use Planar and DC modes as well as certain angular modes using Position Dependent Prediction Combination (PDPC); Note: PDPC is automatically activated based on the block dimensions (Width (W), Height (H)) and the intra-prediction mode index. It is generally disabled if the block is smaller than 4x4, or if other specific tools like Multiple Reference Line (MRL) or Block-based Differential Pulse-Code Modulation (BDPCM) are used).
PNG
media_image2.png
536
660
media_image2.png
Greyscale
Regarding Claim 10, Pfaff discloses the method of claim 1, wherein predicting the sample using the selected filter comprises:
determining a number of reference lines of neighboring samples to the current block to which to apply the selected filter according to a size of the current block; and applying the selected filter to the number of reference lines of neighboring samples (Section IV.G, FIG. 6, Matrix-Based Intra Prediction (MIP): The intra prediction samples can be generated by modes which perform a downsampling of the reference samples, a matrix vector multiplication and an upsampling of the result).
Regarding Claim 11, Pfaff discloses the method of claim 1, wherein generating the prediction block comprises:
predicting a subsampled set of samples using respective filters for the subsampled set of samples to form an intermediate prediction block; and upsampling the intermediate prediction block to form the prediction block(Section IV.G, FIG. 6, Matrix-Based Intra Prediction (MIP): The intra prediction samples can be generated by modes which perform a downsampling of the reference samples, a matrix vector multiplication and an upsampling of the result).
Regarding Claim 12, Pfaff discloses the method of claim 1, wherein the current block has a width of W and a height of H, and wherein a causal template to which the filter is to be applied includes at least one of one or more 2*W-width rows of samples above the current block or 2*H-height columns of samples to the left of the current block(Section IV.G. Sub Section 1, Averaging: the top and left boundary samples refT and refL are reduced to smaller boundaries redT and redL of size boundarySize=2 for 4×4 blocks and of size boundarySize=4 for all other blocks).
Regarding Claim 13, Pfaff discloses the method of claim 1, wherein the current block has a width of W and a height of H, and when a signaled angular intra prediction mode for the current block has an index value between 19 and 49, a causal template to which the selected filter is to be applied includes a W-width rows of samples above the current block and an H-height columns of samples to the left of the current block (Section IV.G. Sub Section 1, Averaging: the top and left boundary samples refT and refL are reduced to smaller boundaries redT and redL of size boundarySize=2 for 4×4 blocks and of size boundarySize=4 for all other blocks).
Regarding Claim 14, Pfaff discloses the method of claim 1, further comprising transposing the selected filter to form a transposed filter, wherein predicting the sample using the selected filter comprises predicting the filter using the transposed filter (Section IV.G, FIG. 6, Matrix-Based Intra Prediction (MIP): The number nMIP of MIP modes supported on a given transform block is equal to 16 for mipSizeId=0 , equal to 8 for mipSizeId=1 and equal to 6 for mipSizeId=2. Here, mipSizeId is set to 0 for 4×4 blocks, to 1 for 8×8 blocks and for blocks that have exactly one side of length 4, and to 2 for all other blocks. Each MIP mode can be transposed which is determined by a flag mipTranspose).
Regarding Claims 17-25, Apparatus claims 17-25 of using the corresponding method claimed in claims 1 and 6-14, and the rejections of which are incorporated herein for the same reasons as used above.
Regarding Claims 27-28, are lists of hardware the usage of which components is well known in the art.
Regarding Claim 29, Encoding method claim 29 of using the corresponding decoding method claimed in claim 1, and the rejections of which are incorporated herein for the same reasons as used above.
Regarding Claim 30, Apparatus claim 30 of using the corresponding method claimed in claim 29, and the rejections of which are incorporated herein for the same s used above.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102 of this title, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 15 & 16 are rejected under 35 U.S.C. 103 as being unpatentable over J. Pfaff et al. ("Intra Prediction and Mode Coding in VVC," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 10, pp. 3834-3847, Oct. 2021, hereinafter Pfaff) in view of CHIANG et al. (US 20250280107, hereinafter CHIANG).
Regarding Claim 15, Pfaff discloses the method of claim 1, but does not explicitly disclose wherein generating the prediction block comprises generating the prediction block using a decoder-derived intra prediction mode
CHIANG teaches generating the prediction block using a decoder-derived intra prediction mode ([0146], two intra modes are derived from the reconstructed neighbour samples, and those two predictors are combined with the planar mode predictor with the weights derived from the gradients when Decoder Side Intra Mode Derivation (DIMD) is applied).
Therefore, it would have been obvious to one ordinary skill in the art before the effective filing date of the claimed invention to modify the teachings of decoder-derived intra prediction mode as taught by CHIANG ([0146]) into the decoding system of Pfaff in order to 7improve video coding efficiency, blending one or more hypotheses of predictions with the existing one or more hypotheses of predictions used for achieving a better accuracy of prediction, and improve the coding performance (CHIANG, [0002]).
Regarding Claim 16, Pfaff in view of CHIANG discloses the method of claim 15, CHIANG discloses wherein the decoder-derived intra prediction mode comprises one of decoder-side intra mode derivation (DIMD), template-based intra mode derivation (TIMD), multiple reference lines (MRL), or spatial geometric partition mode (SGPM) ([0154], FIG. 22, Template-based intra mode derivation(TIMD) mode implicitly derives the intra prediction mode of a CU using a neighbouring template at both the encoder and decoder, and The intra prediction mode with the minimum cost is selected as the DIMD mode and used for intra prediction of the CU). The same reason or rational of obviousness motivation applied as used above in claim 15.
Claim 31 is rejected under 35 U.S.C. 103 as being unpatentable over J. Pfaff et al. ("Intra Prediction and Mode Coding in VVC," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 10, pp. 3834-3847, Oct. 2021, hereinafter Pfaff) in view of XU (US 20250392702, hereinafter XU).
Regarding Claim 31, Pfaff discloses the method of claim 1, but does not explicitly disclose
wherein the sample comprises a first sample, the filter comprises a first filter, and the position of the first sample comprises a first position of the first sample,
and wherein generating the prediction block further comprises: selecting a second filter for a second sample of the prediction block according to the shape of the current block and a second position of the second sample, the second sample being different than the first sample, and the second filter being different than the first filter; and
predicting the second sample using the second filter.
XU teaches wherein the sample comprises a first sample, the filter comprises a first filter, and the position of the first sample comprises a first position of the first sample ([0031] FIG. 15A to FIG. 15D, Position- Dependent Intra Prediction Combination (PDPC)) and wherein generating the prediction block further comprises: selecting a second filter for a second sample of the prediction block according to the shape of the current block and a second position of the second sample, the second sample being different than the first sample, and the second filter being different than the first filter ([0154] In some embodiments, a PDPC technology may also be used. In order to compensate for deficiencies of the above simple intra prediction mode in utilizing the spatial redundancy, VVC introduces a method of adaptively selecting reference sample information at an angle in an opposite direction based on the position of the current sample and the angle of the intra prediction mode, as a new relatively complementary intra prediction; and then performing a weighted average on this intra prediction and the original angular intra prediction based on sample distance);
predicting the second sample using the second filter ([0155] The PDPC uses reconstructed pixel values that are not subjected to smoothing filtering, and the reconstructed pixel values and prediction values are weighted at different weights based on different prediction positions in the block, such that the prediction values are more accurate. A calculation process of applying the PDPC to predicted pixels is shown by the following formula (4)).
Therefore, it would have been obvious to one ordinary skill in the art before the effective filing date of the claimed invention to modify the teachings of decoder-derived intra prediction mode as taught by XU ([0154]) into the decoding system of Pfaff in order to allow the original angular prediction to fully utilize reference sample information corresponding to positive and negative directions at the prediction angle as much as possible, thereby improving prediction performance (XU, [0154]).
Conclusion
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to Samuel D Fereja whose telephone number is (469)295-9243. The examiner can normally be reached 8AM-5PM.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, DAVID CZEKAJ can be reached at (571) 272-7327. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/SAMUEL D FEREJA/Primary Examiner, Art Unit 2487
Prosecution Insights