DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
This communication is responsive to the correspondence filled on 07/15/2026.
Claims 1-4 are presented for examination.
Applicant has filled terminal disclaimer on 07/15/2026 and as such double patent rejection is withdrawn.
IDS Considerations
The information disclosure statement (IDS) submitted on 4/28/25 is/are being considered by the examiner as the submission is in compliance with the provisions of 37 CFR 1.97.
Response to Arguments
Applicant's arguments filed 07/15/2026 with respect to claims 1-4 have been considered but are moot in view of the new ground(s) of rejection.
Claim amendments of removing following limitation “when inter-prediction that uses the gradient values in the vertical direction ends” from independent claims has triggered change in claim scope.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1-4 is/are rejected under 35 U.S.C. 103 as being unpatentable over Chen’172 (U.S. Pub. No. 20180249172 A1), in view of Chen’199 (U.S. Pub. No. 20190320199 A1).
Regarding to claim 1-4:
Examiner’s Note: Encoder and decoder use same and opposite algorithm.
1. Chen’172 teach a decoder that decodes a current block in a current picture, the decoder comprising: a processor; and memory, wherein using the memory, the processor: (Chen’172 [0043] An embodiment of the present invention may also be program code to be executed on a Digital Signal Processor (DSP) to perform the processing described herein. The invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA). These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention. Claim 18. The method of claim 17, wherein if the bi-directional optical-flow prediction is applied to the current block on block-level basis for sub-blocks of the current block, the refined motion vectors associated with the sub-blocks are stored in the motion-vector buffer.) obtains two prediction images (Chen’172 Fig. 1) by interpolation (Chen’172 [0027] A method is disclosed to reduce the complexity and/or cost associated with the BIO process. According to this method, the gradient filter and the interpolation filter in BIO are unified with the interpolation filter for fractional motion compensation) with sub-pixel accuracy (Chen’172 [0014] For fractional pixel resolution, interpolation will be performed first and the gradient is calculated as follows:) using two reference pictures corresponding to the current block for bi-directional prediction; (Chen’172 Fig. 1 [0022] FIG. 2 illustrates an exemplary flowchart of a video coding system incorporating an embodiment of the present invention, where the use of BIO is extended to general bi-prediction motion compensation by including the case that two reference pictures correspond to two previously coded pictures) obtains, using pixel values of first pixels included in the two prediction images, (Chen’172 Fig. 1 [0029] Another method to improve the performance of BIO is to apply BIO for all bi-directional predicted blocks regardless of whether the blocks are “true bi-prediction” or not. According to the assumption of optical flow and steady motion, the corresponding equations and solutions for bi-directional predicted blocks can be used, where both reference frames are previously coded frames by using a similar approach.) gradient values in a vertical direction (Chen’172 [0038] FIG. 2 The y-direction gradient [vertical] difference corresponding to the given position of the current block between first y-direction gradient of the first reference block and second y-direction gradient of the second reference block is determined in step 240) which respectively correspond to second pixels included in a sub-block (Chen’172 claim 19. the y-direction gradient difference weighted by the y-offset value; encode or decode pixel data at the given position of the current block using the bi-directional optical-flow prediction corresponding to the given position; and store refined motion vectors for bi-directional optical-flow predicted pixels of the current block in a motion-vector buffer for motion vector prediction of one or more following blocks) obtained by dividing the current block; (Chen’172 [0031] The BIO can be applied to sub-PUs (prediction units). For example, if a PU block is allowed for sub-PU partition and each sub-PU can have different motion information or modes, the BIO can be applied to each sub-PU. The initial MV for BIO can be different for each sub-PU.) derives a motion estimation value of the sub-block based on the gradient values in the vertical direction; and (Chen’172 claim 19. the y-direction [vertical] gradient difference weighted by the y-offset value; encode or decode pixel data at the given position of the current block using the bi-directional optical-flow prediction corresponding to the given position; and store refined motion vectors for bi-directional optical-flow predicted pixels of the current block in a motion-vector buffer for motion vector prediction of one or more following blocks)
generates an output prediction image corresponding to the sub-block (Chen’172 [0030] In VCEG-AZ05 the BIO is applied in pixel-level basis. In an embodiment of the present invention, the process of the BIO is applied in the block-level basis. The block size can be N×M, where N and M are integers. All the pixels in an N×M block can share the same motion refinement. If N and M are equal to or greater than 4, the refined motion vector can be stored back to the MV buffers. [0031] The BIO can be applied to sub-PUs (prediction units). For example, if a PU block is allowed for sub-PU partition and each sub-PU can have different motion information or modes, the BIO can be applied to each sub-PU. The initial MV for BIO can be different for each sub-PU) using the motion estimation value of the sub-block, (Chen’172 claim 1919. An apparatus for motion compensation of video data performed by a video coding system, the apparatus comprising one or more electronic circuits or processors configured to: receive input data associated with a current block in a current picture; determine a first reference block in a first reference picture based on a first motion vector and a second reference block in a second reference picture based on a second motion vector. [0037] In still yet another embodiment, the offsets calculated in the BIO process can be viewed as an offset to refine the motion vectors for all pixels in current block. The refined MVs can be stored in the MV buffer and used for the MV prediction of the following blocks. Note that, if the BIO is performed in a block level (e.g. 4×4 block), the refined MVs are also stored in the block level.)
wherein the two prediction images are specified using two motion vectors, (Chen’172 claim 19. An apparatus for motion compensation of video data performed by a video coding system, the apparatus comprising one or more electronic circuits or processors configured to: receive input data associated with a current block in a current picture; determine a first reference block in a first reference picture based on a first motion vector and a second reference block in a second reference picture based on a second motion vector.)
Chen’172 do not explicitly teach a reference range for the interpolation is included in a normal reference range to be referenced for obtaining a prediction image with sub-pixel accuracy in a normal inter-prediction that does not use the gradient values in the vertical direction, the prediction image corresponding to the current block, and an 8-tap-filter is used in a process of interpolation with sub-pixel accuracy.
However Chen’199 teach a reference range for the interpolation is included in a normal reference range to be referenced for obtaining a prediction image with sub-pixel accuracy in a normal inter-prediction that does not use the gradient values in the vertical direction, (Chen’199 claim 1: applying PMVD process, BIO process or DMVR process to generate motion refinement for the current block using reference data corresponding to the first motion-compensated reference block and the second motion-compensated reference block without other reference data outside the first motion-compensated reference block and the second motion-compensated reference block; [0046] FIG. 9 illustrates an example required reference data by Decoder-Side Motion Vector Refinement (DMVR) for an M×N block with fractional MVs, where a (M+L−1)*(N+L−1) reference block is required for motion compensation – shows normal reference range. [0033] the PMVD process, the BIO process or the DMVR process to generate motion refinement for the current block is skipped for boundary pixels of the current block if it requires any reference data outside the first motion-compensated reference block and the second motion-compensated reference block. [0052] for a boundary pixel, the {−1, 1} filter is operated on a current pixel at the boundary of the current motion compensated block and a neighbouring pixel within the block. Compared to the 3-tap filter {−1, 0, 1}, the additional pixel outside the current motion-compensated block that would be required is not needed now. [0057] In order to reduce the memory bandwidth requirement, a filter coefficient padding method is proposed. First, a valid reference block is defined. The valid reference block can be the same as the original reference block (e.g. a (M+L−1)*(N+L−1) block 925) or a predefined block that contains the original reference block (e.g. the original reference block 925 plus one-pixel ring area 920). Then, when doing the decoder-side MV refinement and/or the final motion compensation, any reference pixels outside the valid reference block will not be used.)
the prediction image corresponding to the current block, and an 8-tap-filter is used in a process of interpolation with sub-pixel accuracy. (Chen’199 [0056] In the decoder-side predictor refinement tools, such as PMVD, BIO, and DMVR, the process to refine the predictors often requires additional reference samples outside the reference block. For example, for an M×N block 910 with fractional MVs, an (M+L−1)*(N+L−1) reference block 925 is required for motion compensation as shown in FIG. 9, where the L is the interpolation filter tap length. In HEVC, L is equal to 8. [0046] FIG. 9 illustrates an example required reference data by Decoder-Side Motion Vector Refinement (DMVR) for an M×N block with fractional MVs, where a (M+L−1)*(N+L−1) reference block is required for motion compensation.)
It would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to modify Chen’172, further incorporating Chen’199 in video/camera technology. One would be motivated to do so, to incorporate a reference range for the interpolation is included in a normal reference range to be referenced for obtaining a prediction image with sub-pixel accuracy in a normal inter-prediction that does not use the gradient values in the vertical direction. This functionality will improve efficiency with predictable results.
Closely related prior art
Examiner notes teaching of Ikai (U.S. Pub. No. 20190045214 A1), Li (U.S. Pub. No. 20140185680 A1) and Alshin (U.S. Pub. No. 20180376165 A1) is/are pertinent to the independent claim(s) because these teach motion estimation.
Conclusion
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to NASIM N NIRJHAR whose telephone number is (571) 272-3792. The examiner can normally be reached on Monday - Friday, 8 am to 5 pm ET.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, William F Kraig can be reached on (571) 272-8660. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of an application may be obtained from the Patent Application Information Retrieval (PAIR) system. Status information for published applications may be obtained from either Private PAIR or Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative or access to the automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/NASIM N NIRJHAR/Primary Examiner, Art Unit 2896
Prosecution Insights