DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claim Rejections - 35 USC § 102
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(2) the claimed invention was described in a patent issued under section 151, or in an application for patent published or deemed published under section 122(b), in which the patent or application, as the case may be, names another inventor and was effectively filed before the effective filing date of the claimed invention.
Claim(s) 1, 3, 5-6, 12, 14-15 is/are rejected under 35 U.S.C. 102(a)(2) as being anticipated by US 2022/0201315 A1 (“Zhang”).
Regarding claim 1, Zhang discloses a video decoding method comprising: receiving data (e.g. see video decoder 300 receives encoded video bitstream as shown in Fig. 4) for a block of pixels to be decoded as a current block of a current picture of a video (e.g. see video decoder 300 apply multi-pass DMVR to a motion vector for a block (e.g., block 1200) of video data to determine a refined motion vector and decode the block based on the refined motion vector, paragraphs [0126], [0198]-[0200]); receiving a motion vector that references a block of pixels in a reference picture based on the received data (e.g. see motion vector, paragraphs [0126], [0198]-[0200]); refining the motion vector by examining pixels in the reference picture that are identified based on the refined motion vector (e.g. see motion vector refinement, for example, decoder-side motion vector refinement as shown in Fig. 10, paragraphs [0166]-[0175], and see multi-pass DMVR, paragraphs [0126], [0198]-[0200]), wherein the refinement of the motion vector is constrained by a refinement range (e.g. see range, paragraphs [0205], [0227]-[0232], [0242]-[0243]), wherein the motion vector is refined in a plurality of refinement passes (e.g. see video decoder 300 apply multi-pass DMVR to a motion vector for a block (e.g., block 1200) of video data to determine a refined motion vector and decode the block based on the refined motion vector, paragraphs [0126], [0198]-[0200]), the refinement range limits the modification of the motion vector in each refinement pass (e.g. see range, paragraphs [0205], [0227]-[0232], [0242]-[0243]), and the modification of the motion vector is constrained to maintain an integer portion of the motion vector (e.g. see shortened multi-pass DMVR, paragraph [0213]; also see integer-pel precision, paragraph [0241]); and decoding the current block by using the refined motion vector to reconstruct the current block (e.g. see decode the block based on the refined motion vector 1402 in Fig. 14, paragraphs [0346]-[0347]).
Regarding claim 3, Zhang further discloses further comprising deriving the refinement range based on a characteristic of the current block or the current picture (e.g. see range based on characteristic such as width W, height H, etc., paragraphs [0244]-[0260]).
Regarding claim 5, Zhang further discloses wherein the refinement range is applied to two or more refinement passes (e.g. see three-pass, paragraphs [0126], [0198]-[0200]).
Regarding claim 6, Zhang further discloses wherein the refinement of the motion vector in each refinement pass is constrained by a different refinement range (e.g. see range, paragraphs [0205], [0227]-[0232], [0242]-[0243]).
Regarding claim 12, Zhang further discloses further comprising: upon determining that activated reference pictures pair exists in two reference picture lists (e.g. see L0 and L1, paragraphs [0166], [0177], [0248]-[0250]), receiving signaled information related to the refinement of the motion vector (e.g. see flag indicates whether the decoder-side motion vector derivation (e.g. DMVR, bilateral merge, template matching, etc.) is applied to the current block or not, paragraphs [0166], [0177], [0248]-[0250]).
Regarding claims 14-15, the claims recite analogous limitations to the claims above and are therefore rejected on the same premise.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claim(s) 2, 7 is/are rejected under 35 U.S.C. 103 as being unpatentable over Zhang in view of US 2022/0167001 A1 (“Zhang2”).
Regarding claim 2, although Zhang discloses the refinement range (e.g. see range, paragraphs [0205], [0227]-[0232], [0242]-[0243]) and in at least one of a sequence level, a picture level, and slice level (e.g. see SPS, PPS, etc., paragraph [0070]), it is noted Zhang differs from the present invention in that it fails to particularly disclose wherein the refinement range is signaled. Zhang2 however, teaches wherein the refinement range is signaled (e.g. see syntax elements associated with the search area, paragraph [0233]; a person having ordinary skill in the art would have no difficulty recognizing to include such syntax elements in the parameter set such as SPS disclosed by Zhang).
Therefore, given the teachings as a whole, it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention, having the references of Zhang and Zhang2 before him/her, to modify the Multi-pass decoder-side motion vector refinement of Zhang with the teachings of Zhang2 in order to improve DMVR processes by signaling the size of the DMVR search area.
Regarding claim 7, although Zhang discloses a plurality of refinement ranges (e.g. see range, paragraphs [0205], [0227]-[0232], [0242]-[0243]), it is noted Zhang differs from the present invention in that it fails to particularly disclose wherein a plurality of refinement ranges are signaled for the plurality of refinement passes. Zhang however, teaches wherein a plurality of refinement ranges are signaled for the plurality of refinement passes (e.g. see syntax elements associated with the search area, paragraph [0233]; a person having ordinary skill in the art would have no difficulty recognizing to signal the plurality of refinement ranges disclosed by Zhang). The motivation above in the rejection of claim 2 applies here.
Claim(s) 10-11 is/are rejected under 35 U.S.C. 103 as being unpatentable over Zhang in view of US 2020/0236389 A1 (“Esenlik”).
Regarding claim 10, although Zhang discloses wherein using the refined motion vector to reconstruct the current block (e.g. see reconstruction unit 310 in Fig. 4, paragraph [0128]) comprises generating a set of prediction samples for motion compensation based on the refined motion vector (e.g. see motion compensation unit 316 including multi-pass DMVR unit 317, paragraphs [0126], [0198]-[0200], e.g. see DMVR as shown in Fig. 10, paragraphs [0166]-[0175]), wherein prediction samples within a retrieval range (e.g. see motion vector, paragraphs [0126], [0198]-[0200]) are generated by retrieving pixel samples of a reference picture from a memory (e.g. see decoded picture buffer DPB 314 in Fig. 4, paragraphs [0117], [0125], [0130]), it is noted Zhang differs from the present invention in that it fails to particularly disclose and prediction samples beyond the retrieval range are generated without accessing the memory. Esenlik however, teaches and prediction samples beyond the retrieval range are generated without accessing the memory (e.g. see replacing or padding the values which are located outside a predefined memory access window for the purpose of motion vector refinement, paragraph [0017], e.g. see padding examples in Fig. 10, paragraph [0117] and Fig. 11, paragraphs [0126]-[0130]).
Therefore, given the teachings as a whole, it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention, having the references of Zhang and Esenlik before him/her, to modify the Multi-pass decoder-side motion vector refinement of Zhang with the teachings of Esenlik in order to provide motion vector prediction which facilitates taking into account the number of accesses to the external memory and the number of samples which are necessary to be accessible for motion vector refinement of a motion vector for a coding block.
Regarding claim 11, although Zhang discloses the set of prediction samples for motion compensation (e.g. see motion compensation unit 316 including multi-pass DMVR unit 317, paragraphs [0126], [0198]-[0200], e.g. see DMVR as shown in Fig. 10, paragraphs [0166]-[0175]), it is noted Zhang differs from the present invention in that it fails to particularly disclose wherein the retrieval range encompasses only pixel samples of the reference picture that are identified by the original motion vector for generating the set of prediction samples for motion compensation and not pixel samples that are not identified by the original motion vector for generating the set of prediction samples for motion compensation. Esenlik however, teaches wherein the retrieval range encompasses only pixel samples of the reference picture (e.g. see replacing or padding the values which are located outside a predefined memory access window for the purpose of motion vector refinement, paragraph [0017], e.g. see padding examples in Fig. 10, paragraph [0117] and Fig. 11, paragraphs [0126]-[0130]) that are identified by the original motion vector for generating the set of prediction samples for motion compensation (e.g. see initial motion vector, paragraph [0017] and Fig. 11, paragraphs [0126]-[0130]) and not pixel samples that are not identified by the original motion vector for generating the set of prediction samples for motion compensation (e.g. see replacing or padding the values which are located outside a predefined memory access window for the purpose of motion vector refinement, paragraph [0017], e.g. see padding examples in Fig. 10, paragraph [0117] and Fig. 11, paragraphs [0126]-[0130]). The motivation above in the rejection of claim 10 applies here.
Claim(s) 13 is/are rejected under 35 U.S.C. 103 as being unpatentable over Zhang in view of US 2021/0266585 A1 (“Liu”).
Regarding claim 13, although Zhang discloses wherein the signaled information comprises an indication for enabling or disabling the refinement of the motion vector (e.g. see flag indicates whether the decoder-side motion vector derivation (e.g. DMVR, bilateral merge, template matching, etc.) is applied to the current block or not, paragraphs [0166], [0177], [0248]-[0250]), it is noted Zhang differs from the present invention in that it fails to particularly disclose at slice level. Liu however, teaches at slice level (e.g. see slice level, paragraphs [0200], [0253]).
Therefore, given the teachings as a whole, it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention, having the references of Zhang and Liu before him/her, to modify the Multi-pass decoder-side motion vector refinement of Zhang with the teachings of Liu in order to improve the quality of decompressed or decoded digital video.
Response to Arguments
Applicant's arguments filed 11/28/25 have been fully considered but they are not persuasive.
Applicant asserts on pages 7-9 of the Remarks that Zhang fails to disclose "refining the motion vector by examining pixels in the reference picture that are identified based on the refined motion vector, wherein the refinement of the motion vector is constrained by a refinement range, the motion vector is refined in a plurality of refinement pass, the refinement range limits the modification of the motion vector in each refinement pass, and the modification of the motion vector is constrained to maintain an integer portion of the motion vector; and decoding the current block by using the refined motion vector to reconstruct the current block" because paragraph [0213] of Zhang merely appears to disclose "determining whether to skip a sub-block based pass" and that the result appears to include "when the refined MV of the preceding pass is relatively optimal (e.g., further refinement may not result in a change to the MV in terms of the MV (sub-pel) precision." Further, applicant reasons on page 9 that Zhang in paragraph [0241] merely appears to disclose "when to reuse a prediction signal from a previous pass, not on constraining the motion vector modification itself, and not using a refined motion vector with a constrained integer portion in the decoding of the current block. The conditions checked appear to concern the result of the previous refinement, not about limiting the search space in the current refinement."
However, the examiner respectfully disagrees. Zhang, in at least paragraph [0199], discloses a video decoder 300 apply multi-pass DMVR to a motion vector for a block (e.g., block 1200) of video data to determine a refined motion vector and decode the block based on the refined motion vector. At least paragraph [0205] of Zhang discloses that the value range of delta motion vector MV in the p-th pass is predetermined and when the p-th pass is not the first pass, the value range is equal to or smaller than the value range in the preceding pass, and further, paragraph [0228] discloses that where there is a pre-determined value range of delta motion vector MV in the p-th pass, the values of search range determined by the value range of the delta motion vector in the p-th pass DMVR techniques.
Also, at least paragraph [0213] of Zhang discloses as an example of shortened multi-pass DMVR that the determining to skip the given sub-block based pass is based on a result of a preceding pass, such as when the refined MV of the preceding pass is relatively optimal (e.g., further refinement may not result in a change to the MV in terms of the MV (sub-pel) precision). Thus, for example, if the second to the last pass MV is equals to [4.25, 7.75], the preceding pass is equals to [4.5, 7.5], and the current pass MV is equals to [4.5, 7.5], then at the end of the refinement, the final refined MV will have an integer portion and a sub-pel portion that has not changed from the preceding pass. Therefore, as this example illustrate, at least the last two or more passes would have the same integer portion values as the MV is refined optimally until it does not change in sub-pel precision; also, the integer portion of the MV is kept and not discarded in each pass.
Therefore, for at least these reasons, the claim limitations are met in the broadest reasonable sense.
Conclusion
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure:
US 2025/0039371 A1, Kim et al., Video signal processing method and apparatus therefor
US 2023/0007238 A1, Chen et al., Using unrefined motion vectors for performing decoder-side motion vector derivation
Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to FRANCIS G GEROLEO whose telephone number is (571)270-7206. The examiner can normally be reached M-F 7:00 am - 3:30 pm.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Anna M Momper can be reached on (571) 270-5788. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/Francis Geroleo/Primary Examiner, Art Unit 3619