DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Continued Examination Under 37 CFR 1.114
A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 04/06/2026 has been entered.
Response to Arguments
Applicant’s arguments with respect to claim(s) 48-68 have been considered but are moot because the new ground of rejection does not rely on any reference applied in the prior rejection of record for any teaching or matter specifically challenged in the argument.
Claim Rejections - 35 USC § 102
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale or otherwise available to the public before the effective filing date of the claimed invention.
(a)(2) the claimed invention was described in a patent issued under section 151, or in an application for patent published or deemed published under section 122(b), in which the patent or application, as the case may be, names another inventor and was effectively filed before the effective filing date of the claimed invention.
Claims 48-50, 52 and 60-68 are rejected under 35 U.S.C. 102(a)(2) as being anticipated by Li et al. (US 20210058634 A1), hereinafter referred to as Li.
Regarding claim 48, Li discloses method for video processing, comprising:
determining, during a conversion between a current video block of a video and a bitstream of the video (Li, ¶ [0010]) , a refinement process applied to a current video unit associated with the current video block based on coding tools applied to the current video unit (Li, ¶[0010] - motion vector refinement (DMVR)); and
performing the conversion based on the refinement process (Li, ¶ [0010]).
wherein determining the refinement process comprises determining, based on coding tools applied to the current video unit, locations of blocks or sub-blocks in the current video unit, wherein the refinement process is to be applied to the blocks or the sub-block (Li, ¶¶ [0140]-[0141] and [0146] and [0147]).
Regarding claim 49, Li discloses all the limitations of claim 48, and is analyzed as previously discussed with respect to that claim.
Furthermore, Li discloses the method of claim 48, wherein determining the refinement process comprises determining at least one of the following:
location of the blocks or the sub-blocks in the current video unit to be applied with the refinement process, or the number of the samples or pixels in the current video unit to be applied with the refinement process (Li, ¶¶ [0010], [0140] and [0141]).
Regarding claim 50, Li discloses all the limitations of claim 48, and is analyzed as previously discussed with respect to that claim.
Furthermore, Li discloses the method of claim 48, wherein if the current video unit satisfies a predefined dimension condition, surrounding blocks or surrounding sub-blocks within the current video unit are to be refined in the refinement process, or wherein if the current video unit satisfies a predefined dimension condition, at least one block or at least one sub-block, which is not located at boundaries of the current video unit, is to be refined in the refinement process, or wherein if the current video unit satisfies a predefined dimension condition, blocks or sub-blocks located at a top first number of rows and/or a top second number of columns are to be refined in the refinement process, wherein at least one of the first number or second number is unequal to one, or wherein if a width of the current video unit is larger than or equal to a threshold width, and/or if a height of the current video unit is larger than or equal to a threshold height, at least one portion of blocks within the current video unit or at least one portion of sub-blocks within the current video unit are to be refined in the refinement process, or wherein if a width of the current video unit is less than or equal to a threshold width, and/or if a height of the current video unit is less than or equal to a threshold height, at least one portion of blocks within the current video unit or at least one portion of sub-blocks within the current video unit are to be refined in the refinement process, or wherein if a product of a width and a height of the current video unit is greater than or equal to a threshold product, at least one portion of blocks within the current video unit or at least one portion of sub-blocks within the current video unit are to be refined in the refinement process, or wherein if a product of a width and a height of the current video unit is less than a threshold product, at least one portion of blocks within the current video unit or at least one portion of sub-blocks within the current video unit are to be refined in the refinement process, or wherein at least one of blocks, sub-blocks, samples or pixels of the current video unit to be applied with the refinement process is determined dependent on dimensions of the current video unit, or wherein whether the refinement process is applied to at least one of blocks, sub-blocks, samples or pixels within the current video unit is determined on-the-fly (Li, [0152], [0162], [0173] and [0175] ).
Regarding claim 52, Li discloses all the limitations of claim 48, and is analyzed as previously discussed with respect to that claim.
Furthermore, Li discloses the method of claim 48, wherein the refinement process is applied by using at least one of: reconstruction samples in a reference picture other than a current picture associated with the current video unit, samples generated from pictures excluding the current picture, or samples generated from the current picture but not adjacent to the current video unit, or wherein a template matching process is applied by using reconstruction or prediction samples in reference pictures other than reconstruction or prediction samples in a current picture associated with the current video unit, or wherein the refinement process for an inter coded block or motion is applied without using reconstruction or prediction samples in a current picture associated with the current video unit, or wherein the refinement process for an inter coded block or motion is applied without using the intra coded reconstruction or prediction samples in a current picture associated with the current video unit (Li, ¶¶[0126]-[0128]).
Regarding claim 60, Li discloses all the limitations of claim 48, and is analyzed as previously discussed with respect to that claim.
Furthermore, Li discloses the method of claim 48, wherein a bilateral matching process is applied dependent on a prediction direction of a current block associated with the current video unit (Li, ¶¶ [0127] and [0130] ).
Regarding claim 61, Li discloses all the limitations of claim 60, and is analyzed as previously discussed with respect to that claim.
Furthermore, Li discloses the method of claim 60, wherein whether the bilateral matching process is performed from motion-compensated prediction blocks in a same prediction direction is determined dependent on the prediction direction of the current block, or wherein if when an LO predicted inter block is processed, the bilateral matching process is applied to the current block by using information of a first number of templates in a second number reference pictures in the LO prediction direction, or wherein if an L1 predicted inter block is processed, the bilateral matching process is applied to the current block by using information of a first number of templates in a second number reference pictures in the L1 prediction direction, or wherein if a bi-directional predicted inter block is processed, the bilateral matching process is applied to the current block by using information of a first template in a LO reference picture and a second template in a L1 reference picture (Li, ¶¶ [0126]- [0128]).
Regarding claim 62, Li discloses all the limitations of claim 61, and is analyzed as previously discussed with respect to that claim.
Furthermore, Li discloses the method of claim 61, wherein the templates are motion-compensated prediction blocks, or wherein the templates are prediction or reconstruction samples neighboring to motion- compensated prediction blocks (Li, ¶¶ [0126]- [0128]).
Regarding claim 63, Li discloses all the limitations of claim 48, and is analyzed as previously discussed with respect to that claim.
Furthermore, Li discloses the method of claim 48, wherein the refinement process comprises at least one of a template matching process or a bilateral matching process (Li, ¶¶ [0126]-[0128]).
Regarding claim 64, Li discloses all the limitations of claim 48, and is analyzed as previously discussed with respect to that claim.
Furthermore, Li discloses the method of claim 48, wherein the conversion comprises decoding the current video block from the bitstream of the video (Li, ¶¶ [0010] and [0170]).
Regarding claim 65, Li and Chen disclose all the limitations of claim 48, and is analyzed as previously discussed with respect to that claim.
Furthermore, Li discloses the method of claim 48, wherein the conversion comprises encoding the current video block into the bitstream of the video (Li, ¶¶ [0010] and [0062]-[0064]).
Regarding claim 66, this claim is rejected based on the same art and evidentiary limitations applied to the method of claim 48, since it claims analogous subject matter in the form of a method for performing the same or equivalent functionality.
Furthermore, Li discloses apparatus for processing video data comprising a processor and a non- transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to perform a method comprising (Li, ¶¶ [0010], [0183] and [0197])
Regarding claims 67, this claim is directed to a non-transitory computer-readable recording medium storing a bitstream generated by the feature encoding method which is a product by process claim limitation where the product is the bitstream and the process is the method steps to generate the bitstream. MPEP §2113 recites “Product-by-Process claims are not limited to the manipulations of the recited steps, only the structure implied by the steps”. Thus, the scope of the claim is the non-transitory computer-readable recording medium storing the bitstream (with the structure implied by the method steps). The structure includes the information and samples manipulated by the steps.
“To be given patentable weight, the printed matter and associated product must be in a functional relationship. A functional relationship can be found where the printed matter performs some function with respect to the product to which it is associated”. MPEP §2111.05(I)(A). When a claimed “computer-readable medium merely serves as a support for information or data, no functional relationship exists. MPEP §2111.05(III). The non-transitory computer-readable recording medium storing the claimed bitstream in claim 67 merely services as a support for the storage of the bitstream and provides no fictional relationship between the stored bitstream and storage medium. Therefor the structure bitstream, which scope is implied by the method steps, is non-functional descriptive material and given no patentable weight. MPEP §2111.05(III). Thus, the claim scope is just a non-transitory computer-readable recording medium storing data and is anticipated by Li which recites a non-transitory computer-readable recording medium storing a bitstream (See Li, ¶¶[0020], [0182] and [0197]).
Regarding claim 68, this claim is rejected based on the same art and evidentiary limitations applied to the method of claim 48, since it claims analogous subject matter in the form of a method for performing the same or equivalent functionality.
Furthermore, Li discloses, wherein instructions causing a processor to perform the method is stored in a non-transitory computer-readable storage medium (Li, ¶¶[0020], [0182] and [0197]).
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claim 51, 53 -55 are rejected under 35 U.S.C. 103 as being unpatentable over Li, in view of Chen et al. (US20200169748A1), hereinafter referred to as Chen.
Regarding claim 51, Li discloses all the limitations of claim 50, and is analyzed as previously discussed with respect to that claim.
Li does not explicitly disclose the method of claim 50, wherein the surrounding blocks or the surrounding sub-blocks are located at boundaries of the current video unit, or wherein positions of the blocks or the sub-blocks within the current video unit are determined dependent on dimensions of the current video unit.
However, Chen from the same or similar endeavor of data compression discloses the method of claim 50, wherein the surrounding blocks or the surrounding sub-blocks are located at boundaries of the current video unit, or wherein positions of the blocks or the sub-blocks within the current video unit are determined dependent on dimensions of the current video unit (Li, FIG. 18 and corresponding paragraphs – steps 402, 404 and 410).
It would have been obvious to the person of ordinary skill in the art before the effective filing date of the claimed invention to modify the teachings disclosed by Li to add the teachings of Chen as above, in order to improving decoder-side motion vector refinement (DMVR). (Chen, [0005]).
Regarding claim 53, Li and Chen disclose all the limitations of claim 48, and is analyzed as previously discussed with respect to that claim.
Li does not explicitly disclose the method of claim 48, wherein a bilateral matching process is applied dependent on one or more prediction blocks from a same reference picture list.
However, Chen from the same or similar endeavor of data compression discloses the method of claim 48, wherein a bilateral matching process is applied dependent on one or more prediction blocks from a same reference picture list (Li, Figs 5A and 5B and corresponding paragraphs – Bilateral matching).
The motivation for combining Li and Chen has been discussed in connection with claim 51, above.
Regarding claim 54, Li and Chen disclose all the limitations of claim 53, and is analyzed as previously discussed with respect to that claim.
Li does not explicitly disclose the method of claim 53, wherein the bilateral matching process is invoked by comparing a first number of prediction blocks in a second number of reference pictures from a same prediction direction, or wherein the bilateral matching process is used to refine or process a motion of a uni- prediction coded block, or wherein the bilateral matching process is used to refine or process a LO or L1 motion of a bi-prediction coded block.
However, Chen from the same or similar endeavor of data compression discloses the method of claim 53, wherein the bilateral matching process is invoked by comparing a first number of prediction blocks in a second number of reference pictures from a same prediction direction, or wherein the bilateral matching process is used to refine or process a motion of a uni- prediction coded block, or wherein the bilateral matching process is used to refine or process a LO or L1 motion of a bi-prediction coded block (Li, Figs 5A and 5B and corresponding paragraphs – Bilateral matching).
The motivation for combining Li and Chen has been discussed in connection with claim 51, above.
Regarding claim 55, Li and Chen disclose all the limitations of claim 54, and is analyzed as previously discussed with respect to that claim.
Li does not explicitly disclose the method of claim 54, wherein the bilateral matching process is applied by using a first prediction block from a first reference picture in a LO reference list and second prediction block from a second reference picture in the LO reference list, or wherein the bilateral matching process is applied by using a first prediction block from a first reference picture in a L1 reference list and second prediction block from a second reference picture in the L1 reference list.
However, Chen from the same or similar endeavor of data compression discloses the method of claim 54, wherein the bilateral matching process is applied by using a first prediction block from a first reference picture in a LO reference list and second prediction block from a second reference picture in the LO reference list, or wherein the bilateral matching process is applied by using a first prediction block from a first reference picture in a L1 reference list and second prediction block from a second reference picture in the L1 reference list (Li, Figs 5A and 5B and corresponding paragraphs – Bilateral matching).
The motivation for combining Li and Chen has been discussed in connection with claim 51, above.
Claim 56 are rejected under 35 U.S.C. 103 as being unpatentable over Li, in view of Liu et al. (US20210227245A1), hereinafter referred to as Liu.
Regarding claim 56, Li discloses all the limitations of claim 48, and is analyzed as previously discussed with respect to that claim.
Li does not explicitly disclose the method of claim 48, wherein the current video unit is coded with a multiple-hypothesis prediction mode.
However, Liu from the same or similar endeavor of data compression discloses the method of claim 48, wherein the current video unit is coded with a multiple-hypothesis prediction mode (Liu, ¶¶ [0199]- [0210] - perform DMVR on the motion vector if the other criteria indicate that DMVR is enabled (414)).
It would have been obvious to the person of ordinary skill in the art before the effective filing date of the claimed invention to modify the teachings disclosed by Li to add the teachings of Liu as above, in order to get more accurate motion information such that higher coding gains may be expected. (Liu, [0272]).
Claim 57-59 are rejected under 35 U.S.C. 103 as being unpatentable over Li, in view of Choi et al. (US20210227245A1), hereinafter referred to as Choi.
Regarding claim 57, Li discloses all the limitations of claim 48, and is analyzed as previously discussed with respect to that claim.
Li does not explicitly disclose the method of claim 48, wherein a bilateral matching process is used to reorder motion candidates.
However, Choi from the same or similar endeavor of data compression discloses the method of claim 48, wherein a bilateral matching process is used to reorder motion candidates. (Choi, ¶ [0089] - perform a motion vector refinement for selected candidate, e.g., according to a template matching or bilateral matching).
It would have been obvious to the person of ordinary skill in the art before the effective filing date of the claimed invention to modify the teachings disclosed by Li to add the teachings of Choi as above, in order to reorder the set of candidates such that all bi-prediction candidates are ordered higher on the candidate list. (Choi, [0089]).
Regarding claim 58, Li and Choi disclose all the limitations of claim 57, and is analyzed as previously discussed with respect to that claim.
Li does not explicitly disclose the method of claim 57, wherein whether to reorder the motion candidates with the bilateral matching process is determined dependent on a coding mode comprising at least one of the following:
an affine merge, an affine advanced motion vector prediction (AMVP), a regular merge, a regular AMVP, a geometric partition mode (GPM), a triangular prediction mode (TPM), a merge mode with motion vector differences (MMVD), a template matching merge, a combined inter/intra prediction (CIIP), a geometric prediction mode with motion vector difference (GMVD) or an affine MMVD, or wherein the ordering of the motion candidates with the bilateral matching process is performed based on a coding mode comprising at least one of the following: an affine merge, an affine advanced motion vector prediction (AMVP), a regular merge, a regular AMVP, a geometric partition mode (GPM), a triangular prediction mode (TPM), a merge mode with motion vector differences (MMVD), a template matching merge, a combined inter/intra prediction (CIIP), a geometric prediction mode with motion vector difference (GMVD) or an affine MMVD, or wherein the bilateral matching process is used to reorder bi-directional motion candidates, or wherein if the bilateral matching process is used to reorder uni-directional motion candidates, the uni-directional motion candidates are arranged in a motion candidate list according to an initial order, or wherein if the bilateral matching process is used to reorder uni-directional motion candidates, the uni-directional motion candidates are put behind the bi-directional motion candidates, or wherein if the bilateral matching process is used to reorder uni-directional motion candidates, the uni-directional motion candidates are put before the bi-directional motion candidates, or wherein the motion candidates are reordered ascendingly according to cost values based on the bilateral matching process.
However, Choi from the same or similar endeavor of data compression discloses the method of claim 57, wherein whether to reorder the motion candidates with the bilateral matching process is determined dependent on a coding mode comprising at least one of the following:
an affine merge, an affine advanced motion vector prediction (AMVP), a regular merge, a regular AMVP, a geometric partition mode (GPM), a triangular prediction mode (TPM), a merge mode with motion vector differences (MMVD), a template matching merge, a combined inter/intra prediction (CIIP), a geometric prediction mode with motion vector difference (GMVD) or an affine MMVD, or wherein the ordering of the motion candidates with the bilateral matching process is performed based on a coding mode comprising at least one of the following: an affine merge, an affine advanced motion vector prediction (AMVP), a regular merge, a regular AMVP, a geometric partition mode (GPM), a triangular prediction mode (TPM), a merge mode with motion vector differences (MMVD), a template matching merge, a combined inter/intra prediction (CIIP), a geometric prediction mode with motion vector difference (GMVD) or an affine MMVD, or wherein the bilateral matching process is used to reorder bi-directional motion candidates, or wherein if the bilateral matching process is used to reorder uni-directional motion candidates, the uni-directional motion candidates are arranged in a motion candidate list according to an initial order, or wherein if the bilateral matching process is used to reorder uni-directional motion candidates, the uni-directional motion candidates are put behind the bi-directional motion candidates, or wherein if the bilateral matching process is used to reorder uni-directional motion candidates, the uni-directional motion candidates are put before the bi-directional motion candidates, or wherein the motion candidates are reordered ascendingly according to cost values based on the bilateral matching process (Choi, ¶¶ [0039] and [0088]- [0092]).
The motivation for combining Li and Choi has been discussed in connection with claim 57, above.
Regarding claim 59, Li and Choi disclose all the limitations of claim 58, and is analyzed as previously discussed with respect to that claim.
Li does not explicitly disclose the method of claim 58, wherein the uni-directional motion candidates are converted to bi-directional motion candidates for calculating a bilateral matching cost
However, Choi from the same or similar endeavor of data compression discloses the method of claim 58, wherein the uni-directional motion candidates are converted to bi-directional motion candidates for calculating a bilateral matching cost (Choi, ¶ [0039], Examiner notes that the limitations related to the uni-directional motion candidates language are optional in claim 58. Because claim 59 depends on this optional aspect, claim 59 is likewise considered optional).
The motivation for combining Li and Choi has been discussed in connection with claim 57, above.
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to FABIO LIMA whose telephone number is (571)270-0625. The examiner can normally be reached on Monday through Friday, 8:30 AM - 5:00 PM (EST).
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Jamie Atala can be reached on (571) 272-7384. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of an application may be obtained from the Patent Application Information Retrieval (PAIR) system. Status information for published applications may be obtained from either Private PAIR or Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative or access to the automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/FABIO S LIMA/Examiner, Art Unit 2486
Prosecution Insights