DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Priority
Receipt is acknowledged of papers submitted under 35 U.S.C. 119(a)-(d), which papers have been placed of record in the file.
Specification
The title of the invention is not descriptive. A new title is required that is clearly indicative of the invention to which the claims are directed.
The following title is suggested: Method, Apparatus, and Medium for Video Processing Involving Template Based Processing.
Applicant is reminded of the proper language and format for an abstract of the disclosure.
The abstract should be in narrative form and generally limited to a single paragraph on a separate sheet within the range of 50 to 150 words in length. The abstract should describe the disclosure sufficiently to assist readers in deciding whether there is a need for consulting the full patent text for details.
The language should be clear and concise and should not repeat information given in the title. It should avoid using phrases which can be implied, such as, “The disclosure concerns,” “The disclosure defined by this invention,” “The disclosure describes,” etc. In addition, the form and legal phraseology often used in patent claims, such as “means” and “said,” should be avoided.
The abstract of the disclosure is objected to because it includes legal phraseology such as “comprises”. A corrected abstract of the disclosure is required and must be presented on a separate sheet, apart from any other text. See MPEP § 608.01(b).
Claim Rejections - 35 USC § 102
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(2) the claimed invention was described in a patent issued under section 151, or in an application for patent published or deemed published under section 122(b), in which the patent or application, as the case may be, names another inventor and was effectively filed before the effective filing date of the claimed invention.
Claim(s) 1-20 is/are rejected under 35 U.S.C. 102(a)(2) as being anticipated by US 2022/0224915 A1 (“Wang”).
Regarding claim 1, Wang discloses a method of video processing, comprising: determining, for a conversion between a video unit of a video and a bitstream of the video (e.g. see at least video encoder, e.g. in Fig. 2, and/or video decoder, e.g. in Fig. 3), whether a template based processing is applied to the video unit (e.g. see at least template based intra mode as shown in Fig. 20, Abstract, paragraphs [0158]-[0167]), wherein the template based processing is based on at least one template in at least one of: a current picture or a reference picture of the video unit (e.g. see at least template shown in Fig. 20, Abstract, paragraphs [0158]-[0167]; also see other templates in Figs. 24-31); and performing the conversion based on the determining (e.g. see at least video encoder, e.g. in Fig. 2, and/or video decoder, e.g. in Fig. 3; thus, the video encoder performs the conversion of the current block into a bitstream based on the template based intra mode and/or the video decoder performs the conversion of bitstream into the current block based on the template based intra mode).
Regarding claim 2, Wang further discloses wherein a template cost is determined by comparing at least one of the following between a current template and a reference template: a difference, an error, or a distortion, and/or wherein a template matching or a template refinement is performed based on a template cost, and/or wherein the template based processing comprises one of: an intra block copy (IBC) template matching (TM) merge mode, a TM based IBC advanced motion vector prediction (AMVP) candidate refinement, or an adaptive reordering-based motion compensation (ARMC) based IBC mode, and/or wherein in accordance with a determination that the video unit is coded with the template based processing, a reconstruction reordered IBC (RRIBC) is applied to the video unit, or in accordance with a determination that the video unit is coded with the template based processing, the RRIBC is not applied to the video unit, and/or wherein a location of at least a part of the current template relative to a current video unit and a location of at least a part of the reference template relative to a reference video unit are different, and/or wherein the current template is at above and left relative to the current video unit, and the reference template is at above and right relative to the reference video unit, and/or wherein the current template is at above and left relative to the current video unit, and the reference template is at below and left relative to the reference video unit (note: these claim limitations include “and/or”)(e.g. see at least SAD, Abstract, paragraphs [0158]-[0167]).
Regarding claim 3, Wang further discloses wherein if the template based processing in addition to the ARMC is applied to a prediction list, a second reference template that is different from a first reference template is used, and/or wherein if the RRIBC is applied to the video unit that is coded with the template based processing, a second reference template that is different from a first reference template is used, and/or wherein if the ARMC is applied to the video unit that is a non-RRIBC coded video unit, a second reference template that is different from a first reference template is used, and/or wherein if the template based processing in addition to the ARMC is applied to the prediction list, samples in a reference template of a reference block of the video unit are reordered, and/or wherein if the RRIBC is applied to the video unit that is coded with the template based processing, samples in a reference template of a reference block of the video unit are reordered, and/or wherein if the ARMC is applied to the video unit that is a RRIBC coded video unit, samples in a reference template of a reference block of the video unit are reordered, and/or wherein if the ARMC is applied to the prediction list, samples in a current template of a current block of the video unit are ordered, or wherein if the ARMC is applied to the video unit that is a RRIBC coded video unit, samples in a current template of a current block of the video unit are ordered (note: these claim limitations include “and/or” and/or contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 4, Wang further discloses wherein a validation check is applied to a reference template of at least one RRIBC coded motion candidate, and/or wherein the second reference template is used to determine a template cost of at least one RRIBC coded video unit, and/or wherein a validation check is applied to a reference template of the at least one RRIBC coded video unit, and/or wherein a reference template of the video unit includes neighboring samples that are at least one of the following sides adjacent to a reference video unit: a right side, a below side, an above side, or a left side, and/or wherein a reference template of the video unit comprises samples within the reference video unit (e.g. see at least template shown in Fig. 20, Abstract, paragraphs [0158]-[0167]; also see other templates in Figs. 24-31).
Regarding claim 5, Wang further discloses wherein the validation check is applied to check whether a right part of the reference template is within a valid area, and/or wherein the validation check is applied to check whether a bottom part of the reference template is within a valid area, and/or wherein if a sample of the reference template is outside a valid area, another sample within the valid area is used instead to construct the reference template, and/or wherein if at least one sample of the reference template is outside a valid area, the reference template of the at least one RRIBC coded motion candidate is treated as unavailable, and/or wherein if at least one sample of a right part of the reference template is outside a valid area, at least one sample on rightmost M columns inside a reference block is used instead to construct the reference template, wherein M is equal to a width of the right part of the reference template, or if at least one sample of a bottom part of the reference template is outside a valid area, at least one sample on top N rows inside a reference block is used instead to construct the reference template, wherein N is equal to a height of the bottom part of the reference template, and/or wherein whether to use bottom samples or right samples neighboring to a reference block to construct a reference template of a reference lock is dependent on a flip type of the at least one RRIBC coded video unit (note: these claim limitations include “and/or” and/or contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 6, Wang further discloses wherein the valid area is predefined by a set of rules related to coding information, and wherein the coding information comprises at least one of: a virtual pipeline data unit (VPDU) size, a largest coding unit (LCU) size, a tile boundary, a picture boundary, a slice boundary, or a tile row, and/or wherein a valid sample nearest to an invalid sample is used, and/or wherein a valid sample inside a reference block is used, and/or wherein the template based processing is not applied to the prediction list, or wherein the RRIBC is not applied to the video unit that is coded with the template based processing, or wherein the ARMC is not applied to the video unit that is non-RRIBC coded video unit (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 7, Wang further discloses wherein a validation check is applied to a reference template of the non-RRIBC coded video unit (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 8, Wang further discloses wherein the validation check is applied to check whether a right part of the reference template is within a valid area, and/or wherein the validation check is applied to check whether a bottom part of the reference template is within a valid area, and/or wherein if a sample of the reference template is outside a valid area, another sample within the valid area is used instead to construct the reference template, and/or wherein if at least one sample of the reference template is outside a valid area, the reference template of the non-RRIBC coded video unit is treated as unavailable, and/or wherein if at least one sample of a right part of the reference template is outside a valid area, at least one sample on rightmost M columns inside a reference block is used instead to construct the reference template, wherein M is equal to a width of the right part of the reference template, and/or wherein if at least one sample of a bottom part of the reference template is outside a valid area, at least one sample on top N rows inside a reference block is used instead to construct the reference template, wherein N is equal to a height of the bottom part of the reference template, and/or wherein if the reference template of the non-RRIBC coded video unit exceeds a valid region, at least one sample within the valid region is used instead to fill the reference template (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 9, Wang further discloses wherein a valid area is predefined by a set of rules related to coding information, and wherein the coding information comprises at least one of: a virtual pipeline data unit (VPDU) size, a largest coding unit (LCU) size, a tile boundary, a picture boundary, a slice boundary, or a tile row, and/or wherein a valid sample nearest to an invalid sample is used, and/or wherein a valid sample inside a reference block is used, and/or wherein the ARMC is not applied to the non-RRIBC coded video unit (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 10, Wang further discloses wherein the first reference template is constructed from at least one of: left samples or above samples neighboring to a reference block, and/or wherein the second reference template is constructed from at least one of bottom samples or right samples neighboring to a reference block, and/or wherein the second reference template is used to determine a template cost of the at least one RRIBC coded motion candidate, and/or wherein whether to use bottom samples or right samples neighboring to a reference block to construct a reference template of a reference lock is dependent on a flip type of the at least one RRIBC coded motion candidate, and/or wherein whether to use a second reference template or a first reference template is dependent on a flip type of a motion candidate, and/or wherein a second template is constructed from above and right samples neighboring to a reference block, and a first template is constructed from above and left samples neighboring to a current block, and/or wherein a second template is constructed from bottom and left samples neighboring to a reference block, and a first template is constructed from above and left samples neighboring to a current block, and/or wherein sample in an above part of the reference template are reordered, and/or wherein samples in a right part of the reference template are reordered, and/or wherein sample in a left part of the reference template are reordered, and/or wherein samples in a bottom part of the reference template are reordered, and/or wherein whether to reorder samples in the reference template is dependent on a flip type of a motion candidate, and/or wherein a horizontal flip processing is applied to samples in an above part of the reference template which is constructed from above samples neighboring to the reference block, and/or wherein a horizontal flip processing is applied to samples in a right part of the reference template which is constructed from right samples neighboring to the reference block, and/or wherein a vertical flip processing is applied to samples in a left part of the reference template which is constructed from left samples neighboring to the reference block, and/or wherein a vertical flip processing is applied to samples in a bottom part of the reference template which is constructed from bottom samples neighboring to the reference block, and/or wherein sample in an above part of the current template are reordered, and/or wherein samples in a left part of the current template are reordered, and/or wherein whether to reorder samples in the current template is dependent on a flip type of a motion candidate, and/or wherein a horizontal flip processing is applied to samples in an above part of the current template which is constructed from above samples neighboring to the current block, and/or wherein a horizontal flip processing is applied to samples in a left part of the reference template which is constructed from left samples neighboring to the current block, and/or wherein a vertical flip processing is applied to samples in an above part of the reference template which is constructed from above samples neighboring to the current block, and/or wherein a vertical flip processing is applied to samples in a left part of the current template which is constructed from left samples neighboring to the current block, and/or wherein at most one template is reordered, and/or wherein samples in a current template of a current block of the video unit are reordered, and samples in a reference template of a reference block of the video unit are not reordered, and/or wherein samples in a reference template of a reference block of the video unit are reordered, and samples in a current template of a current block of the video unit are not reordered, and/or wherein at least part of samples in the reference template of the video unit that is coded with the template based processing are ordered, and/or wherein at least part of samples in the current template of the video unit that is coded with the template based processing are ordered, and/or wherein at least part of samples in the reference template or at least part of samples in the current template of the video unit that is coded with the template based processing are ordered, and/or wherein samples comprise at least one of: reconstruction samples or prediction samples (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 11, Wang further discloses wherein the first reference template is used to determine a template cost of a motion candidate that is not coded with the RRIBC (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 12, Wang further discloses wherein if a width of the right part of the reference template is equal to a predefined number, the horizontal flip processing is not applied, and/or wherein if a height of the bottom part of the reference template is equal to a predefined number, the vertical flip processing is not applied (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 13, Wang further discloses wherein if a width of the left part of the current template is equal to a predefined number, the horizontal flip processing is not applied (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 14, Wang further discloses wherein if a height of the above part of the current template is equal to a predefined number, the vertical flip processing is not applied (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 15, Wang further discloses wherein if a horizontal flip processing is applied, samples in an above part of the reference template are derived as: temp[x + y * tempW] = cur[curW - 1 - x + (y - tempH) * curStride], and wherein temp represents a sample buffer of the above part of the reference template, (tempW, tempH) represents width and height of the above part of the reference template, (x,y) represents a location of a top-left sample of the above part of the reference template relative such part of the reference template, cur represents the sample buffer of the video unit, (curW, curH) represents width and height of the video unit, curStride represents a stride of the sample buffer of the video unit, or wherein if a horizontal flip processing is applied, samples in a right part of the reference template are derived as: temp[x + y * tempW] = cur[curW + tempW - 1 – x + y * curStride], and wherein temp represents a sample buffer of the right part of the reference template, (tempW, tempH) represents width and height of the right part of the reference template, (x,y) represents a location of a top-left sample of the right part of the reference template relative such part of the reference template, cur represents the sample buffer of the video unit, (curW, curH) represents width and height of the video unit, curStride represents a stride of the sample buffer of the video unit, or wherein if a vertical flip processing is applied, samples in a bottom part of the reference template are derived as: temp[x + y * tempW] = cur[x + (curH + tempH – 1 - y) * curStride] ], and wherein temp represents a sample buffer of the bottom part of the reference template, (tempW, tempH) represents width and height of the bottom part of the reference template, (x,y) represents a location of a top-left sample of the bottom part of the reference template relative such part of the reference template, cur represents the sample buffer of the video unit, (curW, curH) represents width and height of the video unit, curStride represents a stride of the sample buffer of the video unit, or wherein if a vertical flip processing is applied, samples in a left part of the reference template are derived as: temp[x + y * tempW] = cur[x - tempW + (curH - 1 – y] * curStride], and wherein temp represents a sample buffer of the left part of the reference template, (tempW, tempH) represents width and height of the left part of the reference template, (x,y) represents a location of a top-left sample of the left part of the reference template relative such part of the reference template, cur represents the sample buffer of the video unit, (curW, curH) represents width and height of the video unit, curStride represents a stride of the sample buffer of the video unit (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 16, Wang further discloses wherein if a horizontal flip processing is applied, samples in an above part of the current template are derived as: temp[x + y * tempW] = cur[curW - 1 - x + (y - tempH) * curStride], and wherein temp represents a sample buffer of the above part of the current template, (tempW, tempH) represents width and height of the above part of the current template, (x,y) represents a location of a top-left sample of the above part of the current template relative such part of the current template, cur represents the sample buffer of the video unit, (curW, curH) represents width and height of the video unit, curStride represents a stride of the sample buffer of the video unit, or wherein if a horizontal flip processing is applied, samples in a right part of the current template are derived as: temp[x + y * tempW] = cur[curW + tempW - 1 – x + y * curStride], and wherein temp represents a sample buffer of the right part of the current template, (tempW, tempH) represents width and height of the right part of the current template, (x,y) represents a location of a top-left sample of the right part of the current template relative such part of the current template, cur represents the sample buffer of the video unit, (curW, curH) represents width and height of the video unit, curStride represents a stride of the sample buffer of the video unit, or wherein if a vertical flip processing is applied, samples in a bottom part of the current template are derived as: temp[x + y * tempW] = cur[x + (curH + tempH – 1 - y) * curStride] ], and wherein temp represents a sample buffer of the bottom part of the current template, (tempW, tempH) represents width and height of the bottom part of the current template, (x,y) represents a location of a top-left sample of the bottom part of the current template relative such part of the current template, cur represents the sample buffer of the video unit, (curW, curH) represents width and height of the video unit, curStride represents a stride of the sample buffer of the video unit, or wherein if a vertical flip processing is applied, samples in a left part of the current template are derived as: temp[x + y * tempW] = cur[x - tempW + (curH - 1 – y] * curStride], and wherein temp represents a sample buffer of the left part of the current template, (tempW, tempH) represents width and height of the left part of the current template, (x,y) represents a location of a top-left sample of the left part of the current template relative such part of the current template, cur represents the sample buffer of the video unit, (curW, curH) represents width and height of the video unit, curStride represents a stride of the sample buffer of the video unit (note: these claim limitations include “and/or” and/or limitations that refer to contingent limitations that are not required to be performed to practice the claimed invention; since its base claim is met, these limitations are also met under BRI).
Regarding claim 17, Wang further discloses wherein the conversion includes encoding the video unit into the bitstream, or wherein the conversion includes decoding the video unit from the bitstream (e.g. see at least video encoder, e.g. in Fig. 2, and/or video decoder, e.g. in Fig. 3).
Regarding claim 20, Wang further discloses a non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by an apparatus for video processing, wherein the method comprises: determining whether a template based processing is applied to a video unit of the video, wherein the template based processing is based on at least one template in at least one of: a current picture or a reference picture of the video unit; and generating the bitstream based on the determining (e.g. see at least 130b in Fig. 1, paragraphs [0065]-[0066]; note: the non-transitory computer-readable recording medium merely serves as a support for the bitstream, see MPEP 2111.05. No patentable weight is given to the bitstream).
Regarding claims 18-19, the claims recite analogous limitations to the claims above and are therefore rejected on the same premise.
Conclusion
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure.
US 2024/0205386 A1, Robert et al., Intra block copy with template matching for video encoding and decoding
US 2023/0396805 A1, Le et al., Template matching prediction for versatile video coding
US 2021/0250580 A1, Chen et al., Method and apparatus of enhanced intra block copying mode, for video coding
Any inquiry concerning this communication or earlier communications from the examiner should be directed to FRANCIS G GEROLEO whose telephone number is (571)270-7206. The examiner can normally be reached M-F 7:00 am - 3:30 pm.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Anna M Momper can be reached at (571) 270-5788. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/Francis Geroleo/Primary Examiner, Art Unit 3619