DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claim Objections
Claim 8 is objected to because of the following informalities: “any one of claim 2” should be “claim 2”. Appropriate correction is required.
Claim Rejections - 35 USC § 102
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(2) the claimed invention was described in a patent issued under section 151, or in an application for patent published or deemed published under section 122(b), in which the patent or application, as the case may be, names another inventor and was effectively filed before the effective filing date of the claimed invention.
Claims 1-3, 5-7, 9-16, 18-20 are rejected under 35 U.S.C. 102(a)(2) as being anticipated by CIPOLLI et al. (US 20070206673 A1).
Regarding claim 1. CIPOLLI discloses A video encoding method (figure 6, video encoder), wherein the method comprises:
encoding video information, wherein the video information comprises M frames ([0074] Video encoder 600 may, for example, be a motion-compensated, block-based transform coder; [0075] Standard block-based motion compensated codecs have a regular structure of I, P, and B frames), the M frames comprise a first frame, a second frame, and a third frame, the second frame refers to the first frame, and the third frame refers to the second frame or the first frame ([0075] For example, in a picture sequence (in display order) such as IBBPBBP, the `P` frames are predicted from the previous P or I frame, whereas the B pictures are predicted using both the previous and next P or I frame);
storing the first frame, the second frame, and the third frame in a buffer to obtain candidates of a long-term reference frame ([0075] The FRAME BUFFERS block 610 in FIG. 6 represents the memory that stores the reference picture list(s); [0091] the LR pictures may, for example, be stored at a decoder as long-term reference pictures); and
selecting a subset from the candidates as the long-term reference frame ([0091] the LR pictures may, for example, be stored at a decoder as long-term reference pictures).
Regarding claim 2. CIPOLLI discloses The method according to claim 1, wherein selecting the subset from the candidates comprises:
determining, based on a feedback signal, to select one or more of the first frame, the second frame, and the third frame from the candidates as the long-term reference frame, wherein the feedback signal indicates whether a receiver successfully performs receiving ([0103] Using RTCP or other feedback mechanisms, the sender can be notified that a particular receiver is experiencing lost packets; [0091] the LR pictures may, for example, be stored at a decoder as long-term reference pictures; [0095] FIG. 14 shows a preferred mechanism or protocol 1400 for the reliable delivery of the LR frames. Protocol 1400 employs a positive acknowledgment (ACK) message based mechanism to indicate to a sender (e.g., SENDER, SVCS1, or SVCS2) that a particular LR picture has been received by an intended receiver (e.g., SVCS1, SVCS2, or RECEIVER); [0100] the use the transmitted frame as a reference picture is facilitated by marking candidate transmitted pictures as long-term reference pictures).
Regarding claim 3. CIPOLLI discloses The method according to claim 1, wherein the encoding is layered encoding (abstract, The video communication systems are based on scalable video), and wherein selecting the subset from the candidates comprises:
selecting a layer from the long-term reference frame as the long-term reference frame ([0088] FIG. 12 shows an exemplary picture coding structure 1200 in which the L0 base and L1-L2 temporal enhancement layers are coupled with at least one reliably transmitted base layer picture for error resilient video communications. In coding structure 1200, in addition to conventional base and enhancement picture types that are labeled as L0-L2 pictures, there is a new picture type called LR (`R` for reliable); [0091] the LR pictures may, for example, be stored at a decoder as long-term reference pictures).
Regarding claim 5. CIPOLLI discloses The method according to claim 3, wherein each of the M frames comprises a basic layer and an enhancement layer ([0079] FIG. 11 shows an example of a threaded coding structure 1100 for spatial scalability. Coding structure 1100 includes threads for enhancement layers, which are denoted by the letter `S`. It will be noted that the enhancement layer frames may have a different threading structure than the base layer frames), and encoding at the enhancement layer in each frame refers to a lower layer in a same frame and a same layer in a previous frame (figure 11, S0, S1, or S2 refers to a lower layer in a same frame and a same layer in a previous frame).
Regarding claim 6. CIPOLLI discloses The method according to claim 1, wherein the method further comprises:
adding a first mark to the video information, wherein the first mark indicates frame information or layer information of the candidates of the long-term reference frame ([0075] It is possible to select which pictures are used for references and also which references are used for a particular picture that is to be coded. The FRAME BUFFERS block 610 in FIG. 6 represents the memory that stores the reference picture list(s), whereas ENC REF CONTROL 620 determines--at the encoder side--which reference picture is to be used for the current picture).
Regarding claim 7. CIPOLLI discloses The method according to claim 1, wherein the method further comprises:
adding a second mark to the video information, wherein the second mark indicates frame information or layer information of the long-term reference frame ([0100] the use the transmitted frame as a reference picture is facilitated by marking candidate transmitted pictures as long-term reference pictures).
Regarding claim 9. CIPOLLI discloses The method according to claim 2, wherein the feedback signal comprises candidate information of the long-term reference frame that is successfully received ([0103] Using RTCP or other feedback mechanisms, the sender can be notified that a particular receiver is experiencing lost packets; [0091] the LR pictures may, for example, be stored at a decoder as long-term reference pictures; [0095] FIG. 14 shows a preferred mechanism or protocol 1400 for the reliable delivery of the LR frames. Protocol 1400 employs a positive acknowledgment (ACK) message based mechanism to indicate to a sender (e.g., SENDER, SVCS1, or SVCS2) that a particular LR picture has been received by an intended receiver (e.g., SVCS1, SVCS2, or RECEIVER); [0100] the use the transmitted frame as a reference picture is facilitated by marking candidate transmitted pictures as long-term reference pictures), and wherein the method further comprises:
determining and updating the long-term reference frame based on the candidate information ([0103] Using RTCP or other feedback mechanisms, the sender can be notified that a particular receiver is experiencing lost packets; [0091] the LR pictures may, for example, be stored at a decoder as long-term reference pictures; [0095] FIG. 14 shows a preferred mechanism or protocol 1400 for the reliable delivery of the LR frames. Protocol 1400 employs a positive acknowledgment (ACK) message based mechanism to indicate to a sender (e.g., SENDER, SVCS1, or SVCS2) that a particular LR picture has been received by an intended receiver (e.g., SVCS1, SVCS2, or RECEIVER); [0100] the use the transmitted frame as a reference picture is facilitated by marking candidate transmitted pictures as long-term reference pictures).
Regarding claim 10. CIPOLLI discloses The method according to claim 8, wherein the method further comprises:
determining, based on candidate information of the long-term reference frame in each of a plurality of feedback signals, candidate information of the long-term reference frame successfully received on a plurality of channels (abstract, A set of video frames or pictures in a video signal transmission is designated for reliable or guaranteed delivery to receivers; [0095] After a sender receives positive acknowledgments for receipt of a particular frame in a transmitted stream from all receivers, then the video communication system can designate this frame as an LR frame; [0103] Using RTCP or other feedback mechanisms, the sender can be notified that a particular receiver is experiencing lost packets; [0091] the LR pictures may, for example, be stored at a decoder as long-term reference pictures; [0095] FIG. 14 shows a preferred mechanism or protocol 1400 for the reliable delivery of the LR frames. Protocol 1400 employs a positive acknowledgment (ACK) message based mechanism to indicate to a sender (e.g., SENDER, SVCS1, or SVCS2) that a particular LR picture has been received by an intended receiver (e.g., SVCS1, SVCS2, or RECEIVER); [0100] the use the transmitted frame as a reference picture is facilitated by marking candidate transmitted pictures as long-term reference pictures)); and
determining and updating the long-term reference frame based on the candidate information successfully received on the plurality of channels (abstract, A set of video frames or pictures in a video signal transmission is designated for reliable or guaranteed delivery to receivers; [0095] After a sender receives positive acknowledgments for receipt of a particular frame in a transmitted stream from all receivers, then the video communication system can designate this frame as an LR frame; [0103] Using RTCP or other feedback mechanisms, the sender can be notified that a particular receiver is experiencing lost packets; [0091] the LR pictures may, for example, be stored at a decoder as long-term reference pictures; [0095] FIG. 14 shows a preferred mechanism or protocol 1400 for the reliable delivery of the LR frames. Protocol 1400 employs a positive acknowledgment (ACK) message based mechanism to indicate to a sender (e.g., SENDER, SVCS1, or SVCS2) that a particular LR picture has been received by an intended receiver (e.g., SVCS1, SVCS2, or RECEIVER); [0100] the use the transmitted frame as a reference picture is facilitated by marking candidate transmitted pictures as long-term reference pictures)).
Regarding claim 11. CIPOLLI discloses The method according to claim 2, wherein a latest determined long-term reference frame is used based on the feedback signal ([0104] When positive acknowledgments are used, and in order to enable a receiver who has experienced lost packets to resynchronize to the coded bitstream, the sender can elect to encode a current frame using the most recent LR picture as a reference picture. With the knowledge that this LR picture has been reliably received, the sender can encode the current picture as a P picture using the LR picture as a reference).
Regarding claim 12. CIPOLLI discloses The method according to claim 1, wherein the method further comprises:
determining, according to a pre-determined rule, to select the subset from the candidates as the long-term reference frame ([0091] the LR pictures may, for example, be stored at a decoder as long-term reference pictures).
Regarding claim 13. The method according to claim 1, wherein storing the first frame, the second frame, and the third frame in the buffer comprises:
storing frame quantities of the first frame, the second frame, and the third frame and location information of frames in the buffer, wherein the location information comprises frame information or layer information of the first frame, the second frame, and the third frame ([0075] The FRAME BUFFERS block 610 in FIG. 6 represents the memory that stores the reference picture list(s)).
Regarding claim 14, the same analysis has been stated in claim 1.
Regarding claim 15, the same analysis has been stated in claim 2.
Regarding claim 16, the same analysis has been stated in claim 3.
Regarding claim 18, the same analysis has been stated in claim 5.
Regarding claim 19, the same analysis has been stated in claim 6.
Regarding claim 20, the same analysis has been stated in claim 1.
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
This application currently names joint inventors. In considering patentability of the claims the examiner presumes that the subject matter of the various claims was commonly owned as of the effective filing date of the claimed invention(s) absent any evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1.56 to point out the inventor and effective filing dates of each claim that was not commonly owned as of the effective filing date of the later invention in order for the examiner to consider the applicability of 35 U.S.C. 102(b)(2)(C) for any potential 35 U.S.C. 102(a)(2) prior art against the later invention.
Claims 4, 17 are rejected under 35 U.S.C. 103 as being unpatentable over CIPOLLI et al. (US 20070206673 A1) in view of Hannuksela et al. (US 20080260047 A1).
Regarding claim 4. CIPOLLI discloses The method according to claim 3, wherein each of the M frames comprises a basic layer and an enhancement layer ([0079] FIG. 11 shows an example of a threaded coding structure 1100 for spatial scalability. Coding structure 1100 includes threads for enhancement layers, which are denoted by the letter `S`. It will be noted that the enhancement layer frames may have a different threading structure than the base layer frames), and
Hannuksela discloses encoding at the basic layer in each frame refers to an enhancement layer in the long-term reference frame ([0071] either the base representation or the enhancement representation can be used for inter prediction. The decision, whether the base representation or the enhancement representation is used, can be based on which representation provides better coding efficiency).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to combine the inventions of CIPOLLI and Hannuksela, to use enhancement layers as references for inter prediction, in order to provide better coding efficiency (Hannuksela [0071]).
Regarding claim 17, the same analysis has been stated in claim 4.
Claim 8 is rejected under 35 U.S.C. 103 as being unpatentable over CIPOLLI et al. (US 20070206673 A1) in view of Buttimer et al. (US 20080247463 A1).
Regarding claim 8. Buttimer discloses a frame delay of the feedback signal is at least M frames ([0052] Each decoder of a plurality of decoders at the one or more destinations is operable to send messages back to the encoder with the information about whether it correctly received (ACK) or did not receive (NACK) each packet, the round trip time for the encoder to receive this feedback is typically in the range of 300 to 400 ms, that is 6 to 12 video frames at 30 frames per second).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to combine the inventions of CIPOLLI and Buttimer.
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to XIAOLAN XU whose telephone number is (571)270-7580. The examiner can normally be reached Mon. to Fri. 9am-5pm.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, SATH V. PERUNGAVOOR can be reached at (571) 272-7455. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/XIAOLAN XU/Primary Examiner, Art Unit 2488