Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Continued Examination Under 37 CFR 1.114
A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 05/18/2026 has been entered.
DETAILED ACTION
Claims 1-12, 15, 16 and 19-24 are pending and have been examined.
Response to Arguments
Applicant’s arguments with respect to claims 1-12, 15, 16 and 19-24 have been considered but are moot because the new ground of rejection does not rely on any reference applied in the prior rejection of record for any teaching or matter specifically challenged in the argument.
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1, 2, 4, 6, 7, 10, 15, 16, 19, 21, 22 and 24 are rejected under 35 U.S.C. 103 as being unpatentable over Zhang et al. (US 2025/0088679), herein Zhang, in view of Wang et al. (US 2019/0124400), herein Wang, in view of Zukerman et al. (US 2018/0190322), herein Zukerman.
Consider claim 1, Zhang clearly teaches an image processing method, applied to a first client, (Fig. 1) comprising:
obtaining, in response to an operation of adding a sticker image to a live stream, a locator corresponding to the sticker image, wherein the adding the sticker image to the live stream comprises displaying the sticker image in one or more frames of the live stream; (Fig. 1: In response to an effect trigger instruction during a live stream, first effect information, including effect identification information, is obtained and displayed in frames of the live stream, [0056], [0061], [0077], [0078].)
determining a frame of the one or more frames corresponding to the sticker image in the live stream based on determining that the frame comprises image feature information of the sticker image; (First time information corresponding to the effect trigger is determined and used to determine a frame corresponding to the effect in the live stream, [0074], [0076].)
obtaining a frame identifier of the frame, wherein the frame identifier comprises image feature information of the frame; (Fig. 1: A timestamp comprising the time of the effect trigger is used to identify the frame, [0064], [0074], [0077].)
determining display position information of the sticker image in the frame; (Fig. 1: First effect information includes location information of a target object or a preset position for displaying the effect, [0067], [0068].) and
sending a sticker addition information to a second client that is viewing the live stream, wherein the sticker addition information comprises the frame identifier, the locator, and the display position information. (Fig. 1: The first effect information, including the effect identification information, first image frame timestamp, and location information for displaying the effect, is sent to the first viewing client, [0069], [0070], [0077].)
However, Zhang does not explicitly teach a uniform resource locator (URL) corresponding to the sticker image; sending the URL.
In an analogous art, Wang, which discloses a system for video distribution, clearly teaches a uniform resource locator (URL) corresponding to the sticker image; sending the URL. (Fig. 13: A URL of an image is generated and sent to the client devices, [0174]-[0185].)
Therefore, before the effective filing date of the claimed invention, it would have been obvious to one with ordinary skill in the art to modify the system of Zhang by a uniform resource locator (URL) corresponding to the sticker image; sending the URL, as taught by Wang, to achieve the predictable result of allowing the client device to retrieve the effect.
However, Zhang combined with Wang does not explicitly teach wherein the image feature information is indicative that the sticker image is in the frame.
In an analogous art, Zukerman, which discloses a system for video distribution, clearly teaches the image feature information is indicative that the sticker image is in the frame. (The video includes metadata identifying the sticker and frames in which the sticker appears, [0054].)
Therefore, before the effective filing date of the claimed invention, it would have been obvious to one with ordinary skill in the art to modify the system of Zhang combined with Wang by the image feature information is indicative that the sticker image is in the frame, as taught by Zukerman, to achieve the predictable result of inserting the sticker into the video.
Consider claim 2, Zhang combined with Wang and Zukerman clearly teaches the determining a frame corresponding to the sticker image in the live stream comprises: detecting whether each live streaming video frame in the live stream contains the sticker image; and in response to that a live streaming video frame contains the sticker image, determining the live streaming video frame as the frame. (Fig. 1: First time information corresponding to the effect trigger operation is used to determine the first image frame and the client device displays the effect based on the frame information, [0064], [0072], [0074] Zhang.)
Consider claim 4, Zhang combined with Wang and Zukerman clearly teaches determining the display position information of the sticker image in the frame comprises: identifying a target reference identifier area in the frame that meets a preset selection condition; and determining relative position information of the sticker image relative to the target reference identifier area as the display position information. (Fig. 4: The first effect information may be fused with a target object in the live stream content, [0067], [0071], [0098]-[0104] Zhang.)
Consider claim 6, Zhang clearly teaches an image processing method, (Fig. 1) comprising:
extracting, in response to a sticker addition information sent by a server, a frame identifier comprising image feature information of a frame, a locator, and display position information from the sticker addition message information; (Fig. 1: In response to an effect trigger instruction first effect information, including effect identification information, first image frame timestamp, and location information for displaying the effect, is obtained, [0061], [0064], [0067], [0068], [0074], [0078].)
obtaining the sticker image based on the locator, and determining the target in a viewing video stream based on the frame identifier; and
displaying the sticker image in the frame based on the display position information. (Fig. 1: The first effect information, including the effect identification information, first image frame, and location information for displaying the effect, is sent to the first client and the effect is displayed based on the first effect information, [0069]-[0072].)
However, Zhang does not explicitly teach extracting a URL and obtaining an image based on the URL.
In an analogous art, Wang, which discloses a system for video distribution, clearly teaches extracting a URL and obtaining an image based on the URL. (Fig. 13: A URL of an image is generated and sent to the client devices, [0174]-[0185].)
Therefore, before the effective filing date of the claimed invention, it would have been obvious to one with ordinary skill in the art to modify the system of Zhang by extracting a URL and obtaining an image based on the URL, as taught by Wang, to achieve the predictable result of allowing the client device to retrieve the effect.
However, Zhang combined with Wang does not explicitly teach wherein the image feature information is indicative that a sticker image associated with the sticker addition information is displayed at a video frame of a stream.
In an analogous art, Zukerman, which discloses a system for video distribution, clearly teaches wherein the image feature information is indicative that a sticker image associated with the sticker addition information is displayed at a video frame of a stream. (The video includes metadata identifying the sticker and frames in which the sticker appears, [0054].)
Therefore, before the effective filing date of the claimed invention, it would have been obvious to one with ordinary skill in the art to modify the system of Zhang combined with Wang by wherein the image feature information is indicative that a sticker image associated with the sticker addition information is displayed at a video frame of a stream, as taught by Zukerman, to achieve the predictable result of inserting the sticker into the video.
Consider claim 7, Zhang combined with Wang and Zukerman clearly teaches the determining frame based on the frame identifier comprises: obtaining a viewing video frame identifier of each viewing video frame in the viewing video stream; and performing matching between the frame identifier and the viewing video frame identifier, and determining a successfully matched viewing video frame as the frame. (Fig. 1: First time information corresponding to the effect trigger operation is used to determine the first image frame and the client device displays the effect based on the frame information, [0064], [0072], [0074] Zhang.)
Consider claim 10, Zhang combined with Wang and Zukerman clearly teaches displaying the sticker image in the frame based on the display position information comprises adding the sticker image to the frame based on the display position information by: in response to that the display position information comprises relative position information of the sticker image relative to a reference identifier area in a frame, identifying the reference identifier area in the viewing video frame; and displaying the sticker image in the frame based on the relative position information and the reference identifier area in the viewing video frame. (Fig. 4: The first effect information may be fused with a target object in the live stream content, [0067], [0071], [0098]-[0104] Zhang.)
Consider claim 15, Zhang clearly teaches an electronic device, comprising:
a processor; and a memory configured to store instructions executable by the processor, wherein the processor is configured to read the executable instructions from the memory, and execute the executable instructions to implement an image processing method (Fig. 14, [0167]) comprising:
obtaining by a first client, in response to an operation of adding a sticker image to a live stream, a locator corresponding to the sticker image, wherein the adding the sticker image to the live stream comprises displaying the sticker image in one or more frames of the live stream; (Fig. 1: In response to an effect trigger instruction during a live stream, first effect information, including effect identification information, is obtained, [0056], [0061], [0077], [0078].)
determining a frame of the one or more frames corresponding to the sticker image in the live stream based on determining that the frame comprises image feature information of the sticker image; (First time information corresponding to the effect trigger is determined and used to determine a frame corresponding to the effect in the live stream, [0074], [0076].)
obtaining a frame identifier of the frame, wherein the frame identifier comprises image feature information of the frame; (Fig. 1: A timestamp comprising the time of the effect trigger is used to identify the frame, [0064], [0074], [0077].)
determining display position information of the sticker image in the frame; (Fig. 1: First effect information includes location information of a target object or a preset position for displaying the effect, [0067], [0068].) and
sending a sticker addition information to a second client that is viewing the live stream, wherein the sticker addition information comprises the frame identifier, the locator, and the display position information. (Fig. 1: The first effect information, including the effect identification information, first image frame timestamp, and location information for displaying the effect, is sent to the first viewing client, [0069], [0070], [0077].)
However, Zhang does not explicitly teach a uniform resource locator (URL) corresponding to the sticker image; sending the URL.
In an analogous art, Wang, which discloses a system for video distribution, clearly teaches a uniform resource locator (URL) corresponding to the sticker image; sending the URL. (Fig. 13: A URL of an image is generated and sent to the client devices, [0174]-[0185].)
Therefore, before the effective filing date of the claimed invention, it would have been obvious to one with ordinary skill in the art to modify the system of Zhang by a uniform resource locator (URL) corresponding to the sticker image; sending the URL, as taught by Wang, to achieve the predictable result of allowing the client device to retrieve the effect.
However, Zhang combined with Wang does not explicitly teach wherein the image feature information is indicative that the sticker image is in the frame.
In an analogous art, Zukerman, which discloses a system for video distribution, clearly teaches the image feature information is indicative that the sticker image is in the frame. (The video includes metadata identifying the sticker and frames in which the sticker appears, [0054].)
Therefore, before the effective filing date of the claimed invention, it would have been obvious to one with ordinary skill in the art to modify the system of Zhang combined with Wang by the image feature information is indicative that the sticker image is in the frame, as taught by Zukerman, to achieve the predictable result of inserting the sticker into the video.
Consider claim 16, Zhang clearly teaches a non-transitory computer-readable storage medium having a computer program stored thereon, wherein the computer program is configured to perform an image processing method (Fig. 14, [0167]) comprising:
obtaining by a first client, in response to an operation of adding a sticker image to a live stream, a locator corresponding to the sticker image, wherein the adding the sticker image to the live stream comprises displaying the sticker image in one or more frames of the live stream; (Fig. 1: In response to an effect trigger instruction during a live stream, first effect information, including effect identification information, is obtained, [0056], [0061], [0077], [0078].)
determining a frame of the one or more frames corresponding to the sticker image in the live stream based on determining that the frame comprises image feature information of the sticker image; (First time information corresponding to the effect trigger is determined and used to determine a frame corresponding to the effect in the live stream, [0074], [0076].)
obtaining a frame identifier of the frame, wherein the frame identifier comprises image feature information of the frame; (Fig. 1: A timestamp comprising the time of the effect trigger is used to identify the frame, [0064], [0074], [0077].)
determining display position information of the sticker image in the frame; (Fig. 1: First effect information includes location information of a target object or a preset position for displaying the effect, [0067], [0068].) and
sending a sticker addition information to a second client that is viewing the live stream, wherein the sticker addition information comprises the frame identifier, the locator, and the display position information. (Fig. 1: The first effect information, including the effect identification information, first image frame timestamp, and location information for displaying the effect, is sent to the first viewing client, [0069], [0070], [0077].)
However, Zhang does not explicitly teach a uniform resource locator (URL) corresponding to the sticker image; sending the URL.
In an analogous art, Wang, which discloses a system for video distribution, clearly teaches a uniform resource locator (URL) corresponding to the sticker image; sending the URL. (Fig. 13: A URL of an image is generated and sent to the client devices, [0174]-[0185].)
Therefore, before the effective filing date of the claimed invention, it would have been obvious to one with ordinary skill in the art to modify the system of Zhang by a uniform resource locator (URL) corresponding to the sticker image; sending the URL, as taught by Wang, to achieve the predictable result of allowing the client device to retrieve the effect.
However, Zhang combined with Wang does not explicitly teach wherein the image feature information is indicative that the sticker image is in the frame.
In an analogous art, Zukerman, which discloses a system for video distribution, clearly teaches the image feature information is indicative that the sticker image is in the frame. (The video includes metadata identifying the sticker and frames in which the sticker appears, [0054].)
Therefore, before the effective filing date of the claimed invention, it would have been obvious to one with ordinary skill in the art to modify the system of Zhang combined with Wang by the image feature information is indicative that the sticker image is in the frame, as taught by Zukerman, to achieve the predictable result of inserting the sticker into the video.
Consider claim 19, Zhang combined with Wang and Zukerman clearly teaches the determining a frame corresponding to the sticker image in the live stream comprises: detecting whether each live streaming video frame in the live stream contains the sticker image; and in response to that a live streaming video frame contains the sticker image, determining the live streaming video frame as the frame. (Fig. 1: First time information corresponding to the effect trigger operation is used to determine the first image frame and the client device displays the effect based on the frame information, [0064], [0072], [0074] Zhang.)
Consider claim 21, Zhang combined with Wang and Zukerman clearly teaches determining display position information of the sticker image in the frame comprises: identifying a target reference identifier area in the frame that meets a preset selection condition; and determining relative position information of the sticker image relative to the target reference identifier area as the display position information. (Fig. 4: The first effect information may be fused with a target object in the live stream content, [0067], [0071], [0098]-[0104] Zhang.)
Consider claim 22, Zhang combined with Wang and Zukerman clearly teaches the determining a frame corresponding to the sticker image in the live stream comprises: detecting whether each live streaming video frame in the live stream contains the sticker image; and in response to that a live streaming video frame contains the sticker image, determining the live streaming video frame as the frame. (Fig. 1: First time information corresponding to the effect trigger operation is used to determine the first image frame and the client device displays the effect based on the frame information, [0064], [0072], [0074] Zhang.)
Consider claim 24, Zhang combined with Wang and Zukerman clearly teaches the sending a sticker addition information comprises: sending the sticker addition information to a server, which forwards the sticker addition information to the second client for displaying the sticker image. (Fig. 9: First effect information is transmitted to the client via a server, [0133]-[0138] Zhang.)
Claims 3, 5, 8, 9, 11, 12, 20 and 23 are rejected under 35 U.S.C. 103 as being unpatentable over Zhang et al. (US 2025/0088679) in view of Wang et al. (US 2019/0124400) in view of Zukerman et al. (US 2018/0190322) in view of Mu (US 2018/0098028).
Consider claim 3, Zhang combined with Wang and Zukerman clearly teaches determining the display position information of the sticker image in the frame. (Fig. 1: First effect information includes location information for displaying the effect, [0067], [0068] Zhang.)
However, Zhang combined with Wang and Zukerman does not explicitly teach determining first display coordinate information of the sticker image in a live streaming video display area of the frame; determining first display size information of the live streaming video display area; determining coordinate proportion information based on the first display coordinate information and the first display size information; and determining the display position information based on the coordinate proportion information.
In an analogous art, Mu, which discloses a system for video distribution, clearly teaches:
determining first display coordinate information of the sticker image in a live streaming video display area of the frame; (Fig. 2: The first position where the user taps the screen is determined, [0033].)
determining first display size information of the live streaming video display area; (The screen of the first terminal is divided into a 100x100 grid, [0040].)
determining coordinate proportion information based on the first display coordinate information and the first display size information; (When a user performs an operation in a grid whose coordinates are (50, 50), then (50, 50) is determined as the first position, [0040], [0080].) and
determining the display position information based on the coordinate proportion information. (The screen of the second terminal is divided into a 100x100 grid and the second position is determined to be the coordinates (50,50), [0041], [0081].)
Therefore, before the effective filing date of the claimed invention, it would have been obvious to one with ordinary skill in the art to modify the system of Zhang combined with Wang and Zukerman by determining first display coordinate information of the sticker image in a live streaming video display area of the frame; determining first display size information of the live streaming video display area; determining coordinate proportion information based on the first display coordinate information and the first display size information; and determining the display position information based on the coordinate proportion information, as taught by Mu, for the benefit of adapting to different terminal screen sizes.
Consider claim 5, Zhang combined with Wang, Zukerman and Mu clearly teaches before sending the sticker addition information, obtaining second display size information of the sticker image in the frame; and updating the sticker addition information based on the second display size information. (Fig. 6: The size of the target virtual article is determined to increase based on the user input, [0045], [0047], [0048] Mu.)
Consider claim 8, Zhang combined with Wang, Zukerman and Mu clearly teaches displaying the sticker image in the frame based on the display position information comprises adding the sticker image to the target frame based on the display position information (Fig. 1: First effect information includes location information for displaying the effect, [0067], [0068] Zhang.) by: in response to that the display position information comprises coordinate proportion information between coordinates of the sticker image and a size of a corresponding live streaming video display area, (The screen of the first terminal is divided into a 100x100 grid, when a user performs an operation in a grid whose coordinates are (50, 50), then (50, 50) is determined as the first position, [0040], [0080] Mu.) obtaining third display size information of a viewing video display area corresponding to the frame; determining second display coordinate information based on the third display size information and the coordinate proportion information; and displaying the sticker image in the frame based on the second display coordinate information. (The screen of the second terminal is divided into a 100x100 grid and the second position is determined to be the coordinates (50,50), [0041], [0081] Mu.)
Consider claim 9, Zhang combined with Wang, Zukerman and Mu clearly teaches the coordinate proportion information is determined based on first display coordinate information of the sticker image in a live streaming video display area of a frame and first display size information of a live streaming video display area of a live streaming client. (The screen of the first terminal is divided into a 100x100 grid, when a user performs an operation in a grid whose coordinates are (50, 50), then (50, 50) is determined as the first position, [0040], [0080] Mu.)
Consider claim 11, Zhang combined with Wang, Zukerman and Mu clearly teaches in response to that the sticker addition information further comprises fourth display size information of the sticker image, before the displaying the display information of the sticker image in the frame based on the display information, adjusting size information of the sticker image based on the fourth display size information. (Fig. 6: The size of the target virtual article can be increased, [0045], [0047], [0048] Mu.)
Consider claim 12, Zhang combined with Wang, Zukerman and Mu clearly teaches the fourth display size information is display size information of the sticker image in the frame. (Fig. 6: The size of the target virtual article can be increased, [0045], [0047], [0048] Mu.)
Consider claim 20, Zhang combined with Wang, Zukerman and Mu clearly teaches determining display information of the sticker image in the frame (Fig. 1: First effect information includes location information for displaying the effect, [0067], [0068] Zhang.) comprises: determining first display coordinate information of the sticker image in a live streaming video display area of the frame; (Fig. 2: The first position where the user taps the screen is determined, [0033] Mu.) determining first display size information of the live streaming video display area; (The screen of the first terminal is divided into a 100x100 grid, [0040] Mu.) determining coordinate proportion information based on the first display coordinate information and the first display size information; (When a user performs an operation in a grid whose coordinates are (50, 50), then (50, 50) is determined as the first position, [0040], [0080] Mu.) and determining the display position information based on the coordinate proportion information. (The screen of the second terminal is divided into a 100x100 grid and the second position is determined to be the coordinates (50,50), [0041], [0081] Mu.)
Consider claim 23, Zhang combined with Wang, Zukerman and Mu clearly teaches determining display position information of the sticker image in the frame (Fig. 1: First effect information includes location information for displaying the effect, [0067], [0068] Zhang.) comprises: determining first display coordinate information of the sticker image in a live streaming video display area of the frame; (Fig. 2: The first position where the user taps the screen is determined, [0033] Mu.) determining first display size information of the live streaming video display area; (The screen of the first terminal is divided into a 100x100 grid, [0040] Mu.) determining coordinate proportion information based on the first display coordinate information and the first display size information; (When a user performs an operation in a grid whose coordinates are (50, 50), then (50, 50) is determined as the first position, [0040], [0080] Mu.) and determining the display position information based on the coordinate proportion information. (The screen of the second terminal is divided into a 100x100 grid and the second position is determined to be the coordinates (50,50), [0041], [0081] Mu.)
Conclusion
In the case of amending the claimed invention, applicant is respectfully requested to indicate the portion(s) of the specification which dictate(s) the structure relied on for proper interpretation and also to verify and ascertain the metes and bounds of the claimed invention.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to JOHN R SCHNURR whose telephone number is (571)270-1458. The examiner can normally be reached M-F 6a-4p.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Brian Pendleton can be reached at (571)272-7527. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/JOHN R SCHNURR/ Primary Examiner, Art Unit 2425
Prosecution Insights