DETAILED ACTION
This application has been examined. Claims 19-38 are pending. Claims 1-18 are cancelled.
In order to facilitate communication with the Examiner and expedite the prosecution of the instant application the Applicant is requested to submit written authorization to authorize the USPTO to communicate via electronic mail. The written authorization must be compliant with the language from MPEP § 502.03.
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Priority
This application claims benefits of priority from Foreign Application CN202211731258.X (CHINA) filed December 30,2022.
The effective date of the claims described in this application is December 30,2022.
Information Disclosure Statement
The information disclosure statements (IDS) submitted on 12/20/2024, 1/15/2026, 7/14/2026 is in compliance with the provisions of 37 CFR 1.97. Accordingly, the information disclosure statements are being considered by the examiner.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claim(s) 19-20,22,26-34,36,38 is/are rejected under 35 U.S.C. 103 as being unpatentable over Lira (USPGPUB 2006/0041848) further in view of DelaRosa (USPGPUB 2024/0160673)
Regarding Claim 19
Lira Figure 9A, Figure 10 A, Paragraph 102-103 disclosed wherein the sender selects the effects button 121 to begin the selection process from a host system based overlaid message template repository from a repository window 300.
Lira Paragraph 126 disclosed wherein the sender's client may enable the sender to preview the presentation of an overlaid message before to send it by changing the send button into a preview button when the generation of an overlaid message by the sender is in progress. While the overlaid message is previewed, the sender's client may enable the sender to modify the overlaid message parameters, text, and artworks and to see the changes immediately reflected in the preview.
Lira disclosed (re. Claim 19) a method of interface display, comprising: in response to input information generated in a session interface associated with a first user and at least one second user, displaying, in the session interface, a media content acquisition control matching the input information; (Lira-Figure 9A, Figure 10 A, Paragraph 103,sender selects the effects button 121 to begin the selection process from a host system based overlaid message template repository from a repository window 300.)
in response to a first triggering on the media content acquisition control, displaying a media content acquisition interface, (Lira-Figure 9A, Figure 10 A, Paragraph 103,sender selects the effects button 121 to begin the selection process from a host system based overlaid message template repository from a repository window 300.)and
displaying the input information in the media content acquisition interface; (Lira-Paragraph 107, Paragraph 114, FIG. 14A, the sender inputted the string 849, "See you for dinner---rosebud". The string "See you for dinner----rosebud" comprises the text of the overlaid message) and
acquiring a target media content generated in the media content acquisition interface,(Lira-Paragraph 101, Paragraph 126,sender can select an overlaid message template from one of the repositories to, preview, send an overlaid message, and/or add the templates another repository) and
sending the target media content into the session interface.(Lira-Paragraph 114, FIG. 14B shows the presentation 840 which is the presentation of the overlaid message inputted in FIG. 14A.)
While Lira substantially disclosed the claimed invention Lira does not disclose (re. Claim 19) a media content acquisition control matching the input information.
DelaRosa Paragraph 39 disclosed wherein augmentation system 208 provides functions related to the generation and publishing of media overlays for messages processed by the messaging system 100.
DelaRosa Paragraph 28, Paragraph 54, Paragraph 118 disclosed wherein the client device 102 can present a scan interface 700. The scan interface can present a real-time video feed from a camera of the client device 102 and/or a previously captured image or video 710. The client device 102 can provide the image or video 710 to the AR experience search system 224. The AR experience search system 224 applies the machine learning model 530 to the image or video 710 to compute or estimate one or more embeddings, such as based on an object 720 or multiple objects depicted in the image or video 710. The AR experience search system 224 can use the embeddings to identify a subset of AR experiences that are associated with embeddings corresponding to words of previously used search queries.
DelaRosa disclosed (re. Claim 19) a media content acquisition control matching the input information.( DelaRosa-,Paragraph 110, user interface 600 can present a text input region 610 in which a search query is received from the first user. The search query can include one or more words, such as coffee and machine. The search query can include a request to identify AR experiences that match the search query, Paragraph 118, client device 102 can present a scan interface 700. The scan interface can present a real-time video feed from a camera of the client device 102 and/or a previously captured image or video 710. The client device 102 can provide the image or video 710 to the AR experience search system 224. The AR experience search system 224 applies the machine learning model 530 to the image or video 710 to compute or estimate one or more embeddings, such as based on an object 720 or multiple objects depicted in the image or video 710. The AR experience search system 224 can use the embeddings to identify a subset of AR experiences that are associated with embeddings corresponding to words of previously used search queries.)
Lira and DelaRosa are analogous art because they present concepts and practices regarding animation effects for chat interfaces. Before the time of the effective filing date of the claimed invention it would have been obvious to combine DelaRosa into Lira. The motivation for the said combination would have been to enable intelligently automatically identifying AR experiences based on an input image or video without relying on a predefined taxonomy or categorization. Instead of mapping AR experiences and images to discrete tags or categories, the disclosed techniques employ an approach that directly maps images to the AR experiences through a common visual-semantic embedding space defined by a trained machine learning model. (DelaRosa-Paragraph 16)
Regarding Claim 33
Claim 33 (re. device) recites substantially similar limitations as Claim 19. Claim 33 is rejected on the same basis as Claim 19.
Regarding Claim 38
Claim 38 (re. non-transitory computer readable storage medium) recites substantially similar limitations as Claim 19. Claim 38 is rejected on the same basis as Claim 19.
Regarding Claim 20,34
Lira-DelaRosa disclosed (re. Claim 20,34) acquiring the input information generated in the session interface; detecting whether a target effect matching the input information is present, to acquire a detection result; and displaying, in the session interface, the media content acquisition control matching the detection result.(DelaRosa-Paragraph 110, the user interface 600 presents search results 620 including various AR experiences that match words of the search query.)
Regarding Claim 22,36
Lira-DelaRosa disclosed (re. Claim 22,36) in accordance with a determination that a target effect matching the input information is present, displaying a display content matching the target effect on the media content acquisition control; (Lira-Paragraph 107, Paragraph 114, FIG. 14A, the sender inputted the string 849, "See you for dinner---rosebud". The string "See you for dinner----rosebud" comprises the text of the overlaid message) or in accordance with a determination that no target effect matching the target keyword is present, displaying predetermined text information on the media content acquisition control.
Regarding Claim 26
Lira-DelaRosa disclosed (re. Claim 26) in response to a first triggering on the first media content acquisition control , (Lira-Paragraph 158, presentation transparency is typically a parameter of the overlaid message. The sender's client may enable the sender to choose the presentation degree of transparency) determining a target effect matching the input information; (Lira-Paragraph 167, a simulated presentation may be shown in a preset area of the sender's session window to show the overlaid message that is in preparation for sending, e.g. the sender has chosen the overlaid message but has not sent it yet) and displaying the target effect in the media content acquisition interface, to enable the first user to perform generation of the target media content based on the target effect. (Lira-Paragraph 107, Paragraph 114, FIG. 14A, the sender inputted the string 849, "See you for dinner---rosebud". The string "See you for dinner----rosebud" comprises the text of the overlaid message)
Regarding Claim 27
Lira-DelaRosa disclosed (re. Claim 27) wherein the media content acquisition control matching the input information comprises a second media content acquisition control, (DelaRosa-Paragraph 118, scan interface can present a real-time video feed from a camera of the client device 102 and/or a previously captured image or video 710. The client device 102 can provide the image or video 710 to the AR experience search system 224.) and displaying the media content acquisition interface in response to the first triggering on the media content acquisition control comprises: in response to a first triggering on the second media content acquisition control, displaying the media content acquisition interface, to enable the first user to perform generation of the target media content based on a predetermined original camera in the media content acquisition interface.(DelaRosa-Paragraph 118, scan interface can present a real-time video feed from a camera of the client device 102 and/or a previously captured image or video 710. The client device 102 can provide the image or video 710 to the AR experience search system 224.)
Regarding Claim 28
Lira-DelaRosa disclosed (re. Claim 28) in accordance with a determination that a target effect matching the input information is present, displaying, in a predetermined display area of the media content acquisition interface, identification information corresponding to the target effect.( Lira-Figure 17C,Paragraph 130, a left-click on the preview may bring to visibility the assistant menu 184 of FIG. 17C, from where, for example, the sender may select a different artwork, DelaRosa-Paragraph 117, the AR experience search system 224 provides identifiers of the AR experiences 516 to the client device 102.)
Regarding Claim 29
Lira-DelaRosa disclosed (re. Claim 29) in response to a triggering on the identification information corresponding to the target effect, displaying an effect list in the media content acquisition interface, wherein the effect list comprises at least one effect associated with the input information and a plurality of effects meeting a predetermined presentation condition. (Lira-Figure 17C,Paragraph 130, a left-click on the preview may bring to visibility the assistant menu 184 of FIG. 17C, from where, for example, the sender may select a different artwork.)
Regarding Claim 30
Lira-DelaRosa disclosed (re. Claim 30) displaying a predetermined number of effects associated with the input information within a first display area predetermined in the effect list, and displaying the plurality of effects meeting the predetermined presentation condition within a second display area predetermined in the effectlist.(Lira-Figure 17C,Paragraph 130, a left-click on the preview may bring to visibility the assistant menu 184 of FIG. 17C, from where, for example, the sender may select a different artwork.)
Regarding Claim 31
Lira-DelaRosa disclosed (re. Claim 31) in response to a second triggering on the media content acquisition control, displaying at least one association effect associated with the input information in the session interface; in response to a selection on the at least one association effect, determining a selected target association effect; and displaying the target association effect in the media content acquisition interface, to enable the first user to perform generation of the target media content based on the target effect. (Lira-Figure 17C,Paragraph 130, a left-click on the preview may bring to visibility the assistant menu 184 of FIG. 17C, from where, for example, the sender may select a different artwork.)
Regarding Claim 32
Lira-DelaRosa disclosed (re. Claim 32) in response to input information generated on an input control predetermined in the session interface, displaying in the session interface the media content acquisition control matching the input information, and displaying, at a display position associated with the input control, at least one association effect associated with the input information. (Lira-Figure 17C,Paragraph 130, a left-click on the preview may bring to visibility the assistant menu 184 of FIG. 17C, from where, for example, the sender may select a different artwork.)
Claim(s) 21,35 is/are rejected under 35 U.S.C. 103 as being unpatentable over Lira (USPGPUB 2006/0041848) further in view of DelaRosa (USPGPUB 2024/0160673) further in view of Gao (USPGPUB 2020/0202860)
Regarding Claim 21,35
Lira-DelaRosa disclosed (re. Claim 21,35) performing word extraction on the input information to acquire a word extraction result; determining, based on the word extraction result, a target keyword corresponding to the input information; and detecting whether a target effect matching the target keyword is present, to acquire the detection result.(DelaRosa-Paragraph 111, extract one or more words from each search query and associate the words with the AR experiences indicated as having been interacted with by a user in the metadata.
While Lira-DelaRosa substantially disclosed the claimed invention Lira-DelaRosa does not disclose (re. Claim 21,35) performing word segmentation on the input information to acquire a word segmentation result.
Gao Paragraph 6 disclosed performing word segmentation on the text, to obtain a word segmentation result.
Gao disclosed (re. Claim 21,35) performing word segmentation on the input information to acquire a word segmentation result.( Gao-Paragraph 6,performing word segmentation on the text, to obtain a word segmentation result.)
Lira and Gao are analogous art because they present concepts and practices regarding animation effects for chat interfaces. Before the time of the effective filing date of the claimed invention it would have been obvious to combine Gao into Lira. The motivation for the said combination would have been to enable controlling a terminal by voice thereby making it greatly convenient for the user to operate the terminal 102 for for querying scene information.(Gao-Paragraph 39)
Claim(s) 23-25,37 is/are rejected under 35 U.S.C. 103 as being unpatentable over Lira (USPGPUB 2006/0041848) further in view of DelaRosa (USPGPUB 2024/0160673) further in view of Crawford (USPGPUB 2014/0039871)
Regarding Claim 23,37
While Lira-DelaRosa substantially disclosed the claimed invention Lira-DelaRosa does not disclose (re. Claim 23,37) playing, in the media content acquisition interface, an audio corresponding to the input information, to enable the target media content to comprise the audio corresponding to the input information.
Crawford Paragraph 15 disclosed wherein a computer is used to precisely synchronize vocalizations with texts. Audio recordings with vocalized language segments and text transcriptions with correlating text segment are precisely synchronized, reproduced at variables speeds, and output in various presentations
Crawford disclosed (re. Claim 23,37) playing, in the media content acquisition interface, an audio corresponding to the input information, to enable the target media content to comprise the audio corresponding to the input information.( Crawford-Paragraph 15, precisely synchronize vocalizations with texts. Audio recordings with vocalized language segments and text transcriptions with correlating text segment are precisely synchronized, reproduced at variables speeds, and output in various presentations)
Lira and Crawford are analogous art because they present concepts and practices regarding animation effects for chat interfaces. Before the time of the effective filing date of the claimed invention it would have been obvious to combine Crawford into Lira. The motivation for the said combination would have been to enable Syllabic stress and emphasis to be defined , and also control the styling of atypically emphasizes syllables. Stress and emphasis can then be included in output presentations (Crawford-Paragraph 41)
Regarding Claim 24
Lira-DelaRosa-Crawford disclosed (re. Claim 24) in response to a triggering on a predetermined adjustment control, adjusting an audio parameter of the audio corresponding to the input information, wherein the audio parameter comprises one or more of: a timbre parameter, a play speed parameter, or a tone parameter.(Crawford-Paragraph 19, Audio playback speed is controlled. When timing pre-recorded audio vocalizations, recordings are played back at variable speeds.)
Regarding Claim 25
Lira-DelaRosa-Crawford disclosed (re. Claim 25) wherein after playing in the media content acquisition interface the audio corresponding to the input information, the method further comprises: in response to a triggering on a predetermined closing control, stopping playing the audio corresponding to the input information.(Crawford-Paragraph 196,Paragraph 198, The segments of text are thus prepared to be synchronized with an audio recording. When the first pause or syllable is invoked, its timing end-point is defined, as is the timing in point for the next pause or syllable, which only then is made actionable. Thus, each pause and syllable is prepared to be timed and assembled into a series that accurately synchronizes the parts of the text with the correlated parts of the audio recording.)
Conclusion
Examiner’s Note: In the case of amending the claimed invention, Applicant is respectfully requested to indicate the portion(s) of the specification which dictate(s) the structure relied on for proper interpretation and also to verify and ascertain the metes and bounds of the claimed invention.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to GREG C BENGZON whose telephone number is (571)272-3944. The examiner can normally be reached on Monday - Friday 8 AM - 4:30 PM.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, John Follansbee can be reached on (571) 272-3964. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of an application may be obtained from the Patent Application Information Retrieval (PAIR) system. Status information for published applications may be obtained from either Private PAIR or Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative or access to the automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/GREG C BENGZON/ Primary Examiner, Art Unit 2444
Prosecution Insights