Prosecution Insights
Last updated: July 17, 2026
Application No. 18/969,990

AUGMENTED REALITY SPEECH BALLOON SYSTEM

Non-Final OA §DP
Filed
Dec 05, 2024
Priority
Feb 20, 2017 — continuation of 10/074,381 +4 more
Examiner
CHAWAN, VIJAY B
Art Unit
Tech Center
Assignee
Snap Inc.
OA Round
1 (Non-Final)
88%
Grant Probability
Favorable
1-2
OA Rounds
11m
Est. Remaining
99%
With Interview

Examiner Intelligence

Grants 88% — above average
88%
Career Allowance Rate
787 granted / 893 resolved
+28.1% vs TC avg
Moderate +11% lift
Without
With
+11.4%
Interview Lift
resolved cases with interview
Typical timeline
2y 6m
Avg Prosecution
11 currently pending
Career history
910
Total Applications
across all art units

Statute-Specific Performance

§101
11.6%
-28.4% vs TC avg
§103
23.1%
-16.9% vs TC avg
§102
48.5%
+8.5% vs TC avg
§112
1.9%
-38.1% vs TC avg
Black line = Tech Center average estimate • Based on career data from 893 resolved cases

Office Action

§DP
CTNF 18/969,990 CTNF 73109 DETAILED ACTION Notice of Pre-AIA or AIA Status 07-03-aia AIA 15-10-aia The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA. Double Patenting 08-33 AIA The nonstatutory double patenting rejection is based on a judicially created doctrine grounded in public policy (a policy reflected in the statute) so as to prevent the unjustified or improper timewise extension of the “right to exclude” granted by a patent and to prevent possible harassment by multiple assignees. A nonstatutory double patenting rejection is appropriate where the conflicting claims are not identical, but at least one examined application claim is not patentably distinct from the reference claim(s) because the examined application claim is either anticipated by, or would have been obvious over, the reference claim(s). See, e.g., In re Berg , 140 F.3d 1428, 46 USPQ2d 1226 (Fed. Cir. 1998); In re Goodman , 11 F.3d 1046, 29 USPQ2d 2010 (Fed. Cir. 1993); In re Longi , 759 F.2d 887, 225 USPQ 645 (Fed. Cir. 1985); In re Van Ornum , 686 F.2d 937, 214 USPQ 761 (CCPA 1982); In re Vogel , 422 F.2d 438, 164 USPQ 619 (CCPA 1970); In re Thorington , 418 F.2d 528, 163 USPQ 644 (CCPA 1969). A timely filed terminal disclaimer in compliance with 37 CFR 1.321(c) or 1.321(d) may be used to overcome an actual or provisional rejection based on nonstatutory double patenting provided the reference application or patent either is shown to be commonly owned with the examined application, or claims an invention made as a result of activities undertaken within the scope of a joint research agreement. See MPEP § 717.02 for applications subject to examination under the first inventor to file provisions of the AIA as explained in MPEP § 2159. See MPEP § 2146 et seq. for applications not subject to examination under the first inventor to file provisions of the AIA. A terminal disclaimer must be signed in compliance with 37 CFR 1.321(b). The filing of a terminal disclaimer by itself is not a complete reply to a nonstatutory double patenting (NSDP) rejection. A complete reply requires that the terminal disclaimer be accompanied by a reply requesting reconsideration of the prior Office action. Even where the NSDP rejection is provisional the reply must be complete. See MPEP § 804, subsection I.B.1. For a reply to a non-final Office action, see 37 CFR 1.111(a). For a reply to final Office action, see 37 CFR 1.113(c). A request for reconsideration while not provided for in 37 CFR 1.113(c) may be filed after final for consideration. See MPEP §§ 706.07(e) and 714.13. The USPTO Internet website contains terminal disclaimer forms which may be used. Please visit www.uspto.gov/patent/patents-forms. The actual filing date of the application in which the form is filed determines what form (e.g., PTO/SB/25, PTO/SB/26, PTO/AIA/25, or PTO/AIA/26) should be used. A web-based eTerminal Disclaimer may be filled out completely online using web-screens. An eTerminal Disclaimer that meets all requirements is auto-processed and approved immediately upon submission. For more information about eTerminal Disclaimers, refer to www.uspto.gov/patents/apply/applying-online/eterminal-disclaimer. 08-34 AIA Claim s 1-4, 8, 10-11, and 15 are rejected on the ground of nonstatutory double patenting as being unpatentable over claim s 1-3, 5, 10, 12, 14 and 17 of U.S. Patent No. 10,074,381 . Although the claims at issue are not identical, they are not patentably distinct from each other because claims 1-4, 8, 10-11, and 15 of the instant application are similar in scope and content of the patented claims 1-3, 5, 10, 12, 14 and 17 of the patent issued to the same Applicant . It is clear that all the elements of the application claims 1-4, 8, 10-11, and 15 are to be found in patented claims 1-3, 5, 10, 12, 14 and 17 (as the application claims 1-4, 8, 10-11, and 15 fully encompasses patented claims 1-3, 5, 10, 12, 14 and 17 ). The difference between the application claims and the patent claims lies in the fact that the patent claim includes many more elements and is thus much more specific. Thus the invention of claims 1-3, 5, 10, 12, 14 and 17 of the patent is in effect a “species” of the “generic” invention of the application claims 1-4, 8, 10-11, and 15 . It has been held that the generic invention is “anticipated” by the “species”. See In re Goodman , 29 USPQ2d 2010 (Fed. Cir. 1993). Since application claims 1-4, 8, 10-11, and 15 is anticipated by claims 1-3, 5, 10, 12, 14 and 17 of the patent, it is not patentably distinct from of the patented claims. Application No: 18/969,990 Patent No: 10,074,381 1. A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 1. A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising: causing display at a client device, of a presentation of a space, the presentation of the space including at least a first person; detecting, by the client device, speech that includes speech properties; identifying the first person as a source of the speech; transcribing the speech to a text string based on the speech properties; determining an emotional effect of the speech based on the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble at a position adjacent to the first person within the presentation of the space in response to the identifying the first person as the source of the speech, the speech bubble containing a display of the text string. 2. The system of claim 1, wherein the presentation of the image data corresponds with the ambient sound containing speech, and determining the emotional effect is based on a volume of the speech. 2. The system of claim 1 wherein the determining the emotional effect of the speech includes: parsing the text string to a set of words; determining a definition of each word among the set of words; comparing the definition of each word to an emotional effect library; and selecting the emotional effect from the emotional effect library based on the comparison. 3. The system of claim 1, wherein the ambient sound includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 5. The system of claim 1, wherein the instructions cause the system to perform operations further comprising: detecting a non-verbal sound; comparing the non-verbal sound to an onomatopoeia library in response to the detecting the non-verbal sound; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and causing display of a graphical element based on the onomatopoeia within the presentation of the space. 4. The system of claim 2, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 3. The system of claim 1 wherein the first person has a set of facial landmarks, and wherein the determining the emotional effect of the speech includes: capturing an image of the first person in response to identifying the first person as the source of the speech; extracting the set of facial landmarks from the image of the first person; and determining the emotional effect based on the set of facial landmarks. 5. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 6. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of one or more facial features and the speech properties; and wherein the speech bubble includes the transcript. 7. The system of claim 6, wherein the speech bubble comprises a set of graphical properties, the graphical properties based on the emotional effect and the length of the transcript. 8. A method comprising: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 10. A method including: causing display at a client device, of a presentation of a space, the presentation of the space including at least a first person; detecting, by the client device, speech that includes speech properties; identifying the first person as a source of the speech; transcribing the speech to a text string based on the speech properties; determining an emotional effect of the speech based on the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble at a position adjacent to the first person within the presentation of the space in response to the identifying the first person as the source of the speech, the speech bubble containing a display of the text string. 9. The method of claim 8, wherein the presentation of the image data corresponds with the ambient sound containing speech, and the determining the emotional effect is based on and a volume of the speech. 10. The method of claim 9, wherein the ambient sound includes a non-verbal sound, and the method further comprises: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 14. The method of claim 10, further comprising: detecting a non-verbal sound; comparing the non-verbal sound to an onomatopoeia library in response to the detecting the non-verbal sound; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and causing display of a graphical element based on the onomatopoeia within the presentation of the space. 11. The method of claim 9, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the method further comprises: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 12. The method of claim 10 wherein the first person has a set of facial landmarks, and wherein the determining the emotional effect of the speech includes: capturing an image of the first person in response to identifying the first person as the source of the speech; extracting the set of facial landmarks from the image of the first person; and determining the emotional effect based on the set of facial landmarks. 12. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 13. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features; and wherein the speech bubble includes the transcript. 14. The method of claim 13, wherein the speech bubble comprises a set of graphical properties, the graphical properties based on the emotional effect and the length of the transcript. 15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 17. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including: causing display at a client device, of a presentation of a space, the presentation of the space including at least a first person; detecting, by the client device, speech that includes speech properties; identifying the first person as a source of the speech; transcribing the speech to a text string based on the speech properties; determining an emotional effect of the speech based on the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble at a position adjacent to the first person within the presentation of the space in response to the identifying the first person as the source of the speech, the speech bubble containing a display of the text string. 16. The non-transitory machine-readable storage medium of claim 15, wherein the presentation of the image data corresponds with the ambient sound containing speech, and wherein the determining the emotional effect is based on a volume of the speech. 17. The non-transitory machine-readable storage medium of claim 16, wherein the ambient sound includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 18. The non-transitory machine-readable storage medium of claim 16, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 19. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 20. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and wherein the speech bubble includes the transcript . 08-34 AIA Claim s 1-4, 8-11 and 15-18 are rejected on the ground of nonstatutory double patenting as being unpatentable over claim s 1, 3-5, 8, 10-12, 15 and 17-19 of U.S. Patent No. 10,614,828 . Although the claims at issue are not identical, they are not patentably distinct from each other because claims 1-4, 8-11 and 15-18 of the instant application are similar in scope and content of the patented claims 1, 3-5, 8, 10-12, 15 and 17-19 of the patent issued to the same Applicant . It is clear that all the elements of the application claims 1-4, 8-11 and 15-18 are to be found in patented claims 1, 3-5, 8, 10-12, 15 and 17-19 (as the application claims 1-4, 8-11 and 15-18 fully encompasses patented claims 1, 3-5, 8, 10-12, 15 and 17-19 ). The difference between the application claims and the patent claims lies in the fact that the patent claim includes many more elements and is thus much more specific. Thus the invention of claims 1, 3-5, 8, 10-12, 15 and 17-19 of the patent is in effect a “species” of the “generic” invention of the application claims 1-4, 8-11 and 15-18 . It has been held that the generic invention is “anticipated” by the “species”. See In re Goodman , 29 USPQ2d 2010 (Fed. Cir. 1993). Since application claims 1-4, 8-11 and 15-18 is anticipated by claims 1, 3-5, 8, 10-12, 15 and 17-19 of the patent, it is not patentably distinct from of the patented claims. Application No: 18/969,990 Patent No: 10,614,828 1. A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 1. A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising: causing display at a client device, of a presentation of a space, the presentation of the space including at least a first person; detecting, by the client device, speech that comprises speech properties, the speech properties including a volume of the speech; identifying the first person as a source of the speech; identifying a first language in response to the detecting the speech; translating the speech from the first language to a second language in response to the identifying the first language; selecting a speech bubble from a speech bubble library based on the volume of the speech, the speech bubble library comprising a plurality of speech bubbles; and causing display of the speech bubble at a position proximate to the first person within the presentation of the space, the speech bubble containing a display of the translated text string. 2. The system of claim 1, wherein the presentation of the image data corresponds with the ambient sound containing speech, and determining the emotional effect is based on a volume of the speech. 4. The system of claim 1, wherein the speech properties include at least a volume, and wherein the selecting the speech bubble from the speech bubble library includes: determining a property of the volume of the speech based on the speech properties; and selecting the speech bubble based on the property of the volume. 3. The system of claim 1, wherein the ambient sound includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 5. The system of claim 1, wherein the instructions cause the system to perform operations further comprising: detecting a non-verbal sound; comparing the non-verbal sound to an onomatopoeia library in response to the detecting the non-verbal sound; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and causing display of a graphical element based on the onomatopoeia within the presentation of the space. 4. The system of claim 2, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 3. The system of claim 2, wherein the first person has a set of facial landmarks, and wherein the determining the emotional effect of the speech further comprises: capturing an image of the first person in response to identifying the first person as the source of the speech; extracting the set of facial landmarks from the image of the first person; and determining the emotional effect based on the set of facial landmarks and the comparison. 5. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 6. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of one or more facial features and the speech properties; and wherein the speech bubble includes the transcript. 7. The system of claim 6, wherein the speech bubble comprises a set of graphical properties, the graphical properties based on the emotional effect and the length of the transcript. 8. A method comprising: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 8. A method comprising: causing display at a client device, of a presentation of a space, the presentation of the space including at least a first person; detecting, by the client device, speech that comprises speech properties, the speech properties including a volume of the speech; identifying the first person as a source of the speech; identifying a first language in response to the detecting the speech; translating the speech from the first language to a second language in response to the identifying the first language; selecting a speech bubble from a speech bubble library based on the volume of the speech, the speech bubble library comprising a plurality of speech bubbles; and causing display of the speech bubble at a position proximate to the first person within the presentation of the space, the speech bubble containing a display of the translated text string. 9. The method of claim 8, wherein the presentation of the image data corresponds with the ambient sound containing speech, and the determining the emotional effect is based on and a volume of the speech. 11. The method of claim 8, wherein the speech properties include at least a volume, and wherein the selecting the speech bubble from the speech bubble library includes: determining a property of the volume of the speech based on the speech properties; and selecting the speech bubble based on the property of the volume. 10. The method of claim 9, wherein the ambient sound includes a non-verbal sound, and the method further comprises: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 12. The method of claim 8, wherein the instructions cause the system to perform operations further comprising: detecting a non-verbal sound; comparing the non-verbal sound to an onomatopoeia library in response to the detecting the non-verbal sound; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and causing display of a graphical element based on the onomatopoeia within the presentation of the space. 11. The method of claim 9, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the method further comprises: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 10. The method of claim 9, wherein the first person has a set of facial landmarks, and wherein the determining the emotional effect of the speech further comprises: capturing an image of the first person in response to identifying the first person as the source of the speech; extracting the set of facial landmarks from the image of the first person; and determining the emotional effect based on the set of facial landmarks and the comparison. 12. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 13. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features; and wherein the speech bubble includes the transcript. 14. The method of claim 13, wherein the speech bubble comprises a set of graphical properties, the graphical properties based on the emotional effect and the length of the transcript. 15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including: causing display at a client device, of a presentation of a space, the presentation of the space including at least a first person; detecting, by the client device, speech that comprises speech properties, the speech properties including a volume of the speech; identifying the first person as a source of the speech; identifying a first language in response to the detecting the speech; translating the speech from the first language to a second language in response to the identifying the first language, selecting a speech bubble from a speech bubble library based on the volume of the speech, the speech bubble library comprising a plurality of speech bubbles; and causing display of the speech bubble at a position proximate to the first person within the presentation of the space, the speech bubble containing a display of the translated text string. 16. The non-transitory machine-readable storage medium of claim 15, wherein the presentation of the image data corresponds with the ambient sound containing speech, and wherein the determining the emotional effect is based on a volume of the speech. 18. The non-transitory machine-readable storage medium of claim 15, wherein the speech properties include at least a volume, and wherein the selecting the speech bubble from the speech bubble library includes: determining a property of the volume of the speech based on the speech properties; and selecting the speech bubble based on the property of the volume. 17. The non-transitory machine-readable storage medium of claim 16, wherein the ambient sound includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 19. The non-transitory machine-readable storage medium of claim 15, wherein the instructions cause the system to perform operations further comprising: detecting a non-verbal sound; comparing the non-verbal sound to an onomatopoeia library in response to the detecting the non-verbal sound; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and causing display of a graphical element based on the onomatopoeia within the presentation of the space. 18. The non-transitory machine-readable storage medium of claim 16, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 17. The non-transitory machine-readable storage medium of claim 15, wherein the first person has a set of facial landmarks, and wherein the determining the emotional effect of the speech includes: capturing an image of the first person in response to identifying the first person as the source of the speech; extracting the set of facial landmarks from the image of the first person; and determining the emotional effect based on the set of facial landmarks and the comparison. 19. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 20. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and wherein the speech bubble includes the transcript . 08-34 AIA Claim s 1-4, 8-11 and 15-18 are rejected on the ground of nonstatutory double patenting as being unpatentable over claim s 1-6, 8-13 and 15-20 of U.S. Patent No. 11,189,299 . Although the claims at issue are not identical, they are not patentably distinct from each other because claims 1-4, 8-11 and 15-18 of the instant application are similar in scope and content of the patented claims 1-6, 8-13 and 15-20 of the patent issued to the same Applicant . It is clear that all the elements of the application claims 1-4, 8-11 and 15-18 are to be found in patented claims 1-6, 8-13 and 15-20 (as the application claims 1-4, 8-11 and 15-18 fully encompasses patented claims 1-6, 8-13 and 15-20 ). The difference between the application claims and the patent claims lies in the fact that the patent claim includes many more elements and is thus much more specific. Thus the invention of claims 1-6, 8-13 and 15-20 of the patent is in effect a “species” of the “generic” invention of the application claims 1-4, 8-11 and 15-18 . It has been held that the generic invention is “anticipated” by the “species”. See In re Goodman , 29 USPQ2d 2010 (Fed. Cir. 1993). Since application claims 1-4, 8-11 and 15-18 is anticipated by claims 1-6, 8-13 and 15-20 of the patent, it is not patentably distinct from of the patented claims. Application No: 18/969,990 Patent No: 11,189,299 1. A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 1. A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising: causing display at a client device, of a presentation of a space; detecting, by the client device, an auditory signal that comprises auditory properties; identifying a source of the auditory signal within the presentation of the space, the source of the auditory signal corresponding with a position within the presentation of the space; performing a comparison of the auditory signal with a library of words; identifying a word from among the library of words based on at least the auditory properties of the auditory signal; selecting a graphical element that corresponds with the word identified from among the library of words based on the auditory properties of auditory signal; and causing display of the graphical element within the presentation of the space based on the position of the source of the auditory signal. 2. The system of claim 1, wherein the presentation of the image data corresponds with the ambient sound containing speech, and determining the emotional effect is based on a volume of the speech. 2. The system of claim 1, wherein the auditory properties include a volume of the auditory signal. 3. The system of claim 1, wherein the graphical element includes a speech bubble that comprises a set of graphical properties, the graphical properties based on the auditory properties of the auditory signal. 3. The system of claim 1, wherein the ambient sound includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 4. The system of claim 1, wherein the auditory signal includes a non-verbal sound, the library includes an onomatopoeia library, the word includes an onomatopoeia, and the operations further comprise: comparing the non-verbal sound to the onomatopoeia library in response to the detecting the auditory signal; identifying the onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the graphical element based on at least the auditory properties of auditory signal and the onomatopoeia identified based on the non-verbal sound. 4. The system of claim 2, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 5. The system of claim 1, wherein the source of the auditory signal comprises a graphical property, and the selecting the graphical element is based on the auditory properties of the auditory signal and the graphical property of the source of the auditory signal. 6. The system of claim 1, wherein the identifying the source of the auditory signal within the presentation of the space includes: detecting movement within the presentation of the space; and identifying the source of the auditory signal based on the movement. 5. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 6. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of one or more facial features and the speech properties; and wherein the speech bubble includes the transcript. 7. The system of claim 6, wherein the speech bubble comprises a set of graphical properties, the graphical properties based on the emotional effect and the length of the transcript. 8. A method comprising: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 8. A method comprising: causing display at a client device, of a presentation of a space; detecting, by the client device, an auditory signal that comprises auditory properties; identifying a source of the auditory signal within the presentation of the space, the source of the auditory signal corresponding with a position within the presentation of the space; performing a comparison of the auditory signal with a library of words; identifying a word from among the library of words based on at least the auditory properties of the auditory signal; selecting a graphical element that corresponds with the word identified from among the library of words based on the auditory properties of auditory signal; and causing display of the graphical element within the presentation of the space based on the position of the source of the auditory signal. 9. The method of claim 8, wherein the presentation of the image data corresponds with the ambient sound containing speech, and the determining the emotional effect is based on and a volume of the speech. 9. The method of claim 8, wherein the auditory properties include a volume of the auditory signal. 10. The method of claim 8, wherein the graphical element includes a speech bubble that comprises a set of graphical properties, the graphical properties based on the auditory properties of the auditory signal. 10. The method of claim 9, wherein the ambient sound includes a non-verbal sound, and the method further comprises: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 11. The method of claim 8, wherein the auditory signal includes a non-verbal sound, the library includes an onomatopoeia library, the word includes an onomatopoeia, and the method further comprises: comparing the non-verbal sound to the onomatopoeia library in response to the detecting the auditory signal; identifying the onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the graphical element based on at least the auditory properties of auditory signal and the onomatopoeia identified based on the non-verbal sound. 11. The method of claim 9, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the method further comprises: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 12. The method of claim 8, wherein the source of the auditory signal comprises a graphical property, and the selecting the graphical element is based on the auditory properties of the auditory signal and the graphical property of the source of the auditory signal. 13. The method of claim 8, wherein the identifying the source of the auditory signal within the presentation of the space includes: detecting movement within the presentation of the space; and identifying the source of the auditory signal based on the movement. 12. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 13. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features; and wherein the speech bubble includes the transcript. 14. The method of claim 13, wherein the speech bubble comprises a set of graphical properties, the graphical properties based on the emotional effect and the length of the transcript. 15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including: causing display at a client device, of a presentation of a space; detecting, by the client device, an auditory signal that comprises auditory properties; identifying a source of the auditory signal within the presentation of the space, the source of the auditory signal corresponding with a position within the presentation of the space; performing a comparison of the auditory signal with a library of words; identifying a word from among the library of words based on at least the auditory properties of the auditory signal; selecting a graphical element that corresponds with the word identified from among the library of words based on the auditory properties of auditory signal; and causing display of the graphical element within the presentation of the space based on the position of the source of the auditory signal. 16. The non-transitory machine-readable storage medium of claim 15, wherein the presentation of the image data corresponds with the ambient sound containing speech, and wherein the determining the emotional effect is based on a volume of the speech. 16. The non-transitory machine-readable storage medium of claim 15, wherein the auditory properties include a volume of the auditory signal. 17. The non-transitory machine-readable storage medium of claim 15, wherein the graphical element includes a speech bubble that comprises a set of graphical properties, the graphical properties based on the auditory properties of the auditory signal. 17. The non-transitory machine-readable storage medium of claim 16, wherein the ambient sound includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 18. The non-transitory machine-readable storage medium of claim 15, wherein the auditory signal includes a non-verbal sound, the library includes an onomatopoeia library, the word includes an onomatopoeia, and the operations further comprise: comparing the non-verbal sound to the onomatopoeia library in response to the detecting the auditory signal; identifying the onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the graphical element based on at least the auditory properties of auditory signal and the onomatopoeia identified based on the non-verbal sound. 18. The non-transitory machine-readable storage medium of claim 16, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 19. The non-transitory machine-readable storage medium of claim 15, wherein the source of the auditory signal comprises a graphical property, and the selecting the graphical element is based on the auditory properties of the auditory signal and the graphical property of the source of the auditory signal. 20. The non-transitory machine-readable storage medium of claim 15, wherein the identifying the source of the auditory signal within the presentation of the space includes: detecting movement within the presentation of the space; and identifying the source of the auditory signal based on the movement. 19. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 20. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and wherein the speech bubble includes the transcript . 08-34 AIA Claim s 1-3, 8-10 and 15-17 are rejected on the ground of nonstatutory double patenting as being unpatentable over claim s 1-4, 8-11 and 15-18 of U.S. Patent No. 11,748,579 . Although the claims at issue are not identical, they are not patentably distinct from each other because claims 1-3, 8-10 and 15-17 of the instant application are similar in scope and content of the patented claims 1-4, 8-11 and 15-18 of the patent issued to the same Applicant . It is clear that all the elements of the application claims 1-3, 8-10 and 15-17 are to be found in patented claims 1-4, 8-11 and 15-18 (as the application claims 1-3, 8-10 and 15-17 fully encompasses patented claims 1-4, 8-11 and 15-18 ). The difference between the application claims and the patent claims lies in the fact that the patent claim includes many more elements and is thus much more specific. Thus the invention of claims 1-4, 8-11 and 15-18 of the patent is in effect a “species” of the “generic” invention of the application claims 1-3, 8-10 and 15-17 . It has been held that the generic invention is “anticipated” by the “species”. See In re Goodman , 29 USPQ2d 2010 (Fed. Cir. 1993). Since application claims 1-3, 8-10 and 15-17 is anticipated by claims 1-4, 8-11 and 15-18 of the patent, it is not patentably distinct from of the patented claims. Application No: 18/969,990 Patent No: 11,748,579 1. A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 1. A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising: causing display of a presentation of image data at a client device, the presentation of the image data comprising a depiction of a set of facial features; detecting, by the client device, a speech signal that comprises auditory properties; transcribing the speech signal to a text string based on the auditory properties; determining an emotional effect of the speech signal based on the set of facial features; selecting a graphical element based on the emotional effect; and causing display of the text string within the graphical element within the presentation of the image data. 2. The system of claim 1, wherein the presentation of the image data corresponds with the ambient sound containing speech, and determining the emotional effect is based on a volume of the speech. 2. The system of claim 1, wherein the auditory properties include a volume of the speech signal, and the determining the emotional effect is based on the set of facial features and the volume of the speech signal. 3. The system of claim 1, wherein the graphical element includes a speech bubble that comprises a set of graphical properties, the graphical properties based on the auditory properties of the auditory signal. 3. The system of claim 1, wherein the ambient sound includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 4. The system of claim 1, wherein the speech signal includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the speech signal; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the graphical element based on at least the auditory properties of auditory signal and the onomatopoeia identified based on the non-verbal sound. 4. The system of claim 2, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 5. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 6. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of one or more facial features and the speech properties; and wherein the speech bubble includes the transcript. 7. The system of claim 6, wherein the speech bubble comprises a set of graphical properties, the graphical properties based on the emotional effect and the length of the transcript. 8. A method comprising: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 8. A method comprising: causing display of a presentation of image data at a client device, the presentation of the image data comprising a depiction of a set of facial features; detecting, by the client device, a speech signal that comprises auditory properties; transcribing the speech signal to a text string based on the auditory properties; determining an emotional effect of the speech signal based on the set of facial features; selecting a graphical element based on the emotional effect; and causing display of the text string within the graphical element within the presentation of the image data. 9. The method of claim 8, wherein the presentation of the image data corresponds with the ambient sound containing speech, and the determining the emotional effect is based on and a volume of the speech. 9. The method of claim 8, wherein the auditory properties include a volume of the speech signal, and the determining the emotional effect is based on the set of facial features and the volume of the speech signal. 10. The method of claim 8, wherein the graphical element includes a speech bubble that comprises a set of graphical properties, the graphical properties based on the auditory properties of the auditory signal. 10. The method of claim 9, wherein the ambient sound includes a non-verbal sound, and the method further comprises: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 11. The method of claim 8, wherein the speech signal includes a non-verbal sound, and the method further comprises: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the speech signal; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the graphical element based on at least the auditory properties of auditory signal and the onomatopoeia identified based on the non-verbal sound. 11. The method of claim 9, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the method further comprises: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 12. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 13. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features; and wherein the speech bubble includes the transcript. 14. The method of claim 13, wherein the speech bubble comprises a set of graphical properties, the graphical properties based on the emotional effect and the length of the transcript. 15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including: causing display of a presentation of image data at a client device, the presentation of the image data comprising a depiction of a set of facial features; detecting, by the client device, a speech signal that comprises auditory properties; transcribing the speech signal to a text string based on the auditory properties; determining an emotional effect of the speech signal based on the set of facial features; selecting a graphical element based on the emotional effect; and causing display of the text string within the graphical element within the presentation of the image data. 16. The non-transitory machine-readable storage medium of claim 15, wherein the presentation of the image data corresponds with the ambient sound containing speech, and wherein the determining the emotional effect is based on a volume of the speech. 16. The non-transitory machine-readable storage medium of claim 15, wherein the auditory properties include a volume of the speech signal, and the determining the emotional effect is based on the set of facial features and the volume of the speech signal. 17. The non-transitory machine-readable storage medium of claim 15, wherein the graphical element includes a speech bubble that comprises a set of graphical properties, the graphical properties based on the auditory properties of the auditory signal. 17. The non-transitory machine-readable storage medium of claim 16, wherein the ambient sound includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 18. The non-transitory machine-readable storage medium of claim 15, wherein the speech signal includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the speech signal; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the graphical element based on at least the auditory properties of auditory signal and the onomatopoeia identified based on the non-verbal sound. 18. The non-transitory machine-readable storage medium of claim 16, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 19. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 20. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and wherein the speech bubble includes the transcript . 08-34 AIA Claim s 1-20 are rejected on the ground of nonstatutory double patenting as being unpatentable over claim s 1-20 of U.S. Patent No. 12,197,884 . Although the claims at issue are not identical, they are not patentably distinct from each other because claims 1-20 of the instant application are similar in scope and content of the patented claims 1-20 of the patent issued to the same Applicant . It is clear that all the elements of the application claims 1-20 are to be found in patented claims 1-20 (as the application claims 1-20 fully encompasses patented claims 1-20 ). The difference between the application claims and the patent claims lies in the fact that the patent claim includes many more elements and is thus much more specific. Thus the invention of claims 1-20 of the patent is in effect a “species” of the “generic” invention of the application claims 1-20 . It has been held that the generic invention is “anticipated” by the “species”. See In re Goodman , 29 USPQ2d 2010 (Fed. Cir. 1993). Since application claims 1-20 is anticipated by claims 1-20 of the patent, it is not patentably distinct from of the patented claims. Application No: 18/969,990 Patent No: 12,197,884 1. A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 1. A system comprising: a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising: causing display of a presentation of image data at a client device, the presentation of the image data comprising a depiction of a set of facial features; determining an emotional effect based on the set of facial features; selecting a graphical element based on the emotional effect; and causing display of the graphical element within the presentation of the image data. 2. The system of claim 1, wherein the presentation of the image data corresponds with the ambient sound containing speech, and determining the emotional effect is based on a volume of the speech. 2. The system of claim 1, wherein the presentation of the image data corresponds with audio data, the audio data comprising a speech signal, and wherein the determining the emotional effect is based on the set of facial features and a volume of the speech signal. 3. The system of claim 1, wherein the ambient sound includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 3. The system of claim 2, wherein the speech signal includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the speech signal; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the graphical element based on at least the onomatopoeia. 4. The system of claim 2, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 4. The system of claim 2, wherein the speech signal corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the speech signal at a position within the presentation of the image data; and causing display of the media content based on the position of the source of the speech signal. 5. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 5. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the speech signal; and determining the emotional effect based on the set of facial features and the transcript of the speech signal. 6. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of one or more facial features and the speech properties; and wherein the speech bubble includes the transcript. 6. The system of claim 2, wherein the determining the emotional effect further comprises: generating a transcript based on the speech signal; and wherein the graphical element includes the transcript. 7. The system of claim 6, wherein the speech bubble comprises a set of graphical properties, the graphical properties based on the emotional effect and the length of the transcript. 7. The system of claim 1, wherein the graphical element includes a speech bubble that comprises a set of graphical properties, the graphical properties based on the emotional effect. 8. A method comprising: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 8. A method comprising: causing display of a presentation of image data at a client device, the presentation of the image data comprising a depiction of a set of facial features; determining an emotional effect based on the set of facial features; selecting a graphical element based on the emotional effect; and causing display of the graphical element within the presentation of the image data. 9. The method of claim 8, wherein the presentation of the image data corresponds with the ambient sound containing speech, and the determining the emotional effect is based on and a volume of the speech. 9. The method of claim 8, wherein the presentation of the image data corresponds with audio data, the audio data comprising a speech signal, and wherein the determining the emotional effect is based on the set of facial features and a volume of the speech signal. 10. The method of claim 9, wherein the ambient sound includes a non-verbal sound, and the method further comprises: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 10. The method of claim 9, wherein the speech signal includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the speech signal; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the graphical element based on at least the onomatopoeia. 11. The method of claim 9, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the method further comprises: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 11. The method of claim 9, wherein the speech signal corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the speech signal at a position within the presentation of the image data; and causing display of the media content based on the position of the source of the speech signal. 12. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 12. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the speech signal; and determining the emotional effect based on the set of facial features and the transcript of the speech signal. 13. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features; and wherein the speech bubble includes the transcript. 13. The method of claim 9, wherein the determining the emotional effect further comprises: generating a transcript based on the speech signal; and wherein the graphical element includes the transcript. 14. The method of claim 13, wherein the speech bubble comprises a set of graphical properties, the graphical properties based on the emotional effect and the length of the transcript. 14. The method of claim 8, wherein the graphical element includes a speech bubble that comprises a set of graphical properties, the graphical properties based on the emotional effect. 15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including: causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features; detecting ambient sound containing speech; extracting speech properties from the ambient sound containing speech; detecting movement of one or more facial features from the set of facial features; determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties; selecting a speech bubble from a speech bubble library based on the emotional effect of the speech; and causing display of the speech bubble within the presentation of the image data. 15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including: causing display of a presentation of image data at a client device, the presentation of the image data comprising a depiction of a set of facial features; determining an emotional effect based on the set of facial features; selecting a graphical element based on the emotional effect; and causing display of the graphical element within the presentation of the image data. 16. The non-transitory machine-readable storage medium of claim 15, wherein the presentation of the image data corresponds with the ambient sound containing speech, and wherein the determining the emotional effect is based on a volume of the speech. 16. The non-transitory machine-readable storage medium of claim 15, wherein the presentation of the image data corresponds with audio data, the audio data comprising a speech signal, and wherein the determining the emotional effect is based on the set of facial features and a volume of the speech signal. 17. The non-transitory machine-readable storage medium of claim 16, wherein the ambient sound includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the ambient sound containing speech; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the speech bubble based on at least the onomatopoeia. 17. The non-transitory machine-readable storage medium of claim 16, wherein the speech signal includes a non-verbal sound, and the operations further comprise: comparing the non-verbal sound to an onomatopoeia library in response to the detecting the speech signal; identifying an onomatopoeia from the onomatopoeia library based on the non-verbal sound; and selecting the graphical element based on at least the onomatopoeia. 18. The non-transitory machine-readable storage medium of claim 16, wherein the movement of the one or more facial features corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the movement of the one or more facial features at a position within the presentation of the image data; and causing display of the speech bubble based on the position of the source of the movement of the one or more facial features. 18. The non-transitory machine-readable storage medium of claim 16, wherein the speech signal corresponds with a source within the presentation of the image data, and the operations further comprise: identifying the source of the speech signal at a position within the presentation of the image data; and causing display of the media content based on the position of the source of the speech signal. 19. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and determining the emotional effect based on the transcript. 19. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the speech signal; and determining the emotional effect based on the set of facial features and the transcript of the speech signal. 20. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the movement of the one or more facial features and the speech properties; and wherein the speech bubble includes the transcript. 20. The non-transitory machine-readable storage medium of claim 16, wherein the determining the emotional effect further comprises: generating a transcript based on the speech signal; and wherein the graphical element includes the transcript . Conclusion 07-96 AIA The prior art made of record and not relied upon is considered pertinent to applicant's disclosure. Please see attached form PTO-892 . The following is pertinent prior art of record. Barnett et al., (US 2018/0300916 A1) teach systems and methods for utilizing augmented reality elements in connection with a camera viewfinder display of a mobile computing device. For example, systems and methods described herein detect characteristics of the mobile computing device and provide augmented reality elements that correspond to the detected characteristics directly in the camera viewfinder display. Thus, a user can interact with the provided augmented reality elements in the camera viewfinder display to compose a networking system post, view a friend's location, order and pay for merchandise, and so forth. Mullins (US 2019/0068529 A1) teaches a head-mounted device (HMD) of a first user has a transparent display. The HMD determines location information of a second user relative to the HMD of the first user. The second user is located within a predefined distance of the HMD. The location information identifies a distance and a direction of the second user relative to the HMD. The HMD receives audio content from the second user, generates augmented reality (AR) content based on the audio content, and displays the AR content in the transparent display based on the location information of the second user. The AR content appears coupled to the second user. Forutanpour et al., (2014/0081634 A1) teach Various arrangements for using an augmented reality device are presented. Speech spoken by a person in a real-world scene may be captured by an augmented reality (AR) device. It may be determined that a second AR device is to receive data on the speech. The second AR device may not have been present for the speech when initially spoken. Data corresponding to the speech may be transmitted to the second augmented reality device. Any inquiry concerning this communication or earlier communications from the examiner should be directed to VIJAY B CHAWAN whose telephone number is (571)272-7601. The examiner can normally be reached 7-5 Monday thru Thursday. Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Richemond Dorvil can be reached at 571-272-7602. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. /VIJAY B CHAWAN/Primary Examiner, Art Unit 2658 Application/Control Number: 18/969,990 Page 2 Art Unit: 2658 Application/Control Number: 18/969,990 Page 3 Art Unit: 2658 Application/Control Number: 18/969,990 Page 4 Art Unit: 2658 Application/Control Number: 18/969,990 Page 5 Art Unit: 2658 Application/Control Number: 18/969,990 Page 6 Art Unit: 2658 Application/Control Number: 18/969,990 Page 7 Art Unit: 2658 Application/Control Number: 18/969,990 Page 8 Art Unit: 2658 Application/Control Number: 18/969,990 Page 9 Art Unit: 2658 Application/Control Number: 18/969,990 Page 10 Art Unit: 2658 Application/Control Number: 18/969,990 Page 11 Art Unit: 2658 Application/Control Number: 18/969,990 Page 12 Art Unit: 2658 Application/Control Number: 18/969,990 Page 13 Art Unit: 2658 Application/Control Number: 18/969,990 Page 14 Art Unit: 2658 Application/Control Number: 18/969,990 Page 15 Art Unit: 2658 Application/Control Number: 18/969,990 Page 16 Art Unit: 2658 Application/Control Number: 18/969,990 Page 17 Art Unit: 2658 Application/Control Number: 18/969,990 Page 18 Art Unit: 2658 Application/Control Number: 18/969,990 Page 19 Art Unit: 2658 Application/Control Number: 18/969,990 Page 20 Art Unit: 2658 Application/Control Number: 18/969,990 Page 21 Art Unit: 2658 Application/Control Number: 18/969,990 Page 22 Art Unit: 2658 Application/Control Number: 18/969,990 Page 23 Art Unit: 2658 Application/Control Number: 18/969,990 Page 24 Art Unit: 2658 Application/Control Number: 18/969,990 Page 25 Art Unit: 2658 Application/Control Number: 18/969,990 Page 26 Art Unit: 2658 Application/Control Number: 18/969,990 Page 27 Art Unit: 2658 Application/Control Number: 18/969,990 Page 28 Art Unit: 2658 Application/Control Number: 18/969,990 Page 29 Art Unit: 2658 Application/Control Number: 18/969,990 Page 30 Art Unit: 2658 Application/Control Number: 18/969,990 Page 31 Art Unit: 2658 Application/Control Number: 18/969,990 Page 32 Art Unit: 2658 Application/Control Number: 18/969,990 Page 33 Art Unit: 2658 Application/Control Number: 18/969,990 Page 34 Art Unit: 2658 Application/Control Number: 18/969,990 Page 35 Art Unit: 2658 Application/Control Number: 18/969,990 Page 36 Art Unit: 2658 Application/Control Number: 18/969,990 Page 37 Art Unit: 2658 Application/Control Number: 18/969,990 Page 38 Art Unit: 2658 Application/Control Number: 18/969,990 Page 39 Art Unit: 2658 Application/Control Number: 18/969,990 Page 40 Art Unit: 2658 Application/Control Number: 18/969,990 Page 41 Art Unit: 2658 Application/Control Number: 18/969,990 Page 42 Art Unit: 2658 Application/Control Number: 18/969,990 Page 43 Art Unit: 2658 Application/Control Number: 18/969,990 Page 44 Art Unit: 2658 Application/Control Number: 18/969,990 Page 45 Art Unit: 2658 Application/Control Number: 18/969,990 Page 46 Art Unit: 2658 Application/Control Number: 18/969,990 Page 47 Art Unit: 2658 Application/Control Number: 18/969,990 Page 48 Art Unit: 2658 Application/Control Number: 18/969,990 Page 49 Art Unit: 2658 Application/Control Number: 18/969,990 Page 50 Art Unit: 2658 Application/Control Number: 18/969,990 Page 51 Art Unit: 2658 Application/Control Number: 18/969,990 Page 52 Art Unit: 2658 Application/Control Number: 18/969,990 Page 53 Art Unit: 2658 Application/Control Number: 18/969,990 Page 54 Art Unit: 2658 Application/Control Number: 18/969,990 Page 55 Art Unit: 2658 Application/Control Number: 18/969,990 Page 56 Art Unit: 2658 Application/Control Number: 18/969,990 Page 57 Art Unit: 2658 Application/Control Number: 18/969,990 Page 58 Art Unit: 2658 Application/Control Number: 18/969,990 Page 59 Art Unit: 2658 Application/Control Number: 18/969,990 Page 60 Art Unit: 2658 Application/Control Number: 18/969,990 Page 61 Art Unit: 2658 Application/Control Number: 18/969,990 Page 62 Art Unit: 2658 Application/Control Number: 18/969,990 Page 63 Art Unit: 2658 Application/Control Number: 18/969,990 Page 64 Art Unit: 2658 Application/Control Number: 18/969,990 Page 65 Art Unit: 2658 Application/Control Number: 18/969,990 Page 66 Art Unit: 2658 Application/Control Number: 18/969,990 Page 67 Art Unit: 2658 Application/Control Number: 18/969,990 Page 68 Art Unit: 2658 Application/Control Number: 18/969,990 Page 69 Art Unit: 2658 Application/Control Number: 18/969,990 Page 70 Art Unit: 2658 Application/Control Number: 18/969,990 Page 71 Art Unit: 2658 Application/Control Number: 18/969,990 Page 72 Art Unit: 2658 Application/Control Number: 18/969,990 Page 73 Art Unit: 2658 Application/Control Number: 18/969,990 Page 74 Art Unit: 2658 Application/Control Number: 18/969,990 Page 75 Art Unit: 2658 Application/Control Number: 18/969,990 Page 76 Art Unit: 2658 Application/Control Number: 18/969,990 Page 77 Art Unit: 2658 Application/Control Number: 18/969,990 Page 78 Art Unit: 2658 Application/Control Number: 18/969,990 Page 79 Art Unit: 2658 Application/Control Number: 18/969,990 Page 80 Art Unit: 2658 Application/Control Number: 18/969,990 Page 81 Art Unit: 2658 Application/Control Number: 18/969,990 Page 82 Art Unit: 2658 Application/Control Number: 18/969,990 Page 83 Art Unit: 2658 Application/Control Number: 18/969,990 Page 84 Art Unit: 2658 Application/Control Number: 18/969,990 Page 85 Art Unit: 2658 Application/Control Number: 18/969,990 Page 86 Art Unit: 2658
Read full office action

Prosecution Timeline

Dec 05, 2024
Application Filed
Jun 17, 2026
Non-Final Rejection mailed — §DP (current)

Precedent Cases

Applications granted by this same examiner with similar technology

Patent 12675636
Method and System for Analyzing Texts
3y 3m to grant Granted Jul 07, 2026
Patent 12658199
TRAINING METHOD AND ENHANCEMENT METHOD FOR SPEECH ENHANCEMENT MODEL, APPARATUS, ELECTRONIC DEVICE, STORAGE MEDIUM AND PROGRAM PRODUCT
2y 3m to grant Granted Jun 16, 2026
Patent 12645890
AUTOMATION OF TASKS USING LANGUAGE MODEL PROMPTS
2y 11m to grant Granted Jun 02, 2026
Patent 12646516
Wake-up Method and Apparatus for Smart Device, Storage Medium, and Electronic Device
2y 5m to grant Granted Jun 02, 2026
Patent 12640142
QUESTION DETECTION MODEL FOR CALL TRANSCRIPT
3y 3m to grant Granted May 26, 2026
Study what changed to get past this examiner. Based on 5 most recent grants.

Strategy Recommendation AI-generated — please review before filing

Get a prosecution strategy drawn from examiner precedents, rejection analysis, and claim mapping.
Typically takes 5-10 seconds — AI-generated, attorney review required before filing

Prosecution Projections

1-2
Expected OA Rounds
88%
Grant Probability
99%
With Interview (+11.4%)
2y 6m (~11m remaining)
Median Time to Grant
Low
PTA Risk
Based on 893 resolved cases by this examiner. Grant probability derived from career allowance rate.

Sign in with your work email

Enter your email to receive a magic link. No password needed.

Personal email addresses (Gmail, Yahoo, etc.) are not accepted.

Free tier: 3 strategy analyses per month