DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Continued Examination Under 37 CFR 1.114
A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 09/15/2026 has been entered.
Response to Arguments
Applicant’s arguments, see Remarks, filed 09/15/2026, with respect to the rejections of claims 1, 10-13, 15, and 16 under 35 U.S.C. §102 have been fully considered and are persuasive. Therefore, the rejection has been withdrawn. However, upon further consideration, a new grounds of rejection is made in view of Jang and Lu for claims 1-5, 7-13 and 15-20. Regarding applicant’s arguments, the examiner notes that all of the arguments are directed to the language taken from canceled claim 6. Lu is cited as teaching the amended language as argued by the applicant.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1-5, 7-13 and 15-20 are rejected under 35 U.S.C. 103 as being unpatentable over Jang (US PG Pub 20120316876) in view of Lu (US PG Pub 20230126656; as claiming priority to PCT/CN2021/101051 filed 06/18/2021).
As per claims 1, 15 and 16, Jang discloses:
A voice control method, applied in a display terminal, an electronic device and a computer non-transitory readable storage medium on which a computer program is stored (Jang; p. 0182 - the present invention may be recorded in a computer-readable recording medium as a program to be executed in the computer), wherein when the computer program is executed by a processor (Jang; p. 0182 - The program or the code segments may be stored in a processor-readable medium; see also p. 0073-0074 & Fig. 2, item 180), and a memory (Jang; Fig. 2, item 160; p. 0074 - The software codes may be stored in the memory 160), configured to store executable instructions for the processor, the voice control method is implemented, comprising: obtaining user voice information (Jang; Fig. 3, item 17; p. 0080 - The voice input unit 17 receives voice signals of a speaker. For example, the voice input unit 17 can correspond to a microphone), and creating a voice control relationship between the user and a target voice control window based on the user voice information (Jang; Fig. 6, item SI; Fig. 7, item SI; p. 0087-0092 - The display device 100 can display the voice recognition result on the display unit 151 by using an indicator related to at least one of the speaker, the voice input device, and the voice recognition result. The indicator related to the speaker is an indicator capable of identifying the speaker, which can include text, an image, a sound signal, a display setting value corresponding to a particular speaker, and a voice pattern of the particular speaker; see also p. 0105 - though the speaker says "CH 10", the display device 100 displays the name (John) of the speaker S in the form of text on the display unit 151 and thus, the speaker S can know that his or her voice is recognized by the display device 100; see also p. 0106 - …the indicator displayed on the display unit 151 is an avatar for identifying the speaker S; accordingly, the speaker S can know that his or her voice is recognized by the display device 100… The item SI in both Fig. 6 & 7 are display windows that are used to identify the speaker who is using voice control, thus they represent a relationship between the user and the target voice control window on the display; see also p. 0121), wherein the target voice control window is one of multiple voice control windows displayed in the display terminal (Jang; Fig. 11, items S1 & S2; p. 0120 - with reference to FIG. 11, the controller 180 can recognize a first speaker S1 and a second speaker S2 respectively and display a first speaker indicator (SI1, a first avatar) corresponding to the first speaker S1 and a second speaker indicator (SI2, a second avatar) corresponding to the second speaker S2 on the display unit 151; see also p. 0121; see also Fig. 9; see also Fig. 19 & p. 0148); and converting the user voice information into a control instruction, and executing control content corresponding to the control instruction in the target voice control window (Jang; p. 0153 - For example, as shown in FIG. 20, it can be known that the first speaker S1 has set up a "Music" program as his or her favorite or high priority program. Therefore, according to a control method for a display device according to an embodiment of the present invention, the display device 100 can receive a speaker's voice through a voice input device, carry out voice recognition upon the received voice, recognize a speaker corresponding to the voice recognition result, and control itself to operate in the environment set up by the speaker… receiving and converting instructions for controlling a “Music” program).
Jang, however, fails to disclose wherein the creating the voice control relationship between the user and the target voice control window based on the user voice information, comprises: displaying a preset number M of voice control windows in the display terminal, and assigning a window identifier to each voice control window; in a case that the user voice information comprises information matching the window identifier, determining the target voice control window from the M voice control windows according to the user voice information; and creating the voice control relationship between the user corresponding to the user voice information and the target voice control window.
Lu does teach wherein the creating the voice control relationship between the user and the target voice control window based on the user voice information, comprises: displaying a preset number M of voice control windows in the display terminal, and assigning a window identifier to each voice control window (Lu; p. 0130-0131 - For example, the actual number of channels of the video call is 6, and the preset number of channels of the display apparatus is 3. As shown in FIG. 7, since the preset number of channels is 3, the first area includes 3 windows for video chatting, and each window for video chatting presents the video image of the corresponding member, while a voice control is also provided in the window for video chatting to play the audio of a corresponding member. The user ID can also be identified in the window for video chatting to identify the call member corresponding to each window for video chatting; see also p. 0181-0183 - each window (window for video chatting or window for voice chatting) is provided with a user identifier control, and the name shown by the user identifier control can directly include an ID of the user who accesses the video call); in a case that the user voice information comprises information matching the window identifier, determining the target voice control window from the M voice control windows according to the user voice information (Lu; p. 0315 - …for a call user who is allocated with a call window, the display apparatus may establish a mapping relationship between the call data of the call user and the corresponding call window (user voice information comprises information matching the window identifier), and store the above relationship in a mapping relationship table, where the call data of the call user may be identified by the user ID of the corresponding call user, that is, a mapping relationship between the user ID of the call user and the window ID of the corresponding call window is established…); and creating the voice control relationship between the user corresponding to the user voice information and the target voice control window (Lu; p. 0315 - …for a call user who is allocated with a call window, the display apparatus may establish a mapping relationship between the call data of the call user and the corresponding call window, and store the above relationship in a mapping relationship table (creating the voice control relationship), where the call data of the call user may be identified by the user ID of the corresponding call user, that is, a mapping relationship between the user ID of the call user and the window ID of the corresponding call window is established…). Therefore, it would have been obvious to one of ordinary skill in the art to modify the voice control method, electronic device and computer non-transitory readable storage medium of Jang to include wherein the creating the voice control relationship between the user and the target voice control window based on the user voice information, comprises: displaying a preset number M of voice control windows in the display terminal, and assigning a window identifier to each voice control window; in a case that the user voice information comprises information matching the window identifier, determining the target voice control window from the M voice control windows according to the user voice information; and creating the voice control relationship between the user corresponding to the user voice information and the target voice control window, as taught by Lu, in order to improve the ability of the display apparatus to process the multi-channel video call (Lu; p. 0188).
As per claims 2 and 17, Jang in view of Lu discloses: The voice control method and electronic device according to claims 1 and 15, wherein the creating the voice control relationship between the user and the target voice control window based on the user voice information, comprises: determining voice features corresponding to the user voice information (Jang; p. 0117 - in the case of multiple speakers S310, the controller 180 can recognize a voice pattern of a speaker received through a voice recognition device and carry out voice recognition according to the voice pattern S330), and determining a number N of users based on the voice features (Jang; p. 0120 – 0121 - with reference to FIG. 11, the controller 180 can recognize a first speaker S1 and a second speaker S2 respectively and display a first speaker indicator (SI1, a first avatar) corresponding to the first speaker S1 and a second speaker indicator (SI2, a second avatar) corresponding to the second speaker S2 on the display unit 151. As described above, the controller 180 can display a speaker indicator for identifying the first and the second speaker in addition to the first and the second avatar); and creating the voice control relationship between the N users and the N voice control windows, respectively (Jang; p. 0120 – 0121). And further, Lu teaches in a case that the number N of users is less than or equal to a preset number M, displaying N voice control windows in the display terminal (Lu; p. 0309 - displaying the video data in the call data including the video data and the audio data in n call windows presented in a designated area of the display interface upon detecting that the audio data satisfies a preset condition, where n is less than m). Therefore, it would have been obvious to one of ordinary skill in the art to modify the voice control method and electronic device of Jang, to include in a case that the number N of users is less than or equal to a preset number M, displaying N voice control windows in the display terminal, as taught by Lu, in order to improve the ability of the display apparatus to process the multi-channel video call (Lu; p. 0188).
As per claims 3 and 18, Jang in view of Lu discloses: The voice control method and electronic device according to claims 2 and 17, upon which claims 3 and 18 depend. And further, Lu teaches wherein the preset number M is determined based on a size of the display terminal or a target size corresponding to the display terminal (Lu; p. 0298 - due to the limitation of the screen size of the display apparatus, at most 6 call windows can be displayed on the right edge of the display interface where the game screen is displayed. If the number of call windows increases, the size of the call windows will be reduced accordingly, and the user will not be able to see the content shown in the windows. Assuming that there are 8 users (including the user of the display apparatus) in the call, then the video data of only 6 out of the 8 user can be displayed in 6 call windows of the current interface, while the video data of the remaining 2 users cannot be displayed). Therefore, it would have been obvious to one of ordinary skill in the art to modify the voice control method and electronic device of Jang, to include wherein the preset number M is determined based on a size of the display terminal or a target size corresponding to the display terminal, as taught by Lu, in order to improve the ability of the display apparatus to process the multi-channel video call (Lu; p. 0188).
As per claims 4 and 19, Jang in view of Lu disclose: The voice control method and electronic device according to claims 2 and 17, further comprising: in a case that the number N of users is greater than the preset number M, selecting, from the N users, M target users according to a preset rule, wherein the preset rule comprises: detecting a distance between the user and the display terminal, and selecting the M target users from the N users according to the distance; or, selecting the M target users from the N users according to the voice features, wherein the voice features comprises volume; and creating the voice control relationship between the M target users and the M voice control windows, respectively (Jang; p. 0165 - if signal strength of a voice signal (volume) received through the second voice input device is below a predetermined threshold value S622, can recommend the user for using the first voice input device and display an indicator for the recommendation on the display unit 151, S623).
As per claims 5 and 20, Jang in view of Lu discloses: The voice control method and electronic device according to claims 2 and 17, further comprising: in a case that the number N of users is less than or equal to the preset number M, obtaining relative position information of the users relative to the display terminal; and creating, according to the relative position information, the voice control relationship between the N users and the N voice control windows, respectively (Jang; Fig. 13 & 16; p. 0126-0139 - With reference to FIG. 13, in the case of multiple speakers S410, the controller 180 can recognize a speaker's location S420…; see also p. 0149-0150 - The display device 100 can carry out voice recognition upon the voice of the first speaker S1 and select a speaker icon corresponding to the first speaker S1 from multiple speaker icons 58 based on the voice recognition result…).
As per claim 7, Jang in view of Lu discloses: The voice control method according to claim 1, wherein the information matching the window identifier comprises position information of the user; and the determining the target voice control window from the M voice control windows according to the user voice information, comprises: determining the target voice control window from the M voice control windows according to the position information (Jang; Fig. 13 & 16; p. 0126-0139 - With reference to FIG. 13, in the case of multiple speakers S410, the controller 180 can recognize a speaker's location S420…; see also p. 0149-0150 - The display device 100 can carry out voice recognition upon the voice of the first speaker S1 and select a speaker icon corresponding to the first speaker S1 from multiple speaker icons 58 based on the voice recognition result… if there is an existing icon/avatar on the display corresponding to the current speaker, the speaker is assigned to the matching icon/avatar).
As per claim 8, Jang in view of Lu discloses: The voice control method according to claim 1, further comprising: in a case that the user voice information does not comprise information matching the window identifier, obtaining relative position information of the user relative to the display terminal; and creating the voice control relationship between the user corresponding to the user voice information and the target voice control window according to the relative position information (Jang; Fig. 13 & 16; p. 0126-0139 - With reference to FIG. 13, in the case of multiple speakers S410, the controller 180 can recognize a speaker's location S420, recognize the speaker as the speaker's location is recognized, and change a pointing direction of a speaker indicator according to the speaker's location recognized S440… if there is no existing icon/avatar on the display corresponding to the user who is speaking, one is created and placed on the display relative to the user’s position).
As per claim 9, Jang in view of Lu disclose: The voice control method according to claim 2, wherein the creating the voice control relationship between the user and the target voice control window based on the user voice information, comprises: displaying M voice control windows in the display terminal (Jang; Fig. 11, items S1 & S2; p. 0120 - with reference to FIG. 11, the controller 180 can recognize a first speaker S1 and a second speaker S2 respectively and display a first speaker indicator (SI1, a first avatar) corresponding to the first speaker S1 and a second speaker indicator (SI2, a second avatar) corresponding to the second speaker S2 on the display unit 151; see also p. 0121; see also Fig. 9; see also Fig. 19 & p. 0148); determining preset voiceprint information corresponding to the M voice control windows respectively (Jang; p. 0117-0118 - in the case of multiple speakers S310, the controller 180 can recognize a voice pattern of a speaker received through a voice recognition device and carry out voice recognition according to the voice pattern S330); performing voiceprint recognition on the user voice information to obtain user voiceprint information, and in a case that the user voiceprint information matching preset voiceprint information, determining the voice control window corresponding to the preset voiceprint information as the target voice control window (Jang; p. 0119 - The controller 180 can display a speaker indicator on the display unit 151 based on a voice recognition result); and creating the voice control relationship between the user corresponding to the user voiceprint information and the target voice control window (Jang; p. 0121 - As described above, the controller 180 can display a speaker indicator for identifying the first and the second speaker in addition to the first and the second avatar. For example, while the first avatar is displayed for identifying a first speaker, to identify the second speaker, an input device indicator corresponding to a voice input device used by the second speaker can be displayed along with the first avatar. Accordingly, each speaker can know that his or her voice is recognized by the display device 100).
As per claim 10, Jang in view of Lu discloses: The voice control method according to claim 1, wherein the obtaining user voice information comprises: obtaining original user voice information, and decoding the original user voice information to obtain user voice audio (Jang; p. 0118 - The memory 160 can store a reference voice pattern of each speaker. The reference voice pattern can be obtained through a repetitive voice input procedure. More specifically, the controller 180 can extract a feature vector from a voice signal generated by a speaker; calculates a probability value between the extracted feature vector and at least one speaker model pre-stored in a database; and carry out speaker identification determining whether the speaker is the one registered in the database based on the calculated probability value or speaker verification determining whether the speaker's access has been made in a proper way); and performing text recognition on the user voice audio to obtain the user voice information (Jang; p. 0100 - if a speaker S says "CH 10" toward the microphone of the remote control 10, the controller 180 can recognize the voice of the speaker S and display the recognition result on the display unit 151 in the form of text of "CH 10").
As per claim 11, Jang in view of Lu discloses: The voice control method according to claim 1, wherein the control instruction comprises an execution action and execution content; and the executing the control content corresponding to the control instruction in the target voice control window, comprises: executing the execution content in the target voice control window based on the execution action (Jang; p. 0153 - For example, as shown in FIG. 20, it can be known that the first speaker S1 has set up a "Music" program as his or her favorite or high priority program. Therefore, according to a control method for a display device according to an embodiment of the present invention, the display device 100 can receive a speaker's voice through a voice input device, carry out voice recognition upon the received voice, recognize a speaker corresponding to the voice recognition result, and control itself to operate in the environment set up by the speaker… receiving and converting instructions for controlling a “Music” program).
As per claim 12, Jang in view of Lu discloses: The voice control method according to claim 1, further comprising: in a case that the user voice information corresponding to the user is not obtained within a preset time period, displaying default content in the target voice control window (Jang; p. 0086 - At this time, the display device 100 can receive voice from the at least one speaker simultaneously or sequentially with a predetermined time interval. For example, when two speakers generate voice at the same time, the display device 100 can display a voice recognition error message on the display unit 151. Also, when voice is received sequentially, the display device 100 carries out voice recognition according to the order of the corresponding input sequence; on the other hand, when another voice is input while voice recognition is carried out upon particular voice, a voice recognition error message can be displayed on the display unit 151).
As per claim 13, Jang in view of Lu discloses: The voice control method according to claim 1, wherein the user voice information comprises near-field voice information and/or far-field voice information (Jang; p. 0164 - the second voice input device is a microphone embedded in the display device 100 (e.g., a smart TV) or a microphone array prepared near the smart TV; and reveals weak mobility and usually located at a relatively long distance from a speake (far-field information); p. 0171 - Accordingly, if a speaker uses the second voice input device, since signal strength of a voice signal is weak, the display device 100 can display an indicator 62 proposing re-inputting a voice by using the first voice input device on the display unit 151 (near-field information)).
Conclusion
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure. The prior art made of record and not relied upon includes:
Chang (US PG Pub 20220368742) discloses user interfaces for managing shared-content sessions. In some embodiments, content is shared with a group of users participating in a shared-content session. In some embodiments, the content is screen-share content that is shared from one device to other participants of the shared-content session. In some embodiments, the content is synchronized content for which output of the content is synchronized across the participants of the shared-content session (Chang; Abstract).
Any inquiry concerning this communication or earlier communications from the examiner should be directed to Rodrigo A Chavez whose telephone number is (571)270-0139. The examiner can normally be reached Monday - Friday 9-6 ET.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Richemond Dorvil can be reached at 5712727602. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/RODRIGO A CHAVEZ/Examiner, Art Unit 2658
/RICHEMOND DORVIL/Supervisory Patent Examiner, Art Unit 2658
Prosecution Insights