Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
DETAILED ACTION
Claims 1-13 and 15-21 are pending. Claims 1, 15 and 16 are independent. Claims have not been amended.
Applicant’s amendments and arguments are considered but are either unpersuasive or moot in view of the new grounds of rejection that, if presented, were necessitated by the amendments to the Claims.
This action is Final.
Response to Arguments
Applicant's arguments filed 04/10/2026 have been fully considered but they are not persuasive.
Regarding the rejections under 35 U.S.C. §§102 and 103, the applicant argues:
“The premise of the rejection is that Jang's speaker-related indication objects correspond to the claimed ‘target voice control window.’ However, Jang consistently describes these display objects as a ‘speaker indicator’ or an ‘avatar for identifying the speaker S’, i.e., as visual indications identifying who is speaking, rather than as a voice control window to which control is bound and within which control content is executed. See, e.g., Jang T [0105]-[0106], where Jang explains that the displayed name or avatar allows the speaker to know that his or her voice has been recognized.
That is a fundamentally different concept from the present claim. Claim 1 does not merely require displaying a visual indication that a user has spoken. Rather, claim 1 requires: (1) creating a voice control relationship between the user and a target voice control window based on the user voice information, wherein the target voice control window is one of multiple voice control windows displayed in the display terminal; and (2) executing control content corresponding to the control instruction in the target voice control window.
Thus, the claim is directed to a multi-window control architecture in which the system determines which voice control window corresponds to which user, and then carries out control in that corresponding window. Jang, by contrast, is directed to recognizing who is speaking and displaying a visual indication of the recognized speaker.”
…
“Moreover, the Office Action further cites Jang [0153] for the limitation of "executing control content corresponding to the control instruction in the target voice control window." This mapping is likewise insufficient.”
Regarding applicant’s arguments, the examiner respectfully disagrees. The examiner contends that the claimed subject matter of a “target voice control window” is recited so broadly that it would be covered by Jang’s disclosure. The examiner notes that the recited “target voice control window” appears to be nothing more than an object that is presented on a display, where said object is associated to a user upon receiving the user’s voice information. The recited language does not specifically describe the association other than reciting that it is a “voice control relationship”. Upon further inspection, the examiner finds that the specification lacks any further description or definition of the “target voice control window” or the “voice control relationship”. The example in p. 0053 contains a non-exhaustive example of how a target control window may be arranged and displayed on the device. However, no further specificity is provided. The examiner further notes that Jang in fact does teach the voice control relationship, and the capability of providing the user with voice control capabilities upon establishing the voice control relationship, for example, in p. 0153, where Jang discloses:
For example, as shown in FIG. 20, it can be known that the first speaker S1 has set up a "Music" program as his or her favorite or high priority program. Therefore, according to a control method for a display device according to an embodiment of the present invention, the display device 100 can receive a speaker's voice through a voice input device, carry out voice recognition upon the received voice, recognize a speaker corresponding to the voice recognition result, and control itself to operate in the environment set up by the speaker.
Here Jang discloses the capability of operate the device through voice control in the environment set up by the speaker S1, once the voice control relationship has been established. Thus, the examiner contends that the examiner’s reading on the recited language is that the “target voice control window”, “voice control relationship” and “executing control content corresponding to the control instruction in the target voice control window”, is broad and would be covered by the teachings of Jang.
It is suggested that the claim expand on the concept of windows and define them with more particularity.
Claim Rejections - 35 USC § 102
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention.
Claims 1, 10-13, 15, 16 are rejected under 35 U.S.C. 102(a)(1) as being anticipated by Jang (US PG Pub 20120316876).
As per claims 1, 15 and 16, Jang discloses:
A voice control method, applied in a display terminal, an electronic device and a computer non-transitory readable storage medium on which a computer program is stored (Jang; p. 0182 - the present invention may be recorded in a computer-readable recording medium as a program to be executed in the computer), wherein when the computer program is executed by a processor (Jang; p. 0182 - The program or the code segments may be stored in a processor-readable medium; see also p. 0073-0074 & Fig. 2, item 180), and a memory (Jang; Fig. 2, item 160; p. 0074 - The software codes may be stored in the memory 160), configured to store executable instructions for the processor, the voice control method is implemented, comprising: obtaining user voice information (Jang; Fig. 3, item 17; p. 0080 - The voice input unit 17 receives voice signals of a speaker. For example, the voice input unit 17 can correspond to a microphone), and creating a voice control relationship between the user and a target voice control window based on the user voice information (Jang; Fig. 6, item SI; Fig. 7, item SI; p. 0087-0092 - The display device 100 can display the voice recognition result on the display unit 151 by using an indicator related to at least one of the speaker, the voice input device, and the voice recognition result. The indicator related to the speaker is an indicator capable of identifying the speaker, which can include text, an image, a sound signal, a display setting value corresponding to a particular speaker, and a voice pattern of the particular speaker; see also p. 0105 - though the speaker says "CH 10", the display device 100 displays the name (John) of the speaker S in the form of text on the display unit 151 and thus, the speaker S can know that his or her voice is recognized by the display device 100; see also p. 0106 - …the indicator displayed on the display unit 151 is an avatar for identifying the speaker S; accordingly, the speaker S can know that his or her voice is recognized by the display device 100… The item SI in both Fig. 6 & 7 are display windows that are used to identify the speaker who is using voice control, thus they represent a relationship between the user and the target voice control window on the display; see also p. 0121), wherein the target voice control window is one of multiple voice control windows displayed in the display terminal (Jang; Fig. 11, items S1 & S2; p. 0120 - with reference to FIG. 11, the controller 180 can recognize a first speaker S1 and a second speaker S2 respectively and display a first speaker indicator (SI1, a first avatar) corresponding to the first speaker S1 and a second speaker indicator (SI2, a second avatar) corresponding to the second speaker S2 on the display unit 151; see also p. 0121; see also Fig. 9; see also Fig. 19 & p. 0148); and converting the user voice information into a control instruction, and executing control content corresponding to the control instruction in the target voice control window (Jang; p. 0153 - For example, as shown in FIG. 20, it can be known that the first speaker S1 has set up a "Music" program as his or her favorite or high priority program. Therefore, according to a control method for a display device according to an embodiment of the present invention, the display device 100 can receive a speaker's voice through a voice input device, carry out voice recognition upon the received voice, recognize a speaker corresponding to the voice recognition result, and control itself to operate in the environment set up by the speaker… receiving and converting instructions for controlling a “Music” program).
As per claim 10, Jang discloses: The voice control method according to claim 1, wherein the obtaining user voice information comprises: obtaining original user voice information, and decoding the original user voice information to obtain user voice audio (Jang; p. 0118 - The memory 160 can store a reference voice pattern of each speaker. The reference voice pattern can be obtained through a repetitive voice input procedure. More specifically, the controller 180 can extract a feature vector from a voice signal generated by a speaker; calculates a probability value between the extracted feature vector and at least one speaker model pre-stored in a database; and carry out speaker identification determining whether the speaker is the one registered in the database based on the calculated probability value or speaker verification determining whether the speaker's access has been made in a proper way); and performing text recognition on the user voice audio to obtain the user voice information (Jang; p. 0100 - if a speaker S says "CH 10" toward the microphone of the remote control 10, the controller 180 can recognize the voice of the speaker S and display the recognition result on the display unit 151 in the form of text of "CH 10").
As per claim 11, Jang discloses: The voice control method according to claim 1, wherein the control instruction comprises an execution action and execution content; and the executing the control content corresponding to the control instruction in the target voice control window, comprises: executing the execution content in the target voice control window based on the execution action (Jang; p. 0153 - For example, as shown in FIG. 20, it can be known that the first speaker S1 has set up a "Music" program as his or her favorite or high priority program. Therefore, according to a control method for a display device according to an embodiment of the present invention, the display device 100 can receive a speaker's voice through a voice input device, carry out voice recognition upon the received voice, recognize a speaker corresponding to the voice recognition result, and control itself to operate in the environment set up by the speaker… receiving and converting instructions for controlling a “Music” program).
As per claim 12, Jang discloses: The voice control method according to claim 1, further comprising: in a case that the user voice information corresponding to the user is not obtained within a preset time period, displaying default content in the target voice control window (Jang; p. 0086 - At this time, the display device 100 can receive voice from the at least one speaker simultaneously or sequentially with a predetermined time interval. For example, when two speakers generate voice at the same time, the display device 100 can display a voice recognition error message on the display unit 151. Also, when voice is received sequentially, the display device 100 carries out voice recognition according to the order of the corresponding input sequence; on the other hand, when another voice is input while voice recognition is carried out upon particular voice, a voice recognition error message can be displayed on the display unit 151).
As per claim 13, Jang discloses: The voice control method according to claim 1, wherein the user voice information comprises near-field voice information and/or far-field voice information (Jang; p. 0164 - the second voice input device is a microphone embedded in the display device 100 (e.g., a smart TV) or a microphone array prepared near the smart TV; and reveals weak mobility and usually located at a relatively long distance from a speake (far-field information); p. 0171 - Accordingly, if a speaker uses the second voice input device, since signal strength of a voice signal is weak, the display device 100 can display an indicator 62 proposing re-inputting a voice by using the first voice input device on the display unit 151 (near-field information)).
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 2-9 and 17-21 are rejected under 35 U.S.C. 103 as being unpatentable over Jang in view of Skidmore et al. (US Patent 9996535; hereinafter “Skidmore”).
As per claims 2 and 17, Jang discloses: The voice control method and electronic device according to claims 1 and 15, wherein the creating the voice control relationship between the user and the target voice control window based on the user voice information, comprises: determining voice features corresponding to the user voice information (Jang; p. 0117 - in the case of multiple speakers S310, the controller 180 can recognize a voice pattern of a speaker received through a voice recognition device and carry out voice recognition according to the voice pattern S330), and determining a number N of users based on the voice features (Jang; p. 0120 – 0121 - with reference to FIG. 11, the controller 180 can recognize a first speaker S1 and a second speaker S2 respectively and display a first speaker indicator (SI1, a first avatar) corresponding to the first speaker S1 and a second speaker indicator (SI2, a second avatar) corresponding to the second speaker S2 on the display unit 151. As described above, the controller 180 can display a speaker indicator for identifying the first and the second speaker in addition to the first and the second avatar); and creating the voice control relationship between the N users and the N voice control windows, respectively (Jang; p. 0120 – 0121). Jang, however, fails to disclose in a case that the number N of users is less than or equal to a preset number M, displaying N voice control windows in the display terminal. Skidmore does teach in a case that the number N of users is less than or equal to a preset number M, displaying N voice control windows in the display terminal (Skidmore; Col. 12, lines 9-58 - at block 620, organization service 410 accesses a display size of the user computing device to calculate an optimal and/or maximum number of items that can be displayed in the user interface. For example, the accessed display size includes a length and width in pixels, inches, millimeters, or in any other measurement unit. Continuing with the example, organization service 410 accesses a document and/or item representation size. The document and/or item representation size may include a length and width in pixels or any other measurement unit. In some embodiments, the document representation size may include spacing, in pixels or any other measurement unit, of a document from other documents and/or borders of a window. Continuing with the example, organization service 410 calculates the number of document representations, such as icons, that can fit within the display size of the user interface by dividing the display size by the accessed size and/or dimensions of the document representation. Thus, the document viewing threshold may be sixteen for a mobile computing device based on the display size of the mobile computing device and a size of a document in the user interface of the mobile computing device). Therefore, it would have been obvious to one of ordinary skill in the art to modify the voice control method and electronic device of Jang, to include in a case that the number N of users is less than or equal to a preset number M, displaying N voice control windows in the display terminal, as taught by Skidmore, in order to efficiently browse items within any user interface, voice user interface, graphical user interface, page, video, electronic book and/or other electronic content (Skidmore; Col. 2, lines 63-67).
As per claims 3 and 18, Jang in view of Skidmore discloses: The voice control method and electronic device according to claims 2 and 17, upon which claims 3 and 18 depend. And further, Skidmore teaches wherein the preset number M is determined based on a size of the display terminal or a target size corresponding to the display terminal (Skidmore; Col. 12, lines 9-58 - at block 620, organization service 410 accesses a display size of the user computing device to calculate an optimal and/or maximum number of items that can be displayed in the user interface. For example, the accessed display size includes a length and width in pixels, inches, millimeters, or in any other measurement unit. Continuing with the example, organization service 410 accesses a document and/or item representation size. The document and/or item representation size may include a length and width in pixels or any other measurement unit. In some embodiments, the document representation size may include spacing, in pixels or any other measurement unit, of a document from other documents and/or borders of a window. Continuing with the example, organization service 410 calculates the number of document representations, such as icons, that can fit within the display size of the user interface by dividing the display size by the accessed size and/or dimensions of the document representation. Thus, the document viewing threshold may be sixteen for a mobile computing device based on the display size of the mobile computing device and a size of a document in the user interface of the mobile computing device). Therefore, it would have been obvious to one of ordinary skill in the art to modify the voice control method and electronic device of Jang, to include wherein the preset number M is determined based on a size of the display terminal or a target size corresponding to the display terminal, as taught by Skidmore, in order to efficiently browse items within any user interface, voice user interface, graphical user interface, page, video, electronic book and/or other electronic content (Skidmore; Col. 2, lines 63-67).
As per claims 4 and 19, Jang in view of Skidmore disclose: The voice control method and electronic device according to claims 2 and 17, further comprising: in a case that the number N of users is greater than the preset number M, selecting, from the N users, M target users according to a preset rule, wherein the preset rule comprises: detecting a distance between the user and the display terminal, and selecting the M target users from the N users according to the distance; or, selecting the M target users from the N users according to the voice features, wherein the voice features comprises volume; and creating the voice control relationship between the M target users and the M voice control windows, respectively (Jang; p. 0165 - if signal strength of a voice signal (volume) received through the second voice input device is below a predetermined threshold value S622, can recommend the user for using the first voice input device and display an indicator for the recommendation on the display unit 151, S623).
As per claims 5 and 20, Jang in view of Skidmore discloses: The voice control method and electronic device according to claims 2 and 17, further comprising: in a case that the number N of users is less than or equal to the preset number M, obtaining relative position information of the users relative to the display terminal; and creating, according to the relative position information, the voice control relationship between the N users and the N voice control windows, respectively (Jang; Fig. 13 & 16; p. 0126-0139 - With reference to FIG. 13, in the case of multiple speakers S410, the controller 180 can recognize a speaker's location S420…; see also p. 0149-0150 - The display device 100 can carry out voice recognition upon the voice of the first speaker S1 and select a speaker icon corresponding to the first speaker S1 from multiple speaker icons 58 based on the voice recognition result…).
As per claims 6 and 21, Jang in view of Skidmore discloses: The voice control method and electronic device according to claims 2 and 17, wherein the creating the voice control relationship between the user and the target voice control window based on the user voice information, comprises: displaying M voice control windows in the display terminal, and assigning a window identifier to each voice control window; in a case that the user voice information comprises information matching the window identifier, determining the target voice control window from the M voice control windows according to the user voice information; and creating the voice control relationship between the user corresponding to the user voice information and the target voice control window (Jang; p. 0149-0150 - According to the control method for a display device according to an embodiment of the present invention, a first speaker S1 transmits a predetermined voice to the display device 100 through a mobile terminal 20. The display device 100 can carry out voice recognition upon the voice of the first speaker S1 and select a speaker icon corresponding to the first speaker S1 from multiple speaker icons 58 based on the voice recognition result (voice information matching the window identifier)).
As per claim 7, Jang in view of Skidmore discloses: The voice control method according to claim 6, wherein the information matching the window identifier comprises position information of the user; and the determining the target voice control window from the M voice control windows according to the user voice information, comprises: determining the target voice control window from the M voice control windows according to the position information (Jang; Fig. 13 & 16; p. 0126-0139 - With reference to FIG. 13, in the case of multiple speakers S410, the controller 180 can recognize a speaker's location S420…; see also p. 0149-0150 - The display device 100 can carry out voice recognition upon the voice of the first speaker S1 and select a speaker icon corresponding to the first speaker S1 from multiple speaker icons 58 based on the voice recognition result… if there is an existing icon/avatar on the display corresponding to the current speaker, the speaker is assigned to the matching icon/avatar).
As per claim 8, Jang in view of Skidmore discloses: The voice control method according to claim 6, further comprising: in a case that the user voice information does not comprise information matching the window identifier, obtaining relative position information of the user relative to the display terminal; and creating the voice control relationship between the user corresponding to the user voice information and the target voice control window according to the relative position information (Jang; Fig. 13 & 16; p. 0126-0139 - With reference to FIG. 13, in the case of multiple speakers S410, the controller 180 can recognize a speaker's location S420, recognize the speaker as the speaker's location is recognized, and change a pointing direction of a speaker indicator according to the speaker's location recognized S440… if there is no existing icon/avatar on the display corresponding to the user who is speaking, one is created and placed on the display relative to the user’s position).
As per claim 9, Jang in view of Skidmore disclose: The voice control method according to claim 2, wherein the creating the voice control relationship between the user and the target voice control window based on the user voice information, comprises: displaying M voice control windows in the display terminal (Jang; Fig. 11, items S1 & S2; p. 0120 - with reference to FIG. 11, the controller 180 can recognize a first speaker S1 and a second speaker S2 respectively and display a first speaker indicator (SI1, a first avatar) corresponding to the first speaker S1 and a second speaker indicator (SI2, a second avatar) corresponding to the second speaker S2 on the display unit 151; see also p. 0121; see also Fig. 9; see also Fig. 19 & p. 0148); determining preset voiceprint information corresponding to the M voice control windows respectively (Jang; p. 0117-0118 - in the case of multiple speakers S310, the controller 180 can recognize a voice pattern of a speaker received through a voice recognition device and carry out voice recognition according to the voice pattern S330); performing voiceprint recognition on the user voice information to obtain user voiceprint information, and in a case that the user voiceprint information matching preset voiceprint information, determining the voice control window corresponding to the preset voiceprint information as the target voice control window (Jang; p. 0119 - The controller 180 can display a speaker indicator on the display unit 151 based on a voice recognition result); and creating the voice control relationship between the user corresponding to the user voiceprint information and the target voice control window (Jang; p. 0121 - As described above, the controller 180 can display a speaker indicator for identifying the first and the second speaker in addition to the first and the second avatar. For example, while the first avatar is displayed for identifying a first speaker, to identify the second speaker, an input device indicator corresponding to a voice input device used by the second speaker can be displayed along with the first avatar. Accordingly, each speaker can know that his or her voice is recognized by the display device 100).
Conclusion
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure. The prior art made of record and not relied upon includes:
Chang (US PG Pub 20220368742) discloses user interfaces for managing shared-content sessions. In some embodiments, content is shared with a group of users participating in a shared-content session. In some embodiments, the content is screen-share content that is shared from one device to other participants of the shared-content session. In some embodiments, the content is synchronized content for which output of the content is synchronized across the participants of the shared-content session (Chang; Abstract).
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to Rodrigo A Chavez whose telephone number is (571)270-0139. The examiner can normally be reached Monday - Friday 9-6 ET.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Richemond Dorvil can be reached at 5712727602. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/RODRIGO A CHAVEZ/Examiner, Art Unit 2658
/FARIBA SIRJANI/Primary Examiner, Art Unit 2659
Prosecution Insights