Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
DETAILED ACTION
1. This action is responsive to applicant’s amendment dated 7/2/2026.
2. Claims 1-20 are pending in the case.
3. Claims 1, 16,19 and 20 are independent claims.
Applicant’s Response
4. In Applicant’s response dated 7/2/2026, applicant has amended the following:
a) Claims 1, 11, 12, 16,18, 19 and 20
b) Abstract and Title of Specification
Based on Applicant’s amendments and remarks, the following objections and rejections previously set forth in Office Action dated 4/3/2026 are withdrawn:
a) Objection to claim 11
b) Objection to Specification
c) 35 U.S.C. 101 Rejection to claim 20
d) Claims are no longer subjected to an interpretation under 35 U.S.C. § 112(f)
Claim Rejections - 35 USC § 102
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention.
Claims 1-14 and 16-20 are rejected under 35 U.S.C. 102(a)(1) as being anticipated by Hendricks et al. (hereinafter “Hendricks”), U.S. Published Application No. 20120166191 A1.
Claim 1:
Hendricks teaches An interaction method, comprising:
displaying first display content corresponding to a first type in a first display interface; switching from the first display interface to a second display interface in response to a triggering; (e.g., displaying a page of content from an electronic book without dictation and switching to a second page of content from the electronic with dictation in response to turning the page (i.e., triggering) par. 199; An auto text-to-speech section 1106 with manual page turn permits a user to select an option to have the viewer 266 automatically convert an entire page of displayed text to speech. par. 200; A dictation section 1112 permits a user to select an option to perform dictation into an electronic book. The term dictation refers to conversion of speech to corresponding text in electronic form capable of display on a viewer or other display device. par. 202; If the user selected dictation section 1112, a dictation process 1144 executes a dictation routine 1146. If the user selected view book section 1108, a view book process 1148 executes a view book routine 1150. Par. 204; The user may select page turn sections 1210 and 1212 to page backward and forward, respectively, in the displayed electronic book. The user may select a convert section 1206 to convert selected text to speech )
and displaying second display content corresponding to a second type in the second display interface, (e.g., displaying a second page from electronic book with dictation (i.e., second type of content) par. 204; The user may select a convert section 1206 to convert selected text to speech)
wherein the first display content of the first type is one of a data stream corresponding to visual content and a data stream corresponding to auditory content, (e.g., viewing displayed first page of text without dictation (i.e., visual content) par. 55; Preferably, a connector, library unit and an electronic book unit, or viewer unit, are used. The connector portion of the home subsystem receives the analog video signal and strips or extracts the text from the video. par. 56; The viewing device is preferably a portable book shaped viewer which stores one or more electronic books for viewing and provides a screen for interacting with the home library unit.)
the second display content of the second type is the other of the data stream corresponding to visual content and the data stream corresponding to auditory content, (e.g., selecting text to speech feature (i.e., auditory content) for text portions on second page of the displayed electronic book par. 199; An auto text-to-speech section 1106 with manual page turn permits a user to select an option to have the viewer 266 automatically convert an entire page of displayed text to speech Par. 205; The user may select page turn sections 1210 and 1212 to page backward and forward, respectively, in the displayed electronic book. The user may select a convert section 1206 to convert selected text to speech)
and wherein at least one item of auditory content data in the data stream corresponding to auditory content is different from auditory content data corresponding to visual content data in the data stream corresponding to visual content. (e.g., different auditory content based on different textual words or different voice settings such a child voice for one page and male voice for a second page par. 219; The settings menu screen 1280 also includes a voice options section 1301 permitting a user to select various options for speech used to convert text. These options include, for example, a male voice 1313; a female voice 1315; a child's voice 1317; voice option 1 (1319); and voice option N (1321).)
Claim 2 depends on claim 1:
Hendricks teaches wherein the first display content of the first type is the data stream corresponding to visual content, the second display content of the second type is the data stream corresponding to auditory content, (e.g., displaying a page of content from an electronic book without dictation (i.e., data stream corresponding to visual content) and switching to a second page of content from the electronic with dictation (i.e., data stream corresponding to auditory content) in response to turning the page (i.e., triggering) par. 199; An auto text-to-speech section 1106 with manual page turn permits a user to select an option to have the viewer 266 automatically convert an entire page of displayed text to speech. par. 200; A dictation section 1112 permits a user to select an option to perform dictation into an electronic book. The term dictation refers to conversion of speech to corresponding text in electronic form capable of display on a viewer or other display device. par. 202; If the user selected dictation section 1112, a dictation process 1144 executes a dictation routine 1146. If the user selected view book section 1108, a view book process 1148 executes a view book routine 1150. Par. 204; The user may select page turn sections 1210 and 1212 to page backward and forward, respectively, in the displayed electronic book. The user may select a convert section 1206 to convert selected text to speech )
and switching from the first display interface to the second display interface is a conversion from the data stream corresponding to visual content to the data stream corresponding to auditory content. (e.g., displaying a page without dictation and manually turning a page with automatic text to speech of the second page par. 199; An auto text-to-speech section 1106 with manual page turn permits a user to select an option to have the viewer 266 automatically convert an entire page of displayed text to speech. Par. 204; The user may select page turn sections 1210 and 1212 to page backward and forward, respectively, in the displayed electronic book. The user may select a convert section 1206 to convert selected text to speech)
Claim 3 depends on claim 2:
Hendricks teaches further comprising:
determining the second display content according to a background audio associated with the first display content of the first type; (e.g., displaying text with text to speech at low volume (i.e., background audio) par. 199; An auto text-to-speech section 1106 with manual page turn permits a user to select an option to have the viewer 266 automatically convert an entire page of displayed text to speech. For the various text-to-speech conversion features, the viewer 266 may use speaker/microphone 608′ to convert text in electronic form to corresponding speech. Par. 204; The user may select page turn sections 1210 and 1212 to page backward and forward, respectively, in the displayed electronic book. The user may select a convert section 1206 to convert selected text to speech)
or determining the second display content according to play information corresponding to the first display interface. (e.g., selecting a page of text based on title (i.e., play information) par. 203; In using a voice commands mode, a user may speak the title of a particular electronic book, or other identifying information, in order to select it.)
Claim 4 depends on claim 2:
Hendricks teaches further comprising: directly determining the second display content in response to the triggering, wherein there is no corresponding relationship between the second display content and the first display content. (e.g., selecting a first book for the first display and a different book for the second display (i.e., no corresponding relationship) par. 203; In using a voice commands mode, a user may speak the title of a particular electronic book, or other identifying information, in order to select it.)
Claim 5 depends on claim 3:
Hendricks teaches wherein the second display content is a predetermined audio, and the predetermined audio comprises the background audio. (e.g., selecting text for dictation at low volume (i.e., predetermined background audio) par. 199; An auto text-to-speech section 1106 with manual page turn permits a user to select an option to have the viewer 266 automatically convert an entire page of displayed text to speech. For the various text-to-speech conversion features, the viewer 266 may use speaker/microphone 608′ to convert text in electronic form to corresponding speech. Par. 204; The user may select page turn sections 1210 and 1212 to page backward and forward, respectively, in the displayed electronic book. The user may select a convert section 1206 to convert selected text to speech)
Claim 6 depends on claim 5:
Hendricks teaches wherein the determining the second display content according to a background audio associated with the first display content of the first type comprises: acquiring complete song information of the background audio, and determining the complete song information as the second display content. (e.g., low volume text to speech voice setting (i.e., background audio) for second page being the same as the low volume text to speech voice setting for the first page. Examiner considers the characteristics of the voice used for text to speech as the recited “complete song information”. Par. 219; The settings menu screen 1280 also includes a voice options section 1301 permitting a user to select various options for speech used to convert text. These options include, for example, a male voice 1313; a female voice 1315; a child's voice 1317; voice option 1 (1319); and voice option N (1321). A user may select one of these options by, for example, positioning a cursor over the corresponding section next to the desired option and selecting the section, or by entering various other commands such as a particular selection of input keys. Other options 1319 and 1321 may represent other types of voices such as user-defined voices, voices with particular characteristics, or the actual author's voice, for example. The other options 1319 and 1321 could also include the voice of a famous person, such as James Earl Jones or an imitation of James Earl Jones, for example.)
Claim 7 depends on claim 3:
Hendricks teaches wherein the displaying second display content corresponding to a second type in the second display interface comprises: acquiring a recommended audio data stream; (e.g., dictation for highlighted text Par. 204; The user may select page turn sections 1210 and 1212 to page backward and forward, respectively, in the displayed electronic book. The user may select a convert section 1206 to convert selected text to speech)
and determining the recommended audio data stream as the second display content, and automatically playing the recommended audio data stream in the second display interface .(automatic dictation of highlighted text par. 199; An auto text-to-speech section 1106 with manual page turn permits a user to select an option to have the viewer 266 automatically convert an entire page of displayed text to speech.)
Claim 8 depends on claim 2:
Hendricks teaches wherein the second type comprises N sub-categories of audio data streams, N is an integer greater than 1, and the method further comprises: determining one of the N sub-categories of audio data streams as the second display content in response to the triggering. (e.g., different auditory content based on different voice settings (i.e., sub categories of audio data streams) such a child voice for one page and male voice for a second page par. 219; The settings menu screen 1280 also includes a voice options section 1301 permitting a user to select various options for speech used to convert text. These options include, for example, a male voice 1313; a female voice 1315; a child's voice 1317; voice option 1 (1319); and voice option N (1321). Par. 219; Other options 1319 and 1321 may represent other types of voices such as user-defined voices, voices with particular characteristics, or the actual author's voice, for example.)
Claim 9 depends on claim 2:
Hendricks teaches wherein the second type comprises N sub-categories of audio data streams, N is an integer greater than 1, and the method further comprises: switching to play the N sub-categories of audio data streams in the second display interface in response to a preset operation for the second display interface; (e.g., different auditory content based on different voice settings (i.e., sub categories of audio data streams) such a child voice for one page and male voice for a second page (i.e., switching interfaces in response to turning the page operation) Par. 204; The user may select page turn sections 1210 and 1212 to page backward and forward, respectively, in the displayed electronic book. The user may select a convert section 1206 to convert selected text to speech par. 219; The settings menu screen 1280 also includes a voice options section 1301 permitting a user to select various options for speech used to convert text. These options include, for example, a male voice 1313; a female voice 1315; a child's voice 1317; voice option 1 (1319); and voice option N (1321).)
or displaying a first movable control on the second display interface, and switching to play the N sub-categories of audio data streams in the second display interface in response to a dragging for the first movable control. (e.g., selecting voice setting via cursor (i.e., dragging first movable control) par. 118; These unique and novel controls 740 allow the consumer to select stored electronic books and electronic books from catalogues, move a cursor, and turn pages in a book. Typically, preferred controls 740 include forward and reverse page buttons 742, 741, a ball (or trackball) 743 for cursor movement, one or more selection buttons 745, a current book button 747 and a bookmark button 749 (see FIG. 14a). par. 198; Main menu 1100 has a number of sections for permitting the user to select the options by selecting an appropriate section. The term section refers to a definable portion of the screen, and the act of selecting a section may involve, for example, positioning the cursor or a pointer over the section using trackball 743 and depressing selection button 745 to “click on” the section; other cursor-control devices, including peripheral devices, may be used to select a section either by positioning the cursor or by entering a particular command. Par. 219; Other options 1319 and 1321 may represent other types of voices such as user-defined voices, voices with particular characteristics, or the actual author's voice, for example.)
Claim 10 depends on claim 2:
Hendricks teaches further comprising: when current display content is the data stream corresponding to auditory content, controlling the current display content and/or the data stream corresponding to auditory content in response to obtained voice control command. (e.g., selecting textual content corresponding to text to speech (i.e., auditory content) based on voice commands par. 5; The present invention allows a user to control the system by selecting options from a screen or by entering voice commands. par. 203; In using a voice commands mode, a user may speak the title of a particular electronic book, or other identifying information, in order to select it. par. 216; Voice or audible commands are the ability of the viewer 266 to execute a function corresponding to a command provided by a user in speech form. The settings menu screen 1280 also includes an available voice commands section 1311, identifying voice or audible commands available to a user and the following exemplary speech required to execute the command: “page forward” command 1303; “page backward” command 1305; “open book” command 1307; and other functions 1309.)
Claim 11 depends on claim 9:
Hendricks teaches wherein a second movable control is displayed in the first display interface, the switching from the first display interface to a second display interface in response to a triggering comprises: acquiring a first dragging for the second movable control; and determining to trigger interface switching in response to the first dragging, wherein the interface switching correspond to switch from the first display interface to the second display interface. (e.g., selecting turn page button via moving cursor (i.e., dragging movable control) to select the button par. 216; A user may select the activate or deactivate options by, for example, positioning a cursor over the corresponding section next to the desired option and selecting the section, or by entering various other commands such as a particular selection of input keys. Par. 223; Page turn sections 1338 and 1340 permit a user to page backward and forward, respectively, in the displayed electronic book. )
Claim 12 depends on claim 11:
Hendricks teaches wherein the determining to trigger interface switching in response to the first dragging comprises: determining to trigger the interface switching in response to the first dragging corresponding to dragging the second movable control to an area in the first display interface, wherein the area comprises at least one first predetermined area located in the first display interface. (e.g., selecting “next page” arrow button via moving cursor (i.e., dragging movable control) to select the button (i.e., first predetermined area) see Figures 23 and 24; 1212 page turn button; par. 216; A user may select the activate or deactivate options by, for example, positioning a cursor over the corresponding section next to the desired option and selecting the section, or by entering various other commands such as a particular selection of input keys. Par. 223; Page turn sections 1338 and 1340 permit a user to page backward and forward, respectively, in the displayed electronic book. )
Claim 13 depends on claim 11:
Hendricks teaches further comprising: acquiring a second dragging for a third movable control in the second display interface after displaying the second display content in the second display interface; and in response to the second dragging corresponding to dragging the third movable control to a second predetermined area in the second display interface, switching to the first display interface and continuing to display the first display content in the first display interface. (e.g., selecting “previous page” arrow button via moving cursor (i.e., dragging movable control) to select the button (i.e., second predetermined area) see Figures 23 and 24; 1210 page turn button; par. 216; A user may select the activate or deactivate options by, for example, positioning a cursor over the corresponding section next to the desired option and selecting the section, or by entering various other commands such as a particular selection of input keys. Par. 223; Page turn sections 1338 and 1340 permit a user to page backward and forward, respectively, in the displayed electronic book. )
Claim 14 depends on claim 13:
Hendricks teaches wherein the second predetermined area corresponds to a position where the second movable control is displayed in the first display interface. (e.g., predetermined area at the bottom of the interface of Figure 23 is where the cursor (i.e., movable control) selects page turning options see Figures 23 and 24;page turn buttons 1210 and 1212)
Independent Claim 16:
Claim 16 is substantially encompassed in claim 1, therefore, Examiner relies on the same rationale set forth in claim 1 to reject claim 16. (see Hendricks; computer system of Figure 2)
Claim 17 depends on claim 16:
Claim 17 is substantially encompassed in claim 2, therefore, Examiner relies on the same rationale set forth in claim 2 to reject claim 17.
Claim 18 depends on claim 17:
Claim 18 is substantially encompassed in claim 3, therefore, Examiner relies on the same rationale set forth in claim 3 to reject claim 18.
Claim 19:
Claim 19 is substantially encompassed in claim 1, therefore, Examiner relies on the same rationale set forth in claim 1 to reject claim 19. (see Hendricks; computer of Figure 2)
Claim 20 depends on claim 1:
Claim 20 is substantially encompassed in claim 1, therefore, Examiner relies on the same rationale set forth in claim 1 to reject claim 20. (see Hendricks; computer system of Figure 2)
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claim 15 is rejected under 35 U.S.C. 103 as being unpatentable over Hendricks as cited above in view of Alonso Ruiz et al. (hereinafter “Alonso”), U.S. Published Application No. 20210191588 A1.
Claim 15 depends on claim 1:
Hendricks teaches wherein an operable control is displayed in the first display interface, (e.g., page turn controls of Figure 23 and 24; par. 204; The user may select page turn sections 1210 and 1212 to page backward and forward, respectively, in the displayed electronic book.)
the switching from the first display interface to a second display interface in response to a triggering comprises: determining to trigger interface switching in response to an operation duration for the operable control , wherein the interface switching corresponds to switch from the first display interface to the second display interface. (e.g., selecting page turn controls of Figure 23 and 24 to switch pages (i.e., switch from first to second interface); par. 204; The user may select page turn sections 1210 and 1212 to page backward and forward, respectively, in the displayed electronic book.)
Hendricks fails to expressly teach satisfying a time threshold.
However, Alonso teaches an operation duration for a operable control satisfying a time threshold. (e.g., selecting displayed GUI elements (i.e., operable controls) based on touch gestures satisfying a time threshold see par. 56; In some embodiments, a tap gesture is detected in accordance with a determination that the length of time between the finger-down event and the finger-up event is less than a predetermined value (e.g., less than 0.1, 0.2, 0.3, 0.4 or 0.5 seconds) par. 57; a long press gesture is detected based on a duration of the contact on the touch-sensitive surface with less than a threshold amount of movement par. 185; Each application icon, when selected and activated by a user input (e.g., a tap input or double tap input), causes the device to open (e.g., display) the application corresponding to the application icon. Par. 192; In FIG. 5H, after contact 5018 remains substantially stationary for a threshold amount of time (e.g., a long press time threshold), the device enlarges card 5012 to indicate that card 5012 is selected. )
It would have obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify the touch inputs for selecting operable controls as taught by Hendricks to include touch gestures satisfying time thresholds as taught by Alonso, with a reasonable expectation of success, to provide the benefit of performing various operations with a touchscreen in effort to improving user interaction experience with a device.
Response to Arguments
Applicant's arguments filed 7/2/2026 have been fully considered but they are not persuasive.
Prior Art Rejections
Applicant argues that Hendricks does not disclose that at least one item of auditory content data in the data stream corresponding to auditory content is different from auditory content data corresponding to visual content data in the data stream corresponding to visual content. More specifically, Hendricks does not disclose that an item of auditory content in the speech is different from auditory content data corresponding to the text. Indeed, Hendricks suggest the exact opposite-that the speech is an exact dictation of the displayed text. Nowhere does Hendricks disclose that the speech deviates from the displayed text in any way. Accordingly, Hendricks does not meet what is claimed. (see Response; pages 10 and 11)
Examiner respectfully disagrees.
Hendricks teaches various voice options such as male voice or female voice (see par. 219). Examiner submits that merely changing the voice option for one page to be different than a voice option for a second page teaches or suggests an item of auditory content in the speech is different from auditory content data corresponding to the text. Applicant has failed to address or acknowledge this point made by Office Action in respect to par. 219 of Hendricks.
For at least the foregoing reasons, prior art rejections are maintained.
Conclusion
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to HENRY ORR whose telephone number is (571)270-1308. The examiner can normally be reached 9AM-5PM EST M-F.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Adam Queler can be reached at (571)272-4140. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/HENRY ORR/ Primary Examiner, Art Unit 2172
Prosecution Insights