DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claim Rejections - 35 USC § 102
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
Note that citations to figures and elements should be understood to also implicitly refer to any pertinent explanatory text in the reference.
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention.
Claim 1-4, 8, 10-11, and 13-14 are rejected under 35 U.S.C. 102(a)(1) as being anticipated by US 2012/0038679 A1 (Yun).
Regarding claim 1, Yun teaches a method comprising:
at a first electronic device (Figs. 1, 3 at 100) in communication with a display generation component (Fig. 3 at 151), one or more input devices ([79], [86], Fig. 3 at 130), and a second electronic device (Fig. 3 at 200):
while in a remote interaction mode with the second electronic device, transmitting, to the second electronic device, data associated with displaying an image ([115]-[117]; Fig. 3 at 500) and respective data corresponding to the image ([115]-[117]; Fig. 3 at 430), wherein the image is associated with operation of the first electronic device ([115]-[117]), and wherein the respective data provides the second electronic device information about one or more functions, to be performed by the first electronic device, associated with the image ([115]-[119]: the second electronic device receives information on the first screen image input areas which are used to generate control signals to control specific functions on the first electronic device, thus the received data includes information about one or more functions performed by the first electronic device);
after transmitting, to the second electronic device, the data associated with displaying the image and the respective data corresponding to the image, receiving, from the second electronic device, data associated with an input associated with the image, wherein the input associated with the image is received via the second electronic device while the image is being displayed via the second electronic device ([117]-[119]); and
in response to receiving the data associated with the input:
in accordance with a determination that the respective data is first data, performing a first operation at the first electronic device corresponding to the image in accordance with the first data ([117]-[119], esp. [119]: at the second electronic device, the first soft key button 430 may be considered to be corresponding to first data, the second soft key button as corresponding to second data, etc., and the first electronic device controls “a specific function corresponding to the manipulation of the prescribed key button 130 matching the manipulated soft key button 430”); and
in accordance with a determination that the respective data is second data, performing a second operation, different from the first operation, at the first electronic device corresponding to the image in accordance with the second data ([117]-[119], esp. [119]: at the second electronic device, the first soft key button 430 may be considered to be corresponding to first data, the second soft key button as corresponding to second data, etc., and the first electronic device controls “a specific function corresponding to the manipulation of the prescribed key button 130 matching the manipulated soft key button 430”).
Regarding claim 2, Yun teaches wherein: in response to receiving the data associated with the input: in accordance with the determination that the respective data is the first data, the first data includes one or more first instructions that cause the first electronic device to perform the first operation corresponding to the image and the first data ([117]-[119] OR Fig. 19 at S196 & S198); and in accordance with the determination that the respective data is the second data, the second data includes one or more second instructions that cause the first electronic device to perform the second operation corresponding to the image and the second data ([117]-[119] OR Fig. 21 at S216 & S218).
Regarding claim 3, Yun teaches wherein the first electronic device includes a hardware input device ([79]; Fig. 3 at 130), and the data associated with displaying the image includes data associated with displaying a representation of the hardware input device with the image ([117]-[119]), the method further comprising:
while in the remote interaction mode and after transmitting, to the second electronic device, the data associated with displaying the image and the respective data corresponding to the image, receiving, from the second electronic device, data associated with a second input directed to the representation of the hardware input device, wherein the second input is received via the second electronic device while the representation of the hardware input device is being displayed via the second electronic device with the image ([117]-[119]); and
in response to receiving the data associated with the second input:
in accordance with a determination that the data associated with the second input indicates that the second input corresponds to a first interaction with the hardware input device, performing a third operation at the first electronic device corresponding to the first interaction with the hardware input device ([117]-[119]).
Regarding claim 4, Yun teaches in response to receiving the data associated with the second input: in accordance with a determination that the data associated with the second input corresponds to a second interaction with the hardware input device, performing a fourth operation, different from the third operation, at the first electronic device corresponding to the second interaction with the hardware input device ([117]-[119]).
Regarding claim 8, Yun teaches at the first electronic device: while in the remote interaction mode with the second electronic device and while the second electronic device is operating in a respective control mode, receiving, from the second electronic device, data associated with a second input corresponding to selection of a user interface element of the image using the respective control mode, wherein the second input is received via the second electronic device while the user interface element is being displayed via the second electronic device in the image; and in response to receiving the data associated with the second input: performing a third operation corresponding to the selection of the user interface element using the respective control mode ([117]-[122]).
Regarding claim 10, Yun teaches wherein: the second electronic device is in communication with a switch input device, the second input is associated with the switch input device, and performing the third operation corresponding to the selection of the user interface element using the respective control mode includes performing a selection of the user interface element ([117]-[119]).
Regarding claim 11, Yun teaches wherein the second electronic device is in communication with a hardware input device, and the input associated with the image is detected via the hardware input device ([118]).
Regarding claim 13, Yun teaches a first electronic device (Figs. 1, 3 at 100), comprising:
one or more processors ([95], [104], [105]);
memory ([95], [104], [105]); and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions ([95], [104], [105]) for:
while in a remote interaction mode with a second electronic device (Fig. 3 at 200), transmitting, to the second electronic device, data associated with displaying an image ([115]-[117]; Fig. 3 at 500) and respective data corresponding to the image ([115]-[117]; Fig. 3 at 430), wherein the image is associated with operation of the first electronic device ([115]-[117]), and wherein the respective data provides the second electronic device information about one or more functions, to be performed by the first electronic device, associated with the image ([115]-[119]: the second electronic device receives information on the first screen image input areas which are used to generate control signals to control specific functions on the first electronic device, thus the received data includes information about one or more functions performed by the first electronic device);
after transmitting, to the second electronic device, the data associated with displaying the image and the respective data corresponding to the image, receiving, from the second electronic device, data associated with an input associated with the image, wherein the input associated with the image is received via the second electronic device while the image is being displayed via the second electronic device ([117]-[119]); and
in response to receiving the data associated with the input:
in accordance with a determination that the respective data is first data, performing a first operation at the first electronic device corresponding to the image in accordance with the first data ([117]-[119], esp. [119]: at the second electronic device, the first soft key button 430 may be considered to be corresponding to first data, the second soft key button as corresponding to second data, etc., and the first electronic device controls “a specific function corresponding to the manipulation of the prescribed key button 130 matching the manipulated soft key button 430”); and
in accordance with a determination that the respective data is second data, performing a second operation, different from the first operation, at the first electronic device corresponding to the image in accordance with the second data ([117]-[119], esp. [119]: at the second electronic device, the first soft key button 430 may be considered to be corresponding to first data, the second soft key button as corresponding to second data, etc., and the first electronic device controls “a specific function corresponding to the manipulation of the prescribed key button 130 matching the manipulated soft key button 430”).
Regarding claim 14, Yun teaches a non-transitory computer readable storage medium storing one or more programs ([95], [104], [105]), the one or more programs comprising instructions, which when executed by one or more processors of a first electronic device ([95], [104], [105]), cause the first electronic device (Figs. 1, 3 at 100) to:
while in a remote interaction mode with a second electronic device (Fig. 3 at 200), transmitting, to the second electronic device, data associated with displaying an image ([115]-[117]; Fig. 3 at 500) and respective data corresponding to the image ([115]-[117]; Fig. 3 at 430), wherein the image is associated with operation of the first electronic device ([115]-[117]), and wherein the respective data provides the second electronic device information about one or more functions, to be performed by the first electronic device, associated with the image ([115]-[119]: the second electronic device receives information on the first screen image input areas which are used to generate control signals to control specific functions on the first electronic device, thus the received data includes information about one or more functions performed by the first electronic device);
after transmitting, to the second electronic device, the data associated with displaying the image and the respective data corresponding to the image, receiving, from the second electronic device, data associated with an input associated with the image, wherein the input associated with the image is received via the second electronic device while the image is being displayed via the second electronic device ([117]-[119]); and
in response to receiving the data associated with the input:
in accordance with a determination that the respective data is first data, performing a first operation at the first electronic device corresponding to the image in accordance with the first data ([117]-[119], esp. [119]: at the second electronic device, the first soft key button 430 may be considered to be corresponding to first data, the second soft key button as corresponding to second data, etc., and the first electronic device controls “a specific function corresponding to the manipulation of the prescribed key button 130 matching the manipulated soft key button 430”); and
in accordance with a determination that the respective data is second data, performing a second operation, different from the first operation, at the first electronic device corresponding to the image in accordance with the second data ([117]-[119], esp. [119]: at the second electronic device, the first soft key button 430 may be considered to be corresponding to first data, the second soft key button as corresponding to second data, etc., and the first electronic device controls “a specific function corresponding to the manipulation of the prescribed key button 130 matching the manipulated soft key button 430”).
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
This application currently names joint inventors. In considering patentability of the claims the examiner presumes that the subject matter of the various claims was commonly owned as of the effective filing date of the claimed invention(s) absent any evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1.56 to point out the inventor and effective filing dates of each claim that was not commonly owned as of the effective filing date of the later invention in order for the examiner to consider the applicability of 35 U.S.C. 102(b)(2)(C) for any potential 35 U.S.C. 102(a)(2) prior art against the later invention.
Note that citations to figures and elements should be understood to also implicitly refer to any pertinent explanatory text in the reference.
Claims 5, 6 and 12 are rejected under 35 U.S.C. 103 as being unpatentable over US 2012/0038679 A1 (Yun) as applied to claim 1 above, and further in view of US 2014/0019513 A1 (Han).
Regarding claim 5, Yun teaches displaying, via the display generation component, a first user interface object corresponding to establishment of a connection ([115]; Fig. 3: any and all of the interface elements of the first electronic device may be considered to correspond to an establishment of a connection, as these elements are provided to the second electronic device as a result of establishing a connection). Yun does not expressly teach while not operating in the remote interaction mode with the second electronic device, receiving, from the second electronic device, an indication of a request to initialize the remote interaction mode with the second electronic device; and in response to receiving the indication: initializing the remote interaction mode with the second electronic device, including displaying, via the display generation component, a first user interface object corresponding to the indication. Yun does teach that the second electronic device establishes a communication connection with the first electronic device ([106], [112], [115]). Han teaches that a device may establish a P2P connection with another device via a request (Abstract). The suggestion to modify the teaching of Yun by the teaching of Han is present as Yun teaches establishing a communication connection between two devices while Han teaches that establishing a P2P connection includes a request. The motivation is to implement the P2P connection. The combination would have been unsurprising and had a reasonable expectation of success because Yun teaches establishing a communication connection between two devices while Han teaches that establishing a P2P connection includes a request. Note that corresponding to an establishment of a connection is analogous to corresponding to Thus, before the effective filing date of the current application, the combination of Yun and Han would have rendered obvious, to one of ordinary skill in the art, at the first electronic device: while not operating in the remote interaction mode with the second electronic device, receiving, from the second electronic device, an indication of a request to initialize the remote interaction mode with the second electronic device; and in response to receiving the indication: initializing the remote interaction mode with the second electronic device, including displaying, via the display generation component, a first user interface object corresponding to the indication.
Regarding claim 6, Zhao further teaches wherein: while the first electronic device operates in the remote interaction mode with the second electronic device, the first electronic device displays a second visual indication indicating that the first electronic device is in the remote interaction mode with the second electronic device ([118]-[119]: the first controller 180 of the mobile terminal 100 receives the control signal and … the first controller 180 of the mobile terminal 100 can control an image according to the executed specific function to be displayed as the first screen image 300 on the first display unit 151).
Regarding claim 12, Yun teaches initiating the remote interaction mode with the second electronic device ([106], [112], [115]). Yun does not expressly teach while not operating in the remote interaction mode with the second electronic device, receiving, from the second electronic device, an indication of a request to initiate the remote interaction mode with the second electronic device; and in response to receiving the indication: initiating the remote interaction mode with the second electronic device. Yun does teach that the second electronic device establishes a communication connection with the first electronic device ([106], [112], [115]). Han teaches that a device may establish a P2P connection with another device via a request (Abstract). The suggestion to modify the teaching of Yun by the teaching of Han is present as Yun teaches establishing a communication connection between two devices while Han teaches that establishing a P2P connection includes a request. The motivation is to implement the P2P connection. The combination would have been unsurprising and had a reasonable expectation of success because Yun teaches establishing a communication connection between two devices while Han teaches that establishing a P2P connection includes a request. Thus, before the effective filing date of the current application, the combination of Yun and Han would have rendered obvious, to one of ordinary skill in the art, at the first electronic device: while not operating in the remote interaction mode with the second electronic device, receiving, from the second electronic device, an indication of a request to initiate the remote interaction mode with the second electronic device; and in response to receiving the indication: initiating the remote interaction mode with the second electronic device.
Claim 7 is rejected under 35 U.S.C. 103 as being unpatentable over US 2012/0038679 A1 (Yun) as applied to claim 1 above, and further in view of US 2015/0126174 A1 (Gray).
Regarding claim 7, Yun teaches wherein the image includes a user interface region (Fig. 3 at 400, 430, 500), the method further comprising, at the first electronic device: while in the remote interaction mode and after transmitting, to the second electronic device, the data associated with displaying the image and the respective data corresponding to the image, receiving, from the second electronic device, data associated with a second input corresponding to a request to input into the user interface region ([117]-[119]), wherein the second input is received via the second electronic device while the user interface region is being displayed via the second electronic device in the image; in response to receiving the data associated with the second input: displaying, via the display generation component, a keyboard for inputting into the user interface region; while displaying the keyboard, receiving, from the second electronic device, data associated with selection of one or more keys of the keyboard ([117]-[119]); and in response to receiving the data associated with the selection of the one or more keys: displaying, via the display generation component, one or more outputs corresponding to the one or more keys in the user interface region ([117]-[119]). Yun does not expressly teach wherein the image includes a user interface region, the method further comprising: while in the remote interaction mode and after transmitting, to the second electronic device, the data associated with displaying the image and the respective data corresponding to the image, receiving, from the second electronic device, data associated with a second input corresponding to a request to input text into the user interface region, wherein the second input is received via the second electronic device while the user interface region is being displayed via the second electronic device in the image; in response to receiving the data associated with the second input: displaying, via the display generation component, a keyboard for inputting text into the user interface region; while displaying the keyboard, receiving, from the second electronic device, data associated with selection of one or more keys of the keyboard; and in response to receiving the data associated with the selection of the one or more keys: displaying, via the display generation component, one or more characters corresponding to the one or more keys in the user interface region.
Gray teaches that the keyboard may comprise hardware keys for inputting text characters to be displayed via a display generation component (Fig. 1a at 10). The suggestion to modify the teaching of Yun by the teaching of Gray is present as both teach mobile devices with a display and hardware keys. The motivation is to provide options for user input. The combination would have been unsurprising and had a reasonable expectation of success because both Yun and Gray teach mobile devices with a display and hardware keys. Thus, before the effective filing date of the current application, the combination of Yun and Gray would have rendered obvious, to one of ordinary skill in the art, wherein the image includes a user interface region, the method further comprising, at the first electronic device: while in the remote interaction mode and after transmitting, to the second electronic device, the data associated with displaying the image and the respective data corresponding to the image, receiving, from the second electronic device, data associated with a second input corresponding to a request to input text into the user interface region, wherein the second input is received via the second electronic device while the user interface region is being displayed via the second electronic device in the image; in response to receiving the data associated with the second input: displaying, via the display generation component, a keyboard for inputting text into the user interface region; while displaying the keyboard, receiving, from the second electronic device, data associated with selection of one or more keys of the keyboard; and in response to receiving the data associated with the selection of the one or more keys: displaying, via the display generation component, one or more characters corresponding to the one or more keys in the user interface region.
Claim 9 is rejected under 35 U.S.C. 103 as being unpatentable over US 2012/0038679 A1 (Yun) as applied to claim 8 above, and further in view of US 2014/0189510 A1 (Ozcan).
Regarding claim 9, Yun does not expressly teach wherein: the respective control mode corresponds to an audio output mode, the second input corresponds to a secondary selection of the user interface element using the respective control mode, performing the third operation includes presenting an audio output corresponding to the user interface element without performing a fourth operation corresponding to selection of the user interface element, and the method further comprises: receiving, from the second electronic device, data associated with a third input corresponding to primary selection of the user interface element, wherein the third input is received via the second electronic device while the user interface element is being displayed via the second electronic device in the image; and in response to receiving the data associated with the third input, performing the fourth operation. Ozcan teaches wherein: the respective control mode corresponds to an audio output mode ([44]), the second input corresponds to a secondary selection of the user interface element using the respective control mode, performing the third operation includes presenting an audio output corresponding to the user interface element without performing a fourth operation corresponding to selection of the user interface element ([44]), and data associated with a third input corresponding to primary selection of the user interface element, wherein the third input is received via the second electronic device while the user interface element is being displayed via the second electronic device in the image; and in response to receiving the data associated with the third input, performing the fourth operation ([44]). The suggestion to modify the teaching of Yun by the teaching of Ozcan is present as both teach computing devices with user input (Yun Fig. 3; Ozcan [2], [44]). The motivation is to provide greater functionality to a user. The combination would have been unsurprising and had a reasonable expectation of success because both Yun and Ozcan teach computing devices with user input. Note that Yun provides the teachings related to the two device interconnection, Ozcan provides additional teaching related to audio output and dual operation from interacting with the user interface element. Thus, before the effective filing date of the current application, the combination of Yun and Ozcan would have rendered obvious, to one of ordinary skill in the art, wherein: the respective control mode corresponds to an audio output mode, the second input corresponds to a secondary selection of the user interface element using the respective control mode, performing the third operation includes presenting an audio output corresponding to the user interface element without performing a fourth operation corresponding to selection of the user interface element, and the method further comprises, at the first electronic device: receiving, from the second electronic device, data associated with a third input corresponding to primary selection of the user interface element, wherein the third input is received via the second electronic device while the user interface element is being displayed via the second electronic device in the image; and in response to receiving the data associated with the third input, performing the fourth operation.
Response to Arguments
Applicant’s amendment has successfully addressed the objection to claim 1. The objection has been withdrawn.
Applicant’s amendments have successfully addressed the rejection of claims 5-10 and 12 under 35 USC 112(b). Those rejections have been withdrawn.
Applicant’s amendment has successfully overcome the previous rejections relying on Zhao as the primary reference. Those rejections have been withdrawn. Note that claims 1-2, 5-6, and 12-14 remain rejected on alternative grounds and new grounds relying on Yun as the primary reference.
Applicant's arguments with respect to the prior art rejections relying on Yun as the primary reference have been fully considered but they are not persuasive.
Applicant argues that Yun does not teach ‘performing "a first operation at the first electronic device corresponding to the image" or "a second operation, different from the first operation, at the first electronic device corresponding to the image" based on whether "the respective data is first data" or "the respective data is second data."’ However, Yun teaches a first soft key button 430, which may be considered to be corresponding to first data, and a second soft key button may be considered to correspond to second data, and so on. See Fig. 3 at 430. Yun also teaches that the first electronic device controls “a specific function corresponding to the manipulation of the prescribed key button 130 matching the manipulated soft key button 430”. See [119]. Thus, Yun does teach in accordance with a determination that the respective data is first data, performing a first operation at the first electronic device corresponding to the image in accordance with the first data, and in accordance with a determination that the respective data is second data, performing a second operation, different from the first operation, at the first electronic device corresponding to the image in accordance with the second data.
Applicant further argues that Yun does not teach the newly amended limitation wherein the respective data provides the second electronic device information about one or more functions, to be performed by the first electronic device, associated with the image. However, Yun teaches that the second electronic device receives information regarding the first screen image input areas which are used to generate a control signals to control specific functions on the first electronic device, thus the received data includes information about one or more functions performed by the first electronic device. See [115]-[119]. The limitation “information about one or more functions” is broader than apparently suggested by Applicant, and is broad enough to read onto the teaching of Yun.
Conclusion
Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to GENE W LEE whose telephone number is (571)270-7148. The examiner can normally be reached M-F 9:30am-6:00pm.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Matthew Eason can be reached at 571-270-7230. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/Gene W Lee/Primary Examiner, Art Unit 2624
Prosecution Insights