DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Response to Arguments
Applicant’s arguments with respect to claims 1-13 and 15-18 have been considered but are moot because the new ground of rejection does not rely on any reference applied in the prior rejection of record for any teaching or matter specifically challenged in the argument.
Claims 1-3, 6-7, 11-12 and 15-18 have been amended and claim 14 has been canceled.
The amendments to the claims overcome the 112(f) interpretation and the 112(b) rejection.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1-3, 5-9, 11-13, 15-16 and 18 are rejected under 35 U.S.C. 103 as being unpatentable over Palmer (US 20200120400) in view of Applicant provided prior art Song (KR-20190096240).
Regarding claim 1, Palmer discloses a server for providing a three-dimensional (3D) video content service, the server comprising:
server communication circuitry (server; see at least paragraphs 0141, 0169 and 0188);
a server memory (server; see at least paragraphs 0141, 0169 and 0188); and
a server processor connected to the server communication circuitry and the server
memory (server; see at least paragraphs 0141, 0169 and 0188),
wherein, when user interaction editing information for 3D video content to edit a user interaction for the 3D video content is received (retrieving edit decision list EDL; see at least Fig. 1 and paragraph 0142), a processor edits the user interaction for the 3D video content according to the user interaction editing information received and generates and stores metadata for the edited user interaction (processing the EDL to generate interactive media content and recording the user interactions; see at least Fig. 1 and paragraphs 0141 and 0145),
wherein the metadata defines a user interaction corresponding to a point in time of the 3D video content such that a video content play device determines whether a recognized user interaction is appropriate based on the metadata (when a user performs an interaction, interactive content is overlaid based on the interaction such as an AR mask; see at least Figs. 7C-7J paragraphs 0204-0206).
Palmer discloses that is assumed that the process is performed at lest in part using one or more devices forming part of one or more processing systems, such as servers; see at least paragraph 0141, but is not clear about a server processor edits user interactions and generates and stores metadata.
Song discloses the above missing limitations; an interactive media editing apparatus 320 receives user interaction information as input and may generate and store information or metadata. Furthermore, the apparatus 320 may provide a web-based interactive media production application to a user and a user interface for editing; see at least page 6, paragraphs 4-6 and page 7, paragraphs 5-11.
Therefore, it would have been obvious to one of ordinary skill in the art before the effective filling date of the claimed invention to modify Palmer by the teachings of Song by having the above limitations so to be able to provide interactive media based on user motion recognition; see at least the Abstract.
Regarding claim 2, Palmer in view of Song disclose the server of claim 1, wherein, when a video content play device requests the server processor to play the 3D video content through the server communication circuitry, the server processor transmits 3D video content information including at least one of the 3D video content, metadata for the 3D video content, the metadata for the edited user interaction, and 3D video content player information to the video content play device such that the 3D video content is played by the video content play device (Palmer; prefetching and buffering the interactive media content; see at least paragraphs 0147, 0200-0201, 0231, 0233 and 0246 and playing the interactive media content; see at least paragraphs 0166, 0173 and 0200).
Regarding claim 3, Palmer in view of Song disclose the server of claim 2, wherein the server processor transmits a user interaction guide message for requesting a corresponding user interaction at a user interaction occurrence time which is set according to a scenario of the played 3D video content to the video content play device through the server communication circuitry (Palmer; such as instructing a user to open their mouth; see at least Figs. 7C-7J paragraphs 0204-0206).
Regarding claim 5, Palmer in view of Song disclose the server of claim 1, wherein the server processor recognizes a video player which will play a plurality of types of 3D video content and user interaction information using an interactive 3D video content player application programming interface (API) and an interaction API (Palmer; see at least paragraphs 0166, 0173, 0200 and 0242).
Regarding claim 6, Palmer discloses a device for playing video content, the device comprising:
communication circuitry (see at least Fig. 3 and paragraph 0186);
a memory (see at least Fig. 3 and paragraph 0186);
a motion recognition circuitry (see at least Fig. 3 and paragraph 0186); and
a processor connected to the communication circuitry, the memory, and the motion
recognition circuitry (see at least Fig. 3 and paragraphs 0186-0187),
wherein the processor receives three-dimensional (3D) video content from a 3D video content service server through the communication circuitry (by prefetching and buffering interactive media content; see at least paragraphs 0147, 0200-0201, 0231, 0233 and 0246, wherein the interactive content can be AR and 3D content; see at least paragraphs 0154-0156 and 0205) and plays the 3D video content according to a 3D video content play request (playing the interactive media content; see at least paragraphs 0166, 0173 and 0200), when a user interaction is recognized by the motion recognition module while the 3D video content is played, determines whether the recognized user interaction is appropriate, and when the recognized user interaction is appropriate, plays 3D video content corresponding to the recognized user interaction (when a user performs an interaction, interactive content is overlaid based on the interaction such as an AR mask; see at least Figs. 7C-7J paragraphs 0204-0206).
Palmer is not clear about receiving video content comprising metadata for an edited user interaction from a server.
Song discloses the above missing limitations; an interactive media player may include metadata parser that parses metadata generated by the interactive media editing device 320; see at least page 6, paragraph 9, page 7, paragraph 2 and page 8, last 2 paragraphs.
Therefore, it would have been obvious to one of ordinary skill in the art before the effective filling date of the claimed invention to modify Palmer by the teachings of Song by having the above limitations so to be able to provide interactive media based on user motion recognition; see at least the Abstract.
Regarding claim 7, Palmer in view of Song disclose the device of claim 6, wherein, in response to the 3D video content play request, the processor receives 3D video content information including at least one of the 3D video content, metadata for the edited user interaction, metadata for the 3D video content, and 3D video content player information for playing the 3D video content from the 3D video content service server (Palmer; prefetching, buffering and playing the interactive media content; see at least paragraphs 0147, 0166, 0200-0201, 0231, 0233 and 0246).
Regarding claim 8, Palmer in view of Song disclose the device of claim 7, wherein the processor plays the 3D video content using a 3D video content player corresponding to the 3D video content player information (Palmer; playing the interactive media content; see at least paragraphs 0166, 0173 and 0200. Furthermore, the player information is alternative language).
Regarding claim 9, Palmer in view of Song disclose the device of claim 6, wherein, when a user interaction guide message is received from the 3D video content service server while the 3D video content is played, the processor outputs interaction guide information for describing user interactions applied to the video content play device (Palmer; such as instructing a user to open their mouth; see at least Figs. 7C-7J paragraphs 0204-0206).
Regarding claim 11, Palmer in view of Song disclose the device of claim 6, wherein the motion recognition circuitry includes at least one of a leap motion device, a webcam, and a touchscreen (Palmer; see at least paragraphs 0146 and 0172).
Regarding claim 12, Palmer discloses a method of providing a three-dimensional (3D) video content service according to a user interaction, the method comprising:
receiving, user interaction editing information for a 3D video content to edit a user interaction for the 3D video content (retrieving edit decision list EDL; see at least Fig. 1 and paragraph 0142 and processing the EDL to generate interactive media content and recording the user interactions; see at least Fig. 1 and paragraphs 0141 and 0145);
providing, by a 3D video content service server, an interactive 3D video content play environment on a video content play device (downloading an application software to a user device for generating interactive media content; see at least paragraphs 0081-0082, 0188 and 0192. Furthermore, the interactive content can be AR and 3D content; see at least paragraphs 0154-0156 and 0205);
transmitting, by the 3D video content service server, 3D video content information of
3D video content requested by the video content play device to the video content play device (by prefetching and buffering the interactive media content; see at least paragraphs 0147, 0200-0201, 0231, 0233 and 0246);
playing, by the video content play device, the 3D video content (playing the interactive media content; see at least paragraphs 0166, 0173 and 0200);
when the played 3D video content requires the user interaction, transmitting, by the 3D
video content service server, a user interaction guide message to the video content play
device (such as instructing a user to open their mouth; see at least Figs. 7C-7J paragraphs 0204-0206); and
when the user interaction is recognized, playing, by the video content play device, 3D
video content corresponding to the recognized user interaction (when a user performs an interaction, interactive content is overlaid based on the interaction such as an AR mask; see at least Figs. 7C-7J paragraphs 0204-0206),
wherein the playing of the 3D video content corresponding to the recognized user interaction comprises:
outputting, by the video content play device, interaction guide information for describing user interactions applied to the video content play device (Palmer; such as instructing a user to open their mouth; see at least Figs. 7C-7J paragraphs 0204-0206);
when the user interaction is recognized, determining, by the video content play device, whether the recognized user interaction is appropriate (Palmer; when a user performs an interaction, interactive content is overlaid based on the interaction such as an AR mask; see at least Figs. 7C-7J paragraphs 0204-0206); and
when the user interaction is appropriate, playing, by the video content play device, 3D video content corresponding to the recognized user interaction (Palmer; playing the interactive media content; see at least paragraphs 0166, 0173 and 0200).
Palmer is not clear about receiving, by a 3D video content service server, user interaction editing information for a video content.
Song discloses the above missing limitations; an interactive media player may include metadata parser that parses metadata generated by the interactive media editing device 320; see at least page 6, paragraph 9, page 7, paragraph 2 and page 8, last 2 paragraphs.
Therefore, it would have been obvious to one of ordinary skill in the art before the effective filling date of the claimed invention to modify Palmer by the teachings of Song by having the above limitations so to be able to provide interactive media based on user motion recognition; see at least the Abstract.
Regarding claim 13, Palmer in view of Song disclose the method of claim 12, wherein the playing of the 3D video content comprises playing, by the video content play device, the 3D video content using a 3D video content player corresponding to 3D video content player information included in the 3D video content information (Palmer; playing the interactive media content; see at least paragraphs 0166, 0173 and 0200).
Regarding claim 15, Palmer in view of Song disclose the method of claim 12, wherein the outputting of the interaction guide information comprises recognizing, by the video content play device, a type of video content play device using a device interaction application programming interface (API) (Palmer; see at least paragraph 0242) and outputting interaction guide information for describing user interactions applied to the recognized type of video content play device (Palmer; playing the interactive media content; see at least paragraphs 0166, 0173, 0200 and 0242).
Regarding claim 16, Palmer in view of Song disclose the method of claim 12, wherein the determining of whether the recognized user interaction is appropriate comprises determining, by the video content play device, whether the recognized user interaction is appropriate for user interaction metadata which is set for a corresponding point in time (Palmer; when a user performs an interaction at any time, interactive content is overlaid based on the interaction such as an AR mask; see at least Figs. 7C-7J paragraphs 0204-0206).
Regarding claim 18, Palmer in view of Song disclose the method of claim 12, further comprising:
generating, by the 3D video content service server, metadata for the edited user interaction (Palmer; by processing the EDL to generate interactive media content and recording the user interactions; see at least Fig. 1 and paragraphs 0141 and 0145).
Claims 4, 10 and 17 are rejected under 35 U.S.C. 103 as being unpatentable over Palmer in view of Song and further in view of Bragdon (US 2013/0346917).
Regarding claim 4, Palmer in view of Song disclose the server of claim 3, wherein, when a user interaction recognition success message is received from the video content play device, the server processor plays 3D video content corresponding to the user interaction (Palmer; playing the interactive media content; see at least paragraphs 0166, 0173, 0200 and 0242), but is not clear about a user interaction recognition success message is received from a device.
Bragdon discloses the above missing limitation; a user interaction log file that captures certain user actions is collected and analyzed; see at least paragraphs 0015 and 0025-0027.
Therefore, it would have been obvious to one of ordinary skill in the art before the effective filling date of the claimed invention to modify Palmer in view of Song disclose by the teachings of Bragdon by having the above limitations so to be able to provide a developer with insight into the user’s behavior when using an application; see at least the Abstract.
Regarding claim 10, Palmer in view of Song disclose the device of claim 6, wherein the processor determines whether the recognized user interaction is appropriate for user interaction metadata which is set for a corresponding point in time, and when the recognized user interaction is appropriate, receives 3D video content corresponding to the user interaction from the 3D video content service server, and plays the received 3D video content (Palmer; when a user performs an interaction, interactive content is overlaid based on the interaction such as an AR mask; see at least Figs. 7C-7J paragraphs 0204-0206), but is not clear about transmitting a user interaction recognition success message to a server.
Bragdon discloses the above missing limitation; a user interaction log file that captures certain user actions is collected and analyzed; see at least paragraphs 0015 and 0025-0027.
Therefore, it would have been obvious to one of ordinary skill in the art before the effective filling date of the claimed invention to modify Palmer in view of Song by the teachings of Bragdon by having the above limitations so to be able to provide a developer with insight into the user’s behavior when using an application; see at least the Abstract.
Regarding claim 17, Palmer in view of Song disclose the method of claim 11, wherein the playing, by the video content play device, of the 3D video content corresponding to the recognized user interaction when the user interaction is appropriate comprises:
providing 3D video content corresponding to the recognized user interaction to the video content play device (Palmer; by prefetching and buffering the interactive media content; see at least paragraphs 0147, 0200-0201, 0231, 0233 and 0246); and
receiving and playing, by the video content play device, the 3D video content corresponding to the user interaction (Palmer; playing the interactive media content; see at least paragraphs 0166, 0173, 0200 and 0242), but are not clear about transmitting by a play device, a user interaction recognition success message to a server and analyzing, by the server, user interaction metadata included in the message to recognize user interaction.
Bragdon discloses the above missing limitation; a user interaction log file that captures certain user actions is collected from multiple users and analyzed by a server; see at least paragraphs 0015 and 0025-0027.
Therefore, it would have been obvious to one of ordinary skill in the art before the effective filling date of the claimed invention to modify Palmer in view of Song by the teachings of Bragdon by having the above limitations so to be able to provide a developer with insight into the user’s behavior when using an application; see at least the Abstract.
Conclusion
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to YASSIN ALATA whose telephone number is (571)270-5683. The examiner can normally be reached Mon-Fri 7-4 ET.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Nasser Goodarzi can be reached at 571-272-4195. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/YASSIN ALATA/Primary Examiner, Art Unit 2426