Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
DETAILED ACTION
1. This Office Action is in response to the application filed on 06/23/2025.
Claims 1-20 are pending.
Priority
2. Receipt is acknowledged of papers submitted under 35 U.S.C. 119(a)-(d), which papers have been placed of record in the file.
Claim Rejections - 35 USC § 101
3. 35 U.S.C. 101 reads as follows:
Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of this title.
4. Claims 1-20 are rejected under 35 U.S.C. 101 because the claimed invention is directed to non-statutory subject matter.
Claims 1-20 are rejected under 35 U.S.C. 101 because the claimed invention is directed to an abstract idea without significantly more.
Independent claims 1, 9 and 16 recite:
A multimodal information interaction method, comprising:
performing intention recognition on a media resource request from a terminal to obtain an intention recognition result, wherein the intention recognition result represents whether the media resource request hits a predetermined processing mode;
in response to the media resource request hitting the predetermined processing mode, determining a media resource address corresponding to the media resource request; and
rendering a media resource in the media resource address, and outputting a rendered media stream to the terminal.
Step 2A Prong One:
The limitations of receiving media request, determining a media resource address; and rendering a media resource that, under its broadest reasonable interpretation, covers performance of the limitation in the mind, but for the recitation of generic computer components. That is , other than reciting, “computer method’; nothing in the claim element precludes the step from practically being performed in a human mind. Note that the limitations are done by the generically recited computer components under its broadest reasonable interpretation, covers performance of the limitation in the mind but for the recitation of generic computer components, then it falls within the “Mental Processes’ grouping of abstract ideas (concepts performed in the human mind including an observation, evaluation, judgment, and opinion).
Step 2A Prong Two:
The judicial exception is not integrated into a practical application. Claims 1, 11 and 20 recite the additional element, “requesting …rendering.” these limitation is a mere generic transmission and presentation of collected and analyzed data (MPEP 2106.05(g)). The limitations amount to a data gathering step and a mere generic transmission and presentation of collected and analyzed data which is considered to be insignificant extra solution activity (see MPEP 2106.05(g)).
Step 2B:
The claims do not include additional elements that are sufficient to amount to significantly more than the judicial exception. The limitation “requesting … rendering”, are recognized by the courts as well-understood, routine , and conventional activities when they are claimed in a merely generic manner (see MPEP 2106.05(qd)/(II) (iv) transferring and/or displaying information, Versata Dev. Group Inc.
Dependent Claims 2-8, 10-15 and 17-20
The limitations as recited in dependent claims 2, 10 and 17 recite, “wherein the rendering a media resource in the media resource address comprises: acquiring the media resource from the media resource address; rendering the media resource onto a virtual screen; and collecting a content on the virtual screen to obtain a media stream” which further describes the concepts performed in the human mind including an observation, evaluation, judgment, and opinion, in step 2A prong one.
Claims 3, 11 and 18 recite, “receiving an interaction operation event from the terminal, wherein the interaction operation event is generated by the terminal in response to an interaction operation of a target object on the media stream on the terminal; and performing the interaction operation on the media stream on the virtual screen according to the interaction operation event, SO that the terminal displays an interaction result.” which further describes the concepts performed in the human mind including an observation, evaluation, judgment, and opinion, in step 2A prong one.
Claims 4, 12 and 19 recite, “wherein the intention recognition result further represents a processing type of the media resource request; the in response to the media resource request hitting the predetermined processing mode, determining a media resource address corresponding to the media resource request comprises one of: searching, in response to the processing type being searching, the media resource corresponding to the media resource request to obtain the media resource address corresponding to the media resource request; determining, in response to the processing type being returning, a predetermined address as the media resource address corresponding to the media resource request; and generating, in response to the processing type being generating, the media resource and the media resource address corresponding to the media resource request.” which further describes the concepts performed in the human mind including an observation, evaluation, judgment, and opinion, in step 2A prong one.
Claims 5, 13 and 20 recite, “ in response to an intelligent agent call request from the terminal, starting an intelligent agent and assigning a cloud rendering task; and in response to an intelligent agent shutdown request from the terminal, shutting down the intelligent agent and releasing the cloud rendering task” which further describes the concepts performed in the human mind including an observation, evaluation, judgment, and opinion, in step 2A prong one.
Claims 6-7 and 14-15 recite, “wherein the rendering a media resource in the media resource address comprises: starting the cloud rendering task to perform an operation of rendering the media resource in the media resource address..” which further describes the concept is mere gathered data under prong 2 (insignificant extra solution activity— MPEP 2106.06g) and WURC under 2b (using gather data - MPEP 2106.05d).
Examiner’s Note
5. Rendering a media resource onto a virtual screen (According to Google): “Rendering a media resource onto a virtual screen is the process of generating a digital image or video from 2D/3D models and projecting it onto a software-based display, rather than a physical monitor. This process is driven by rendering engines, GPU-based virtual drivers, and media projection services that convert data into visual pixels in real time.”
Visual renderings of focus objects (According to Google): “Visual renderings of focus objects on a virtual screen refer to computer-generated, 3D representations of items that appear sharply in focus, while surrounding, non-focused areas are blurred to mimic natural human vision, a technique often achieved through gaze-contingent rendering or varifocal display systems. These rendering techniques are used in virtual reality (VR) and augmented reality (AR) to enhance realism, reduce eye strain, and solve the vergence-accommodation conflict.”
Multimodal information interaction (According to Google): “Multimodal information interaction refers to human-computer systems that process two or more combined user input modes—such as speech, gesture, gaze, touch, and facial expressions—simultaneously or sequentially to enable natural, intuitive communication. These systems integrate various sensory channels (text, audio, vision) to enhance interaction, improve robustness, and increase bandwidth between users and technologies like AI and virtual reality.”
An intelligent call request from a terminal (According to Google): “An intelligent call request from a terminal (often referred to in technical, networking, or legacy contexts) is a specially formatted data packet generated by a user terminal (DTE – Data Terminal Equipment) to initiate a network connection. It is not just a phone number dial, but a structured request, common in X.25 or virtual circuit-based networks, that acts as a signal to the network to establish a "virtual call" (a temporary, logical connection) between two endpoints.”
An intelligent agent in a network (According to Google): “An intelligent agent in a network is an autonomous software entity that perceives its environment, makes decisions, and takes actions to achieve specific goals, such as optimizing performance or security, without constant human intervention. In the context of computer networking, these agents use artificial intelligence (AI), including machine learning and Large Language Models (LLMs), to monitor traffic, analyze telemetry data, and automatically manage network infrastructure.”
Meng et al, US 20250103183, [Meng: Paragraph 127 (“For example, the webpage access addresses of various media resources can be added to the browser webpage in the form of links, so that when the user wants to watch the media resource, he/she can directly click the shortcut in the webpage to browse the content of the media resource”)] [Meng: Paragraphs 148, 398 and 435 (“In order to realize that different loading modes are presented different display modes, in the process of webpage loading, when user interface WEBUI receives the message that the loading state is started, the display apparatus 200 can present the first window and the second window simultaneously,”, i.e., ‘predetermined processing mode’)] [Meng: Paragraphs 92 and 314 (“the demultiplexing module is used for demultiplexing the input audio and video data stream, such as inputting moving picture experts group-2 (MPEG-2)”)] [Meng: Paragraphs 291-292 (“and send the relevant information of the media resource and a signal requesting to start play to the play area management component”)] [Meng: Paragraph 67 (“entering user commands through the buttons, voice input, control panel,”, i.e., ‘multimodal information interaction’)].
Billi-Duran et al, US 20180052835, [Billi-Duran: Abstract and paragraph 45 (“a user may record visual or audio information for a machine and submit this multimedia information to the search and diagnosis system”)].
Zeng et al, US 20140129676, [Zeng: Title and Abstract (“live video sharing with mutlmodal modes”)].
Claim Rejections - 35 USC § 102
6. In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
7. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(2) the claimed invention was described in a patent issued under section 151, or in an application for patent published or deemed published under section 122(b), in which the patent or application, as the case may be, names another inventor and was effectively filed before the effective filing date of the claimed invention.
8. Claims 1-20 are rejected under 35 U.S.C. 102(a)(2) as being anticipated by Meng et al (US 20250103183).
Claim 1:
Meng suggests a multimodal information interaction method [Meng: Paragraph 67 (“entering user commands through the buttons, voice input, control panel,”, i.e., ‘multimodal information interaction’)], comprising: performing intention recognition on a media resource request from a terminal to obtain an intention recognition result, wherein the intention recognition result represents whether the media resource request hits a predetermined processing mode [Meng: Paragraph 127 (“For example, the webpage access addresses of various media resources can be added to the browser webpage in the form of links, so that when the user wants to watch the media resource, he/she can directly click the shortcut in the webpage to browse the content of the media resource”, i.e., ‘media resource request’)] [Meng: Paragraphs 148, 398 and 435 (“In order to realize that different loading modes are presented different display modes, in the process of webpage loading, when user interface WEBUI receives the message that the loading state is started, the display apparatus 200 can present the first window and the second window simultaneously,”, i.e., ‘predetermined processing mode’)]. Meng suggests in response to the media resource request hitting the predetermined processing mode, determining a media resource address corresponding to the media resource request [Meng: Paragraphs 148, 398 and 435 (“In order to realize that different loading modes are presented different display modes, in the process of webpage loading, when user interface WEBUI receives the message that the loading state is started, the display apparatus 200 can present the first window and the second window simultaneously,”, i.e., ‘predetermined processing mode’)]. Meng suggests rendering a media resource in the media resource address, and outputting a rendered media stream to the terminal [Meng: Paragraphs 92 and 314 (“the demultiplexing module is used for demultiplexing the input audio and video data stream, such as inputting moving picture experts group-2 (MPEG-2)”)] [Meng: Paragraph 127 (“For example, the webpage access addresses of various media resources can be added to the browser webpage in the form of links, so that when the user wants to watch the media resource, he/she can directly click the shortcut in the webpage to browse the content of the media resource”)].
Claim 2:
Meng suggests wherein the rendering a media resource in the media resource address comprises: acquiring the media resource from the media resource address rendering the media resource onto a virtual screen [Meng: Paragraph 106 (“and visual renderings of focus objects”)]; an collecting a content on the virtual screen to obtain a media stream [Meng: Paragraphs 92 and 314 (“the demultiplexing module is used for demultiplexing the input audio and video data stream, such as inputting moving picture experts group-2 (MPEG-2)”)].
Claim 3:
Meng suggests receiving an interaction operation event from the terminal, wherein the interaction operation event is generated by the terminal in response to an interaction operation of a target object on the media stream on the terminal; and performing the interaction operation on the media stream on the virtual screen according to the interaction operation event, SO that the terminal displays an interaction result [Meng: Paragraph 106 (“and visual renderings of focus objects”)] [Meng: Paragraph 67 (“entering user commands through the buttons, voice input, control panel,”, i.e., ‘multimodal information interaction’)] [Meng: Paragraphs 92 and 314 (“the demultiplexing module is used for demultiplexing the input audio and video data stream, such as inputting moving picture experts group-2 (MPEG-2)”)] [Meng: Paragraph 66 (“FIG. 1 is a schematic diagram of an interaction between a display apparatus and a control device”)].
Claim 4:
Meng suggests wherein the intention recognition result further represents a processing type of the media resource request; the in response to the media resource request hitting the predetermined processing mode, determining a media resource address corresponding to the media resource request comprises one of: searching, in response to the processing type being searching, the media resource corresponding to the media resource request to obtain the media resource address corresponding to the media resource request; determining, in response to the processing type being returning, a predetermined address as the media resource address corresponding to the media resource request; and generating, in response to the processing type being generating, the media resource and the media resource address corresponding to the media resource request [Meng: Paragraph 289 (“the three player applications can be respectively Hiplayer, mpctrl dmp and source, which can support the play of various types of media resources, and have the ability to execute play-pause control logic”’)] [Meng: Paragraph 127 (“For example, the webpage access addresses of various media resources can be added to the browser webpage in the form of links, so that when the user wants to watch the media resource, he/she can directly click the shortcut in the webpage to browse the content of the media resource”, i.e., ‘media resource request’)] [Meng: Paragraphs 148, 398 and 435 (“In order to realize that different loading modes are presented different display modes, in the process of webpage loading, when user interface WEBUI receives the message that the loading state is started, the display apparatus 200 can present the first window and the second window simultaneously,”, i.e., ‘predetermined processing mode’)].
Claim 5:
Meng suggests in response to an intelligent agent call request from the terminal, starting an intelligent agent and assigning a cloud rendering task; and in response to an intelligent agent shutdown request from the terminal, shutting down the intelligent agent and releasing the cloud rendering task [Meng: Paragraph 112 (“the communicating device 220 may also be an external control component, such as a mouse, or a remote control, etc., that establishes communication connection with a display apparatus. When the user performs different control operations on the external control component, the external control component can, in response to the user's control operation, generate different control signals, and send the generated control signals to the display apparatus. The display apparatus can perform feature extraction on the received control signal, thereby determining the control function to be performed by the user according to the extracted features:”)] [Meng: Paragraphs 134-135 (“the loading mode and configuration data to the cloud.”)] [Meng: Paragraph 271 (“When the webpage loading mode in the display apparatus is the second loading mode, turning off other presented pages of the browser application,”)].
Claim 6:
Meng suggests wherein the rendering a media resource in the media resource address comprises: starting the cloud rendering task to perform an operation of rendering the media resource in the media resource address [Meng: Paragraph 112 (“the communicating device 220 may also be an external control component, such as a mouse, or a remote control, etc., that establishes communication connection with a display apparatus. When the user performs different control operations on the external control component, the external control component can, in response to the user's control operation, generate different control signals, and send the generated control signals to the display apparatus. The display apparatus can perform feature extraction on the received control signal, thereby determining the control function to be performed by the user according to the extracted features:”)] [Meng: Paragraphs 134-135 (“the loading mode and configuration data to the cloud.”)] [Meng: Paragraph 271 (“When the webpage loading mode in the display apparatus is the second loading mode, turning off other presented pages of the browser application,”)] [Meng: Paragraph 127 (“For example, the webpage access addresses of various media resources can be added to the browser webpage in the form of links, so that when the user wants to watch the media resource, he/she can directly click the shortcut in the webpage to browse the content of the media resource”)].
Claim 7:
Meng suggests wherein one or more media resource addresses correspond to the media resource request, and when a plurality of media resource addresses correspond to the media resource request, media resources are opened and rendered in sequence according to a list of the plurality of media resource addresses [Meng: Paragraph 112 (“the communicating device 220 may also be an external control component, such as a mouse, or a remote control, etc., that establishes communication connection with a display apparatus. When the user performs different control operations on the external control component, the external control component can, in response to the user's control operation, generate different control signals, and send the generated control signals to the display apparatus. The display apparatus can perform feature extraction on the received control signal, thereby determining the control function to be performed by the user according to the extracted features:”)] [Meng: Paragraphs 134-135 (“the loading mode and configuration data to the cloud.”)] [Meng: Paragraph 271 (“When the webpage loading mode in the display apparatus is the second loading mode, turning off other presented pages of the browser application,”)] [Meng: Paragraph 127 (“For example, the webpage access addresses of various media resources can be added to the browser webpage in the form of links, so that when the user wants to watch the media resource, he/she can directly click the shortcut in the webpage to browse the content of the media resource”)].
Claim 8:
Meng suggests an intelligent agent, configured to perform the method according to claim 1 [Meng: Paragraphs 69 and 135 (“the mobile terminal 300 can be connected and communicated with the software application installed with the display apparatus 200 through a network communication protocol to realize the purpose of one-to-one control operation and data communication”)] [Meng: Paragraph 397 (“The first selection mode is an intelligent selection mode, that is, the page content that can be selected is automatically recognized by the display apparatus”)].
Claim 9:
Claim 9 is essentially the same as claim 1 except that it sets forth the claimed invention as a device rather than a method and rejected under the same reasons as applied above.
Claim 10:
Claim 10 is essentially the same as claim 2 except that it sets forth the claimed invention as a device rather than a method and rejected under the same reasons as applied above.
Claim 11:
Claim 11 is essentially the same as claim 3 except that it sets forth the claimed invention as a device rather than a method and rejected under the same reasons as applied above.
Claim 12:
Claim 12 is essentially the same as claim 4 except that it sets forth the claimed invention as a device rather than a method and rejected under the same reasons as applied above.
Claim 13:
Claim 13 is essentially the same as claim 5 except that it sets forth the claimed invention as a device rather than a method and rejected under the same reasons as applied above.
Claim 14:
Claim 14 is essentially the same as claim 6 except that it sets forth the claimed invention as a device rather than a method and rejected under the same reasons as applied above.
Claim 15:
Claim 15 is essentially the same as claim 7 except that it sets forth the claimed invention as a device rather than a method and rejected under the same reasons as applied above.
Claim 16:
Claim 16 is essentially the same as claim 1 except that it sets forth the claimed invention as a program product rather than a method and rejected under the same reasons as applied above.
Claim 17:
Claim 17 is essentially the same as claim 2 except that it sets forth the claimed invention as a program product rather than a method and rejected under the same reasons as applied above.
Claim 18:
Claim 18 is essentially the same as claim 3 except that it sets forth the claimed invention as a program product rather than a method and rejected under the same reasons as applied above.
Claim 19:
Claim 19 is essentially the same as claim 4 except that it sets forth the claimed invention as a program product rather than a method and rejected under the same reasons as applied above.
Claim 20:
Claim 20 is essentially the same as claim 5 except that it sets forth the claimed invention as a program product rather than a method and rejected under the same reasons as applied above.
9. Any inquiry concerning this communication or earlier communications from the examiner should be directed to [Hung D. Le], whose telephone number is [571-270-1404]. The examiner can normally be communicated on [Monday to Friday: 9:00 A.M. to 5:00 P.M.].
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Apu Mofiz can be reached on [571-272-4080]. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of an application may be obtained from the Patent Application Information Retrieval (PAIR) system. Status information for published applications may be obtained from either Private PAIR or Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative or access to the automated information system, contact [800-786-9199 (IN USA OR CANADA) or 571-272-1000].
Hung Le
04/17/2026
/HUNG D LE/Primary Examiner, Art Unit 2161
Prosecution Insights