DETAILED ACTION
This action is responsive to the Applicant’s response filed 4/29/26.
As indicated in Applicant’s response, claims 1, 8, 16, 19 have been amended, and claims 4-5 cancelled. Claims 1-3, 6-20 are pending a next office action.
Claim Rejections - 35 USC § 101
35 U.S.C. 101 reads as follows:
Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of this title.
Claims 1, 16 and 19 is/are rejected under 35 U.S.C. 101 because the claimed invention is directed to a judicial exception (i.e., a law of nature, a natural phenomenon, or an abstract idea) without significantly more. Claim(s) 1, 16 and 19 is/are directed to an Abstract Idea. The claim(s) does/do not include additional elements that are sufficient to amount to significantly more than the judicial exception because of the following 2-step analysis.
Eligibility of Claim 1
Step I: this claim belongs to a system/apparatus category.
Step II-A
Prong One:
The elements recited as “detecting initiation of a video session”, “initiate monitoring of data captured (by a camera), “determine an engagement score (of a user during the video session, “by analyzing data captured … to determine changes in orientation (of the user’s face), “determine a change in the engagement of the user” are activities that can be performed in the mind of a human (e.g. detect, monitor, analyze, determine a change) or via use of pen/paper (a score in a user engagement), which in all are part of the Mental process subgroup of an Abstract Idea type Judicial Exception as defined by the circuits - MPEP 2106.04(a).
Prong Two:
The elements recited as “computing platform”, I.H.S., “video session”, “set of firmware instructions”, “device to provide a corresponding firmware service”, “orchestrator … to initiate a background process tracking” are construed as a computer setting which provides a platform as a tool and computer for one to initiate a tracking process, which in turn enables detection of a video session or image capture. As such, the computer platform, the devices, the firmware service recited as a tool understood in a high level of generality amount to a field of computer operations/setting in which the Abstract Idea operates (to detect, monitor, analyze, determine a change) - MPEP 2106.05(h) - whereas the initiating of a (tracking) process at best amounts to a insignificant extra-solution activity the precede the mental process activities (to detect, monitor, analyze, determine a change) whereas the step recited as “deliver notifications” is construed as a post-activity to the abstracted “determining” (changes); in that sense, the above elements cannot transform the mental processes into a practical application nor can they clearly demonstrate a technical improvement or transformation to the computer field in which the video/camera tracking operates. MPEP 2106.05(a), (c ) (g)
Step II-B
The additional elements of the computer platform, IHS, plurality of devices, the firmware service, recited in a high level of generality amount to a field of computer operations/setting in which the Abstract Idea operates – MPEP 2106.05(h) and are not sufficient to depict any transformation of significance technical value to the field of computer or video image capturing. The acts of initiating a tracking and delivering a notification based on determined changes are insignificant pre-activity or post activity – MPEP 2106.05 (g) - to the mental process activities (to detect, monitor, analyze, determine a change) thus cannot evidence that a meaningful and specific set of limitations are in place to provide an non-conventional transformation to the field of image capture by computer – MPEP 2106.05 (c ) (e)
Thus, the additional element as expressed in the order of the claim language cannot be seen as rendering the Abstract Idea significantly more than itself.
Claim 1 is deemed non-eligible under the 35 USC 101 statute
B. Eligibility of Claim 16
This memory device claim belongs to a product/device category (Step I) and includes the same features of method claim 1, including Abstract Idea activities of detecting initiation of a video session”, “initiate monitoring of data captured (by a camera), “determine an engagement score (of a user during the video session, “by analyzing data captured … to determine changes in orientation (of the user’s face), “determine a change in the engagement of the user”; thus is directed to a mental process type of Judicial Exception per step IIA, prong one – see 2106.04(a) - and where, per step IIA prong two, elements recited as computer platform, I.H.S., vide session, the devices, the firmware service recited in a high level of generality and indicative of a field of use – MPEP 2106.05(h) - and those recited as of initiating a tracking and delivering a notification (mere extra-solution activities) cannot be seen as improving the computer field in which the Abstract Idea operates, and cannot be viewed as capable of integrating the Abstract Idea into a practical application. See MPEP 2106.05(a), (c ) (g)
Claim 16 also recites initiating a tracking and delivering a notification based on determined changes and as additional elements, are insignificant pre-activity or post activity, and additional elements such as computer platform, the devices, the firmware service amount to a computer-based field of use without significant limitations to demonstrate a improvement to this computer field. As per Step IIB, these additional elements cannot be seen as transforming the Abstract Idea of step IIA significantly more than itself.
Claim 16 is deemed non-eligible under the 35 USC 101 statute.
C. Eligibility of claim 19:
This claim belongs to a process/method category (per Step I) and includes the same features of method claim 1, including Abstract Idea activities of detecting initiation of a video session”, “initiate monitoring of data captured (by a camera), “determine an engagement score (of a user during the video session, “(based on) analyzing data captured”; “determine changes in orientation” (of the user’s face), “determine a change in the engagement of the user”; thus as set forth above in claim 1, is directed to a mental process type of Judicial Exception per step IIA, prong one – see 2106.04(a) - where, per step IIA prong two, elements recited as computer platform, the devices, the firmware service recited in a high level of generality and indicative of a field of use – MPEP 2106.05(h) - along with those recited as of initiating a tracking and delivering a notification (mere extra-solution activities) cannot be seen as improving the computer field in which the Abstract Idea operates, and cannot be viewed as capable of integrating the Abstract Idea into a practical application. See MPEP 2106.05(a), (c ) (g)
Claim 19 also recites initiating a tracking and delivering one or more notifications based on determined changes; and as additional elements, these are insignificant pre-activity or post activity items, whereas additional elements such as computing platform, I.H.S.., the devices, the firmware service, video session amount to a computer-based field of use without significant limitations to demonstrate any improvement to this computer field. Accordingly, per Step IIB, these additional elements cannot be seen as transforming the Abstract Idea of step IIA significantly more than itself.
Claim 19 is therefore non-eligible under the 35 USC 101 statute.
D. Step IIB analysis of dependent claims.
Claims 2-3 recite examples of computing platform and orchestrator, hence do add significant teaching to the state of the Judicial exception regarding act of monitoring, inferencing and detecting.
Claim 6 recites characterization of "interrupted workflow notifications" such as images capture, but this "additional element" fails to convert the mental steps of monitoring, inferencing and detecting in a practical application.
Claim 7 recites response of the I.H.S. regarding audio power but this response fails to significantly convert the mental process aspect of the Judicial Exception into the status of a Practical Application or transform the Abstract Idea significantly more than itself.
Claims 8-9 characterizes what constitutes change in a user engagement based on audio stream and keywords indicative of user presence; but this "additional element" provides no concrete means that realistically converts or uplifts the mental steps of claim 1 into a practical application or transforms the Abstract Idea significantly more than itself
Claims 10-11 depicts possible destination for the delivery of notification; but this feature cannot be seen at rendering the mental process of claim 1 much more significant than an Abstract Idea type of Judicial Exception.
Claims 12-15 recite nature of the interface, the network or composing structure thereof, to
which the delivery of notifications is directed, and like for claims 10-11, are considered "additional
elements" of no significance toward resolving the Judicial Exception of claim 1.
Claim 17 recites a possible response to the notifications relates to audio adjust; but this
response is remote from converting the mental process of claim 16 significantly more than the Abstract Idea itself.
Claim 18 recites nature of a destination to which delivery of notifications is directed, and
like in claims 10-12, this 'additional element' is not rendering the Judicial Exception of claim 16
sufficiently for it to amount to significantly more than the Abstract Idea.
Claim 20 for reciting the audio setting adjust of claim 7, equally fails to render the Judicial
Exception of claim 19 significantly much more than the Judicial exception aspect thereof.
In conclusion, claims 1, 16, 19 are rejected under 35 U.S.C. 101 because the claimed invention is directed to a judicial exception.
Claim Objections
Claim 19 is objected to because of the following informalities: the phrase recited as “in response to the detected determined change the engagement, one or more interrupted user workflow notifications to one or more of the plurality of devices of the heterogeneous computing platform” (lines 17-19) contains no verb and/or is grammatically faulted with a syntactic omission, one of which being a missing preposition between “determined change” and “the engagement”. Appropriate correction is highly recommended.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1, 3, 6, 8-16, 18-19 is/are rejected under § 35 U.S.C. 103 as being unpatentable over Jorasch et al, USPubN: 2021/0319408 (herein Jorasch), in view of El Kaliouby et al, USPubN: 2016/0191995(herein Kaliouby), Baba Kenji et al, JP 2010154134 (translation), 07-08-2010, 13 pgs (herein Kenji) and Lund et al, USPubN: 2021/0357842 (herein Lund)
As per claim 1, Jorasch discloses an Information Handling System ( device 100 – Fig. 3C ; monitoring device – para 0024-0026; Fig .4; Fig .5A), comprising:
a heterogeneous computing platform comprising a plurality of devices (one or more central processors and/or one more processors for graphics – para 0265; device 371,373, 363, device 100 – Fig. 3C; para 0248 ;monitoring device 100, other computing-devices 373, tenant device, operator device, provider device ,third-party device, gateway, cellular network – para 0277; computing devices 373 – para 0267; one or more monitoring devices 100 – para 0191-0192; para 0077); and a memory coupled to the heterogeneous computing platform, wherein the memory comprises a plurality of sets of firmware instructions (firmware – para 0180, 0205, 0227, 0229, 0276), wherein each of the sets of firmware instructions, upon execution by a respective device among the plurality of devices (Fig. 3C; computing devices 373- para 0277), enables the respective device to provide a corresponding firmware service (NINCE – para 0015; given monitoring device to receive a firmware … for the device 100 to … escalate an event for NINCE 367 to de-escalate an event detected – para 0239), and
wherein at least one of the plurality of devices operates as an orchestrator (central controller – para 0097; may be one or more central processors – para 0265; processor 501 - Fig. 5A; monitoring device – para 0387; tenant 401/403 … control access may be centrally determined by … operator 405 – para 0386; para 0257) configured to:
initiate a background process tracking operation of the IHS (set of instructions NINCE 367 may be configured to … receive information such as sensor 505 data from the monitoring device – para 0253; para 0625-0626; trigger the scheduling of a meeting, may ensure proper pre-work are generated e.g. agenda – para 0580; Fig. 79A, 79B – Note1: pre-arrangement and setup of room/conference meeting by a central controller with effect of tracking engagement of users/participants - e.g. eye tracking, facial expression, posture: para 0626 - being invited/convened for one such session reads on initiating a tracking process in the background of a conference/meeting or video session), the background initiation of a streaming video session (e.g. communications with the central controller … include conference room control systems, video communication networks … streaming platforms … central controller may include hardware and software that interfaces with user devices and peripheral devices to facilitate communications – para 0098; central controller … transmit lower bandwidth video … feeds, central controller may determine the frequency at which to poll data from a user or a peripheral device – para 0110; central controller … recommend … certain types of meetings – para 0336; video of a meeting – para 0345; tracking of the overall number of meetings – para 0347; Figs. 78-79; person participating in a … video conferencing session – para 0144) using a camera of the IHS, to initiate monitoring of data captured by the camera (image from a camera in conference room – para 0468; cameras capture video signal … transmit the video to the central controller … send video feed directly to the central controller … video feed from one or more cameras – para 0471; cameras – para 0514, 0520) during the streaming video session (video conferencing – para 0476; Figs 64; video screen in the room … to display a video – para 0511; real time feedback, sources of feedback including … mice, cameras – para 0514) to determine an engagement score of an user (Fig. 53; engagement over time 6702, 6704 – Fig. 67; engagement level … over time interval … from the input of meeting participants, engagement scores – para 0516; central controller tracks engagement 7936 – Fig. 79B; indication of the level of engagement of a person participating in … video conferencing session – para 0144; information could be about an individual ... current engagement level – para 0795; engagement may refer to one or more behaviors of an attendee … paying attention, focusing, contributions to a discussion, performing a role, staying on topic, interacting with others, behavior of interest – para 0359; central controller can recommend … individuals or owners with high engagement scores – para 0565) of the IHS with video content presented on the IHS (para 0471, 0511, 0514) during the video session (a person participating in … video conferencing session – para 0144)
wherein the engagement score (engagement over time 6702, 6704 – Fig. 67; para 0702, 0709; displayed in the image gallery … based on sensor data, participants gallery view image, information could be about an individual ... current engagement level – para 0795; para 0731-0732) is determined based on analyzing data capture by the camera and video content (para 0468,0471, 0476, 0511) presented on the IHS (real time feedback, sources of feedback including … mice, cameras – para 0514; snapshots over time … indication of the level engagement of a person participating in … video conferencing session – para 0144)
based at least in part on the determined engagement score of the user of the I.H.S. (see above) determine a change in the engagement of the user (assessing engagement …captures data about people entering or leaving – para 0775; engagement levels have fluctuated over the time interval, engagement levels only fell below the Red Zone – para 0516; yawning, distraction – para 0626; downward movement includes boredom and lack of engagement – para 0632; levels start to drop – para 0744; review information collected about meeting participants to look for signs, changes in level of meeting engagement – para 0852) with the video content presented on the I.H.S ( see above)
Jorasch does not explicitly disclose determining engagement score of a user (based on analyzing data captured by the camera) in terms of
(i) wherein the determination of engagement score based on the data analysis to determine changes in orientation of the user's face relative to the video content presented on the IHS; and
(ii) in response to the determined change in the engagement, deliver one or more interrupted user workflow notifications to one or more of the plurality of devices of the heterogeneous computing platform.
As for (i)
Tracking of user engagement (e.g. engagement may refer to one or more behaviors of an attendee … paying attention, focusing, contributions to a discussion, performing a role, staying on topic, interacting with others, behavior of interest – para 0359) in Jorasch can be based on capture of a person posture, eye tracking, facial expression (para 0626) and head movements like shaking in regard to agreement, nod, strong emotional reaction, disagreement or neutrality, or movements detected by camera (para 0925) as signs of frustration, an opinion or fatigue (para 0890-0896), with camera feeds to be collected by the central controller (cameras 8366, 8368 – Fig. 83B), where feed from a camera source (para 0245, 0471) can be presented via a central controller – e.g. as gallery view, para 0792; video stream, video call avatar , para 0793 - as live feed to track user behavior/participation (para 0774), to exhibit their real-time interaction (para 0796) and dynamic state of their engagement (information … showing the users current engagement level - para 0795); including tracking a remote participant equipped with a headset-mounted camera based on which head movements are detected by the camera, transmitted and interpreted by the central controller (para 0889-0896) to derive an emotion reaction or visual cues to participating aspect of a participant of that moment. Hence, a measure of engagement level based on the visual/video analysis by a central controller in regard to determination of changes in movements of the user's head or face relative to the video content presented on the IHS is recognized.
Kaliouby discloses a human face being analyzed in relation to determination of emotions, mental states, facial recognition, motion capture, eye tracking and computer animation, the range of emotions indicative of engagement from following video data or media presentation engaging interest of a viewer (para 0008), where image acquisition captured as display from a device that houses the camera provide images that support evaluation on head pose, orientation, and eye gaze direction by individual as part of determining viewership and attendance evaluation (para 0041), the video capture belonging to one person or plurality thereof as facial data including head gestures, eye movements and expression like smile (para 0060) based on which taxonomies of facial movements can be formed by a coding system (FACS) based on analysis of determined mental state patterns, emotions of persons whose facial data is capture in the videos; e.g. including head movements, head turn left or up, eyes turned left or up etc. (para 0081) as part of determination of viewership or level of interest by viewers of a displayed content (para 0051-0052) where upon detecting a change in viewability status, the digital content can be modified or edited (para 0056-0057). Hence, engagement level based on the data analysis to determine changes in orientation of the user's face relative to the video content or visual presentation is recognized.
As for (ii),
Jorasch discloses monitoring status of a meeting by the central controller to take corrective action proposed via notification to all participants (available rooms ... needed amenities, person absent from a meeting, para 0863; alerts via audio, text messaging - Fig. 50) including delivery of a notification by the central controller in response to a changed situation where one or more users are present and desire to communicate with another user to engage in a collaboration, the latter provided as status updates to plural user devices or peripheral devices, smartphones (para 0100); e.g. a change scenario wherein an attendance app can provide notification to users in response to latest change to meeting location, time, or list of invitees (para 0523), where a recognized engagement change (a dip thereof – engagement has decreased, levels are low – para 0361; levels fell under a score of 20 – para 0516) can trigger a mitigating action from the central controller (innovation meetings – para 0570) or a warning from the app(para 0516). Hence upon a recognized update/change to a collaborative situation or meeting, transmitting, sending a status update or notification to a one or more participant devices or other user devices in response to a latest change (added invitees, change in meeting status, convenance, loss in engagement) to user/collaborative engagement is recognized – referred herein as (*)
As entering and leaving (Jorasch: para 0470) is considered a user behavior indicative of a personal level of engagement or interest, Kenji discloses monitoring camera arranged as security device for capturing image in monitoring a person passing through a gate, with notification of the person information from an entering/leaving management device to cause storage of the video storage and meta-information associated thereof (see Abstract; pg. 4) in that entrance/exit time recordation for the person is combined with person shape and affiliation name authentication in form of time series and stored as shape or behavior pattern (pg. 5-6) such that upon notification by the camera caused by a person entering/leaving a space, e.g. where the stored metadata and image can be mapped with the actual capture of image and meta-information obtained under entering/leaving management device to detect a deviant event (pg. 13) as part of video surveillance established via a notification using a entering/leaving management device coupled to the gate camera (pg. 10). Hence notification by a surveillance front camera enabling an exit/entry management device to record a person attribute and shape in order establish legitimacy of the person entering (engaged) or leaving (or no longer engaged) a monitored space entails delivery of one or more interrupted user workflow (entering/exiting event) in form of camera capture or notifications transmitted to an entry/exit management device.
Lund discloses tracking engagement level of participants of a development system or social media by a controller based on facial video and audio recording of a participant in regard to reviewing and assessing a mental status of the participant (para 0061-0062, 0070, 0074) and based on the assessed metrics, the controller transmit suggested activity to one or more devices of the participants for the latter to re-engage (para 0044), a alert message or push notification requesting the participant to select a evaluation option (para 0004; 0041 ,0042, 0043, 0051) or a message seeking assistance and therapy from a participant (para 0052), or notification offering hints/tips to support the partner device (para 0055) for recovering or healing (para 0056)
Therefore, based on role of a orchestrator unit (central processor) and tracking of engagement level of meeting participants based on which the central processor issue notification update or mitigating suggestions, it would have been obvious for one of ordinary skill in the art before the effective filing date of the invention to implement tracking determining engagement score/level of a user on basis of analyzing data captured by the camera so that
(1) determination of engagement score is based on determining changes in orientation of the user's face relative to the video content presented on the IHS – as set forth in Kaliouby’s viewership and attendance evaluation;
(2) the central controller, in response determined change in the engagement level – as set forth per (*) - would deliver one or more interrupted user workflow notifications – similar to Kenji and Lund - to one or more of the plurality of devices of the heterogeneous computing platform – as set forth per (*) or participant entities in Lund; because
evaluation of a degree of a user participants via video or camera captured data analysis would enable visual identification of dynamics and quantization of the real-time level of interest, focus in a user in the course of participating/attending with an ongoing presentation or a collaborative process, and use of a central controller capable of collecting camera capture as set forth in Jorasch so to evaluate attention/mood behavior over time and detect change to this level of engagement via physical manifestation signs (e.g. tracked facial expression, head movement, and eye motions from a camera) that would signify a behavioral swing, a personal loss of interest, a functional setback to the NW entities or system being monitored, an alarming status to a particular environment, a negative condition/impact to an endeavor for which plural users or social group were to collaboratively participate, so that based thereon, notification or proposed actions issued by the analytic controller can be transmitted to relevant devices entities, NW responders or participants in order for corrective actions to be timely considered and/or dispatched to mitigate any issue or conditions inferred from visual capture or findings derived by a central controller as in Jorasch, using the video-based tracking of user engagement.
As per claim 3, Jorasch discloses the IHS of claim 1 wherein the orchestrator comprises at least one of: a sensing hub (cameras 8314, sensor 8316 [Wingdings font/0xE0] room controller 8312 – Fig. 83A; room controller 8312, cameras 8366, cameras 8368[Wingdings font/0xE0] central controller 110 – Fig. 83B – Note2: communication of monitored sensor, cameras data to a local controller and ending into a central controller reads on the central controller being a sensing hub), an Embedded Controller (EC), or a Baseboard Management Controller (BMC).
As per claim 6, Jorasch discloses IHS of claim 1, wherein the delivery of the one or more
interrupted user workflow notifications comprises delivery of one or more images captured from
the graphics frame buffer of the camera (image from a camera in conference room – para 0468; camera send a video feed … to central controller – para 0471; para 0466; sources of feedback … cameras – para 0514 ) of the IHS.
As per claims 8-9, Jorasch discloses IHS of claim 1, wherein the detected determined change in the engagement of the user is determined based at least in part on interpreting an audio stream (level 5310: high/low/average/none and engagement indicator 5312 – Fig. 53; para 0365) that are indicative of the user's engagement.
Jorasch does not explicitly disclose interpreting user engagement by way of one or more keywords in the audio stream;
wherein the one or more keywords are indicative of an inquiry concerning the presence of the user.
However, information set to track as part of monitoring discussion and conference in Jorasch network configuration approach includes pre-establishing of various type of information likely to concern participants of conference or relate to topics of meeting as part of a planning or mock-ups table (Fig. 63) where asset information thereby presented as a table can list keywords as one of the assets to track (para 0427) where keywords can be stored and serve as basis of search by the central controller to track level of inter-actions or indication of the business involvement the attendees were being preoccupied with (para 0866)
Therefore, based on voice tracking as part of planning or determination of user engagement (engagement indicator 5312 – Fig. 53; para 0365) associated with participants of a gathering or meeting whose accommodation is being prepared by a central controller based on querying status of attendance in conjunction with room availability (para 0475, 0557), it would have been obvious for one of ordinary skill in the art before the effective filing date of the invention to implement collection of keywords by Jorasch preplanning system so that user engagement or involvement with their business can be used as indication from within the audio or voice tracking, which in part is based one or more keywords - as set forth above - in the monitored audio stream, one or more of said keywords susceptible of indicating of an inquiry concerning attendance or presence of the user to accommodate as part of a planned meeting as set forth above by Jorasch’s central controller; because
audio type keywords when collected in real-time can be indicative of significant involvement, engagement intentions and prospected undertaking by person(s) source of that captured audio which in turn, when properly understood, interpreted in the very context of group interaction or collaborative settings – e.g. of a conference or a video session - can be used toward inference or build of a collective endeavor, a business direction, or an actionable intent which participants of the meeting or conference are inclined to follow or adopt, according to which, adaptive reaction or accommodation measure can be presented from an analytic central controller as set forth above, as technical suggestions or engagement type recommendations or measures for the meeting participants to elect; e.g. to improve any attendance/room availability issue or features associated with implementation of their intended solution.
As per claim 10, Jorasch discloses IHS of claim 1, wherein the delivery of the one or more
interrupted user workflow notifications comprises delivery of the notifications (refer to rationale of claim A 1) to an optimization service (optimize the allocation of meeting rooms and meeting participants – para 0572-0574; para 0577; optimize meeting size, staff requirements, physical layout – para 0910; step 7912 – Fig. 79A) of an operating system of the I.H.S. (optimizing the distribution of employees at meetings – para 0005; system 100 – para 0055-0058; system 100: user device 902, operating system 924, Ip Address 936 – Fig. 9).
As per claim 11, Jorasch discloses IHS of claim 1, wherein the delivery of the one or more
interrupted user workflow notifications comprises delivery of the notifications (see rationale A in claim 1) to a network device of the IHS; i.e. one or more of the plurality of devices of the heterogeneous computing platform.
(refer to rationale A of claim 1)
As per claim 12, Jorasch discloses IHS of claim 11, wherein the delivery of the one or more interrupted user workflow notifications comprises a wireless notification (refer to rationale A of claim 1; see send commands from below) delivered to the network device (some of the devices … may be … controlled … in order to improved productivity, clarity, collaboration, engagement … meeting factors … under control of a controller which may use … wireless connections to send commands or requests … in order to command various devices in the conference room – para 0773; processor 8125a can communicate via … wireless network with central controller 110 – para 0785).
As per claim 13, Jorasch discloses IHS of claim 1, wherein the delivery of the one or more
interrupted user workflow notifications comprises delivery of notifications (refer to rationale A of claim 1) to a wireless device (refer to wireless notification in claim 12) connected to the IHS.
As per claim 14, Jorasch discloses IHS of claim 13, wherein the notifications are delivered (refer to rationale A of claim 1) via a wireless interface (wireless communications – para 0773) implemented by a first of the plurality of devices (camera 8010 captures a video signal that is transmitted to room controller via a … wireless connection for storage or processing – para 0774; processor 8125a can communicate via … wireless network with central controller 110 – para 0785) of the heterogeneous computing platform.
As per claim 15, Jorasch discloses IHS of claim 14, wherein the wireless device connected to the IHS comprises at least one of a wireless phone (smartphones, tablets – para 0789, 0791, 0904) and a tablet.
As per claim 16, Jorasch discloses a memory device having a plurality of sets of firmware
instructions, wherein each of the sets of firmware instructions is executable by a respective
device among a plurality of devices of a heterogeneous computing platform to enable the
respective device to provide a corresponding firmware service, and wherein a given one of the
plurality of sets of firmware instructions, upon execution by a given device, cause the selected
device to:
initiate a background process tracking operation of the IHS;
in response to the background process detecting initiation of a streaming video session
that uses a camera of the IHS, initiate monitoring of data captured by the camera during the
streaming video session to determine an engagement score of a user of the IHS with video
content presented on the IHS during the video session,
wherein the engagement score is determined based on analyzing the data captured by the camera to determine changes in orientation of the user's face relative to the video content presented on the IHS;
based at least in part on the monitored determined engagement score of the user of the
IHS, determine a change in the engagement of the user of the IHS with the video content
presented on the IHS; and
in response to the determined change in the engagement, deliver one or more
interrupted user workflow notifications to one or more of the plurality of devices of the
heterogeneous computing platform.
(all of which having been addressed in claim 1)
As per claim 18, Jorasch discloses memory device of claim 16, wherein the delivery of the one or more interrupted user workflow notifications comprises delivery of the notifications to an
optimization service of an operating system of the IHS.
Refer to rationale of claim 10.
As per claim 19, Jorasch discloses a method comprising:
configuring, by a first firmware service (refer to claim 1) running on an orchestrator device (refer to claim 1) of a heterogeneous computing platform of an Information Handling System (IHS), a background process tracking operation of the IHS (see Note1);
in response to the background process detecting initiation of a streaming video session(refer to claim 1) that uses a camera (refer to claim 1) of the IHS, initiate monitoring of data captured by the camera during the streaming video session(refer to claim 1) to determine an engagement score of a user the IHS with video content presented on the IHS during the video session (refer to claim 1),
wherein the engagement score is determined based on analyzing the data captured by the camera to determine changes in orientation of the user's face relative to (refer to rationale A(i) of claim 1) the video content presented on the IHS;
at least in part on the determined engagement score of the user of the IHS, determining a change in the engagement of the user (refer to claim 1) of the IHS with the video content presented on the IHS; and
in response to the determined change in the engagement, one or more interrupted user workflow notifications (refer to rationale A(ii) of claim 1) to one or more of the plurality of devices of the heterogeneous computing platform.
Claims 2 is/are rejected under § 35 U.S.C. 103 as being unpatentable over Jorasch et al, USPubN: 2021/0319408 (herein Jorasch), in view of Baba Kenji et al, JP 2010154134 (translation), 07-08-2010, 13 pgs (herein Kenji), El Kaliouby et al, USPubN: 2016/0191995(herein Kaliouby), and Lund et al, USPubN: 2021/0357842 (herein Lund) further in view of Binder et al, USPubN: 2013/0201316 (herein Binder)
As per claim 2, Jorasch does not explicitly disclose IHS of claim 1,
wherein the heterogeneous computing platform comprises at least one of: a System-On-Chip (SoC), a Field-Programmable Gate Array (FPGA), or an Application-Specific Integrated Circuit (ASIC).
Binder discloses server-based control with one or more computer systems disposed in an internet inter-connection setting (Figs. 20) comprising server, field units and client host, and portable/handheld device communicating with a router, each computing system equipped with image processing (digital camera or video recorder) to support a interconnect mechanism for passing information (image or voice data) to be processed using an integrated circuit within a corresponding computer system (Fig 13, para 0557), where the integrated circuit can be implemented as ASICs, FPGAs or SoC devices (para 0571), each such local computer via a camera-based sensor, sensor-based actuator operation is capable of processing, handling camera image, where image and/or voice being processed by control logic of the computer or a field unit are to be transferred over paths of a building, a vehicle and an external LAN, WAN or home networks (see Abstract; Fig. 13) to a control server (para 0054) in which the capture image or voice is being processed or recognized (para 0055). Hence, devices provided as ASICs, FPGAs or SoC implementation and disposed in a server interconnect network to provide camera sensor data to a server for image processing, extracting and recognition by the server is recognized.
Therefore, it would have been obvious for one of ordinary skill in the art before the effective filing date of the invention to implement computers in the I.H.S heterogeneous platform so that each such computing system would comprise at least one SoC, FPGA or ASIC as set forth in Binder, because
these particular multi-element processor embodiments can be programmed, flashed and reprogrammed on a per-need basis so to accommodate specific type of demand, workload, graphics type complexity associated with computation-intensive application such as graphics data being passed from raw sources like camera sensor – as set forth in the video tracking approach by Jorasch – in that capabilities of a FPGA or ASIC processing architecture can be arranged or allocated to synergically or cooperatively handle large and complex dataset in the likes of camera/video capture/stream as set forth in Jorasch conference tracking system, according to which, multitude of image pixels can be processed in an accelerated manner by a corresponding number of processing units provided by the SoC, FPGA or ASIC platform, thereby improving the throughput of the video recognition and analysis as endeavored in Jorasch system.
Claims 7, 17, 20 is/are rejected under § 35 U.S.C. 103 as being unpatentable over Jorasch et al, USPubN: 2021/0319408 (herein Jorasch), in view of Baba Kenji et al, JP 2010154134 (translation), 07-08-2010, 13 pgs (herein Kenji), El Kaliouby et al, USPubN: 2016/0191995(herein Kaliouby), and Lund et al, USPubN: 2021/0357842 (herein Lund) further in view of JP 3742474, (translation) 02-01-2006, 20 pgs (herein '474)
As per claim 7, Jorasch does not explicitly disclose IHS of claim 1, wherein, in response to the delivery of the one or more interrupted user workflow notifications, one or more of the plurality of devices of the heterogeneous computing platform respond by conserving IHS power by at least one of:
muting audio of the IHS and adjusting IHS performance of one or more IHS processors.
Jorasch discloses participation of a group (for performing a game) where a particular allocation of power is specific to one such instance of group participation (para 0161-0162) to arm the game with sufficient energy or ammunition (Fig. 30) shown in power fields indicated as the initial GUI setting from a central controller, the allocation of power also shown via settings and adjustment of temperature by the central controller in response to sensing a particular number of attendees in a conference room for necessary amount of air conditioning and lightning (para 0779-0780); hence power provisioning and adjustment thereof per effect of a central controller actions in response to users participation or engagement changes associated with conferencing attendance or group collaboration is recognized.
Analogous to tracking of voice or speech as indicators of engagement in Jorasch (level 5310: high/low/average/none and engagement indicator 5312 – Fig. 53; para 0365) in conjunction with allocation of resources, '474 discloses an energy management system that targets proper power utilization by computers of the system, such as decreasing power supply of the audio amplifier as a way to save energy (para 0005), the audio power control thereof including muting the amplifier component of the audio (see Abstract) by asserting a control that triggers speaker muting signal (para 0008) in conjunction with the muting of the amplifier, the muting being enhanced with elimination of pops, clicks and snaps likely caused by the computer power fluctuations that accompany the effect of the muting signal (para 0052); hence conservation of power or energy to computers per effect of sending a muting command to the audio components is recognized.
Therefore, as occupancy/attendance state of a conference or gathering requires control or accommodation adjust (e.g. Fig. 79A) to operational allocation/demand of energy to optimize provisioning or cost inferred by the engagement tracking and voice monitoring in Jorasch (para 0779-0780) it would have been obvious for one of ordinary skill in the art before the effective filing date of the invention to implement adjust to the settings of the heterogenous platform in Jorasch so that conservation on energy or over power expenditure by components and electronics of the I.H.S. platform can be made by increasing or decreasing energy provisioning by one or more IHS central processing unit clusters, IHS networking in direct relevance to involvement of participants within one or more gathering or collaborative contexts of the IHS, including a form of energy conserving as shown in '474 central control issuing or asserting a signal sent to a respective component to turn off audio output or mute amplification of sound, for effect to reduce the energy consumption portion of the HW controller when engagement of users no longer warrants such energy expenditure; because
activating workflow actions in response to indication or acquired information indicative of
user engagement or level of attendance as intended by Jorasch approach would necessarily identify consumption portions of various operational units or host devices of the I.H.S. system associated with energy supply, performance demand or amount of activities to sustain so that proper power allocation can be dispatched and timely optimization thereof can be put into effect to mitigate starvation of energy or otherwise excessive cost on energy spent more or less in a real-time, the conservation of power aspect of this optimization scheme by a central controller including elimination of excessive power expenditure carried out in part with adjusting made to relevant IHS setting to decrease IHS performance of one or more IHS central processing unit clusters, IHS networking and one or more IHS host contexts in which engagement of users – as in Jorasch conference tracking - is being monitored and detected as dipping, where the timely response by a central controller responsive to this dynamic change includes reduction or decrease in energy supplying by the underlying HW support; e.g. sending a control that asserts a muting effect to a respective HW component (amplifier) using a voice assisting service – as in ‘474 - configured to track the aggregate sound/voice from the occupants inside a gathering or venue, and react to a diminishing engagement instance by instantly turning off audio output slated for the gathering in order to conserve a measure of power consumption and avert unjustified energy consumption by the I.H.S. when the justification therefor is deemed insufficient.
As per claim 17, Jorasch does not explicitly disclose memory device of claim 16, wherein in response to the delivery of the one or more interrupted user workflow notifications, one or more of the plurality of devices of the heterogeneous computing platform respond by adjusting one or more IHS power settings.
But adjusting power settings such as muting audio power output as part of optimization directives (Fig. 79A) by a central controller in Jorasch system has been addressed as obvious per rationale in claim 7 from above.
As per claim 20, Jorasch discloses method of claim 19, wherein, in response to the delivery of the one or more interrupted user workflow notifications, one or more of the plurality of devices
of the heterogeneous computing platform respond by conserving IHS power by adjusting one or
more IHS settings.
(refer to rejection of claim 17)
Response to Arguments
Applicant's arguments filed 4/29/26 have been fully considered but they are not persuasive. Following are the Examiner’s observations in regard thereto.
The arguments are solely directed to merits of the limitations included with the current Amendment to the claims and this cannot be considered a proper prima facie case of rebut because a adjusted Office Action has been issued in direct response to the claim amendment, rendering the above observations by Applicant toward patentability of the claimed matter unapplicable or largely MOOT.
Conclusion
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to Tuan A Vu whose telephone number is (571) 272-3735. The examiner can normally be reached on 8AM-4:30PM/Mon-Fri.
If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Chat Do can be reached on (571)272-3721.
The fax phone number for the organization where this application or proceeding is assigned is (571) 273-3735 ( for non-official correspondence - please consult Examiner before using) or 571-273-8300 ( for official correspondence) or redirected to customer service at 571-272-3609.
Any inquiry of a general nature or relating to the status of this application should be directed to the TC 2100 Group receptionist: 571-272-2100.
/Tuan A Vu/
Primary Examiner, Art Unit 2193
June 21, 2026
Prosecution Insights