DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claim(s) 1-15 and 17-21 is/are rejected under 35 U.S.C. 103 as being unpatentable over Beck et al. (US 20220160918 A1) in view of Shoji et al. (US 20230076864 A1).
Regarding claims 1, 15, and 20, Beck discloses a contamination control system (fig. 2), comprising:
a processor ([0067] at least one processor); and
a non-transitory, processor readable storage medium communicatively coupled to the processor, the non-transitory, processor readable storage medium comprising one or more instructions stored thereon that, when executed, cause the processor ([0068] a computer program) to:
obtain a reference image of a room ([0036] a geometry reference image is acquired without the presence of people and additional objects; [0094] a reference image is acquired from the cameras in the absence of people and additional object in the room);
detect occurrence of one or more triggering events based on one or more contamination identification processes ([0023] a microphone has proven to be useful, in particular, when aerosol contamination due to speaking, sneezing, coughing and the like is also to be tracked, since events of this kind can then be detected by corresponding detection of the associated noises; [0101], [0104], and [0105] the trained function detects, for example, sneezing, coughing or another aerosol generating procedure), wherein the one or more triggering events comprises a contamination detection based on a sneeze, a cough, a lack of sanitization, a lack of personal protective equipment sanitization, a contagious touch, or any combination thereof ([0023] and [0101] a microphone has proven to be useful, in particular, when aerosol contamination due to speaking, sneezing, coughing and the like is also to be tracked, since events of this kind can then be detected by corresponding detection of the associated noises; [0092] during this utilization phase sensor data of the various sensors of the sensor arrangement of the cleaning system, in the present case in particular the cameras 9a, 9b and the microphones 8 therefore, is acquired in a step S2. This sensor data is evaluated in a step S3 in order to identify potentially contaminated regions of the useful surface and to mark them in a surface map of the useful surface);
obtain a second image of a first region of interest of contamination (9a and 9b of fig. 2, [0036] at least one currently acquired image from a camera, [0094] images currently being acquired by the cameras);
compare the second image to the reference image ([0036] formation of difference images of the geometry reference image with at least one currently acquired image; [0094] The geometry model can be derived, for example, from geometry reference images acquired with the cameras 9a, 9b and which were acquired in the absence of people and additional objects. These geometry reference images describe the three-dimensional geometry of the useful surface and can also be used in the framework of the image processing algorithm, moreover, to detect, by comparison with images currently being acquired, people and/or objects who/which have come along and take account of them accordingly);
determine, based on the comparison, a change between the second image and the reference image ([0036] people and/or objects obscuring the useful surface being detected by formation of difference images of the geometry reference image with at least one currently acquired image and being taken into account when determining contaminated regions; [0092] and [0130] this sensor data is evaluated in a step S3 in order to identify potentially contaminated regions of the useful surface and to mark them in a surface map of the useful surface; [0097] and [0098] a temperature difference image can be generated by comparison with a current image and the level of the temperature difference can make an important contribution to the determination of the level of contamination since, for example, heating is greater with intensive skin/body contact compared to brief contact or brief contact with an item of clothing; [0104] determining a level of contamination); and
control initiation of one or more reaction events responsive to the change ([0066] and [0067] the control facility for the cleaning system based on the detected contamination regions, 16 of figs. 7 and 8; [0117] treatment information, for example cleaning agents to be used, cleaning methods and the like, can also be assigned in the cleaning workflow to the individual contaminated regions 16 that are to be cleaned one after the other; [0019] The portion 20 can then be presented for example in green, so the result of the cleaning measure is immediately evident to the cleaner. Furthermore, the cleaner can thus be alerted to portions that have not yet been sufficiently dealt with and prepared; [0118] In a step S6, cf. FIG. 1 again, the cleaning information is output to a cleaner).
It is noted that Beck is silent about wherein at least one of the one or more reaction events includes overlaying the first region of interest of contamination and a second region of interest of contamination onto a combined image.
Shoji teaches wherein at least one of the one or more reaction events includes overlaying the first region of interest of contamination and a second region of interest of contamination onto a combined image ([0045] The contamination information generation unit 107 also stores contamination information satisfying a predetermined storage condition and combines pieces of the stored contamination information to generate combined contamination information; [0084] in step S601, the contamination information generation unit 107 combines pieces of the stored contamination information to generate the combined contamination information; [0085], [0089], and [0090] The conversion of the contamination information or the combined contamination information performed by the information presentation unit 108 may include the conversion into mapping information in which a video is mapped on an object; in step S602 (contamination information presentation processing) in FIG. 6, the information presentation unit 108 needs to convert the video of the combined contamination information generated in step S601 into the mapping information in which a video is mapped on an object, and project the information for presentation).
Taking the teachings of Beck and Shoji together as a whole, it would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify the overlaying process of the contamination areas of Shoji into the system of Beck by converting the contaminated area into a video and projecting the video to an object for presentation in this way, it becomes possible to visually recognize a contaminated area to which droplets scattered from a person adhere and it is possible to visually recognize a contaminated area to which droplets scattered from a person adhere, enabling efficient cleaning.
Regarding claim 2, Beck and Shoji teach the contamination control system of claim 1, Beck further teaches wherein obtaining the reference image of the room comprises scanning, via a plurality of imaging devices, the room ([0036] a camera is used as part of the sensor arrangement it can be provided that without the presence of people and additional objects in the field of view of the at least one camera, in particular together with the comparison image, a geometry reference image is acquired; [0094] The geometry model can be derived, for example, from geometry reference images acquired with the cameras 9a, 9b and which were acquired in the absence of people and additional objects).
Regarding claims 3 and 17, Beck and Shoji teach the contamination control system of claim 2, Beck further teaches wherein the one or more instructions further cause the processor to:
obtain, via the plurality of imaging devices, a second reference image of the room (9a and 9b of fig. 2, the cameras capture a second reference at a second region or area; 16 and 17 of fig. 8, sneezing or coughing area of the patient; [0036] a geometry reference image is treated as a second reference image for the second region or area, [0094] reference images encompass a second reference image for the second region or area, [0108] the method indicates the return to capture picture in different areas or regions);
detect occurrence of the one or more triggering events based on the one or more contamination identification processes (16 and 17 of fig. 8, [0101] and [0115] an act of sneezing and coughing of the patient is detected);
obtain, via the plurality of imaging devices, a third image of the room containing a second region of interest of contamination (9a and 9b of fig. 2, [0036] at least one currently acquired image from a camera, [0094] images currently being acquired by the cameras, the currently acquired images encompass a third image; 16 and 17 of fig. 8, [0115] the second region of interest of contamination is captured by the cameras 9a and 9b);
compare the second reference image with the third image ([0094] and [0097] comparison the currently acquired image to the reference image);
determine, based on the comparison, a second change between the second reference image and the third image ([0029] a temperature difference based on the at least comparison image; [0036] information of difference images, [0094] and [0097] the level of the temperature difference can make an important contribution to the determination of the level of contamination); and
control initiation of the one or more reaction events responsive to the second change ([0117] treatment information, for example cleaning agents to be used, cleaning methods and the like, can also be assigned in the cleaning workflow to the individual contaminated regions 16 that are to be cleaned one after the other).
Regarding claims 4 and 18, Beck and Shoji teach the contamination control system of claim 1, Beck further teaches wherein the one or more contamination identification processes comprises pixel content comparison, contrast determination, or predetermined spectral frequencies evaluation ([0036] and [0097]).
Regarding claims 5 and 19, Beck and Shoji teach the contamination control system of claim 1, Beck further teaches wherein the one or more reaction events include generation and output of an alert to a device, the alert being indicative of a probability of contamination ([0095] the probability of contamination, [0101] output data describing at least one aerosol procedure, [0119] the cleaner can thus be alerted to portions that have not yet been sufficiently dealt with and prepared).
Regarding claim 6, Beck and Shoji teach the contamination control system of claim 1, Beck further teaches wherein the one or more reaction events include control of illumination on an affected area to indicate a site of contamination ([0086] a UV irradiation light, [0100] illumination using black light).
Regarding claim 7, Beck and Shoji teach the contamination control system of claim 1, Beck further teaches wherein the one or more reaction events include control of illumination on an affected area to clean a site of contamination ([0038] an illumination with UV light, [0100] illumination using black light, [0119] illustrating cleaning hand).
Regarding claim 8, Beck and Shoji teach the contamination control of claim 1, Beck further teaches wherein the one or more reaction events include control of disinfectant dissemination applied to an affected area ([0123] the use of particular cleaning agents and/or cleaning methods, for assignment to a contaminated region 16 is possible).
Regarding claim 9, Beck and Shoji teach the contamination control system of claim 8, Beck further teaches the disinfectant dissemination comprises spraying the disinfectant to the affected area by controlling an atomizer or an ionizer to: disseminate a predetermined amount of the disinfectant, or disseminate the predetermined amount of the disinfectant at predetermined time intervals ([0047] for example, a cleaning tool to be used, a cleaning agent to be used, a cleaning time and the like and thereby constitutes an additional item of information, which can be included in the cleaning information in addition to the surface map or the potentially contaminated region, [0116] for example, cleaning instructions such as a cleaning agent to be used and the like; [0123] the use of particular cleaning agents and/or cleaning methods, for assignment to a contaminated region 16 is possible).
Regarding claim 10, Beck and Shoji teach the contamination control system of claim 1, Beck further teaches wherein the one or more instructions further cause the processor to: identify, via the plurality of imaging devices, one or more objects in the room (6 and 15 of fig. 6, more objects in the room) and compute a contamination probability for each of the one or more objects based on a plurality of parameters (16 of figs. 3, 4, 5, and 6, [0095] the closer the face is to the useful surface and/or the longer it remains in a corresponding position, the greater the aerosol pollution is and thus the greater the probability of contamination can be assumed to be).
Regarding claim 11, Beck and Shoji teach the contamination control system of claim 10, Beck further teaches the plurality of parameters comprises a posture, a direction of coughing or sneezing, personal protective equipment, time elapsed since the coughing or sneezing, sterilization activities, or any combination thereof (16 of fig. 7, [0115]; 17 of fig. 8, [0115]).
Regarding claim 12, Beck and Shoji teach the contamination control system of claim 1, Beck further teaches the one or more instructions further cause the processor to:
track, via the plurality of imaging devices and prior to the initiation of one or more reaction events ([0084] a cleaning system, which tracks potential instances of contamination/soiling and is used in a cleaning phase, which follows a utilization phase beginning in step S1 in FIG.1; [0092] a utilization phase of the imaging facility 1 begins in a step S1. During this utilization phase sensor data of the various sensors of the sensor arrangement of the cleaning system, in the present case in particular the cameras 9a, 9b and the microphones 8 therefore, is acquired in a step S2), one or more room-specific infection control policies ([0010] cleaning and disinfection of imaging facilities in the medical field; [0014] cleaning can take place after every patient or it is at least possible to assess whether cleaning and disinfection is necessary in preparation for the next patient; [0053] a cleaning requirement);
track, via the plurality of imaging devices, violations relative to any of the one or more room-specific infection control policies ([0014] the detected and aggregated, contaminated regions of the useful surface, possibly together with additional information, for example cleaning instructions, [0036] cameras detect the contaminated regions, 9a and 9b of fig. 2, 16 of fig. 7 and 17 of fig. 8, the detected contaminated regions are violations of the policies; [0053] a cleaning requirement for the contaminated regions; [0092] this sensor data is evaluated in a step S3 in order to identify potentially contaminated regions of the useful surface and to mark them in a surface map of the useful surface); and
control initiation of one or more reaction events responsive to the violations of any of the one or more room-specific infection control policies ([0014] where cleaning/disinfection is required, and/or, if provided, even cleaning apparatuses of the imaging facility can be actuated automatically for targeted cleaning of the contaminated regions, [0056] the treatment information and cleaning instructions, for example permitted cleaning agents, methods or required work steps, can be presented, [0116] a cleaning phase begins in step S5 after the end of the utilization phase, [0118] In a step S6, cf. FIG. 1 again, the cleaning information is output to a cleaner).
Regarding claim 13, Beck and Shoji teach the contamination control system of claim 12, Beck further teaches wherein the one or more room-specific infection control policies include, upon entry or exit of the room, pre-contact washing, post-contact washing, sterilization activities ([0014] distribution apparatuses for disinfectant and/or a cleaning robot), barrier compliance, or any combination thereof ([0014] cleaning can take place after every patient or it is at least possible to assess whether cleaning and disinfection is necessary in preparation for the next patient; [0018] Preferably, it is alternatively after a fixed period, however, when the imaging facility or the cleaning system is automatically put into a cleaning operating mode, for example after each patient; [0031] the patient, at least one operator, and medical staff enter the room).
Regarding claim 14, Beck and Shoji teach the contamination control system of claim 1, Beck further teaches wherein the one or more instructions further cause the processor to track, via the plurality of imaging devices, a plurality of types of contamination transmission including airborne transmission, contact transmission, and droplet transmission (9a, and 9b of fig. 2, contamination transmission, 16 of fig. 7 and 17 of fig. 8, [0023] aerosol contamination due to speaking, sneezing, coughing and the like as airborne transmission and droplet transmission, [0026] the contacted regions of the useful surface can be marked as contaminated regions in the surface map as contact transmission).
Regarding claim 21, Beck and Shoji teach the contamination control system of claim 1, Shoji further teaches wherein the combined image comprises information regarding a type of fitting of personal protective equipment ([0042]).
Conclusion
Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Contact Information
Any inquiry concerning this communication or earlier communications from the examiner should be directed to TUNG T VO whose telephone number is (571)272-7340. The examiner can normally be reached Monday-Friday 6:30 AM - 5:00 PM.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Brian Pendleton can be reached at 571-272-7527. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
TUNG T. VO
Primary Examiner
Art Unit 2425
/TUNG T VO/Primary Examiner, Art Unit 2425
Prosecution Insights