DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Response to Arguments
Applicant's arguments filed 02/24/2026 have been fully considered but they are not persuasive.
In response to applicant's argument that the references fail to show certain features of the invention, it is noted that the features upon which applicant relies (i.e.,the conveyance state representing examples such as a suitcase being upright or wheel-upfront) are not recited in the rejected claim(s). Although the claims are interpreted in light of the specification, limitations from the specification are not read into the claims. See In re Van Geuns, 988 F.2d 1181, 26 USPQ2d 1057 (Fed. Cir. 1993). While Applicant notes that the claim should not be limitedly interpreted in accordance with these examples (i.e. suitcase, upright, wheels-upfront), the limitation “conveyance state” without further definition or specification within the claim can be taken very broadly. Under its broadest reasonable interpretation, the limitation “conveyance state” can be interpreted as an all-encompassing state, as long as the state is attributed to the conveyance object. Therefore, Examiner would like to make reference to paragraph 0080 where it is disclosed that the conveyance state (start, stop, slowed or increased) is dependent on the state of the conveyed object (the space of the conveyed object between other conveyed objects, i.e the density). Therefore, due to the lack of definition within the claim of the limitation “conveyance state”, the Examiner is able to interpret the conveyance state as being the starting, stopping, slowing or increasing of the conveyor due to occupancy density.
Applicant further argues that Schroader is silent regarding the conveyor controlling module stopping the conveyor such that the conveyance object, which has been subject to the determination, is positioned within the assessment zone. In response, Applicant would like to make reference to paragraph 0080 wherein it is stated that the computer can control the conveyor to start, stop, slow or increase based on the monitoring of packages on the conveyor sections. Therefore, if a forwarding condition hasn’t been met (an occupancy density that requires stopping the conveyor), the computer can control the conveyor to stop.
Regarding Claims 3-10 and 13-20, Applicant provides no other arguments other than to state these rejections should be traversed under the amended Claims 1 and 11.
For the foregoing reasons, the claims stand rejected.
Claim Rejections - 35 USC § 102
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention.
(a)(2) the claimed invention was described in a patent issued under section 151, or in an application for patent published or deemed published under section 122(b), in which the patent or application, as the case may be, names another inventor and was effectively filed before the effective filing date of the claimed invention.
Claims 1, 3-6, 10, 11, 13-16 and 20 are rejected under 35 U.S.C. 102(a)(1) as being anticipated by Schroader (United States Patent Application US2016221762A1).
Regarding Claim 1, Schroader teaches A conveyor controlling apparatus for controlling a conveyor in accordance with environment parameters with respect to the conveyor, the apparatus comprising:(Figure 9: Conveyor section system 10)a capturing device for capturing an environmental image related to the conveyor;(Figure 9: Plurality of cameras 20-29, 32, 33)an image-analyzing module for determining, based on the environmental image captured by the capturing device, whether an operational condition of the conveyor is satisfied; and(Paragraph 0070: " The vision control system includes a plurality of smart camera modules 20 capable of processing video images and determine the percent of occupancy within defined zones which can be adjusted for each camera by zooming in or out or by selecting a particular grid or area on a smart device video screen to determine the optimum conveyor speed. The smart camera modules process video images and determine occupancy percentage within the defined zones. ")a conveyor-controlling module for controlling the conveyor based on a result of the determination carried out by the image-analyzing module,(Figure 9: Video computer 500)wherein if the image-analyzing module determines that the operational condition is not satisfied, then the conveyor-controlling module stops the conveyor.(Paragraph 0010: "Cameras are positioned at selected individual input points in wired or wireless communication with a computer including a process control algorithm to recognize incoming flow density, in terms of both belt utilization and throughput rate. These measures can be used to make changes to reduce parcel input flow, and could require stoppage of the feed line, if flow is too sparse or dense. Similarly, absence of flow could be recognized prompting an increase in speed of a selected input conveyor or input conveyors."), the capturing device captures an object image of a conveyance object on the conveyor when the conveyance object is in an assessment zone on the conveyor, the object image is the environmental image with respect to the conveyance object, the image-analyzing module determines based on the object image captured by the capturing device whether a conveyance state, which is a state attributed to the conveyance object satisfies a forwarding condition which is in accordance with a conveyance capability of a conveyance system downstream of the conveyor, the forwarding condition is the operational condition of the conveyance system with respect to the conveyance object, and if the image-analyzing module determines based on the object image that the conveyance state of the conveyance object does not satisfy the forwarding condition, then the conveyor-controlling module stops the conveyor such that the conveyance object, which has been subject to the determination, is positioned within the assessment zone.(Paragraph 0063: "The vision based bulk parcel flow management system 5 comprises or consists of a section 10 of a vision based conveyor system wherein a plurality of cameras 20 detect parcels upon the primary or main conveyor collector conveyor which incorporate at least one feed conveyor 11 and one receiving conveyor 13 used in conjunction with a singulator 8 , hold-and-release conveyor, accumulator, and/or strip conveyor typically downstream from the feed conveyor 11 which are shown in linear alignment with a singulator 8 . The conveyors utilize roller and/or belts and each unit is powered by at least one independent motor to convey, arrange, and separate parcels at selected rates activation or of speed based upon desired occupancy of one or more selected conveyors. Thus, the degree of occupancy can be controlled on each conveyor independently of an adjacent conveyor upstream or downstream and the plurality of conveyors in the conveying system can be started, stopped, or the speed can be increased or decreased in order to increase the area of occupancy for a particular conveyor. The conveyor system section 10 utilizes independent motor driven conveyor zones.")
Regarding Claim 3, Schroader teaches the conveyor controlling apparatus according to claim 1, as seen above. Schroader further teaches wherein when the conveyor is stopped by the conveyor-controlling module, if the image- analyzing module determines based on the object image of the conveyance object stopped in the assessment zone that the conveyance state of the conveyance object satisfies the forwarding condition, then the conveyor-controlling module restarts the conveyor.(Paragraph 0063: "The vision based bulk parcel flow management system 5 comprises or consists of a section 10 of a vision based conveyor system wherein a plurality of cameras 20 detect parcels upon the primary or main conveyor collector conveyor which incorporate at least one feed conveyor 11 and one receiving conveyor 13 used in conjunction with a singulator 8 , hold-and-release conveyor, accumulator, and/or strip conveyor typically downstream from the feed conveyor 11 which are shown in linear alignment with a singulator 8 . The conveyors utilize roller and/or belts and each unit is powered by at least one independent motor to convey, arrange, and separate parcels at selected rates activation or of speed based upon desired occupancy of one or more selected conveyors. Thus, the degree of occupancy can be controlled on each conveyor independently of an adjacent conveyor upstream or downstream and the plurality of conveyors in the conveying system can be started, stopped, or the speed can be increased or decreased in order to increase the area of occupancy for a particular conveyor. The conveyor system section 10 utilizes independent motor driven conveyor zones.")
Regarding Claim 4, Schroader teaches the conveyor controlling apparatus according to claim 1, as seen above. Schroader further teaches wherein the assessment zone includes a first assessment zone, Anda second assessment zone which is provided in a downstream direction with respect to the first assessment zone, the first assessment zone is an area in which the object image is captured as a first image by the capturing device while the conveyance object is conveyed by the conveyor, the second assessment zone is an area in which the object image is captured as a second image by the capturing device while the conveyance object is stationary on the conveyor when the conveyor is stopped by the conveyor-controlling module, the conveyor-controlling module stops the conveyor such that the conveyance object is positioned within the second assessment zone if the image-analyzing module determines based on the first image that the conveyance state of the conveyance object does not satisfy the forwarding condition, and when the conveyor is stopped by the conveyor-controlling module, if the image- analyzing module determines based on the second image that the conveyance state of the conveyance object satisfies the forwarding condition, then the conveyor-controlling module restarts the conveyor.(Paragraph 0086: "The video computer 500 utilizes a plurality of cameras to monitor the occupancy zones of selected areas on the conveyors leading up to singulator or separation process. The computer compares the amount of free space on the selected conveyors and compares it to the size of the package on the feed conveyor. If there is an adequate space, the feed conveyor will transfer the package. The amount of room required by a given package is determined by the programmer. For instance, the program may required that the amount of space on the collector conveyor is 1.5 or even 2 times the footprint of a given package depending on the orientation of the adjacent articles. Rate of speed changes of various conveyors are also controlled by the video computer to keep the singulator conveyor fully supplied. The video computer send speed control signals to the speed controllers of all the conveyor sections to regulate throughput of packages.")
Regarding Claim 5, Schroader teaches the conveyor controlling apparatus according to claim 4, as seen above. Schroader further teaches wherein the capturing device includes a first image-capturing device for capturing the first image, Anda second image-capturing device for capturing the second image, the first assessment zone is defined on the conveyor provided in an upstream direction with respect to the first image-capturing device, and the second assessment zone is defined on the conveyor provided in the downstream direction with respect to the second image-capturing device.(Paragraph 0086: "The video computer 500 utilizes a plurality of cameras to monitor the occupancy zones of selected areas on the conveyors leading up to singulator or separation process. The computer compares the amount of free space on the selected conveyors and compares it to the size of the package on the feed conveyor. If there is a adequate space, the feed conveyor will transfer the package. The amount of room required by a given package is determined by the programmer. For instance, the program may required that the amount of space on the collector conveyor is 1.5 or even 2 times the footprint of a given package depending on the orientation of the adjacent articles. Rate of speed changes of various conveyors are also controlled by the video computer to keep the singulator conveyor fully supplied. The video computer send speed control signals to the speed controllers of all the conveyor sections to regulate throughput of packages.")
Regarding Claim 6, Schroader teaches the conveyor controlling apparatus according to claim 1, as seen above. Schroader further teaches wherein the image-analyzing module is further configured to implement a learning model, the learning model defines an assessment standard for the conveyance state, and the image-analyzing module utilizes the learning model in the determination of whether the conveyance state of the conveyance object satisfies the forwarding condition.(Paragraph 0013: "In accordance with the present invention, there is provided a video/camera based conveyor package management system comprising, consisting of, or consisting essentially of a video compute and camera or other digital or pixel detecting and/or recording devices, at least one collector conveyor including separate sections of conveyor separately driven by individual motors with individual speed controllers, selected ones of the sections of the collector conveyor having means such as skewed rollers capable of urging a package to a selected side of the collector conveyor, a plurality of infeed or induction conveyors including separate sections of conveyor separately driven by individual motors with individual speed controllers, first video cameras monitoring areas of the collector conveyor leading up to merge areas of each of the infeed conveyors with the collector conveyor, second video cameras monitoring areas of the infeed conveyor leading up to merge areas of each of the infeed conveyors with the collector conveyor, and a algorithm control program within the video computer capable of controlling speeds and movement of the sections of the various conveyor and of the sections of the infeed conveyors based on a calculated amount of free space on a given collector section compared to a footprint of a package on an oncoming infeed conveyor, as calculated on a pixel by pixel basis. A singulator conveyor may be incorporated within the conveyor system and fed by the collector conveyor.", wherein implementation of learning models are obvious common features able to be initiated within a computer, and are known to a person skilled in the art.)
Regarding Claim 10, Schroader teaches the conveyor controlling apparatus according to claim 1, as seen above. Schroader further teaches further comprising: a main body in which has the image-analyzing module and the conveyor- controlling module a pillar extending upwardly from the main body; and a head unit, which is provided at a top end of the pillar, housing the capturing device.(Paragraph 0031: "It is an object of the present invention to provide a vision based flow management system that includes a camera and computer processor and interface to define and control and integrate with a conveyor control system via Ethernet, WIFI, bluetooth, and other smart electronic devices such as phones, tablets, laptop computers and other visual aid computer based devices capable of communicating with a computer system.", wherein a body, pillar and top end housing the capturing device are obviously known components of a camera)
Regarding Claim 11, Schroader teaches A conveyor controlling method for controlling a conveyor in accordance with environment parameters with respect to the conveyor, (Figure 9: Conveyor section system 10)the method comprising providing a capturing device; first capturing an environmental image related to the conveyor by the capturing device;(Figure 9: Plurality of cameras 20-29, 32, 33)first determining, based on the environmental image captured in the first capturing , whether an operational condition of the conveyor is satisfied; (Paragraph 0070: " The vision control system includes a plurality of smart camera modules 20 capable of processing video images and determine the percent of occupancy within defined zones which can be adjusted for each camera by zooming in or out or by selecting a particular grid or area on a smart device video screen to determine the optimum conveyor speed. The smart camera modules process video images and determine occupancy percentage within the defined zones. ")and conveyor-controlling the conveyor based on a result of the determination carried out by the first determining (Figure 9: Video computer 500)wherein if the first determining determines based on the environmental image that the operational condition is not satisfied, then the conveyor- controlling stops the conveyor.(Paragraph 0010: "Cameras are positioned at selected individual input points in wired or wireless communication with a computer including a process control algorithm to recognize incoming flow density, in terms of both belt utilization and throughput rate. These measures can be used to make changes to reduce parcel input flow, and could require stoppage of the feed line, if flow is too sparse or dense. Similarly, absence of flow could be recognized prompting an increase in speed of a selected input conveyor or input conveyors.") the first capturing captures an object image of a conveyance object on the conveyor when the conveyance object is in an assessment zone on the conveyor, the object image is the environmental image with respect to the conveyance object, the first determining determines, based on the object image captured in the first capturing, whether a conveyance state, which is a state attributed to the conveyance object, satisfies a forwarding condition which is in accordance with a conveyance capability of a conveyance system downstream of the conveyor, the forwarding condition is the operational condition with respect to the conveyance object, and if the first determining determines based on the object image that the conveyance state of the conveyance object does not satisfy the forwarding condition, then the conveyor-controlling stops the conveyor such that the conveyance object, which has been subject to the determination, is positioned within the assessment zone.(Paragraph 0063: "The vision based bulk parcel flow management system 5 comprises or consists of a section 10 of a vision based conveyor system wherein a plurality of cameras 20 detect parcels upon the primary or main conveyor collector conveyor which incorporate at least one feed conveyor 11 and one receiving conveyor 13 used in conjunction with a singulator 8 , hold-and-release conveyor, accumulator, and/or strip conveyor typically downstream from the feed conveyor 11 which are shown in linear alignment with a singulator 8 . The conveyors utilize roller and/or belts and each unit is powered by at least one independent motor to convey, arrange, and separate parcels at selected rates activation or of speed based upon desired occupancy of one or more selected conveyors. Thus, the degree of occupancy can be controlled on each conveyor independently of an adjacent conveyor upstream or downstream and the plurality of conveyors in the conveying system can be started, stopped, or the speed can be increased or decreased in order to increase the area of occupancy for a particular conveyor. The conveyor system section 10 utilizes independent motor driven conveyor zones.")
Regarding Claim 13, Schroader teaches the method according to claim 11, as seen above. Schroader further teaches further comprising :second capturing the object image of the conveyance object in the assessment zone by the capturing device when the conveyor is stopped by the stopping; second determining based on the object image of the conveyance object stopped in the assessment zone captured in by the second capturing whether the conveyance state of the conveyance object satisfies the forwarding condition; and restarting the conveyer if the second determining determines that the conveyance state satisfies the forwarding condition.(Paragraph 0063: "The vision based bulk parcel flow management system 5 comprises or consists of a section 10 of a vision based conveyor system wherein a plurality of cameras 20 detect parcels upon the primary or main conveyor collector conveyor which incorporate at least one feed conveyor 11 and one receiving conveyor 13 used in conjunction with a singulator 8 , hold-and-release conveyor, accumulator, and/or strip conveyor typically downstream from the feed conveyor 11 which are shown in linear alignment with a singulator 8 . The conveyors utilize roller and/or belts and each unit is powered by at least one independent motor to convey, arrange, and separate parcels at selected rates activation or of speed based upon desired occupancy of one or more selected conveyors. Thus, the degree of occupancy can be controlled on each conveyor independently of an adjacent conveyor upstream or downstream and the plurality of conveyors in the conveying system can be started, stopped, or the speed can be increased or decreased in order to increase the area of occupancy for a particular conveyor. The conveyor system section 10 utilizes independent motor driven conveyor zones.")
Regarding Claim 14, Schroader teaches the method according to claim 11, as seen above. Schroader further teaches wherein the first capturing captures the object image as a first image when the conveyance object is within a first assessment zone which is a part of the assessment zone, the second capturing captures the object image as a second image when the conveyance object is within a second assessment zone which is another part of the assessment zone and is provided in a downstream direction with respect to the first- assessment zone, the first determining is carried out by determining, based on the first image captured in the first capturing , whether the conveyance state of the conveyance object in the first assessment zone satisfies the forwarding condition, the second determining is carried out by determining, based on the second image captured in the second capturing , whether the conveyance state of the conveyance object in the second assessment zone satisfies the forwarding condition, the conveyor-controlling stops the conveyor such that the conveyance object is positioned within the second assessment zone if the first determining determines that the conveyance state of the conveyance object in the first assessment zone does not satisfy the forwarding condition, and the restarting restarts the conveyer if the second determining determines based on the second image, when the conveyor is stopped by the stopping , that the conveyance state of the conveyance object in the second assessment zone satisfies the forwarding condition.(Paragraph 0086: "The video computer 500 utilizes a plurality of cameras to monitor the occupancy zones of selected areas on the conveyors leading up to singulator or separation process. The computer compares the amount of free space on the selected conveyors and compares it to the size of the package on the feed conveyor. If there is a adequate space, the feed conveyor will transfer the package. The amount of room required by a given package is determined by the programmer. For instance, the program may required that the amount of space on the collector conveyor is 1.5 or even 2 times the footprint of a given package depending on the orientation of the adjacent articles. Rate of speed changes of various conveyors are also controlled by the video computer to keep the singulator conveyor fully supplied. The video computer send speed control signals to the speed controllers of all the conveyor sections to regulate throughput of packages.")
Regarding Claim 15, Schroader teaches the method according to claim 14, as seen above. Schroader further teaches further comprising :providing a first image-capturing device, as a part of the capturing device, for capturing the first image, and providing a second image-capturing device, as another part of the capturing device, for capturing the second image, wherein the first assessment zone is defined on the conveyor provided in an upstream direction with respect to the first image-capturing device, and the second assessment zone is defined on the conveyor provided in the downstream direction with respect to the second image-capturing device.(Paragraph 0086: "The video computer 500 utilizes a plurality of cameras to monitor the occupancy zones of selected areas on the conveyors leading up to singulator or separation process. The computer compares the amount of free space on the selected conveyors and compares it to the size of the package on the feed conveyor. If there is a adequate space, the feed conveyor will transfer the package. The amount of room required by a given package is determined by the programmer. For instance, the program may required that the amount of space on the collector conveyor is 1.5 or even 2 times the footprint of a given package depending on the orientation of the adjacent articles. Rate of speed changes of various conveyors are also controlled by the video computer to keep the singulator conveyor fully supplied. The video computer send speed control signals to the speed controllers of all the conveyor sections to regulate throughput of packages.")
Regarding Claim 16, Schroader teaches the method according to claim 11, as seen above. Schroader further teaches further comprising :providing a learning model, which defines an assessment standard for the conveyance state, being utilized in the determination of whether the conveyance state of the conveyance object satisfies the forwarding condition.(Paragraph 0013: "In accordance with the present invention, there is provided a video/camera based conveyor package management system comprising, consisting of, or consisting essentially of a video compute and camera or other digital or pixel detecting and/or recording devices, at least one collector conveyor including separate sections of conveyor separately driven by individual motors with individual speed controllers, selected ones of the sections of the collector conveyor having means such as skewed rollers capable of urging a package to a selected side of the collector conveyor, a plurality of infeed or induction conveyors including separate sections of conveyor separately driven by individual motors with individual speed controllers, first video cameras monitoring areas of the collector conveyor leading up to merge areas of each of the infeed conveyors with the collector conveyor, second video cameras monitoring areas of the infeed conveyor leading up to merge areas of each of the infeed conveyors with the collector conveyor, and a algorithm control program within the video computer capable of controlling speeds and movement of the sections of the various conveyor and of the sections of the infeed conveyors based on a calculated amount of free space on a given collector section compared to a footprint of a package on an oncoming infeed conveyor, as calculated on a pixel by pixel basis. A singulator conveyor may be incorporated within the conveyor system and fed by the collector conveyor.", wherein implementation of learning models are obvious common features able to be initiated within a computer, and are known to a person skilled in the art.)
Regarding Claim 20, Schroader teaches the method according to claim 11, as seen above. Schroader further teaches further comprising: providing a main body; providing a pillar extending upwardly from the main body; and providing a head unit, which houses the capturing device, at a top end of the pillar.(Paragraph 0031: "It is an object of the present invention to provide a vision based flow management system that includes a camera and computer processor and interface to define and control and integrate with a conveyor control system via Ethernet, WIFI, bluetooth, and other smart electronic devices such as phones, tablets, laptop computers and other visual aid computer based devices capable of communicating with a computer system.", wherein a body, pillar and top end housing the capturing device are obviously known components of a camera)
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claims 7-9 and 17-19 are rejected under 35 U.S.C. 103 as being unpatentable over Schroader (United States Patent Application US2016221762A1) in view of Bunkers (United States Patent Application US 2014168374A1).
Regarding Claim 7, Schroader discloses the conveyor controlling apparatus according to claim 6, as seen above.
However, Schroader does not disclose further comprising: an overriding module for executing an overriding operation, which is an operation to forcibly restart the conveyor, even when the image-analyzing module determines based on the object image that the conveyance state of the conveyance object does not satisfy the forwarding condition, in response to an overriding command; and a training module for updating the learning model based on the overriding command and the object image of the conveyance object when the overriding operation is executed by the overriding module, wherein the overriding command must include an overriding reason for execution of the overriding operation.
Bunkers discloses a similar conveyor controlling apparatus further comprising: an overriding module for executing an overriding operation, which is an operation to forcibly restart the conveyor, even when the image-analyzing module determines based on the object image that the conveyance state of the conveyance object does not satisfy the forwarding condition, in response to an overriding command; and a training module for updating the learning model based on the overriding command and the object image of the conveyance object when the overriding operation is executed by the overriding module, wherein the overriding command must include an overriding reason for execution of the overriding operation.(Paragraph 0004: "The object of the present invention is to provide a conveying system as can advantageously be used in particular, but not exclusively, in a check-in system, wherein the number of false alerts to the presence of a living creature on a conveyor of the conveying system is reduced as much as possible. In order to achieve that object, the present invention provides a conveying system as described in the introductory paragraph, wherein the camera is a camera designed to make images of the infrared type, wherein the image processing means are designed to process images of the infrared type and the image processing means have at their disposal information regarding infrared images of non-suspect pieces of luggage exhibiting at least one area with an elevated temperature, wherein the image processing means are further designed to make a comparison between an infrared image made by the camera that exhibits at least one elevated temperature area and said information for deeming or not deeming the at least one object that is the subject of the infrared image made by the camera to be “suspect” on the basis of the comparison by the image processing means. The information regarding infrared images of non-suspect pieces of luggage may for example be available in the form of a digital library of infrared images exhibiting at least one elevated temperature area, possibly, for example, in combination with an algorithm by means of which the image processing means can determine to what extent infrared images made by the camera may maximally deviate from infrared images from the library so as not to be deemed to be “suspect”. Such information may also exclusively be available, for example, in the form of an algorithm. Within the context of the term “elevated temperature”, temperatures of, for example, at least 20, 22 or 24 degrees Celsius may be thought of, or in any case temperatures which are for example 2 or 4 degrees Celsius higher than the ambient temperature. Such temperatures are higher than the temperatures that pieces of luggage normally have. In addition to that, the fact that body parts that are covered, for example by clothing, will exhibit a lower temperature on an infrared image, for example a temperature of 30 degrees Celsius or 25 degrees Celsius, is taken into account. It is important that the infrared image comprises at least one area with a temperature higher than that of another area shown on the infrared image. After all, such an elevated temperature area might indicate the presence of a living creature. The present invention is based, inter alia, on the surprising perception that the presence of such elevated temperature areas may also be caused by “innocent” factors and on the fact that such conditions can also be established by image processing means. In those cases the invention provides the possibility that, in spite of the fact that an elevated temperature area shows up on an infrared image being viewed, the object that is the subject of the infrared image being viewed is not deemed to be “suspect”. The conveying process and, in the case that the invention is used in a check-in system, the check-in process can proceed without interruption without human interference being required. Conditions in which an infrared image does exhibit an elevated temperature area but in which there is no question of a suspect situation may occur, for example, in the case of a suitcase on wheels. The friction that occurs at the location of the wheels, in particular in the case of bad wheel bearings, may result in one or two elevated temperature areas showing up on the infrared image. The invention makes it possible for the image processing means to recognize such a situation because such elevated temperature areas will invariably occur in a corner of a piece of luggage, for example, and their size will be limited. Thus, false alarms can be prevented. Another example is a piece of luggage that has been sealed with a plastic foil at an airport. This service is frequently offered to passengers at airports. The foil is heated upon sealing, and elevated temperature areas form in particular at overlap areas and at seams. This type of situations, too, can be recognized as “non-suspect” by the image processing means, for example because the areas are elongate in shape and extend parallel to each other and also within the rectangular contours of a suitcase.", wherein the image processing means is override the false alerts when deemed "non-suspect").
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Schroader to include the overriding module as taught by Bunkers. The motivation for the modification would have been to allow for a conveying system with a check in system that can detect suspect scenarios on the belt and stop movement to prevent damage, while also reducing the amount of false alerts to incorrectly judged scenarios (Paragraph 0004).
Regarding Claim 8, Schroader discloses the conveyor controlling apparatus according to claim 1, as seen above.
However, Schroader does not disclose further comprising: an intrusion camera as the capturing device for capturing an intrusion image; and an intrusion-analyzing module for determining based on the intrusion image captured by the intrusion camera whether an intrusion state of the keep-out zone satisfies an intrusion condition, wherein the intrusion image is the environmental image with respect to a keep-out zone which is an area including at least the conveyer, the intrusion condition, which is the operational condition with respect to the keep-out zone, is a condition that any human is not detected in the keep-out zone, if the intrusion-analyzing module determines that the intrusion state does not satisfy the intrusion condition, then the conveyor-controlling module stops the conveyor.
Bunker discloses a similar conveyor controlling apparatus further comprising: an intrusion camera as the capturing device for capturing an intrusion image; and an intrusion-analyzing module for determining based on the intrusion image captured by the intrusion camera whether an intrusion state of the keep-out zone satisfies an intrusion condition, wherein the intrusion image is the environmental image with respect to a keep-out zone which is an area including at least the conveyer, the intrusion condition, which is the operational condition with respect to the keep-out zone, is a condition that any human is not detected in the keep-out zone, if the intrusion-analyzing module determines that the intrusion state does not satisfy the intrusion condition, then the conveyor-controlling module stops the conveyor.(Paragraph 0032: "In use, an infrared image is made of every object, as a rule being a piece of luggage, 3 , by the camera 31 at the checking location 24 . The infrared images that are made may exhibit one or more areas with an elevated temperature. In practice, such a temperature will be a temperature a temperature in excess of 22° C. or 24° C., for example. Depending in part on the ambient temperature, a piece of luggage will normally have a lower temperature. An elevated temperature area on an infrared image might indicate the presence of a human being or an animal or, in other words, a living creature. The possible presence of a living creature on the belt conveyor 21 would imply a security or safety risk, of course, and consequently a further check of the object, whether or not being a piece of luggage, is needed. Such a check may for example consist of the conveyor belt 21 being stopped and personnel checking the object at the checking location 24 . During that time, also the check-in process at the various check-in stations 10 may be disturbed because the supply of checked-in pieces of luggage from the supply belt conveyors 12 to the stationary belt conveyor 21 is not possible. Once personnel have determined that there is no question of suspect conditions, the belt conveyor 21 can be started again.")
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Schroader to include the intrusion camera as taught by Bunkers. The motivation for the modification would have been to allow for a conveying system with a check in system that can detect suspect scenarios on the belt and stop movement to prevent damage, while also reducing the amount of false alerts to incorrectly judged scenarios (Paragraph 0004).
Regarding Claim 9, Schroader in view of Bunkers discloses the conveyor controlling apparatus according to claim 1, as seen above. Bunkers further discloses wherein when the conveyor is stopped by the conveyor-controlling module because of the determination by the intrusion-analyzing module that the intrusion condition was not satisfied, if the intrusion-analyzing module determines based on the intrusion image that the intrusion state satisfies the intrusion condition, then the conveyor-controlling module restarts the conveyor.(Paragraph 0032: "In use, an infrared image is made of every object, as a rule being a piece of luggage, 3 , by the camera 31 at the checking location 24 . The infrared images that are made may exhibit one or more areas with an elevated temperature. In practice, such a temperature will be a temperature a temperature in excess of 22° C. or 24° C., for example. Depending in part on the ambient temperature, a piece of luggage will normally have a lower temperature. An elevated temperature area on an infrared image might indicate the presence of a human being or an animal or, in other words, a living creature. The possible presence of a living creature on the belt conveyor 21 would imply a security or safety risk, of course, and consequently a further check of the object, whether or not being a piece of luggage, is needed. Such a check may for example consist of the conveyor belt 21 being stopped and personnel checking the object at the checking location 24 . During that time, also the check-in process at the various check-in stations 10 may be disturbed because the supply of checked-in pieces of luggage from the supply belt conveyors 12 to the stationary belt conveyor 21 is not possible. Once personnel have determined that there is no question of suspect conditions, the belt conveyor 21 can be started again.")
Regarding Claim 17, Schroader discloses the method according to claim 16, as seen above.
However, Schroader does not disclose further comprising :executing an overriding operation, which is an operation forcibly restarts the conveyor, even when the second determining determines that the conveyance state of the conveyance object in the second assessment zone does not satisfy the forwarding condition, in response to an overriding command; and updating the learning model based on the overriding command and the object image when the overriding operation is executed by the executing , wherein the overriding command must include an overriding reason for execution of the overriding operation.
Bunkers discloses a similar method comprising further comprising :executing an overriding operation, which is an operation forcibly restarts the conveyor, even when the second determining determines that the conveyance state of the conveyance object in the second assessment zone does not satisfy the forwarding condition, in response to an overriding command; and updating the learning model based on the overriding command and the object image when the overriding operation is executed by the executing , wherein the overriding command must include an overriding reason for execution of the overriding operation.(Paragraph 0004: "The object of the present invention is to provide a conveying system as can advantageously be used in particular, but not exclusively, in a check-in system, wherein the number of false alerts to the presence of a living creature on a conveyor of the conveying system is reduced as much as possible. In order to achieve that object, the present invention provides a conveying system as described in the introductory paragraph, wherein the camera is a camera designed to make images of the infrared type, wherein the image processing means are designed to process images of the infrared type and the image processing means have at their disposal information regarding infrared images of non-suspect pieces of luggage exhibiting at least one area with an elevated temperature, wherein the image processing means are further designed to make a comparison between an infrared image made by the camera that exhibits at least one elevated temperature area and said information for deeming or not deeming the at least one object that is the subject of the infrared image made by the camera to be “suspect” on the basis of the comparison by the image processing means. The information regarding infrared images of non-suspect pieces of luggage may for example be available in the form of a digital library of infrared images exhibiting at least one elevated temperature area, possibly, for example, in combination with an algorithm by means of which the image processing means can determine to what extent infrared images made by the camera may maximally deviate from infrared images from the library so as not to be deemed to be “suspect”. Such information may also exclusively be available, for example, in the form of an algorithm. Within the context of the term “elevated temperature”, temperatures of, for example, at least 20, 22 or 24 degrees Celsius may be thought of, or in any case temperatures which are for example 2 or 4 degrees Celsius higher than the ambient temperature. Such temperatures are higher than the temperatures that pieces of luggage normally have. In addition to that, the fact that body parts that are covered, for example by clothing, will exhibit a lower temperature on an infrared image, for example a temperature of 30 degrees Celsius or 25 degrees Celsius, is taken into account. It is important that the infrared image comprises at least one area with a temperature higher than that of another area shown on the infrared image. After all, such an elevated temperature area might indicate the presence of a living creature. The present invention is based, inter alia, on the surprising perception that the presence of such elevated temperature areas may also be caused by “innocent” factors and on the fact that such conditions can also be established by image processing means. In those cases the invention provides the possibility that, in spite of the fact that an elevated temperature area shows up on an infrared image being viewed, the object that is the subject of the infrared image being viewed is not deemed to be “suspect”. The conveying process and, in the case that the invention is used in a check-in system, the check-in process can proceed without interruption without human interference being required. Conditions in which an infrared image does exhibit an elevated temperature area but in which there is no question of a suspect situation may occur, for example, in the case of a suitcase on wheels. The friction that occurs at the location of the wheels, in particular in the case of bad wheel bearings, may result in one or two elevated temperature areas showing up on the infrared image. The invention makes it possible for the image processing means to recognize such a situation because such elevated temperature areas will invariably occur in a corner of a piece of luggage, for example, and their size will be limited. Thus, false alarms can be prevented. Another example is a piece of luggage that has been sealed with a plastic foil at an airport. This service is frequently offered to passengers at airports. The foil is heated upon sealing, and elevated temperature areas form in particular at overlap areas and at seams. This type of situations, too, can be recognized as “non-suspect” by the image processing means, for example because the areas are elongate in shape and extend parallel to each other and also within the rectangular contours of a suitcase.", wherein the image processing means is override the false alerts when deemed "non-suspect")
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Schroader to include the overriding operation as taught by Bunkers. The motivation for the modification would have been to allow for a conveying system with a check in system that can detect suspect scenarios on the belt and stop movement to prevent damage, while also reducing the amount of false alerts to incorrectly judged scenarios (Paragraph 0004).
Regarding Claim 18, Schroader discloses the method according to claim 11, as seen above.
However, Schroader does not disclose further comprising :preparing an intrusion camera as the capturing device for capturing an intrusion image; intrusion-determining, based on the intrusion image captured by the intrusion camera, whether an intrusion state of the keep-out zone satisfies an intrusion condition; wherein the intrusion image is the environmental image with respect to a keep-out zone which is an area including at least the conveyer the intrusion condition, which is the operational condition with respect to the keep-out zone, is a condition that any human is not detected in the keep-out zone, and if the intrusion-determining determines that the intrusion state does not satisfy the intrusion condition, then the conveyor-controlling stops the conveyor.
Bunkers teaches a similar method comprising further comprising :preparing an intrusion camera as the capturing device for capturing an intrusion image; intrusion-determining, based on the intrusion image captured by the intrusion camera, whether an intrusion state of the keep-out zone satisfies an intrusion condition; wherein the intrusion image is the environmental image with respect to a keep-out zone which is an area including at least the conveyer the intrusion condition, which is the operational condition with respect to the keep-out zone, is a condition that any human is not detected in the keep-out zone, and if the intrusion-determining determines that the intrusion state does not satisfy the intrusion condition, then the conveyor-controlling stops the conveyor.(Paragraph 0032: "In use, an infrared image is made of every object, as a rule being a piece of luggage, 3 , by the camera 31 at the checking location 24 . The infrared images that are made may exhibit one or more areas with an elevated temperature. In practice, such a temperature will be a temperature a temperature in excess of 22° C. or 24° C., for example. Depending in part on the ambient temperature, a piece of luggage will normally have a lower temperature. An elevated temperature area on an infrared image might indicate the presence of a human being or an animal or, in other words, a living creature. The possible presence of a living creature on the belt conveyor 21 would imply a security or safety risk, of course, and consequently a further check of the object, whether or not being a piece of luggage, is needed. Such a check may for example consist of the conveyor belt 21 being stopped and personnel checking the object at the checking location 24 . During that time, also the check-in process at the various check-in stations 10 may be disturbed because the supply of checked-in pieces of luggage from the supply belt conveyors 12 to the stationary belt conveyor 21 is not possible. Once personnel have determined that there is no question of suspect conditions, the belt conveyor 21 can be started again.")
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to have modified Schroader to include the intrusion degerming as taught by Bunkers. The motivation for the modification would have been to allow for a conveying system with a check in system that can detect suspect scenarios on the belt and stop movement to prevent damage, while also reducing the amount of false alerts to incorrectly judged scenarios (Paragraph 0004).
Regarding Claim 19, Schroader in view of Bunkers discloses the method of claim 18, as seen above. Bunkers further discloses wherein when the conveyor is stopped by the conveyor-controlling because of the determination by the intrusion-determining that the intrusion condition was not satisfied, if the intrusion-determining determines based on the object image that the intrusion state satisfies the intrusion condition, then the controlling restarts the conveyor.(Paragraph 0032: "In use, an infrared image is made of every object, as a rule being a piece of luggage, 3 , by the camera 31 at the checking location 24 . The infrared images that are made may exhibit one or more areas with an elevated temperature. In practice, such a temperature will be a temperature a temperature in excess of 22° C. or 24° C., for example. Depending in part on the ambient temperature, a piece of luggage will normally have a lower temperature. An elevated temperature area on an infrared image might indicate the presence of a human being or an animal or, in other words, a living creature. The possible presence of a living creature on the belt conveyor 21 would imply a security or safety risk, of course, and consequently a further check of the object, whether or not being a piece of luggage, is needed. Such a check may for example consist of the conveyor belt 21 being stopped and personnel checking the object at the checking location 24 . During that time, also the check-in process at the various check-in stations 10 may be disturbed because the supply of checked-in pieces of luggage from the supply belt conveyors 12 to the stationary belt conveyor 21 is not possible. Once personnel have determined that there is no question of suspect conditions, the belt conveyor 21 can be started again.")
Conclusion
THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to ABBY ALLURA JORGENSEN whose telephone number is (571)270-7124. The examiner can normally be reached M-F 8-5:30.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Gene Crawford can be reached at (571) 272-6911. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/ABBY A JORGENSEN/Examiner, Art Unit 3651
Prosecution Insights