DETAILED ACTION
The Office Action is responsive to the communication filed on 4/26/2026.
Claims 1-8 are pending.
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
Response to Arguments
Applicant's arguments filed 4/26/2026 have been fully considered but they are not persuasive.
In response to applicant's argument that the references fail to show certain features of the invention, it is noted that the features upon which applicant relies (i.e., “adjusting the imaging environment involves controlling the machining machine itself, such as stopping coolant, stopping spindle rotation, moving the loader, moving the spindle to the front of the imaging device, and turning on the light inside the machine”) are not recited in the rejected claim(s). Although the claims are interpreted in light of the specification, limitations from the specification are not read into the claims. See In re Van Geuns, 988 F.2d 1181, 26 USPQ2d 1057 (Fed. Cir. 1993). If Applicant intends for “adjust the imaging environment into the control state indicated by the at least one environment setting item”, as recited in claim 1, to have a particular meaning, Examiner recommends amending the claims to state the same.
Regarding claims 1-8, the applicant argues that the cited references do not teach or suggest the claim limitations with respect to independent claim 1 below. Independent claim 8 is substantially similar to independent claim 1. Dependent claims 2-7 depend, directly or indirectly, from independent claim 1. The Examiner respectfully disagrees. The cited prior art describe the claim limitations as briefly outlined below and as described in the rejection of claims 1 and 8 below.
a memory storing at least one environment setting item defining an imaging environment in a machining machine; and
Applicant’s arguments are directed to Habibi not disclosing a memory storing an environment setting item. Examiner respectfully disagrees. Habibi describes logic stored in memory and the logic includes algorithms for predicting occlusions. If Applicant intends for environment setting item to have a particular meaning, Examiner recommends amending the claim to state the same.
(Habibi: see the logic 314 stored in the memory 304 as illustrated in figure 3 and as described in 0110, 0111; “In some embodiments, known occlusions may be communicated to the vision tracking system 100. Such occlusions may be predicted based upon information available to or known by the robot controller 116, or the occlusions may be learned from prior robotic operations.” Paragraph 0104; “Logic 314 may include one or more algorithms to predict the occurrence of an occlusion. For example, if one or more portions of the manipulators 410, 412 are detected as they come into the field of view 124, the algorithm may determine that an occlusion event will occur in the future, based upon knowledge of where the workpiece 104 currently is, and will be in the future, in the workspace geometry. As another example, the relative positions of the workpiece 104 and robotic device 114 or portions thereof may be learned, known or predefined over the period of time that the workpiece 104 is in the workspace geometry.” Paragraph 0110; “Logic 314 resides in or is implemented in the memory 304.” Paragraph 0070)
detect at least one type of trigger to adjust the imaging environment;
Applicant’s arguments are directed to Habibi not teaching or suggesting detecting a type of trigger to adjust the imaging environment. Examiner respectfully disagrees. Habibi describes a signal being communicated to the image system. If Applicant intends for type of trigger to have a particular meaning, Examiner recommends amending the claims to state the same.
(Habibi: “The process starts at block 902, which corresponds to either of the ending blocks of FIG. 7 (block 716) or FIG. 8 (block 816). Accordingly, the robot controller 116 has received the processor signal 118 from transducer 114 based upon the emulated output signal 110 communicated from the vision tracking system 100 (FIG. 1), or the robot controller 116 has received an emulated processor signal 202 directly communicated from the vision tracking system 100 (FIG. 2).” Paragraph 0152; “At block 904, a signal is communicated from the robot controller 116 to the image capture device positioning system 122.” Paragraph 0153)
in response to detecting the at least one type of trigger to adjust the imaging environment and the determination result indicating to adjust the imaging environment, adjust the imaging environment into the control state indicated by the at least one environment setting item.
Applicant’s arguments are directed to Habibi not teaching or suggesting adjusting the imagine environment in response to the trigger and determination result. Examiner respectfully disagrees. Habibi describes moving the image capture device based on the signal from the vision tracking system 100 (i.e., trigger) and the occlusion detection (i.e., determination result). If Applicant intends for adjust the imaging environment, trigger, and determination result to have a particular meaning then Examiner recommends amending the claims to state the same.
(Habibi: see the vision tracking system 100 including the movement of the image capture device 120 based on the signal from the vision tracking system 100 (i.e., trigger) and the occlusion detection (i.e., determination result) as illustrated in figures 5A, 5B, 9 and as described in paragraphs 0152, 0153; “At block 908, in response to occlusion events, position of the image capture device 120 is further adjusted to avoid or mitigate the effect of occlusion events.” Paragraph 0153)
Accordingly, applicant’s arguments are not persuasive since the cited prior art describe the limitations in these claims.
For at least these reasons, the rejection of the claims is maintained.
Claim Rejections - 35 USC § 102
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention.
(a)(2) the claimed invention was described in a patent issued under section 151, or in an application for patent published or deemed published under section 122(b), in which the patent or application, as the case may be, names another inventor and was effectively filed before the effective filing date of the claimed invention.
Claims 1-8 are rejected under 35 U.S.C. 102(a)(1) as being unpatentable by
U.S. Patent Application Publication No. 2007/0073439 (Habibi) (cited by Applicant).
Claim 1:
The cited prior art describes an imaging environment adjustment device comprising: (Habibi: “This disclosure generally relates to machine vision, and more particularly, to visual tracking systems using image capture devices.” Paragraph 0003; “In a further embodiment, the vision tracking system advantageously addresses the problems of occlusion and/or focus by controlling the position and/or orientation of one or more cameras independently of the robotic device.” Paragraph 0031; see the processor 302 and memory 304 as illustrated in figure 3)
a memory storing at least one environment setting item defining an imaging environment in a machining machine; and (Habibi: see the logic 314 stored in the memory 304 as illustrated in figure 3 and as described in 0110, 0111; “In some embodiments, known occlusions may be communicated to the vision tracking system 100. Such occlusions may be predicted based upon information available to or known by the robot controller 116, or the occlusions may be learned from prior robotic operations.” Paragraph 0104; “Logic 314 may include one or more algorithms to predict the occurrence of an occlusion. For example, if one or more portions of the manipulators 410, 412 are detected as they come into the field of view 124, the algorithm may determine that an occlusion event will occur in the future, based upon knowledge of where the workpiece 104 currently is, and will be in the future, in the workspace geometry. As another example, the relative positions of the workpiece 104 and robotic device 114 or portions thereof may be learned, known or predefined over the period of time that the workpiece 104 is in the workspace geometry.” Paragraph 0110; “Logic 314 resides in or is implemented in the memory 304.” Paragraph 0070)
a processor configured to:
detect at least one type of trigger to adjust the imaging environment; (Habibi: “The process starts at block 902, which corresponds to either of the ending blocks of FIG. 7 (block 716) or FIG. 8 (block 816). Accordingly, the robot controller 116 has received the processor signal 118 from transducer 114 based upon the emulated output signal 110 communicated from the vision tracking system 100 (FIG. 1), or the robot controller 116 has received an emulated processor signal 202 directly communicated from the vision tracking system 100 (FIG. 2).” Paragraph 0152; “At block 904, a signal is communicated from the robot controller 116 to the image capture device positioning system 122.” Paragraph 0153)
acquire a determination result as to whether or not to adjust the imaging environment into a control state indicated by the at least one environment setting item; and (Habibi: see the occlusion detection as described in paragraphs 0099, 0100, 0103, 0104; “Upon detection of the occlusion (determination of an occlusion in the occlusion region 502), the vision tracking system 100 adjusts movement of the image capture device 120 to eliminate or minimize the occlusion. For example, in response to the vision tracking system 100 detecting an occlusion event, the image capture device 120 may be moved backward, stopped or decelerated to avoid or mitigate the effect of the occlusion.” Paragraph 0099; “Detection of occlusion events are determined upon analysis of captured image data.” Paragraph 0103; “In some embodiments, known occlusions may be communicated to the vision tracking system 100. Such occlusions may be predicted based upon information available to or known by the robot controller 116, or the occlusions may be learned from prior robotic operations.” Paragraph 0104; “At block 908, in response to occlusion events, position of the image capture device 120 is further adjusted to avoid or mitigate the effect of occlusion events.” Paragraph 0153)
in response to detecting the at least one type of trigger to adjust the imaging environment and the determination result indicating to adjust the imaging environment, adjust the imaging environment into the control state indicated by the at least one environment setting item. (Habibi: see the vision tracking system 100 including the movement of the image capture device 120 based on the signal from the vision tracking system 100 (i.e., trigger) and the occlusion detection (i.e., determination result) as illustrated in figures 5A, 5B, 9 and as described in paragraphs 0152, 0153; “At block 908, in response to occlusion events, position of the image capture device 120 is further adjusted to avoid or mitigate the effect of occlusion events.” Paragraph 0153)
Claim 2:
The cited prior art describes the imaging environment adjustment device according to claim 1 further comprising wheren the processor is configured determine whether or not to adjust the imaging environment into the control state indicated by the at least one environment setting item. (Habibi: see the occlusion detection as described in paragraphs 0099, 0100, 0103, 0104; “Upon detection of the occlusion (determination of an occlusion in the occlusion region 502), the vision tracking system 100 adjusts movement of the image capture device 120 to eliminate or minimize the occlusion. For example, in response to the vision tracking system 100 detecting an occlusion event, the image capture device 120 may be moved backward, stopped or decelerated to avoid or mitigate the effect of the occlusion.” Paragraph 0099; “Detection of occlusion events are determined upon analysis of captured image data.” Paragraph 0103; “In some embodiments, known occlusions may be communicated to the vision tracking system 100. Such occlusions may be predicted based upon information available to or known by the robot controller 116, or the occlusions may be learned from prior robotic operations.” Paragraph 0104; “Logic 314 (FIG. 3) includes one or more algorithms that then identify the above-described occurrence of occlusion events.” Paragraph 0109)
Claim 3:
The cited prior art describes the imaging environment adjustment device according to claim 1 wherein the processor is configured to accept input of the determination result indicating whether or not to adjust the imaging environment into the control state indicated by the at least one environment setting item. (Habibi: see the occlusion detection as described in paragraphs 0099, 0100, 0103, 0104; “Upon detection of the occlusion (determination of an occlusion in the occlusion region 502), the vision tracking system 100 adjusts movement of the image capture device 120 to eliminate or minimize the occlusion. For example, in response to the vision tracking system 100 detecting an occlusion event, the image capture device 120 may be moved backward, stopped or decelerated to avoid or mitigate the effect of the occlusion.” Paragraph 0099; “Detection of occlusion events are determined upon analysis of captured image data.” Paragraph 0103; “In some embodiments, known occlusions may be communicated to the vision tracking system 100. Such occlusions may be predicted based upon information available to or known by the robot controller 116, or the occlusions may be learned from prior robotic operations.” Paragraph 0104)
Claim 4:
The cited prior art describes the imaging environment adjustment device according to claim 1,
wherein the at least one type of trigger includes multiple types of triggers, and (Habibi: see the emulated output signal 110 and the emulated processor signal 202 as described in paragraph 0152; “The process starts at block 902, which corresponds to either of the ending blocks of FIG. 7 (block 716) or FIG. 8 (block 816). Accordingly, the robot controller 116 has received the processor signal 118 from transducer 114 based upon the emulated output signal 110 communicated from the vision tracking system 100 (FIG. 1), or the robot controller 116 has received an emulated processor signal 202 directly communicated from the vision tracking system 100 (FIG. 2).” Paragraph 0152)
wherein the smemory stores the at least one environment setting item in association with each of the multiple types of triggers. (Habibi: see the logic 314 stored in the memory 304 for processing the emulated output signal 110 and the emulated processor signal 202 as illustrated in figure 3 and as described in 0110, 0111; “In some embodiments, known occlusions may be communicated to the vision tracking system 100. Such occlusions may be predicted based upon information available to or known by the robot controller 116, or the occlusions may be learned from prior robotic operations.” Paragraph 0104; “As noted above, some embodiments of logic 314 contain conversion information such that the determined position, velocity and/or acceleration information can be converted into information corresponding to the above described output signal of a shaft encoder or the signal of another electro-mechanical movement detection device.” Paragraph 0076; “Logic 314 may include one or more algorithms to predict the occurrence of an occlusion. For example, if one or more portions of the manipulators 410, 412 are detected as they come into the field of view 124, the algorithm may determine that an occlusion event will occur in the future, based upon knowledge of where the workpiece 104 currently is, and will be in the future, in the workspace geometry. As another example, the relative positions of the workpiece 104 and robotic device 114 or portions thereof may be learned, known or predefined over the period of time that the workpiece 104 is in the workspace geometry.” Paragraph 0110; “Logic 314 resides in or is implemented in the memory 304.” Paragraph 0070)
Claim 5:
The cited prior art describes the imaging environment adjustment device according to claim 1 wherein the processor is configured to
acquire operation information indicating an operation state of the machining machine stored in association with the at least one environment setting item applied when detecting the at least one type of trigger, and (Habibi: see the belt 112 (i.e., table) as illustrated in figure 1; “Alternatively, the vision tracking system 100 may be configured to track movement of the belt 112 or another component whose movement is relatable to the speed of the belt 112 and/or workpiece 104 using machine-vision techniques, and to determine an emulated encoder output signal 110.” Paragraph 0054; “FIG. 7 is a flowchart illustrating an embodiment of a process for emulating the output of an electromechanical movement detection system such as a shaft encoder. The process begins at block 702. At block 704, a plurality of images of a feature 108 (FIG. 1) corresponding to a workpiece 104 are captured by the vision tracking system 100.” Paragraph 0140)
acquire the determination result determined based on the operation information. (Habibi: “FIG. 7 is a flowchart illustrating an embodiment of a process for emulating the output of an electromechanical movement detection system such as a shaft encoder. The process begins at block 702. At block 704, a plurality of images of a feature 108 (FIG. 1) corresponding to a workpiece 104 are captured by the vision tracking system 100.” Paragraph 0140)
Claim 6:
The cited prior art describes the imaging environment adjustment device according to claim 5,
wherein the operation information includes position information indicating a position of at least any one of a tool spindle, a table, a robot, or a loader, and (Habibi: see the belt 112 (i.e., table) as illustrated in figure 1; “Alternatively, the vision tracking system 100 may be configured to track movement of the belt 112 or another component whose movement is relatable to the speed of the belt 112 and/or workpiece 104 using machine-vision techniques, and to determine an emulated encoder output signal 110.” Paragraph 0054)
wherein the processor is configured to move at least any one of the tool spindle, the table, the robot, or the loader to a retracted position based on the position information. (Habibi: see the movement of the image capture device 120 (i.e., robot) based on the signal from the vision tracking system 100 (i.e., trigger) and the occlusion detection (i.e., determination result) as illustrated in figures 5A, 5B, 9 and as described in paragraphs 0152, 0153; “At block 908, in response to occlusion events, position of the image capture device 120 is further adjusted to avoid or mitigate the effect of occlusion events.” Paragraph 0153)
Claim 7:
The cited prior art describes the imaging environment adjustment device according to claim 1 wherein the processor is configured to acquire an image in the imaging environment adjusted into the control state indicated by the at least one environment setting item. (Habibi: “The vision tracking system 100 comprises an image capture device 120 (also referred to herein as a camera).” Paragraph 0056)
Claim 8:
The cited prior art describes a non-transitory computer readable storage medium storing an instruction for causing, when executed by a computer, the computer to perform: (Habibi: “This disclosure generally relates to machine vision, and more particularly, to visual tracking systems using image capture devices.” Paragraph 0003; “In a further embodiment, the vision tracking system advantageously addresses the problems of occlusion and/or focus by controlling the position and/or orientation of one or more cameras independently of the robotic device.” Paragraph 0031; see the processor 302 and memory 304 as illustrated in figure 3)
detecting at least one type of trigger to adjust an imaging environment, (Habibi: “The process starts at block 902, which corresponds to either of the ending blocks of FIG. 7 (block 716) or FIG. 8 (block 816). Accordingly, the robot controller 116 has received the processor signal 118 from transducer 114 based upon the emulated output signal 110 communicated from the vision tracking system 100 (FIG. 1), or the robot controller 116 has received an emulated processor signal 202 directly communicated from the vision tracking system 100 (FIG. 2).” Paragraph 0152; “At block 904, a signal is communicated from the robot controller 116 to the image capture device positioning system 122.” Paragraph 0153)
acquiring a determination result as to whether or not to adjust the imaging environment into a control state indicated by at least one environment setting item defining the imaging environment in a machining machine; and (Habibi: see the occlusion detection as described in paragraphs 0099, 0100, 0103, 0104; “Upon detection of the occlusion (determination of an occlusion in the occlusion region 502), the vision tracking system 100 adjusts movement of the image capture device 120 to eliminate or minimize the occlusion. For example, in response to the vision tracking system 100 detecting an occlusion event, the image capture device 120 may be moved backward, stopped or decelerated to avoid or mitigate the effect of the occlusion.” Paragraph 0099; “Detection of occlusion events are determined upon analysis of captured image data.” Paragraph 0103; “At block 908, in response to occlusion events, position of the image capture device 120 is further adjusted to avoid or mitigate the effect of occlusion events.” Paragraph 0153)
in response to the at least one type of trigger being detected to adjust the imaging environment and the acquired determination result indicateing to adjust the imaging environment, adjusting the imaging environment into the control state indicated by the at least one environment setting item. (Habibi: see the movement of the vision tracking system 100 including the image capture device 120 based on the signal from the vision tracking system 100 (i.e., trigger) and the occlusion detection (i.e., determination result) as illustrated in figures 1, 5A, 5B, 9 and as described in paragraphs 0152, 0153; “At block 908, in response to occlusion events, position of the image capture device 120 is further adjusted to avoid or mitigate the effect of occlusion events.” Paragraph 0153)
Conclusion
Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure.
U.S. Patent Application Publication No. 2021/0255599 describes a machine tool operation monitoring system.
U.S. Patent Application Publication No. 2016/0085232 describes a numerical control device to calculate an approach path.
U.S. Patent No. 11,636,382 describes a robotic self programming visual inspection.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to CHRISTOPHER E EVERETT whose telephone number is (571)272-2851. The examiner can normally be reached Monday-Friday 8:00 am to 5:00 pm (Pacific).
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Robert Fennema can be reached at 571-272-2748. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/Christopher E. Everett/Primary Examiner, Art Unit 2117
Prosecution Insights