DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Response to Arguments
Applicant’s arguments with respect to claim(s) 1-21 have been considered but are moot because the new ground of rejection does not rely on any reference applied in the prior rejection of record for any teaching or matter specifically challenged in the argument.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claims 1-4, 9-16, and 18-21 are rejected under 35 U.S.C. 103 as being unpatentable over Li et al (CN111134727B; hereinafter referred to as Srinivasan) in view of Qi et al (S. Qi, J. Li, and Z. Sun, “Adaptive confidence threshold algorithm for vehicle detection by employing temporal information,” 2018 10th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), pp. 348–352, Aug. 2018; hereinafter referred to as Qi).
Regarding Claim 1, Li discloses an image processing apparatus (“The invention relates to the technical field of medical ultrasound, in particular to a vein and artery identification method and system based on a neural network.” [n0001]) comprising:
a processor configured to analyze each of a plurality of ultrasound images of a subject to detect a structure in each of the plurality of ultrasound images and calculate a certainty that the structure is a blood vessel for each of the plurality of ultrasound images (“ randomly selecting 3/5 of the images in all the collected ultrasound images as a training set; randomly selecting 1/5 of images as a verification set; the remaining 1/5 of the ultrasound images are used as a test set; the training set is used for training the neural network model, the verification set is used for verifying the recognition accuracy of the neural network and optimizing weight parameters of the neural network model, and the test set is used for finally evaluating the recognition accuracy of the neural network model; of course, the randomly selected proportion can be 3/5, 1/5, or other proportions;” [n0091], “inputting an ultrasonic image to be recognized into a neural network model obtained through training for processing; acquiring position information of veins and arteries from an ultrasonic image to be identified through the neural network model; the marked veins and arteries are distinguished according to the acquired position information, and an ultrasound image containing the vein marks and the artery marks is generated.” [n0085],
the certainty being an index representing a likelihood that the structure is the blood vessel, the certainty being represented by a probability that the structure is the blood vessel (“ the information of the bounding box comprises probability information that the image in the bounding box is an artery or a vein, and position information and size information of the bounding box.” [n0051] “information of each boundary frame needs to be represented by 2 + 4 + 1 = 7 number, wherein 2 numbers respectively represent the image in the boundary frame is artery, probability information of vein, two probability information are respectively recorded as c1, c2; 4 numbers represent the coordinate information of the central position of the boundary frame, namely abscissa, ordinate and length, width information; 1 number records the size of the possibility of the artery or vein contained in the boundary frame; at last setting softmax classification layer of the neural network model, limiting 2 probability information to 0 to 1, and when the boundary frame contains artery or vein, 2 probability information c1, c2 sum is 1;” [n0110]),
detect, as the blood vessel, the structure having the certainty higher than a certainty threshold value (“Further, screening boundary frame refers to selecting the prediction probability is greater than the set threshold of the boundary frame as the prediction result; in the boundary frame with prediction probability greater than the set threshold, using maximum suppression method for further screening, the specific method is calculating the overlapping degree between the boundary frame, the overlapping degree index is greater than the boundary frame of the set threshold value, selecting the boundary frame with the highest prediction probability as the identification result” [n0141]),
Li does not specifically disclose changing the certainty threshold value based on a plurality of the calculated certainties that the structure in the plurality of images is the desired structure.
However, in a similar field of endeavor, Qi teaches an adaptive confidence algorithm for vehicle detection using convolutional neural networks is proposed [Abstract].
Qi also teaches changing the certainty threshold value based on a plurality of the calculated certainties that the structure in the plurality of images is the desired structure (“There exists two problems in vehicle detection– false alarms and false negatives. When a false alarm appears in the current frame, it must be that its confidence is larger than fixed confidence thresh we set in advance. In this situation, we should increase confidence thresh to ensure it can not be selected as a vehicle. When a vehicle does not appear in the current frame, it must be that its confidence is smaller than fixed confidence thresh. Now, we should decrease confidence thresh to ensure it can be selected as a vehicle. To solve this problem, we introduce parameter K to learn an optimal confidence. This is achieved with the following equation. N ST =FT− i=1 (Ci −FT)e−Ki (1) where ST ∈ (0,1) is the dynamic confidence that we deter mine, i is the order of the pictures before current frame, N is the number of vehicles that are regarded as relevant to current vehicle, FT is fixed confidence thresh in the MS CNN algorithm, and Ci is the confidence of the front frame, if it does not exist corresponding ROI, Ci is zero.” [Pg. 349 Col. 2 Lines 3-20]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li as outlined above with changing the certainty threshold value based on a plurality of the calculated certainties that the structure in the plurality of images is the desired structure as taught by Qi, because It can effectively reduce the false alarm rate and increase the true positive rate [Pg. 348 Col. 2 Lines 23-25].
Regarding Claim 2, Li discloses that the apparatus further comprising: an ultrasound probe; and wherein the processor is further configured to generate the plurality of ultrasound images based on transmission and reception of an ultrasound beam using the ultrasound probe (“Fig. 1-a shows a neural network based real-time ultrasonic guidance system for jugular vein puncture, which comprises: the transducer is used for transmitting and receiving ultrasonic signals; ” [n0074]).
Regarding Claim 3, Li discloses that further comprising: a certainty memory, wherein the processor is further configured to store the certainty in the certainty memory (“The module can be configured to reside in addressable storage media and to execute on one or more processors. Modules can include components (such as software components, object-oriented software components, class components, and task components), processes, functions, properties, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables” [n0070]).
Regarding Claim 4, Li discloses that the processor is further configured to control storage of the certainty in the certainty memory (“The module can be configured to reside in addressable storage media and to execute on one or more processors. Modules can include components (such as software components, object-oriented software components, class components, and task components), processes, functions, properties, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables” [n0070]).
Regarding Claim 9, Li discloses all limitations noted above except that the processor is further configured to calculate a change value by multiplying a maximum value of the plurality of certainties calculated for the plurality of ultrasound images by a determined ratio, and changes the certainty threshold value to the change value.
However, in a similar field of endeavor, Qi teaches the processor is further configured to calculate a change value by multiplying a maximum value of the plurality of certainties calculated for the plurality of ultrasound images by a determined ratio, and changes the certainty threshold value to the change value (“There exists two problems in vehicle detection– false alarms and false negatives. When a false alarm appears in the current frame, it must be that its confidence is larger than fixed confidence thresh we set in advance. In this situation, we should increase confidence thresh to ensure it can not be selected as a vehicle. When a vehicle does not appear in the current frame, it must be that its confidence is smaller than fixed confidence thresh. Now, we should decrease confidence thresh to ensure it can be selected as a vehicle. To solve this problem, we introduce parameter K to learn an optimal confidence. This is achieved with the following equation. N ST =FT− i=1 (Ci −FT)e−Ki (1) where ST ∈ (0,1) is the dynamic confidence that we deter mine, i is the order of the pictures before current frame, N is the number of vehicles that are regarded as relevant to current vehicle, FT is fixed confidence thresh in the MS CNN algorithm, and Ci is the confidence of the front frame, if it does not exist corresponding ROI, Ci is zero.” [Pg. 349 Col. 2 Lines 3-20]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li as outlined above with the processor is further configured to calculate a change value by multiplying a maximum value of the plurality of certainties calculated for the plurality of ultrasound images by a determined ratio, and changes the certainty threshold value to the change value as taught by Qi, because It can effectively reduce the false alarm rate and increase the true positive rate [Pg. 348 Col. 2 Lines 23-25].
Regarding Claim 10, Li discloses all limitations noted above except that the processor is further configured to calculate a change value by multiplying a maximum value of the plurality of certainties calculated for the plurality of ultrasound images by a determined ratio, and changes the certainty threshold value to the change value.
However, in a similar field of endeavor, Qi teaches the processor is further configured to calculate a change value by multiplying a maximum value of the plurality of certainties calculated for the plurality of ultrasound images by a determined ratio, and changes the certainty threshold value to the change value (“There exists two problems in vehicle detection– false alarms and false negatives. When a false alarm appears in the current frame, it must be that its confidence is larger than fixed confidence thresh we set in advance. In this situation, we should increase confidence thresh to ensure it can not be selected as a vehicle. When a vehicle does not appear in the current frame, it must be that its confidence is smaller than fixed confidence thresh. Now, we should decrease confidence thresh to ensure it can be selected as a vehicle. To solve this problem, we introduce parameter K to learn an optimal confidence. This is achieved with the following equation. N ST =FT− i=1 (Ci −FT)e−Ki (1) where ST ∈ (0,1) is the dynamic confidence that we deter mine, i is the order of the pictures before current frame, N is the number of vehicles that are regarded as relevant to current vehicle, FT is fixed confidence thresh in the MS CNN algorithm, and Ci is the confidence of the front frame, if it does not exist corresponding ROI, Ci is zero.” [Pg. 349 Col. 2 Lines 3-20]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li as outlined above with the processor is further configured to calculate a change value by multiplying a maximum value of the plurality of certainties calculated for the plurality of ultrasound images by a determined ratio, and changes the certainty threshold value to the change value as taught by Qi, because It can effectively reduce the false alarm rate and increase the true positive rate [Pg. 348 Col. 2 Lines 23-25].
Regarding Claim 11, Li discloses all limitations noted above except that the processor is further configured to calculate a change value by multiplying a maximum value of the plurality of certainties calculated for the plurality of ultrasound images by a determined ratio, and changes the certainty threshold value to the change value.
However, in a similar field of endeavor, Qi teaches the processor is further configured to calculate a change value by multiplying a maximum value of the plurality of certainties calculated for the plurality of ultrasound images by a determined ratio, and changes the certainty threshold value to the change value (“There exists two problems in vehicle detection– false alarms and false negatives. When a false alarm appears in the current frame, it must be that its confidence is larger than fixed confidence thresh we set in advance. In this situation, we should increase confidence thresh to ensure it can not be selected as a vehicle. When a vehicle does not appear in the current frame, it must be that its confidence is smaller than fixed confidence thresh. Now, we should decrease confidence thresh to ensure it can be selected as a vehicle. To solve this problem, we introduce parameter K to learn an optimal confidence. This is achieved with the following equation. N ST =FT− i=1 (Ci −FT)e−Ki (1) where ST ∈ (0,1) is the dynamic confidence that we deter mine, i is the order of the pictures before current frame, N is the number of vehicles that are regarded as relevant to current vehicle, FT is fixed confidence thresh in the MS CNN algorithm, and Ci is the confidence of the front frame, if it does not exist corresponding ROI, Ci is zero.” [Pg. 349 Col. 2 Lines 3-20]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li as outlined above with the processor is further configured to calculate a change value by multiplying a maximum value of the plurality of certainties calculated for the plurality of ultrasound images by a determined ratio, and changes the certainty threshold value to the change value as taught by Qi, because It can effectively reduce the false alarm rate and increase the true positive rate [Pg. 348 Col. 2 Lines 23-25].
Regarding Claim 12, Li discloses all limitations noted above except that the processor is further configured to calculate a change value by statistically analyzing the plurality of certainties calculated for the plurality of ultrasound images, and changes the certainty threshold value to the change value.
However, in a similar field of endeavor, Qi teaches the processor is further configured to calculate a change value by statistically analyzing the plurality of certainties calculated for the plurality of ultrasound images, and changes the certainty threshold value to the change value (“There exists two problems in vehicle detection– false alarms and false negatives. When a false alarm appears in the current frame, it must be that its confidence is larger than fixed confidence thresh we set in advance. In this situation, we should increase confidence thresh to ensure it can not be selected as a vehicle. When a vehicle does not appear in the current frame, it must be that its confidence is smaller than fixed confidence thresh. Now, we should decrease confidence thresh to ensure it can be selected as a vehicle. To solve this problem, we introduce parameter K to learn an optimal confidence. This is achieved with the following equation. N ST =FT− i=1 (Ci −FT)e−Ki (1) where ST ∈ (0,1) is the dynamic confidence that we deter mine, i is the order of the pictures before current frame, N is the number of vehicles that are regarded as relevant to current vehicle, FT is fixed confidence thresh in the MS CNN algorithm, and Ci is the confidence of the front frame, if it does not exist corresponding ROI, Ci is zero.” [Pg. 349 Col. 2 Lines 3-20]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li as outlined above with the processor is further configured to calculate a change value by statistically analyzing the plurality of certainties calculated for the plurality of ultrasound images, and changes the certainty threshold value to the change value as taught by Qi, because It can effectively reduce the false alarm rate and increase the true positive rate [Pg. 348 Col. 2 Lines 23-25].
Regarding Claim 13, Li discloses all limitations noted above except that the processor is further configured to calculate a change value by statistically analyzing the plurality of certainties calculated for the plurality of ultrasound images, and changes the certainty threshold value to the change value.
However, in a similar field of endeavor, Qi teaches the processor is further configured to calculate a change value by statistically analyzing the plurality of certainties calculated for the plurality of ultrasound images, and changes the certainty threshold value to the change value (“There exists two problems in vehicle detection– false alarms and false negatives. When a false alarm appears in the current frame, it must be that its confidence is larger than fixed confidence thresh we set in advance. In this situation, we should increase confidence thresh to ensure it can not be selected as a vehicle. When a vehicle does not appear in the current frame, it must be that its confidence is smaller than fixed confidence thresh. Now, we should decrease confidence thresh to ensure it can be selected as a vehicle. To solve this problem, we introduce parameter K to learn an optimal confidence. This is achieved with the following equation. N ST =FT− i=1 (Ci −FT)e−Ki (1) where ST ∈ (0,1) is the dynamic confidence that we deter mine, i is the order of the pictures before current frame, N is the number of vehicles that are regarded as relevant to current vehicle, FT is fixed confidence thresh in the MS CNN algorithm, and Ci is the confidence of the front frame, if it does not exist corresponding ROI, Ci is zero.” [Pg. 349 Col. 2 Lines 3-20]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li as outlined above with the processor is further configured to calculate a change value by statistically analyzing the plurality of certainties calculated for the plurality of ultrasound images, and changes the certainty threshold value to the change value as taught by Qi, because It can effectively reduce the false alarm rate and increase the true positive rate [Pg. 348 Col. 2 Lines 23-25].
Regarding Claim 14, Li discloses all limitations noted above except that the processor is further configured to calculate a change value by statistically analyzing the plurality of certainties calculated for the plurality of ultrasound images, and changes the certainty threshold value to the change value.
However, in a similar field of endeavor, Qi teaches the processor is further configured to calculate a change value by statistically analyzing the plurality of certainties calculated for the plurality of ultrasound images, and changes the certainty threshold value to the change value (“There exists two problems in vehicle detection– false alarms and false negatives. When a false alarm appears in the current frame, it must be that its confidence is larger than fixed confidence thresh we set in advance. In this situation, we should increase confidence thresh to ensure it can not be selected as a vehicle. When a vehicle does not appear in the current frame, it must be that its confidence is smaller than fixed confidence thresh. Now, we should decrease confidence thresh to ensure it can be selected as a vehicle. To solve this problem, we introduce parameter K to learn an optimal confidence. This is achieved with the following equation. N ST =FT− i=1 (Ci −FT)e−Ki (1) where ST ∈ (0,1) is the dynamic confidence that we deter mine, i is the order of the pictures before current frame, N is the number of vehicles that are regarded as relevant to current vehicle, FT is fixed confidence thresh in the MS CNN algorithm, and Ci is the confidence of the front frame, if it does not exist corresponding ROI, Ci is zero.” [Pg. 349 Col. 2 Lines 3-20]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li as outlined above with the processor is further configured to calculate a change value by statistically analyzing the plurality of certainties calculated for the plurality of ultrasound images, and changes the certainty threshold value to the change value as taught by Qi, because It can effectively reduce the false alarm rate and increase the true positive rate [Pg. 348 Col. 2 Lines 23-25].
Regarding Claim 15, Li discloses all limitations noted above except that the processor is further configured to change the certainty threshold value to the change value in a case in which the change value is lower than the certainty threshold value.
However, in a similar field of endeavor, Qi teaches the processor is further configured to change the certainty threshold value to the change value in a case in which the change value is lower than the certainty threshold value (“There exists two problems in vehicle detection– false alarms and false negatives. When a false alarm appears in the current frame, it must be that its confidence is larger than fixed confidence thresh we set in advance. In this situation, we should increase confidence thresh to ensure it can not be selected as a vehicle. When a vehicle does not appear in the current frame, it must be that its confidence is smaller than fixed confidence thresh. Now, we should decrease confidence thresh to ensure it can be selected as a vehicle. To solve this problem, we introduce parameter K to learn an optimal confidence. This is achieved with the following equation. N ST =FT− i=1 (Ci −FT)e−Ki (1) where ST ∈ (0,1) is the dynamic confidence that we deter mine, i is the order of the pictures before current frame, N is the number of vehicles that are regarded as relevant to current vehicle, FT is fixed confidence thresh in the MS CNN algorithm, and Ci is the confidence of the front frame, if it does not exist corresponding ROI, Ci is zero.” [Pg. 349 Col. 2 Lines 3-20]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li as outlined above with the processor is further configured to change the certainty threshold value to the change value in a case in which the change value is lower than the certainty threshold value as taught by Qi, because It can effectively reduce the false alarm rate and increase the true positive rate [Pg. 348 Col. 2 Lines 23-25].
Regarding Claim 16, Li discloses all limitations noted above except that the processor is further configured to change the certainty threshold value to the change value in a case in which the change value is lower than the certainty threshold value.
However, in a similar field of endeavor, Qi teaches the processor is further configured to change the certainty threshold value to the change value in a case in which the change value is lower than the certainty threshold value (“There exists two problems in vehicle detection– false alarms and false negatives. When a false alarm appears in the current frame, it must be that its confidence is larger than fixed confidence thresh we set in advance. In this situation, we should increase confidence thresh to ensure it can not be selected as a vehicle. When a vehicle does not appear in the current frame, it must be that its confidence is smaller than fixed confidence thresh. Now, we should decrease confidence thresh to ensure it can be selected as a vehicle. To solve this problem, we introduce parameter K to learn an optimal confidence. This is achieved with the following equation. N ST =FT− i=1 (Ci −FT)e−Ki (1) where ST ∈ (0,1) is the dynamic confidence that we deter mine, i is the order of the pictures before current frame, N is the number of vehicles that are regarded as relevant to current vehicle, FT is fixed confidence thresh in the MS CNN algorithm, and Ci is the confidence of the front frame, if it does not exist corresponding ROI, Ci is zero.” [Pg. 349 Col. 2 Lines 3-20]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li as outlined above with the processor is further configured to change the certainty threshold value to the change value in a case in which the change value is lower than the certainty threshold value as taught by Qi, because It can effectively reduce the false alarm rate and increase the true positive rate [Pg. 348 Col. 2 Lines 23-25].
Regarding Claim 18, Srinivasan discloses that further comprising: a certainty threshold memory; the processor is further configured to store the changed certainty threshold value in the certainty threshold memory for each subject (“The module can be configured to reside in addressable storage media and to execute on one or more processors. Modules can include components (such as software components, object-oriented software components, class components, and task components), processes, functions, properties, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables” [Li n0070]).
Regarding Claim 19, Srinivasan discloses that the apparatus further comprises: an input device configured to accept an input operation of a user wherein the processor is further configured to change the certainty threshold value based on the input operation via the input device (“inputting an ultrasonic image to be identified into a trained neural network model, and acquiring all bounding boxes output by the neural network model; and screening the output bounding box according to a set probability threshold value so as to obtain the position information of the vein and the artery. Further, the bounding box that is output by screening according to the set probability threshold specifically includes: selecting a bounding box with the prediction probability larger than a set probability threshold value as a prediction result; and in the boundary frames with the prediction probability larger than the set probability threshold, screening the boundary frame with the highest prediction probability by adopting a maximum suppression method as a screening result, and further acquiring the position information of the veins and the arteries.” [0034-0037]).
Regarding Claim 20, Li discloses a control method of an image processing apparatus (“The invention relates to the technical field of medical ultrasound, in particular to a vein and artery identification method and system based on a neural network.” [n0001]) comprising:
analyzing each of a plurality of ultrasound images of a subject to detect a structure in each of the plurality of ultrasound images and calculate a certainty that the structure is a blood vessel for each of the plurality of ultrasound images (“ randomly selecting 3/5 of the images in all the collected ultrasound images as a training set; randomly selecting 1/5 of images as a verification set; the remaining 1/5 of the ultrasound images are used as a test set; the training set is used for training the neural network model, the verification set is used for verifying the recognition accuracy of the neural network and optimizing weight parameters of the neural network model, and the test set is used for finally evaluating the recognition accuracy of the neural network model; of course, the randomly selected proportion can be 3/5, 1/5, or other proportions;” [n0091], “inputting an ultrasonic image to be recognized into a neural network model obtained through training for processing; acquiring position information of veins and arteries from an ultrasonic image to be identified through the neural network model; the marked veins and arteries are distinguished according to the acquired position information, and an ultrasound image containing the vein marks and the artery marks is generated.” [n0085],
the certainty being an index representing a likelihood that the structure is the blood vessel, the certainty being represented by a probability that the structure is the blood vessel (“ the information of the bounding box comprises probability information that the image in the bounding box is an artery or a vein, and position information and size information of the bounding box.” [n0051] “information of each boundary frame needs to be represented by 2 + 4 + 1 = 7 number, wherein 2 numbers respectively represent the image in the boundary frame is artery, probability information of vein, two probability information are respectively recorded as c1, c2; 4 numbers represent the coordinate information of the central position of the boundary frame, namely abscissa, ordinate and length, width information; 1 number records the size of the possibility of the artery or vein contained in the boundary frame; at last setting softmax classification layer of the neural network model, limiting 2 probability information to 0 to 1, and when the boundary frame contains artery or vein, 2 probability information c1, c2 sum is 1;” [n0110]),
detecting, as the blood vessel, the structure having the certainty higher than a certainty threshold value (“Further, screening boundary frame refers to selecting the prediction probability is greater than the set threshold of the boundary frame as the prediction result; in the boundary frame with prediction probability greater than the set threshold, using maximum suppression method for further screening, the specific method is calculating the overlapping degree between the boundary frame, the overlapping degree index is greater than the boundary frame of the set threshold value, selecting the boundary frame with the highest prediction probability as the identification result” [n0141]),
Li does not specifically disclose changing the certainty threshold value based on a plurality of the calculated certainties that the structure in the plurality of images is the desired structure.
However, in a similar field of endeavor, Qi teaches an adaptive confidence algorithm for vehicle detection using convolutional neural networks is proposed [Abstract].
Qi also teaches changing the certainty threshold value based on a plurality of the calculated certainties that the structure in the plurality of images is the desired structure (“There exists two problems in vehicle detection– false alarms and false negatives. When a false alarm appears in the current frame, it must be that its confidence is larger than fixed confidence thresh we set in advance. In this situation, we should increase confidence thresh to ensure it can not be selected as a vehicle. When a vehicle does not appear in the current frame, it must be that its confidence is smaller than fixed confidence thresh. Now, we should decrease confidence thresh to ensure it can be selected as a vehicle. To solve this problem, we introduce parameter K to learn an optimal confidence. This is achieved with the following equation. N ST =FT− i=1 (Ci −FT)e−Ki (1) where ST ∈ (0,1) is the dynamic confidence that we deter mine, i is the order of the pictures before current frame, N is the number of vehicles that are regarded as relevant to current vehicle, FT is fixed confidence thresh in the MS CNN algorithm, and Ci is the confidence of the front frame, if it does not exist corresponding ROI, Ci is zero.” [Pg. 349 Col. 2 Lines 3-20]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li as outlined above with changing the certainty threshold value based on a plurality of the calculated certainties that the structure in the plurality of images is the desired structure as taught by Qi, because It can effectively reduce the false alarm rate and increase the true positive rate [Pg. 348 Col. 2 Lines 23-25].
Regarding Claim 21, Li discloses that the certainty is calculated using machine learning (“inputting an ultrasonic image to be identified into a trained neural network model, and acquiring all bounding boxes output by the neural network model; and screening the output bounding box according to a set probability threshold value so as to obtain the position information of the vein and the artery. Further, the bounding box that is output by screening according to the set probability threshold specifically includes: selecting a bounding box with the prediction probability larger than a set probability threshold value as a prediction result; and in the boundary frames with the prediction probability larger than the set probability threshold, screening the boundary frame with the highest prediction probability by adopting a maximum suppression method as a screening result, and further acquiring the position information of the veins and the arteries.” [0034-0037]).
Claims 5-6 is rejected under 35 U.S.C. 103 as being unpatentable over Li in view of Qi as applied to Claim 4 above, and further in view of Radulescu et al (US20200043129A1; hereinafter referred to as Radulescu).
Regarding Claim 5, Li in view of Qi discloses that the processor is further configured to store the certainty in the certainty memory (“The module can be configured to reside in addressable storage media and to execute on one or more processors. Modules can include components (such as software components, object-oriented software components, class components, and task components), processes, functions, properties, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables” [Li n0070]).
Li in view of Qi does not specifically disclose that the processor is further configured determine that the ultrasound probe is stationary and store information in a case in which it is determined that the ultrasound probe is stationary for a determined time or longer.
However, in a similar field of endeavor, Radulescu teaches an apparatus includes an imaging probe and is configured for dynamically arranging presentation of visual feedback for guiding manual adjustment [Abstract].
Radulescu also teaches that the processor is further configured determine that the ultrasound probe is stationary and store information in a case in which it is determined that the ultrasound probe is stationary for a determined time or longer (“issuing a user alert for halting the adjustment is responsive to content of imaging dynamically acquired via the probe.” [0026], “the apparatus is configured for detecting the halting” [0027], “In a yet, further sub-aspect, the apparatus is further configured for, responsive to detecting that the halting has occurred, performing the segmenting.” [0028], “Once the movement halts (step S260), query is made, as in step S249, as to whether the current view is sufficiently on target for commencing quantification and optionally live imaging acquisition for storage (step S264)… the current view is sufficiently on target for commencing quantification and optionally live imaging acquisition for storage (step S264)” [0069]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li in view of Qi as outlined above with the processor is further configured determine that the ultrasound probe is stationary and store information in a case in which it is determined that the ultrasound probe is stationary for a determined time or longer as taught by Radulescu, because would improve patient treatment [0007].
Regarding Claim 6, Li in view of Qi discloses that the processor is further configured to store the certainty in the certainty memory (“The module can be configured to reside in addressable storage media and to execute on one or more processors. Modules can include components (such as software components, object-oriented software components, class components, and task components), processes, functions, properties, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables” [Li n0070]).
Li in view of Qi does not specifically disclose that the processor is further configured to determine that the ultrasound probe is in contact with a body surface of the subject.
However, in a similar field of endeavor, Radulescu teaches that the processor is further configured to determine that the ultrasound probe is in contact with a body surface of the subject (“issuing a user alert for halting the adjustment is responsive to content of imaging dynamically acquired via the probe.” [0026], “the apparatus is configured for detecting the halting” [0027], “In a yet, further sub-aspect, the apparatus is further configured for, responsive to detecting that the halting has occurred, performing the segmenting.” [0028], “Once the movement halts (step S260), query is made, as in step S249, as to whether the current view is sufficiently on target for commencing quantification and optionally live imaging acquisition for storage (step S264)… the current view is sufficiently on target for commencing quantification and optionally live imaging acquisition for storage (step S264)” [0069]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li in view of Qi as outlined above with the processor is further configured to determine that the ultrasound probe is in contact with a body surface of the subject as taught by Radulescu, because would improve patient treatment [0007].
Claims 7-8, & 17 are rejected under 35 U.S.C. 103 as being unpatentable over Li in view of Qi as applied to Claims 1 and 4 above, and further in view of Matsumoto (US20190200963A1).
Regarding Claim 7, Li in view of Qi discloses that the processor is further configured to store the certainty in the certainty memory (“The module can be configured to reside in addressable storage media and to execute on one or more processors. Modules can include components (such as software components, object-oriented software components, class components, and task components), processes, functions, properties, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables” [Li n0070]).
Li in view of Qi does not specifically disclose that it is determined that a moving speed of the ultrasound probe is lower than a determined moving speed.
However, in a similar field of endeavor, Matsumoto teaches an ultrasound diagnostic apparatus and a control method of the ultrasound diagnostic apparatus [0002].
Matsumoto also teaches that it is determined that a moving speed of the ultrasound probe is lower than a determined moving speed (“In step S10, the image analyzing unit 13 performs image analysis on the ultrasound image further generated by the B-mode processing unit 20 of the image generating unit 6 in order to identify the part of the subject included in the ultrasound image. For example, in a case where a high frame rate at the time of the ultrasound diagnosis is set as the second imaging condition, the image analyzing unit 13 can perform optical flow, which is time-series image analysis, as the image analysis. Although not illustrated, the optical flow is a technique for mapping a direction and distance of movement of each pattern by using a vector or the like for a plurality of characteristic patterns in the same part included in ultrasound images of a plurality of frames in common by using the ultrasound images of a plurality of frames acquired by the image acquiring unit 3 in a time-series manner. By using such a time-series analysis method, for example, it can become easier to identify a part with much movement such as the heart and a part with a little movement such as the abdomen.” [0064]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li in view of Qi as outlined above with it being determined that a moving speed of the ultrasound probe is lower than a determined moving speed as taught by Matsumoto, because it can become easier to identify a part [0064].
Regarding Claim 8, Li in view of Qi discloses that the processor is further configured to store the certainty in the certainty memory (“The module can be configured to reside in addressable storage media and to execute on one or more processors. Modules can include components (such as software components, object-oriented software components, class components, and task components), processes, functions, properties, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables” [Li n0070]).
Li in view of Qi does not specifically disclose that the certainty being calculated based on the ultrasound image having a frame selected by a frame interval according to a moving speed of the ultrasound probe in the ultrasound image having a plurality of frames.
However, in a similar field of endeavor, Matsumoto teaches that the certainty being calculated based on the ultrasound image having a frame selected by a frame interval according to a moving speed of the ultrasound probe in the ultrasound image having a plurality of frames (“a part probability calculating unit that calculates, for the ultrasound image acquired in the image acquiring unit in accordance with a first imaging condition, a probability that a part of the subject included in the ultrasound image is a specific part from at least one of an orientation angle of the ultrasound probe or an analysis result of the ultrasound image;” [0008], “In step S10, the image analyzing unit 13 performs image analysis on the ultrasound image further generated by the B-mode processing unit 20 of the image generating unit 6 in order to identify the part of the subject included in the ultrasound image. For example, in a case where a high frame rate at the time of the ultrasound diagnosis is set as the second imaging condition, the image analyzing unit 13 can perform optical flow, which is time-series image analysis, as the image analysis. Although not illustrated, the optical flow is a technique for mapping a direction and distance of movement of each pattern by using a vector or the like for a plurality of characteristic patterns in the same part included in ultrasound images of a plurality of frames in common by using the ultrasound images of a plurality of frames acquired by the image acquiring unit 3 in a time-series manner. By using such a time-series analysis method, for example, it can become easier to identify a part with much movement such as the heart and a part with a little movement such as the abdomen.” [0064]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li in view of Qi as outlined above with the certainty being calculated based on the ultrasound image having a frame selected by a frame interval according to a moving speed of the ultrasound probe in the ultrasound image having a plurality of frames as taught by Matsumoto, because it can become easier to identify a part [0064].
Regarding Claim 17, Li in view of Qi discloses all limitation noted above except that the processor is further configured to notify a user of a change of the certainty threshold value.
However, in a similar field of endeavor, Matsumoto teaches that the processor is further configured to notify a user of a change of the certainty threshold value (“Subsequently, when the number of times of determination that the plurality of part probabilities are all less than the threshold value becomes N, the process proceeds to st+ep S17. A message indicating that an error has occurred is displayed in the display unit 8, and then the ultrasound diagnostic apparatus 1 terminates the operation.” [0060]).
It would have been obvious to an ordinary skilled person in the art before the effective filing
date of the claimed invention to modify the system of Li in view of Qi as outlined above with the processor being further configured to notify a user of a change of the certainty threshold value as taught by Matsumoto, because it can indicate that an error has occurred [0060].
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to STEVEN MALDONADO whose telephone number is 703-756-1421. The examiner can normally be reached 8:00 am-4:00 pm PST M-Th Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at
http://www.uspto.gov/interviewpractice. If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Christopher Koharski can be reached on (571) 272-7230. Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/Steven Maldonado/
Patent Examiner, Art Unit 3797
/CHRISTOPHER KOHARSKI/Supervisory Patent Examiner, Art Unit 3797
Prosecution Insights