DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Response to Amendment
The proposed reply filed on 10/20/2025 has been entered. Claims 1-6, 8-18, and 20-24 remain pending in the current application.
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA 35 U.S.C. 102 and 103 (or as subject to pre-AIA 35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claims 1-4, 8-9, 13-16, and 20-21 are rejected under 35 U.S.C. 103 as being unpatentable over Yang (US Pub No. 2016/0166159) in the view of Akkus (NPL: “Deep learning for brain MRI segmentation: state of art and future directions”) and Kang (WO 2017139895).
Regarding claim 1, Yang teaches a brain imaging system, comprising (para. 0038; CT, MRI and MN imaging systems):
a first imaging device, configured to capture a first brain image set by scanning a patient, wherein the first brain image set includes a plurality of first brain images that provides cerebral data representing a first contrast agent in a brain of the patient over time (para. 0038; A bolus of contrasting agents is introduced via a needle into a patient nt, for example, the arm of the patient. However, the bolus can be input to any other part of the patient. A region of interest (ROI) may be a tissue 6 in a part of the patient's brain as shown in FIG. 1. Alternatively, the ROI may be a pixel or a plurality of pixels, where any pixels represent a calculated image to produce one or more perfusion maps. Blood circulating throughout the patient will contain the contrast agent and in particular may be delivered to the tissue 6 via artery 8 and the blood flowing through the tissue 6 is returned to the heart via vein 10. Raw data and/or images collected by a scan, such as from a CT scanner 20, MRI scanner 30 or NM scanner 35 arc forwarded to a data storage system 40.);
a second imaging device, configured to capture a second brain image set by scanning the patient, wherein the second brain image set includes a plurality of second brain images that provides cerebral data representing a second contrast agent in the brain of the patient over time (para. 0038; A bolus of contrasting agents is introduced via a needle into a patient nt, for example, the arm of the patient. However, the bolus can be input to any other part of the patient. A region of interest (ROI) may be a tissue 6 in a part of the patient's brain as shown in FIG. 1. Alternatively, the ROI may be a pixel or a plurality of pixels, where any pixels represent a calculated image to produce one or more perfusion maps. Blood circulating throughout the patient will contain the contrast agent and in particular may be delivered to the tissue 6 via artery 8 and the blood flowing through the tissue 6 is returned to the heart via vein 10. Raw data and/or images collected by a scan, such as from a CT scanner 20, MRI scanner 30 or NM scanner 35 arc forwarded to a data storage system 40.); and
a processor electrically connected to the first imaging device and the second imaging device, wherein the processor is configured to (para. 0038; A computer program operating on a processor 50, in the form of a computer, is used to retrieve the various images or raw data from any one of the scanners 20, 30 or 35 or from the data storage system 40. The computer program need not reside on computer 50, but may reside in a console computer linked to any one of the scanners 20, 30 or 35.):
obtain, by performing an image pre-processing process on the first brain image set and the second brain image set, a first processed brain image set and a second processed brain image set (paras. 0038 and 0072; the program performs various pre-processing including (i) motion correction; (ii) detection of AIF and VOF; (iii) setting baseline time period before contrast arrival; and (iv) converting a signal intensity profile to contrast concentration time curve.);
obtain, by performing an image enhancing process on the first processed brain image set and the second processed brain image set, a first enhanced brain image set and a second enhanced brain image set (para. 0038; The program then processes those images to provide an improved data set for a clinician to use, particularly in relation to perfusion indices including blood flow, blood volume, mean transit time, arterial delay time, arterial dispersion time or relative arterial dispersion, tissue dispersion time or relative tissue dispersion. The system is performing data processing on the images to provide an enhanced images after processing them);
select, by using a first model having been trained, first features from the first enhanced image set that are optimal for estimating cerebral perfusion (para. 0056; Using the computer program, the user selects the initial AIF and VIF, the program, will automatically derive the AIF.sub.t(t) input to the tissue 6 based on the first model and the convolution thereof. Secondly the program will estimate tissue blood flow F.sub.t and IRF R.sub.e(t) and derive parameter values used to build the simulated tissue IRF R.sub.s(t) in the second model. The program further calculates a simulated contrast curve at the tissue of interest. The seven parameters F.sub.t, t.sub.1, σ.sub.1, α.sub.1, σ.sub.2, α.sub.2 and t.sub.2 are optimized through a least squares method in order to fit the simulated C.sub.s(t) to the measured tissue curve C(t). The examiner notes that the parameters derived from the image data using the first model are the first features.);
select, by using a second model having been trained, second features from the second enhanced image set that are optimal for brain lesion identification (paras. 0071-0078; The program loads the dynamic perfusion data and/or images, then process them to produce various perfusion maps including CBV, VBF, MTT and DT, and further create a color-coded tissue status map consisting of an infarct (red) 702 and penumbra (green) regions overlaid on the corresponding raw image. At step 906, the program process data on a pixel-by-pixel basis to produce various perfusion maps using a model-free deconvolution technique such as the singular value decomposition (SVD) technique by taking into account arterial delay and dispersion effects. the program identifies ischemic pixels where DT is greater than a predetermined first threshold value and CBV is below a second threshold value. the program identifies the infarct portion of the ischemic lesion, where DT is greater than a predetermined third threshold value and/or CBV is below a fourth threshold value. The examiner notes that the model extract prefusion maps such as CBV and DT maps from image data. The CBV and DT maps are the second features extracted from image data.);
obtain, by performing calculations on first features, a plurality of brain perfusion indices (para. 0057; With the optimized seven parameters F.sub.1, t.sub.1, σ.sub.1, α.sub.1, σ.sub.2, α.sub.2 and t.sub.2, several quantitative perfusion indices can be determined as BF, MTT, BV, DT, TDT, etc.); and
identify, by inputting the second features to a model having been trained, position information and volume information of one or more target brain lesions in the brain of the patient (paras. 0073-0078; At step 908, the program identifies ischemic pixels where DT is greater than a predetermined first threshold value and CBV is below a second threshold value. At step 910, the program identifies the infarct portion of the ischemic lesion, where DT is greater than a predetermined third threshold value and/or CBV is below a fourth threshold value. At step 912, the program may further apply cluster analysis to all the detected ischemic pixels and infarct pixels respectively by removing small islands or filling small holes with maximum cluster size below a predetermined fifth threshold value. The cluster analysis may involve general morphological operators such as opening and closing, or the general k-means clustering technique. The ischemic penumbra can be identified at step 914, by the mismatch region between the ischemic lesion and infarct. Then a tissue status map can be created to display the infarct (red) 702 surrounded by the penumbra (green) 704 as a color overlay on the corresponding raw image. the program measures the penumbra volume as a percentage of the total said ischemic lesion to determine treatment of the acute stroke patient. The examiner notes that using the second features (CBV and DT maps) the program create color coded tissue status maps that shows the position of the lesion and further measures the penumbra volume as a percentage of the total said ischemic lesion to determine treatment of the acute stroke patient.).
However, Yang fails to explicitly teach using deep learning models to detect abnormalities in the brain; wherein the deep learning models are a long-short term memory (LSTM) neural networks capable of learning order dependence in fitting time-series data, and the third deep learning model is trained according to the second features.
Akkus, in the same field of endeavor, teaches using deep learning models to detect abnormalities in the brain and the deep learning model is trained according to the features (figure 4, pages 450 and 453; An emerging machine learning technique referred to as deep learning [1], can help avoid limitations of classical machine learning algorithms, and its self-learning of features may enable identification of new useful imaging features for quantitative analysis of brain MRI. Deep learning refers to neural networks with many layers
(usually more than five) that extract a hierarchy of features from raw input images. It is a new and popular type of machine learning techniques that extract a complex hierarchy of features from images due to their self-learning ability as opposed to the hand-crafted feature extraction in classical machine learning algorithms. A cascaded CNN architecture for brain tumor segmentation task, where the output of the first network (CNN 1) is used in addition to image data for a refined input to the second network (CNN 2), which provides final segmentation. This type of architecture combines two CNN architectures [32]. The output of the first CNN is used as an input to the second CNN to obtain classification results. The first CNN is used to train the model with initial prediction of class labels while second CNN is used to further tune the results of the first CNN. The examiner notes that machine learning models are used to extract features from images and input the extracted features to another machine learning model to train it. The other machine learning model uses the extracted features to provide a final segmentation of the brain lesion.).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the models of Yang to incorporate the teaching Akkus to include deep learning models to extract features and detect brain abnormalities. Doing so will help in identification of new useful imaging features for quantitative analysis of a large number of brain images and accurate classification and quantifications of brain structures and lesions as taught within Akkus in page 450.
However, Yang in the view of Akkus fail to explicitly teach that the deep learning models are a long-short term memory (LSTM) neural networks capable of learning order dependence in fitting time-series data.
Kang, in the same field of endeavor, teaches are a long-short term memory (LSTM) neural networks capable of learning order dependence in fitting time-series data (paras. 0040-0059; The Long Short Term Memory (LSTM) neural network allows us to perform group feature selections and classifications. The LSTM machine learning algorithms are discussed in more detail below. From this process, the set of bitplanes to be isolated from image sequences to reflect temporal changes in HC is obtained. An image filter is configured to isolate the identified bitplanes in subsequent steps described below. The Long Short Term Memory (LSTM) neural network, or a suitable alternative such as non-linear Support Vector Machine, and deep learning may again be used to assess the existence of common spatial-temporal patterns of hemoglobin changes across subjects. One recurrent neural network is known as the Long Short Term Memory (LSTM) neural network, which is a category of neural network model specified for sequential data analysis and prediction. The LSTM neural network comprises at least three layers of cells. The first layer is an input layer, which accepts the input data. The second (and perhaps additional) layer is a hidden layer, which is composed of memory cells (see Fig. 12). The final layer is output layer, which generates the output value based on the hidden layer using Logistic Regression. The goal is to classify the sequence into different conditions. The Logistic
Regression output layer generates the probability of each condition based on the representation sequence from the LSTM hidden layer. The examiner notes that LSTM is trained on temporal hemoglobin signal sequence to capture spatiotemporal patterns and classify physiological states from sequential inputs, thus, LSTM is used for learning order dependence and fitting time series data for classifying physiological state.).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the deep learning models of Yang in the view of Akkus to incorporate the teaching Kang to include Long Short-Term Memory (LSTM) neural network. Doing so will enable the system to learn meaningful order dependent features for improved feature selection and classification. The LSTM is able to identify which temporal image features (bitplanes) mater most for physiological state classification, detect patterns of physiological change across time and regions, and model sequential inputs while preserving important earlier information as disclosed in paras. 0040, 0046, and 0051-0059. Thus, by modifying the deep learning models of Yang in the view of Akkus with the LSTM neural network of Kang would enable the system to accurately model temporal patterns and sequential relationship.
Regarding claim 2, Yang teaches the brain imaging system according to claim 1, wherein the first imaging device is a computed tomography (CT) imaging device, the plurality of first brain images are CT brain images, the second imaging device is a magnetic resonance imaging (MRI) device, and the plurality of second brain images are MRI brain images (para. 0038; the imaging devices are CT and MRI and the system is a multimodal imaging system which uses images from both imaging devices).
Regarding claim 3, Yang teaches the brain imaging system according to claim 2, however, fails to explicitly teach wherein the pre-processing process includes: performing a re-alignment process to align positions of the brain in each image; performing a co-registration process to normalize sizes and coordinates in each image; and performing a segmentation process to isolate a target region of the brain in each image.
Akkus, in the same field of endeavor, teaches pre-processing process includes: performing a re-alignment process to align positions of the brain in each image (page 452, right col; Registration is spatial alignment of the images to a common anatomical space. Intrapatient registration aims to align the images of different sequences, e.g., T1 and T2, to obtain a multi-channel representation for each location within the brain.);
performing a co-registration process to normalize sizes and coordinates in each image (page 452, right col; Registration is spatial alignment of the images to a common anatomical space); and performing a segmentation process to isolate a target region of the brain in each image (pages 454-455; lesion segmentation where it provides segmented region in an image).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the preprocessing steps of Yang to incorporate the teaching Akkus to include preprocessing steps of the images including alignment, registration, and segmentation. Doing so will help in automated analysis of the images and improve the learning process. Doing so would help to avoid suppression of true patterns of structures and intensity differentiation in the output of the models as taught within Akkus in pages 452 and 457.
Regarding claim 4, Yang teaches the brain imaging system according to claim 3, however, fails to explicitly teach wherein the co-registration process further includes: obtaining a target brain atlas from a plurality of reference brain atlases built from one or more representations of brain; spatially normalizing the brain of each image to a coordinate system; and registering the brain of each image to the target brain atlas by matching anatomy of the brain with a representation of anatomy in the target brain atlas.
Akkus, in the same field of endeavor, teaches obtaining a target brain atlas from a plurality of reference brain atlases built from one or more representations of brain (page 454, right col; supervised machine learning methods that, given a representative dataset, learn the textural and appearance properties of lesions [46], and atlas-based methods that combine both supervised and unsupervised learning into a unified pipeline by registering labeled data or a known cohort data into a common anatomical space); spatially normalizing the brain of each image to a coordinate system (page 452, right col; Registration is spatial alignment of the images to a common anatomical space); and registering the brain of each image to the target brain atlas by matching anatomy of the brain with a representation of anatomy in the target brain atlas (pages 452 and 454; an atlas based methods register images to a common space (atlas)).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang to incorporate the teaching Akkus to include co-registration step. Doing so will help in automated analysis of the images and improve the learning process. Doing so would help to avoid suppression of true patterns of structures and intensity differentiation in the output of the models as taught within Akkus in pages 452 and 457.
Regarding claim 8, Yang teaches the brain imaging system according to claim 1, wherein the processor is further configured to: detecting a vessel occlusion, infarction or ischemia region of the first brain image set according to the plurality of brain perfusion indices (para. 0015; detecting the infarct portion of the ischemic lesion, where DT is greater than a predetermined third threshold value and/or CBV is below a fourth threshold value).
Regarding claim 9, Yang teaches the brain imaging system according to claim 8, wherein the plurality of brain perfusion indices include one or more of a first concentration curve, a first cerebral blood flow, a first cerebral blood volume, a first cerebral blood mean transit time and a first contrast agent time to peak (para. 0038; The program then processes those images to provide an improved data set for a clinician to use, particularly in relation to perfusion indices including blood flow, blood volume, mean transit time, arterial delay time, arterial dispersion time or relative arterial dispersion, tissue dispersion time or relative tissue dispersion.).
Regarding claim 13, Yang teaches a brain imaging method, comprising (para. 0038; CT, MRI and MN imaging systems):
configuring a first imaging device, configured to capture a first brain image set by scanning a patient, wherein the first brain image set includes a plurality of first brain images that provides cerebral data representing a first contrast agent in a brain of the patient over time (para. 0038; A bolus of contrasting agents is introduced via a needle into a patient nt, for example, the arm of the patient. However, the bolus can be input to any other part of the patient. A region of interest (ROI) may be a tissue 6 in a part of the patient's brain as shown in FIG. 1. Alternatively, the ROI may be a pixel or a plurality of pixels, where any pixels represent a calculated image to produce one or more perfusion maps. Blood circulating throughout the patient will contain the contrast agent and in particular may be delivered to the tissue 6 via artery 8 and the blood flowing through the tissue 6 is returned to the heart via vein 10. Raw data and/or images collected by a scan, such as from a CT scanner 20, MRI scanner 30 or NM scanner 35 arc forwarded to a data storage system 40.);
configuring a second imaging device, configured to capture a second brain image set by scanning the patient, wherein the second brain image set includes a plurality of second brain images that provides cerebral data representing a second contrast agent in the brain of the patient over time (para. 0038; A bolus of contrasting agents is introduced via a needle into a patient nt, for example, the arm of the patient. However, the bolus can be input to any other part of the patient. A region of interest (ROI) may be a tissue 6 in a part of the patient's brain as shown in FIG. 1. Alternatively, the ROI may be a pixel or a plurality of pixels, where any pixels represent a calculated image to produce one or more perfusion maps. Blood circulating throughout the patient will contain the contrast agent and in particular may be delivered to the tissue 6 via artery 8 and the blood flowing through the tissue 6 is returned to the heart via vein 10. Raw data and/or images collected by a scan, such as from a CT scanner 20, MRI scanner 30 or NM scanner 35 arc forwarded to a data storage system 40.); and
configuring a processor electrically connected to the first imaging device and the second imaging device, to (para. 0038; A computer program operating on a processor 50, in the form of a computer, is used to retrieve the various images or raw data from any one of the scanners 20, 30 or 35 or from the data storage system 40. The computer program need not reside on computer 50, but may reside in a console computer linked to any one of the scanners 20, 30 or 35.):
obtain, by performing an image pre-processing process on the first brain image set and the second brain image set, a first processed brain image set and a second processed brain image set (paras. 0038 and 0072; the program performs various pre-processing including (i) motion correction; (ii) detection of AIF and VOF; (iii) setting baseline time period before contrast arrival; and (iv) converting a signal intensity profile to contrast concentration time curve.);
obtain, by performing an image enhancing process on the first processed brain image set and the second processed brain image set, a first enhanced brain image set and a second enhanced brain image set (para. 0038; The program then processes those images to provide an improved data set for a clinician to use, particularly in relation to perfusion indices including blood flow, blood volume, mean transit time, arterial delay time, arterial dispersion time or relative arterial dispersion, tissue dispersion time or relative tissue dispersion. The system is performing data processing on the images to provide an enhanced images after processing them);
select, by using a first model having been trained, first features from the first enhanced image set that are optimal for estimating cerebral perfusion (para. 0056; Using the computer program, the user selects the initial AIF and VIF, the program, will automatically derive the AIF.sub.t(t) input to the tissue 6 based on the first model and the convolution thereof. Secondly the program will estimate tissue blood flow F.sub.t and IRF R.sub.e(t) and derive parameter values used to build the simulated tissue IRF R.sub.s(t) in the second model. The program further calculates a simulated contrast curve at the tissue of interest. The seven parameters F.sub.t, t.sub.1, σ.sub.1, α.sub.1, σ.sub.2, α.sub.2 and t.sub.2 are optimized through a least squares method in order to fit the simulated C.sub.s(t) to the measured tissue curve C(t). The examiner notes that the parameters derived from the image data using the first model are the first features.);
select, by using a second model having been trained, second features from the second enhanced image set that are optimal for brain lesion identification (paras. 0071-0078; The program loads the dynamic perfusion data and/or images, then process them to produce various perfusion maps including CBV, VBF, MTT and DT, and further create a color-coded tissue status map consisting of an infarct (red) 702 and penumbra (green) regions overlaid on the corresponding raw image. At step 906, the program process data on a pixel-by-pixel basis to produce various perfusion maps using a model-free deconvolution technique such as the singular value decomposition (SVD) technique by taking into account arterial delay and dispersion effects. the program identifies ischemic pixels where DT is greater than a predetermined first threshold value and CBV is below a second threshold value. the program identifies the infarct portion of the ischemic lesion, where DT is greater than a predetermined third threshold value and/or CBV is below a fourth threshold value. The examiner notes that the model extract prefusion maps such as CBV and DT maps from image data. The CBV and DT maps are the second features extracted from image data.);
obtain, by performing calculations on first features, a plurality of brain perfusion indices (para. 0057; With the optimized seven parameters F.sub.1, t.sub.1, σ.sub.1, α.sub.1, σ.sub.2, α.sub.2 and t.sub.2, several quantitative perfusion indices can be determined as BF, MTT, BV, DT, TDT, etc.); and
identify, by inputting the second features to a model having been trained, position information and volume information of one or more target brain lesions in the brain of the patient (paras. 0073-0078; At step 908, the program identifies ischemic pixels where DT is greater than a predetermined first threshold value and CBV is below a second threshold value. At step 910, the program identifies the infarct portion of the ischemic lesion, where DT is greater than a predetermined third threshold value and/or CBV is below a fourth threshold value. At step 912, the program may further apply cluster analysis to all the detected ischemic pixels and infarct pixels respectively by removing small islands or filling small holes with maximum cluster size below a predetermined fifth threshold value. The cluster analysis may involve general morphological operators such as opening and closing, or the general k-means clustering technique. The ischemic penumbra can be identified at step 914, by the mismatch region between the ischemic lesion and infarct. Then a tissue status map can be created to display the infarct (red) 702 surrounded by the penumbra (green) 704 as a color overlay on the corresponding raw image. the program measures the penumbra volume as a percentage of the total said ischemic lesion to determine treatment of the acute stroke patient. The examiner notes that using the second features (CBV and DT maps) the program create color coded tissue status maps that shows the position of the lesion and further measures the penumbra volume as a percentage of the total said ischemic lesion to determine treatment of the acute stroke patient.).
However, Yang fails to explicitly teach using deep learning models to detect abnormalities in the brain; wherein the deep learning models are a long-short term memory (LSTM) neural networks capable of learning order dependence in fitting time-series data, and the third deep learning model is trained according to the second features.
Akkus, in the same field of endeavor, teaches using deep learning models to detect abnormalities in the brain and the deep learning model is trained according to the features (figure 4, pages 450 and 453; An emerging machine learning technique referred to as deep learning [1], can help avoid limitations of classical machine learning algorithms, and its self-learning of features may enable identification of new useful imaging features for quantitative analysis of brain MRI. Deep learning refers to neural networks with many layers
(usually more than five) that extract a hierarchy of features from raw input images. It is a new and popular type of machine learning techniques that extract a complex hierarchy of features from images due to their self-learning ability as opposed to the hand-crafted feature extraction in classical machine learning algorithms. A cascaded CNN architecture for brain tumor segmentation task, where the output of the first network (CNN 1) is used in addition to image data for a refined input to the second network (CNN 2), which provides final segmentation. This type of architecture combines two CNN architectures [32]. The output of the first CNN is used as an input to the second CNN to obtain classification results. The first CNN is used to train the model with initial prediction of class labels while second CNN is used to further tune the results of the first CNN. The examiner notes that machine learning models are used to extract features from images and input the extracted features to another machine learning model to train it. The other machine learning model uses the extracted features to provide a final segmentation of the brain lesion.).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the models of Yang to incorporate the teaching Akkus to include deep learning models to extract features and detect brain abnormalities. Doing so will help in identification of new useful imaging features for quantitative analysis of a large number of brain images and accurate classification and quantifications of brain structures and lesions as taught within Akkus in page 450.
However, Yang in the view of Akkus fail to explicitly teach that the deep learning models are a long-short term memory (LSTM) neural networks capable of learning order dependence in fitting time-series data.
Kang, in the same field of endeavor, teaches are a long-short term memory (LSTM) neural networks capable of learning order dependence in fitting time-series data (paras. 0040-0059; The Long Short Term Memory (LSTM) neural network allows us to perform group feature selections and classifications. The LSTM machine learning algorithms are discussed in more detail below. From this process, the set of bitplanes to be isolated from image sequences to reflect temporal changes in HC is obtained. An image filter is configured to isolate the identified bitplanes in subsequent steps described below. The Long Short Term Memory (LSTM) neural network, or a suitable alternative such as non-linear Support Vector Machine, and deep learning may again be used to assess the existence of common spatial-temporal patterns of hemoglobin changes across subjects. One recurrent neural network is known as the Long Short Term Memory (LSTM) neural network, which is a category of neural network model specified for sequential data analysis and prediction. The LSTM neural network comprises at least three layers of cells. The first layer is an input layer, which accepts the input data. The second (and perhaps additional) layer is a hidden layer, which is composed of memory cells (see Fig. 12). The final layer is output layer, which generates the output value based on the hidden layer using Logistic Regression. The goal is to classify the sequence into different conditions. The Logistic
Regression output layer generates the probability of each condition based on the representation sequence from the LSTM hidden layer. The examiner notes that LSTM is trained on temporal hemoglobin signal sequence to capture spatiotemporal patterns and classify physiological states from sequential inputs, thus, LSTM is used for learning order dependence and fitting time series data for classifying physiological state.).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the deep learning models of Yang in the view of Akkus to incorporate the teaching Kang to include Long Short-Term Memory (LSTM) neural network. Doing so will enable the system to learn meaningful order dependent features for improved feature selection and classification. The LSTM is able to identify which temporal image features (bitplanes) mater most for physiological state classification, detect patterns of physiological change across time and regions, and model sequential inputs while preserving important earlier information as disclosed in paras. 0040, 0046, and 0051-0059. Thus, by modifying the deep learning models of Yang in the view of Akkus with the LSTM neural network of Kang would enable the system to accurately model temporal patterns and sequential relationship.
Regarding claim 14, Yang teaches the brain imaging method according to claim 13, wherein the first imaging device is a computed tomography (CT) imaging device, the plurality of first brain images are CT brain images, the second imaging device is a magnetic resonance imaging (MRI) device, and the plurality of second brain images are MRI brain images (para. 0038; the imaging devices are CT and MRI and the system is a multimodal imaging system which uses images from both imaging devices).
Regarding claim 15, Yang teaches the brain imaging method according to claim 14, however, fails to explicitly teach wherein the pre-processing process includes: performing a re-alignment process to align positions of the brain in each image; performing a co-registration process to normalize sizes and coordinates in each image; and performing a segmentation process to isolate a target region of the brain in each image.
Akkus, in the same field of endeavor, teaches pre-processing process includes: performing a re-alignment process to align positions of the brain in each image (page 452, right col; Registration is spatial alignment of the images to a common anatomical space. Intrapatient registration aims to align the images of different sequences, e.g., T1 and T2, to obtain a multi-channel representation for each location within the brain.);
performing a co-registration process to normalize sizes and coordinates in each image (page 452, right col; Registration is spatial alignment of the images to a common anatomical space); and performing a segmentation process to isolate a target region of the brain in each image (pages 454-455; lesion segmentation where it provides segmented region in an image).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang to incorporate the teaching Akkus to include preprocessing steps of the images including alignment, registration, and segmentation. Doing so will help in automated analysis of the images and improve the learning process. Doing so would help to avoid suppression of true patterns of structures and intensity differentiation in the output of the models as taught within Akkus in pages 452 and 457.
Regarding claim 16, Yang teaches the brain imaging method according to claim 15 however, fails to explicitly teach wherein the co-registration process further includes: obtaining a target brain atlas from a plurality of reference brain atlases built from one or more representations of brain; spatially normalizing the brain of each image to a coordinate system; and registering the brain of each image to the target brain atlas by matching anatomy of the brain with a representation of anatomy in the target brain atlas.
Akkus, in the same field of endeavor, teaches obtaining a target brain atlas from a plurality of reference brain atlases built from one or more representations of brain (page 454, right col; supervised machine learning methods that, given a representative dataset, learn the textural and appearance properties of lesions [46], and atlas-based methods that combine both supervised and unsupervised learning into a unified pipeline by registering labeled data or a known cohort data into a common anatomical space); spatially normalizing the brain of each image to a coordinate system (page 452, right col; Registration is spatial alignment of the images to a common anatomical space); and registering the brain of each image to the target brain atlas by matching anatomy of the brain with a representation of anatomy in the target brain atlas (pages 452 and 454; an atlas based methods register images to a common space (atlas)).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang to incorporate the teaching Akkus to include co-registration step. Doing so will help in automated analysis of the images and improve the learning process. Doing so would help to avoid suppression of true patterns of structures and intensity differentiation in the output of the models as taught within Akkus in pages 452 and 457.
Regarding claim 20, Yang teaches the brain imaging method according to claim 13, wherein the processor is further configured to: detecting a vessel occlusion, infarction or ischemia region of the first brain image set according to the plurality of brain perfusion indices (para. 0015; detecting the infarct portion of the ischemic lesion, where DT is greater than a predetermined third threshold value and/or CBV is below a fourth threshold value).
Regarding claim 21, Yang teaches the brain imaging method according to claim 20, wherein the plurality of brain perfusion indices include one or more of a first concentration curve, a first cerebral blood flow, a first cerebral blood volume, a first cerebral blood mean transit time and a first contrast agent time to peak (para. 0038; The program then processes those images to provide an improved data set for a clinician to use, particularly in relation to perfusion indices including blood flow, blood volume, mean transit time, arterial delay time, arterial dispersion time or relative arterial dispersion, tissue dispersion time or relative tissue dispersion.).
Claims 5-6 and 17-18 are rejected under 35 U.S.C. 103 as being unpatentable over Yang (US Pub No. 2016/0166159) in the view of Akkus (NPL: “Deep learning for brain MRI segmentation: state of art and future directions”) and Kang (WO 2017139895) and in further view of Selvy (NPL: “A Proficient Clustering Technique to Detect CSF Level in MRI Brain imaging using PSO algorithm”).
Regarding claim 5, Yang teaches the brain imaging system according to claim 1, however, fails to explicitly teach wherein the image enhancing process includes: applying a contrast-limited adaptative histogram equalization (CLAHE) algorithm on each image to locally enhance differences between normal regions and regions of interest.
Selvy, in the same field of endeavor, teaches applying a contrast-limited adaptative histogram equalization (CLAHE) algorithm on each image to locally enhance differences between normal regions and regions of interest (page 300, left col; Contrast Limited Adaptive Histogram Equalization (CLAHE) [19] was originally developed for medical imaging and has proven to be successful for enhancement of low-contrast images. CLAHE algorithm partitions the images into contextual regions and applies the histogram equalization to each pixel. This evens out the distribution of used grey values and thus makes hidden features of the image more visible. The full grey spectrum is used to express the image. CLAHE operates on small regions in the image, rather than the entire image. Each small region is contrast enhanced, so that the histogram of the output region approximately matches the histogram specified by the 'Distribution' parameter.).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang in the view of Akkus and Kang to incorporate the teaching Selvy to include the use of CLAHE algorithm. Doing so will help enhance small regions in the image instead than the entire image as taught within Selvy in page 300, left col.
Regarding claim 6, Yang teaches the brain imaging system according to claim 5, however, fails to explicitly teach wherein the image enhancing process further includes: performing a particle swarm optimization algorithm, before applying the CLAHE algorithm, to obtain optimal parameters for the CLAHE algorithm; and applying the CLAHE algorithm on each image by utilizing the optimal parameters.
Selvy, in the same field of endeavor, teaches performing a particle swarm optimization algorithm, before applying the CLAHE algorithm, to obtain optimal parameters for the CLAHE algorithm (page 299, left col; . PSO is a population-based stochastic approach for solving continuous nonlinear functions. PSO method optimizes the objective function. PSO is initialized with a group of random particles (solutions) and then searches for optimal solution by updating generations. Particles move through the solution space, and are evaluated according to some fitness criterion after each iteration time step. In every iteration, each particle is updated by the two best values, the first one is the fitness value it has achieved so for. This value is called p_best. Another best value that is tracked by the particle swarm optimizer is the best value obtained so far by any particle in the population. This is called the global best value (i.e) g_best.); and applying the CLAHE algorithm on each image by utilizing the optimal parameters (page 300, left col; Contrast Limited Adaptive Histogram Equalization (CLAHE) [19] was originally developed for medical imaging and has proven to be successful for enhancement of low-contrast images. CLAHE algorithm partitions the images into contextual regions and applies the histogram equalization to each pixel. This evens out the distribution of used grey values and thus makes hidden features of the image more visible. The full grey spectrum is used to express the image. CLAHE operates on small regions in the image, rather than the entire image. Each small region is contrast enhanced, so that the histogram of the output region approximately matches the histogram specified by the 'Distribution' parameter.).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang in the view of Akkus and Kang to incorporate the teaching Selvy to include the use of CLAHE algorithm. Doing so will help enhance small regions in the image instead than the entire image as taught within Selvy in page 300, left col.
Regarding claim 17, Yang teaches the brain imaging method according to claim 13, however, fails to explicitly teach wherein the image enhancing process includes: applying a contrast-limited adaptative histogram equalization (CLAHE) algorithm on each image to locally enhance differences between normal regions and regions of interest.
Selvy, in the same field of endeavor, teaches applying a contrast-limited adaptative histogram equalization (CLAHE) algorithm on each image to locally enhance differences between normal regions and regions of interest (page 300, left col; Contrast Limited Adaptive Histogram Equalization (CLAHE) [19] was originally developed for medical imaging and has proven to be successful for enhancement of low-contrast images. CLAHE algorithm partitions the images into contextual regions and applies the histogram equalization to each pixel. This evens out the distribution of used grey values and thus makes hidden features of the image more visible. The full grey spectrum is used to express the image. CLAHE operates on small regions in the image, rather than the entire image. Each small region is contrast enhanced, so that the histogram of the output region approximately matches the histogram specified by the 'Distribution' parameter.).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang in the view of Akkus and Kang to incorporate the teaching Selvy to include the use of CLAHE algorithm. Doing so will help enhance small regions in the image instead than the entire image as taught within Selvy in page 300, left col.
Regarding claim 18, Yang teaches the brain imaging method according to claim 17, however, fails to explicitly teach wherein the image enhancing process further includes: performing a particle swarm optimization algorithm, before applying the CLAHE algorithm, to obtain optimal parameters for the CLAHE algorithm; and applying the CLAHE algorithm on each image by utilizing the optimal parameters.
Selvy, in the same field of endeavor, teaches performing a particle swarm optimization algorithm, before applying the CLAHE algorithm, to obtain optimal parameters for the CLAHE algorithm (page 299, left col; . PSO is a population-based stochastic approach for solving continuous nonlinear functions. PSO method optimizes the objective function. PSO is initialized with a group of random particles (solutions) and then searches for optimal solution by updating generations. Particles move through the solution space, and are evaluated according to some fitness criterion after each iteration time step. In every iteration, each particle is updated by the two best values, the first one is the fitness value it has achieved so for. This value is called p_best. Another best value that is tracked by the particle swarm optimizer is the best value obtained so far by any particle in the population. This is called the global best value (i.e) g_best.); and applying the CLAHE algorithm on each image by utilizing the optimal parameters (page 300, left col; Contrast Limited Adaptive Histogram Equalization (CLAHE) [19] was originally developed for medical imaging and has proven to be successful for enhancement of low-contrast images. CLAHE algorithm partitions the images into contextual regions and applies the histogram equalization to each pixel. This evens out the distribution of used grey values and thus makes hidden features of the image more visible. The full grey spectrum is used to express the image. CLAHE operates on small regions in the image, rather than the entire image. Each small region is contrast enhanced, so that the histogram of the output region approximately matches the histogram specified by the 'Distribution' parameter.).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang in the view of Akkus and Kang to incorporate the teaching Selvy to include the use of CLAHE algorithm. Doing so will help enhance small regions in the image instead than the entire image as taught within Selvy in page 300, left col.
Claims 10-12 and 22-24 are rejected under 35 U.S.C. 103 as being unpatentable over Yang (US Pub No. 2016/0166159) in the view of Akkus (NPL: “Deep learning for brain MRI segmentation: state of art and future directions”) and Kang (WO 2017139895) and in further view of Tajbakhsh (NPL: “comparing two class of end-to-end machine learning models in lung nodule detection and classification: MTANNs vs. CNNs”.).
Regarding claim 10, Yang teaches the brain imaging system according to claim 1, wherein the processor is further configured to: using different type of images to identify brain lesions (paras. 0038 and 0071; the system uses images from MRI and CT imaging systems to process them to produce various perfusion maps including CBV, VBF, MTT and DT, and further create a color-coded tissue status map consisting of an infarct (red) 702 and penumbra (green) regions overlaid on the corresponding raw image.).
However, Yang fails to explicitly teach select, according to type of the one or more target brain lesions, the third deep learning model from a plurality of candidate deep learning models having been trained for identifying different types of brain lesions, wherein the plurality of candidate deep learning models are trained by a plurality of training sets having different types of images, respectively.
Tajbakhsh, in the same field of endeavor, teaches select, according to type of the one or more target lesions, the third deep learning model from a plurality of candidate deep learning models having been trained for identifying different types of lesions, wherein the plurality of candidate deep learning models are trained by a plurality of training sets (pages 481 and 485; The training set in the division scenario consisted of patches from 10 malignant nodules and 60 benign nodules (because of the 6 MTANNs in the ensemble), and the testing set consisted of the patches from 66 malignant nodules and 353 benign nodules. During the testing stage, the probability of each ROI being a malignant nodule was computed as the average of probabilities assigned to the patches that were extracted from the ROI with data augmentation. For performance comparison, we used ROC analysis. As can be seen, CNNs with varying depths performed comparably, yielding no significant performance improvement compared to each other. However, the MTANNs achieved a substantial improvement over the CNN-based systems. compared the performance of the CNNs and MTANNs after being trained using limited training data. Our experiments showed that the performance of the MTANNs was higher than that of the CNNs for both lung nodule detection and classification. In the second scenario, we used large training datasets for training the CNNs. We observed a lower performance gap between the two models, but the difference was still significant. The examiner notes that the testing and validation of different deep learning models shows the candidate model with the best performance to detect lesions).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang in the view of Akkus and Kang to incorporate the teaching Tajbakhsh to include the testing and validation of different deep learning models to select the candidate deep learning model for lesion detection. Doing so will help to compare different models and select the best performance model as taught within Tajbakhsh in page 485.
Regarding claim 11, Yang teaches the brain imaging system according to claim 10, using different type of images to identify brain lesions (paras. 0038 and 0071; the system uses images from MRI and CT imaging systems to process them to produce various perfusion maps including CBV, VBF, MTT and DT, and further create a color-coded tissue status map consisting of an infarct (red) 702 and penumbra (green) regions overlaid on the corresponding raw image.).
However, Yang fails to explicitly teach the candidate deep learning models are trained by the different images, and the trained candidate deep learning models are each tested to determine whether or not each of the candidate deep learning models can be selected to identify the one or more target lesions.
Tajbakhsh, in the same field of endeavor, teaches the candidate deep learning models are trained by the different images, and the trained candidate deep learning models are each tested to determine whether or not each of the candidate deep learning models can be selected to identify the one or more target lesions (pages 481 and 485; The training set in the division scenario consisted of patches from 10 malignant nodules and 60 benign nodules (because of the 6 MTANNs in the ensemble), and the testing set consisted of the patches from 66 malignant nodules and 353 benign nodules. During the testing stage, the probability of each ROI being a malignant nodule was computed as the average of probabilities assigned to the patches that were extracted from the ROI with data augmentation. For performance comparison, we used ROC analysis. As can be seen, CNNs with varying depths performed comparably, yielding no significant performance improvement compared to each other. However, the MTANNs achieved a substantial improvement over the CNN-based systems. compared the performance of the CNNs and MTANNs after being trained using limited training data. Our experiments showed that the performance of the MTANNs was higher than that of the CNNs for both lung nodule detection and classification. In the second scenario, we used large training datasets for training the CNNs. We observed a lower performance gap between the two models, but the difference was still significant. The examiner notes that the testing and validation of different deep learning models shows the candidate model with the best performance to detect lesions).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang in the view of Akkus and Kang to incorporate the teaching Tajbakhsh to include the testing and validation of different deep learning models to select the candidate deep learning model for lesion detection. Doing so will help to compare different models and select the best performance model as taught within Tajbakhsh in page 485.
Regarding claim 12, Yang teaches the brain imaging system according to claim 11, wherein the one or more target brain lesions includes one or more of infarction areas, tumors, tumor metastasis, lymph nodes and lesions associated with dementia (para. 0071; the ischemic penumbra and infarct identified by the current method has the potential to more accurately reflect the tissue status at the acute stage).
Regarding claim 22, Yang teaches the brain imaging method according to claim 13, wherein further configuring the processor: using different type of images to identify brain lesions (paras. 0038 and 0071; the system uses images from MRI and CT imaging systems to process them to produce various perfusion maps including CBV, VBF, MTT and DT, and further create a color-coded tissue status map consisting of an infarct (red) 702 and penumbra (green) regions overlaid on the corresponding raw image.).
However, Yang fails to explicitly teach select, according to type of the one or more target brain lesions, the third deep learning model from a plurality of candidate deep learning models having been trained for identifying different types of brain lesions, wherein the plurality of candidate deep learning models are trained by a plurality of training sets having different types of images, respectively.
Tajbakhsh, in the same field of endeavor, teaches select, according to type of the one or more target lesions, the third deep learning model from a plurality of candidate deep learning models having been trained for identifying different types of lesions, wherein the plurality of candidate deep learning models are trained by a plurality of training sets (pages 481 and 485; The training set in the division scenario consisted of patches from 10 malignant nodules and 60 benign nodules (because of the 6 MTANNs in the ensemble), and the testing set consisted of the patches from 66 malignant nodules and 353 benign nodules. During the testing stage, the probability of each ROI being a malignant nodule was computed as the average of probabilities assigned to the patches that were extracted from the ROI with data augmentation. For performance comparison, we used ROC analysis. As can be seen, CNNs with varying depths performed comparably, yielding no significant performance improvement compared to each other. However, the MTANNs achieved a substantial improvement over the CNN-based systems. compared the performance of the CNNs and MTANNs after being trained using limited training data. Our experiments showed that the performance of the MTANNs was higher than that of the CNNs for both lung nodule detection and classification. In the second scenario, we used large training datasets for training the CNNs. We observed a lower performance gap between the two models, but the difference was still significant. The examiner notes that the testing and validation of different deep learning models shows the candidate model with the best performance to detect lesions).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang in the view of Akkus and Kang to incorporate the teaching Tajbakhsh to include the testing and validation of different deep learning models to select the candidate deep learning model for lesion detection. Doing so will help to compare different models and select the best performance model as taught within Tajbakhsh in page 485.
Regarding claim 23, Yang teaches the brain imaging method according to claim 22, using different type of images to identify brain lesions (paras. 0038 and 0071; the system uses images from MRI and CT imaging systems to process them to produce various perfusion maps including CBV, VBF, MTT and DT, and further create a color-coded tissue status map consisting of an infarct (red) 702 and penumbra (green) regions overlaid on the corresponding raw image.).
However, Yang fails to explicitly teach the candidate deep learning models are trained by the different images, and the trained candidate deep learning models are each tested to determine whether or not each of the candidate deep learning models can be selected to identify the one or more target lesions.
Tajbakhsh, in the same field of endeavor, teaches the candidate deep learning models are trained by the different images, and the trained candidate deep learning models are each tested to determine whether or not each of the candidate deep learning models can be selected to identify the one or more target lesions (pages 481 and 485; The training set in the division scenario consisted of patches from 10 malignant nodules and 60 benign nodules (because of the 6 MTANNs in the ensemble), and the testing set consisted of the patches from 66 malignant nodules and 353 benign nodules. During the testing stage, the probability of each ROI being a malignant nodule was computed as the average of probabilities assigned to the patches that were extracted from the ROI with data augmentation. For performance comparison, we used ROC analysis. As can be seen, CNNs with varying depths performed comparably, yielding no significant performance improvement compared to each other. However, the MTANNs achieved a substantial improvement over the CNN-based systems. compared the performance of the CNNs and MTANNs after being trained using limited training data. Our experiments showed that the performance of the MTANNs was higher than that of the CNNs for both lung nodule detection and classification. In the second scenario, we used large training datasets for training the CNNs. We observed a lower performance gap between the two models, but the difference was still significant. The examiner notes that the testing and validation of different deep learning models shows the candidate model with the best performance to detect lesions).
It would have been obvious to an ordinary skilled in the art before the invention was made to modify the device of Yang in the view of Akkus and Kang to incorporate the teaching Tajbakhsh to include the testing and validation of different deep learning models to select the candidate deep learning model for lesion detection. Doing so will help to compare different models and select the best performance model as taught within Tajbakhsh in page 485.
Regarding claim 24, Yang teaches the brain imaging method according to claim 23, wherein the one or more target brain lesions includes one or more of infarction areas, tumors, tumor metastasis, lymph nodes and lesions associated with dementia (para. 0071; the ischemic penumbra and infarct identified by the current method has the potential to more accurately reflect the tissue status at the acute stage).
Response to Arguments
Applicant's arguments filed on 10/20/2025 have been fully considered but they are not persuasive. The applicant argues that Yang in the view of Akkus and Kang fail to disclose “select, by using a second deep learning model having been trained, second features from the second enhanced image set that are optimal for brain lesion identification; and identify, by inputting the second features to a third deep learning model having been trained, position information and volume information of one or more target brain lesions in the brain of the patient”. The examiner respectfully disagrees. Yang teaches a computer program to load data and/or images into memory at step 902, where the data has been retrieved from any one of the scanners 602, 604 or PACS 606, including the signal intensities containing information of the contrast agent. At step 904 the program performs various pre-processing including (i) motion correction; (ii) detection of AIF and VOF; (iii) setting baseline time period before contrast arrival; and (iv) converting a signal intensity profile to contrast concentration time curve. At step 906, the program process data on a pixel-by-pixel basis to produce various perfusion maps using a model-free deconvolution technique such as the singular value decomposition (SVD) technique by taking into account arterial delay and dispersion effects. The various perfusion maps including CBV, VBF, MTT and DT. At step 908, the program identifies ischemic pixels where DT is greater than a predetermined first threshold value and CBV is below a second threshold value. At step 910, the program identifies the infarct portion of the ischemic lesion, where DT is greater than a predetermined third threshold value and/or CBV is below a fourth threshold value. The ischemic penumbra can be identified at step 914, by the mismatch region between the ischemic lesion and infarct. Then a tissue status map can be created to display the infarct (red) 702 surrounded by the penumbra (green) 704 as a color overlay on the corresponding raw image. At step 916, the program measures the penumbra volume as a percentage of the total said ischemic lesion to determine treatment of the acute stroke patient [paras. 0071-0078]. The applicant argues that Yang does not disclose how the second features are selected, however, Yang teaches using the preprocessed images to derive DT and CBV maps which are the second features used to identify brain lesions. The DT and CBV maps are used to create a color coded tissue status map that segments the lesion and measures the volume. The examiner notes that although Yang disclose the method of using image data to extract features and using the extracted features to identify brain lesions, however, fails to teach that this method is preformed using machine learning models that receives image data and extract features to be used as an input to train another machine learning model to generate a segmented map of brain abnormalities. Thus, the examiner found that it would have been obvious to modify the models of Yang with the machine learning models of Akkus to produce a machine learning model that extract features from inputted image data and input the extracted features into another machine learning model to further tune the results of the first model and provide a final segmentation of the lesion. This modification would lead to more accurate and robust lesion detection because machine learning models can automatically learn features from brain images that traditional mathematical models often miss. By extracting these learned features and using them for classification, the system adapts better to variations in anatomy, imaging conditions, and lesion appearance.
Conclusion
Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to ZAINAB M ALDARRAJI whose telephone number is (571)272-8726. The examiner can normally be reached Monday-Thursday7AM-5PM EST.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Carey Michael can be reached at (571) 270-7235. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/ZAINAB MOHAMMED ALDARRAJI/Patent Examiner, Art Unit 3797
/MICHAEL J CAREY/Supervisory Patent Examiner, Art Unit 3795