DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Double Patenting
The nonstatutory double patenting rejection is based on a judicially created doctrine grounded in public policy (a policy reflected in the statute) so as to prevent the unjustified or improper timewise extension of the “right to exclude” granted by a patent and to prevent possible harassment by multiple assignees. A nonstatutory double patenting rejection is appropriate where the conflicting claims are not identical, but at least one examined application claim is not patentably distinct from the reference claim(s) because the examined application claim is either anticipated by, or would have been obvious over, the reference claim(s). See, e.g., In re Berg, 140 F.3d 1428, 46 USPQ2d 1226 (Fed. Cir. 1998); In re Goodman, 11 F.3d 1046, 29 USPQ2d 2010 (Fed. Cir. 1993); In re Longi, 759 F.2d 887, 225 USPQ 645 (Fed. Cir. 1985); In re Van Ornum, 686 F.2d 937, 214 USPQ 761 (CCPA 1982); In re Vogel, 422 F.2d 438, 164 USPQ 619 (CCPA 1970); In re Thorington, 418 F.2d 528, 163 USPQ 644 (CCPA 1969).
A timely filed terminal disclaimer in compliance with 37 CFR 1.321(c) or 1.321(d) may be used to overcome an actual or provisional rejection based on nonstatutory double patenting provided the reference application or patent either is shown to be commonly owned with the examined application, or claims an invention made as a result of activities undertaken within the scope of a joint research agreement. See MPEP § 717.02 for applications subject to examination under the first inventor to file provisions of the AIA as explained in MPEP § 2159. See MPEP § 2146 et seq. for applications not subject to examination under the first inventor to file provisions of the AIA . A terminal disclaimer must be signed in compliance with 37 CFR 1.321(b).
The filing of a terminal disclaimer by itself is not a complete reply to a nonstatutory double patenting (NSDP) rejection. A complete reply requires that the terminal disclaimer be accompanied by a reply requesting reconsideration of the prior Office action. Even where the NSDP rejection is provisional the reply must be complete. See MPEP § 804, subsection I.B.1. For a reply to a non-final Office action, see 37 CFR 1.111(a). For a reply to final Office action, see 37 CFR 1.113(c). A request for reconsideration while not provided for in 37 CFR 1.113(c) may be filed after final for consideration. See MPEP §§ 706.07(e) and 714.13.
The USPTO Internet website contains terminal disclaimer forms which may be used. Please visit www.uspto.gov/patent/patents-forms. The actual filing date of the application in which the form is filed determines what form (e.g., PTO/SB/25, PTO/SB/26, PTO/AIA /25, or PTO/AIA /26) should be used. A web-based eTerminal Disclaimer may be filled out completely online using web-screens. An eTerminal Disclaimer that meets all requirements is auto-processed and approved immediately upon submission. For more information about eTerminal Disclaimers, refer to www.uspto.gov/patents/apply/applying-online/eterminal-disclaimer.
Claims 1-3, 6-13, and 16-20 are rejected on the ground of nonstatutory double patenting as being unpatentable over claims 1-20 of U.S. Patent No. US 12142039 B1. Although the claims at issue are not identical, they are not patentably distinct from each other because all the limitations in claim 1 is anticipated by claim 1 of the U.S. Patent No. US 12142039 B1.
Application 18941907
Claim 1
U.S. Patent No. US 12142039 B1
Claim 1
1. A system, comprising:
1. A system, comprising:
one or more processors; and
one or more processors; and
memory coupled to the one or more processors, the memory storing instructions executable by the one or more processors to perform operations comprising:
memory coupled to the one or more processors, the memory storing instructions executable by the one or more processors to perform operations comprising:
receiving sensor data representing a physical environment;
receiving environment information from an electronic device, the environment information including data representing a physical environment and a physical object within the physical environment;
identifying, based on the sensor data, a physical object within the physical environment;
identifying the physical object using a trained machine learning model, based at least in part on the environment information;
determining required data associated with the physical object;
determining, based at least in part on the identification of the physical object, required data associated with the physical object for an insurance claim;
presenting, on an electronic display, an augmented or mixed reality interface including a representation of the physical environment;
presenting, on a display of the electronic device and based at least in part on the environment information, an augmented or mixed reality representation of the physical environment, including a representation of a virtual assistant;
causing, within the augmented or mixed reality interface representation of the physical environment, a virtual assistant to indicate the physical object and present a request for the required data at a location relative to the physical object;
presenting, via the augmented or mixed reality representation, a request for the required data associated with the physical object, wherein presenting the request includes causing the virtual assistant to point to or otherwise non-verbally indicate the physical object within the augmented or mixed reality representation of the physical environment;
receiving, via an input device of the system, an input provided by a user responsive to the request for the required data; and
receiving, from the electronic device, an input provided by a user responsive to the request for the required data; and
initiating an automated process on the system, based on the input and an attribute of the physical object.
generating the insurance claim based at least in part on the input and the identity of the physical object.
Claims 2-3, 6-13, and 16-20
Claims 2-20
Claims 1-3, 6-13, and 16-20 are rejected on the ground of nonstatutory double patenting as being unpatentable over claims 1-20 of U.S. Patent No. US 11393198 B1 in view of Liu (US 20130050258 A1). Although the claims at issue are not identical, they are not patentably distinct from each other.
Application 18941907
Claim 1
US 11393198 B1
Claim 1
1. A system, comprising:
1. A method, comprising:
one or more processors; and
by one or more processors:
memory coupled to the one or more processors, the memory storing instructions executable by the one or more processors to perform operations comprising:
receiving pupil data via a network from an electronic device, the pupil data indicating a gaze direction of a user associated with an environment;
receiving sensor data representing a physical environment;
receiving environment information from the electronic device via the network, the environment information including point cloud data representing the environment and a plurality of objects located within the environment;
identifying, based on the sensor data, a physical object within the physical environment;
determining required data associated with the physical object;
determining an identity of an object of the plurality of objects based at least in part on the gaze direction and the environment information;
presenting, on an electronic display, an augmented or mixed reality interface including a representation of the physical environment;
presenting, on a display of the electronic device and based at least in part on the environment information, an image including: a three-dimensional representation of at least a portion of the environment including the object, and
causing, within the augmented or mixed reality interface representation of the physical environment, a virtual assistant to indicate the physical object and present a request for the required data at a location relative to the physical object;
a three-dimensional representation of an assistant providing a request corresponding to the object, wherein the request is provided via the display and the assistant is in the shape of a human;
receiving, via an input device of the system, an input provided by a user responsive to the request for the required data; and
receiving, from the electronic device and via the network, information indicative of an input provided by the user, the input corresponding to the object, and comprising a hand gesture; and
initiating an automated process on the system, based on the input and an attribute of the physical object.
generating an insurance claim based at least in part on the hand gesture and the identity of the object.
Claims 2-3, 6-13, and 16-20
Claims 2-20
The claim 1 of US 11393198 B1 fails to explicitly disclose “memory coupled to the one or more processors, the memory storing instructions executable by the one or more processors to perform operations”. In same field of endeavor, Liu (US 20130050258 A1) discloses “memory coupled to the one or more processors, the memory storing instructions executable by the one or more processors to perform operations” in Fig. 1 and paragraphs [0044], [0046], and [0107]. The motivation for doing so would have been to display augmented reality images as taught by Liu in Fig. 8 and paragraph [0107].
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1, 4-8, 10-11, 14-18, and 20 are rejected under 35 U.S.C. 103 as being unpatentable over Liu (US 20130050258 A1) in view of Schmitt (US 20090326989 A1), in view of Lebaredian (US 20210358188 A1), and further in view of Brown (US 20200143481 A1).
Regarding to claim 1, Liu discloses a system (Fig. 1; [0041]: a block diagram depicts components of an HMD device and hub computer system; Fig. 1; [0044]: the processor executes instructions stored on a processor readable storage device; Fig. 8; [0107]: a process for associating a data stream with a real-world object; display augmented reality images), comprising:
one or more processors (Fig. 1; [0044]: the processor executes instructions stored on a processor readable storage device; Fig. 1; [0046]: the hub computing system 12 includes a processor that executes instructions stored on a processor readable storage device); and
memory coupled to the one or more processors, the memory storing instructions executable by the one or more processors to perform operations (Fig. 1; [0044]: the processor executes instructions stored on a processor readable storage device; [0046]: execute instructions stored on a processor readable storage device; Fig. 8; [0107]: a process for associating a data stream with a real-world object; display augmented reality images) comprising:
receiving sensor data representing a physical environment ([0057]: receive an augmented reality image from micro-display; Fig. 3; [0062]: receive sensory information from hub computing device 12; [0069]: a depth map of a user's living room is made; the depth map identifies walls, furniture and so forth which characterize the room; provide a 3d model of the environment; [0078]: the HMD device creates a model of the environment that the user is in and track various objects in that environment; [0080]: a depth camera captures a depth image of a scene; Fig. 1; [0101]: the hub generates the model of the environment and provides that model to all of the mobile terminals in communication with the hub; transfer that information to each of the mobile terminals);
identifying, based on the sensor data, a physical object within the physical environment (Fig. 15A; [0135]: the user 1500 wearing the HMD device 2 looks in a gaze direction 1512 toward an object 1502; other objects in the scene include a flowerpot 1504 on a table 1506; identify wall-hanging picture in a room; Fig. 16B; [0139]: the object has been identified by the user as an object which is to be associated with a data stream, e.g., based on the user gazing at the object for a period of time, making a gesture such as pointing at the object and/or providing a verbal command; [0153]: the fact that the user is gazing at the billboard is determined by recognizing the billboard in the field of view of the HMD device);
determining required data associated with the physical object ([0064]: obtain depth data, i.e. required data, for objects in a room, indicating the distance from the cameras/HMD device to the object; [0065]: images from forward-facing cameras identify people, hand gestures and other objects in a field of view of the user; [0081]: determine a physical distance, i.e. required data, from the capture device 20 to a particular location on the targets or objects in the scene; [0153]: the fact, i.e. required data, that the user is gazing at the billboard is determined by recognizing the billboard in the field of view of the HMD device);
presenting, on an electronic display, an augmented or mixed reality interface including a representation of the physical environment ([0078]: create a model of the environment that the user is in and track various objects in that environment, based on the field of view of the HMD device; [0105]: the augmented reality image includes a 3-D object; Fig. 8; [0107]: the HMD device displays augmented reality images of one or more data streams which have been associated with the real-world object; Fig. 16F; [0143]: select the augmented reality images 1632 and 1634 by the user;
PNG
media_image1.png
374
534
media_image1.png
Greyscale
; present additional augmented reality images 1641 and 1643);
receiving, via an input device of the system, an input provided by a user responsive to the request for the required data ([0065]: identify people, hand gestures and other objects in a field of view of the user; the user makes a hand gesture; [0135]: the user 1500 wearing the HMD device 2 looks in a gaze direction 1512 toward an object 1502, such as a wall-hanging picture; Fig. 16B; [0139]: the object has been identified by the user as an object which is to be associated with a data stream, e.g., based on the user gazing at the object for a period of time, making a gesture such as pointing at the object and/or providing a verbal command; the user makes a verbal command such as next step to proceed; [0142]: the user enters a command to have different candidates displayed; [0153]: the fact that the user is gazing at the billboard could also be determined by recognizing the billboard in the field of view of the HMD device);
Liu fails to explicitly disclose:
causing, within the augmented or mixed reality interface representation of the physical environment, a virtual assistant to indicate the physical object and present a request for the required data at a location relative to the physical object; and
initiating an automated process on the system, based on the input and an attribute of the physical object.
In same field of endeavor, Schmitt teaches:
present a request for the required data at a location relative to the physical object (Fig. 7; [0033]: a screen provides request for editing the insured's profile, e.g. with updated personal information; display a profile including his or her personal information; Fig. 8; [0034]: interactively add a lost or damaged item of insured property to a claim from the insured side of the web site; a request for selecting a list of categories of household items, i.e. physical objects; Fig. 9; [0034]: present and submit the categorized lists of damaged or lost items, i.e. physical objects; various information are tabulated and displayed, including item number, description, quantity, unit cost, total original cost and replacement cost; the insurance claim inventory is submitted to the adjuster 10 for review, verification, adjustment and claim payment);
initiating an automated process on the system, based on the input and an attribute of the physical object (Fig. 4; [0032]: generate reports of the claim settlement at 74 according to the procedures of the insurer 6; Fig. 8; Fig. 9; [0034]: office, kitchen, and garage are environment information; generate insurance claim based on item-specific information which includes environment information, such as, office, kitchen, and garage, information indicative, and damaged item name in an automated process; generate a comprehensive insurance claim inventory report based on the categorized lists of damaged or lost items, as shown in FIG. 9).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Liu to include present a request for the required data at a location relative to the physical object; initiating an automated process on the system, based on the input and an attribute of the physical object as taught by Schmitt. The motivation for doing so would have been to improve the process for both the insurers and the insureds/claimants; to generate a comprehensive insurance claim inventory report as taught by Schmitt in paragraphs [0006] and [0034].
Liu in view of Schmitt fails to explicitly disclose:
causing, within the augmented or mixed reality interface representation of the physical environment, a virtual assistant to indicate the physical object.
In same field of endeavor, Lebaredian teaches:
causing, within the augmented or mixed reality interface representation of the physical environment, a virtual assistant to indicate the object (or is optional; Fig. 2B; [0051]: the video conference, i.e. physical environment, includes an AI agent 204; the AI agent 204B is a virtual assistant and is within a virtual environment 206; the AI agent 204B points to the window, and speaks to the properties of the window, e.g., dimensions, materials, etc., based on some conversation, gestures, and inputs form the users 202;
PNG
media_image2.png
429
542
media_image2.png
Greyscale
; update the CAD file corresponding to the architectural plan 208, i.e. in physical environment; [0075]: the computing device 400 renders immersive augmented reality or virtual reality).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Liu in view of Schmitt to include causing, within the augmented or mixed reality interface representation of the physical environment, a virtual assistant to indicate the object as taught by Lebaredian. The motivation for doing so would have been to generate a virtual representation of the location, with cloudy skies and rain falling; to make the AI agent 204B point to the window, and speak to the properties of the window, e.g., dimensions, materials, etc., based on some conversation, gestures, and inputs form the users 202 as taught by Lebaredian in Fig. 2B and paragraphs [0035] and [0051].
Liu in view of Schmitt and Lebaredian fails to explicitly disclose: the object is the physical object.
In same field of endeavor, Brown teaches the object is the physical object (Fig. 14; [0192]: capture digital images and video of the damage 1404 of a roof, i.e. physical object;
PNG
media_image3.png
436
544
media_image3.png
Greyscale
; [0215]: display user interface icons over a 3D generated model that represents a user's house, i.e. physical object).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Liu in view of Schmitt and Lebaredian to include the object is the physical object as taught by Brown. The motivation for doing so would have been to improve the loss response; to reduce processing time of the loss data 1114 when analyzing the reported loss; to automatically identify objects within the digital image 1110, such as the object recognition techniques; to improve object recognition and damage identification in digital images; to display user interface icons over a 3D generated model that represents a user's house as taught by Brown in paragraphs [0057], [0164-0165], [0199], and [0215]
Regarding to claim 4, Liu in view of Schmitt, Lebaredian and Brown discloses the system of claim 1, wherein determining the required data associated with the physical object (same as rejected in claim 1) comprises:
based on identifying the physical object, retrieving, from a database, metadata associated with the physical object (Brown; [0047]: locations of shelters and time; [0087]: current location of the property; [0165]: the image processing component 1014 verifies when the digital image 1110 was taken, e.g., from metadata associated with the digital image; [0188]: the image processing component 1014 identifies a time stamp associated with the digital images from metadata received with the digital images; [0241]: retrieve the policy data for the users that have property from a database for analysis and/or processing; [0243]: retrieve data from a database); and
determining, based on the sensor data and the retrieved metadata, the required data associated with the physical object (Brown; [0074]: determine different rooms in a building, and what items are included in different rooms; [0193]: the reporting verification component 1030 verifies that the damage 1404 documented in digital images and video submitted by the user 1402 coordinates with the damage as documented by the drone 1408, including but not limited to comparing time stamps, comparing extent of the damage, comparing locations of the damage, and so on).
Same motivation of claim 1 is applied here.
Regarding to claim 5, Liu in view of Schmitt, Lebaredian and Brown discloses the system of claim 1, wherein:
identifying the physical object comprises detecting the physical object as a damaged object (Schmitt; Fig. 9; [0034]: determine and submit the categorized lists of damaged or lost items; submit lost property claims; [0035]: adjust a property loss claim; identify the damaged or lost items); and
determining the required data associated with the physical object comprises determining a request based on damage detected to the physical object (Schmitt; Fig. 8; Fig. 9; [0034]: office, kitchen, and garage are environment information; generate insurance claim based on item-specific information which includes environment information, such as, office, kitchen, and garage, information indicative, and damaged item name; generate a comprehensive insurance claim inventory report based on the categorized lists of damaged or lost items, as shown in FIG. 9; [0035]: adjust a property loss claim; identify the damaged or lost items).
Same motivation of claim 1 is applied here.
Regarding to claim 6, Liu in view of Schmitt, Lebaredian and Brown discloses the system of claim 1, wherein the input comprises an indication of a gesture or utterance and the operations (Liu; [0127]: the user provides the voice command "select" or "yes" to determine and select a currently highlighted augmented reality image; Fig. 16B; [0139]: the object has been identified by the user as an object which is to be associated with a data stream, e.g., based on the user gazing at the object for a period of time, making a gesture such as pointing at the object and/or providing a verbal command; Fig. 16F; [0143]: the user selects two of the three initial candidates, namely the augmented reality images 1632 and 1634, using a voice command or gesture) further comprising:
confirming the identity of the object based on the indication of the gesture or utterance (Liu; [0065]: identify people, hand gestures and other objects in a field of view of the user; the user makes a hand gesture; Fig. 3; [0111]: detect a user hand gesture; detect a user voice command; [0127]: the user provides the voice command "select" or "yes" to determine and select a currently highlighted augmented reality image; Fig. 16F; [0143]: the user selects two of the three initial candidates, namely the augmented reality images 1632 and 1634, using a voice command or gesture).
Regarding to claim 7, Liu in view of Schmitt, Lebaredian and Brown discloses the system of claim 1, wherein the sensor data represents the physical environment at a first time and the operations (Liu; [0057]: receive an augmented reality image from micro display; Fig. 3; [0062]: receive sensory information from hub computing device 12; [0069]: a depth map of a user's living room is made; the depth map identifies walls, furniture and so forth which characterize the room; provide a 3d model of the environment; [0078]: the HMD device creates a model of the environment that the user is in and track various objects in that environment; Fig. 1; [0101]: the hub generates the model of the environment and provides that model to all of the mobile terminals in communication with the hub; transfer that information to each of the mobile terminals) further comprising:
receiving second sensor data representing the physical environment at a second time prior to the first time (Liu; [0047]: the surrounding space are captured, analyzed, and tracked to perform one or more controls or actions; Fig. 2; [0051]: the visible light video camera 113; one visible light video camera 113 captures video; Fig. 5; [0079]: capture device 20 captures video with depth information in different times; [0105]: render the augmented reality image is in synchronism with content displayed on a video display screen; [0152]: the user's head has another orientation); and
presenting, on the electronic display, based on the second sensor data, a representation of the physical object at the second time (Liu; [0054]: video images; [0105]: rendering the augmented reality image is in synchronism with content displayed on a video display screen; [0105]: the augmented reality image includes a 3-D object).
Regarding to claim 8, Liu in view of Schmitt, Lebaredian and Brown discloses the system of claim 1, wherein identifying the physical object (same as rejected in claim 1) comprises:
determining an object identifier associated with the physical object, wherein determining the required data is based at least in part on the object identifier (Liu; [0067]: the location is learned from an identifier; [0069]: a depth map of an environment of the user is saved and used as an identifier of the location; [0110]: the RFID tag of an object responds by transmitting an identifier; [0128]: the record identifies the one or more selected data streams such as by a URL or other web address, file name, or other data source identifier; Fig. 13B; [0132]: the record 1310 includes an object and/or object class identifier 1312, one or more visual characteristics 1314, one or more types of location data 1316, privacy settings 1318 and one or more data streams 1320 which are associated with the object or object class).
Regarding to claim 10, Liu in view of Schmitt, Lebaredian and Brown discloses the system of claim 1, wherein identifying the physical object (same as rejected in claim 1) comprises:
determining, based on the sensor data, an object identifier associated with the physical object, wherein determining the required data is based at least in part on the object identifier (Liu; [0110]: the RFID tag of an object responds by transmitting an identifier; [0128]: the record identifies the one or more selected data streams such as by a URL or other web address, file name, or other data source identifier; Fig. 13B; [0132]: the record 1310 includes an object and/or object class identifier 1312, one or more visual characteristics 1314, one or more types of location data 1316, privacy settings 1318 and one or more data streams 1320 which are associated with the object or object class).
Regarding to claim 11, Liu discloses a method (Fig. 1; [0041]: a block diagram depicts components of an HMD device and hub computer system; Fig. 1; [0044]: the processor executes instructions stored on a processor readable storage device; Fig. 8; [0107]: a process for associating a data stream with a real-world object; display augmented reality images) comprising:
a mobile computing device (Fig. 1; [0101]: the hub generates the model of the environment and provides that model to all of the mobile terminals in communication with the hub; transfer that information to each of the mobile terminals);
the rest claim limitations are similar to claim limitations recited in claim 1. Therefore, same rational used to reject claim 1 is also used to reject claim 11.
Regarding to claim 14, Liu in view of Schmitt, Lebaredian and Brown discloses the method of claim 11,
The rest claim limitations are similar to claim limitations recited in claim 4. Therefore, same rational used to reject claim 4 is also used to reject claim 14.
Regarding to claim 15, Liu in view of Schmitt, Lebaredian and Brown discloses the method of claim 11, wherein:
The rest claim limitations are similar to claim limitations recited in claim 5. Therefore, same rational used to reject claim 5 is also used to reject claim 15.
Regarding to claim 16, Liu in view of Schmitt, Lebaredian and Brown discloses the method of claim 11,
The rest claim limitations are similar to claim limitations recited in claim 6. Therefore, same rational used to reject claim 6 is also used to reject claim 16.
Regarding to claim 17, Liu in view of Schmitt, Lebaredian and Brown discloses the method of claim 11,
The rest claim limitations are similar to claim limitations recited in claim 7. Therefore, same rational used to reject claim 7 is also used to reject claim 17.
Regarding to claim 18, Liu in view of Schmitt, Lebaredian and Brown discloses the method of claim 11,
The rest claim limitations are similar to claim limitations recited in claim 8. Therefore, same rational used to reject claim 8 is also used to reject claim 18.
Regarding to claim 20, Liu in view of Schmitt, Lebaredian and Brown discloses the method of claim 11,
The rest claim limitations are similar to claim limitations recited in claim 10. Therefore, same rational used to reject claim 10 is also used to reject claim 20.
Claims 2-3, 9, 12-13, and 19 are rejected under 35 U.S.C. 103 as being unpatentable over Liu (US 20130050258 A1) in view of Schmitt (US 20090326989 A1), in view of Lebaredian (US 20210358188 A1), in view of Brown (US 20200143481 A1), and further in view of Flick (US 10137984 B1).
Regarding to claim 2, Liu in view of Schmitt, Lebaredian and Brown discloses the system of claim 1, wherein identifying the physical object (same as rejected in claim 1) comprises:
providing the sensor data to a trained image recognition machine learning engine (Lebaredian; [0027]: train machine learning and/or deep learning models using custom data; [0087]: a machine learning model(s) is trained by calculating weight parameters; the trained or deployed machine learning models corresponding to one or more neural networks receive input to infer or predict information; [0088]: image recognition; allow users to train or performing inferencing of information, such as image recognition, speech recognition, or other artificial intelligence services); and
Liu in view of Schmitt, Lebaredian and Brown fails to explicitly disclose:
identifying the physical object based on an output of the trained image recognition machine learning engine.
In same field of endeavor, Flick teaches:
identifying the physical object based on an output of the trained image recognition machine learning engine (col. 18, lines 10-20: train a machine learning program; determine and estimate damages to property and personal articles using a trained machine program; generate a proposed insurance claim based upon the estimate amount of damages; col. 20, lines 15-25: machine learning program is trained to determine or estimate damages to property and/or personal articles; col. 21, lines 1-10: a machine learning program is trained to identify abnormal conditions; col. 33, lines 10-20: train a machine learning program to identify damaged home features or personal articles).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Liu in view of Schmitt, Lebaredian and Brown to include identifying the physical object based on an output of the trained image recognition machine learning engine as taught by Flick. The motivation for doing so would have been to determine and estimate damages to property and personal articles using a trained machine program; to generate a proposed insurance claim based upon the estimate amount of damages as taught by Flick in col. 18, lines 10-20, col, 20, lines 15-25, and col. 21, lines 1-10.
Regarding to claim 3, Liu in view of Schmitt, Lebaredian, Brown, and Flick discloses the system of claim 2, wherein the image recognition machine learning engine is trained to automatically recognize damaged objects (Flick; col. 18, lines 10-20: a machine learning program is trained to automatically determine or estimate damages to property and personal articles; generate a proposed insurance claim based upon the estimate amount of damages; col. 20, lines 15-25: machine learning program is trained to determine or estimate damages to property and/or personal articles; col. 21, lines 1-10: a machine learning program is trained to identify and recognize abnormal conditions; col. 33, lines 10-20: Flick teaches training a machine learning program to automatically identify and recognize damaged home features or personal articles).
Same motivation of claim 2 is applied here.
Regarding to claim 9, Liu in view of Schmitt, Lebaredian and Brown discloses the system of claim 1, wherein the sensor data represents the physical environment at a first time and the operations (Liu; [0057]: receive an augmented reality image from micro display; Fig. 3; [0062]: receive sensory information from hub computing device 12; [0069]: a depth map of a user's living room is made; the depth map identifies walls, furniture and so forth which characterize the room; provide a 3d model of the environment; [0078]: the HMD device creates a model of the environment that the user is in and track various objects in that environment; Fig. 1; [0101]: the hub generates the model of the environment and provides that model to all of the mobile terminals in communication with the hub; transfer that information to each of the mobile terminals) further comprising:
Liu in view of Schmitt, Lebaredian and Brown fails to explicitly disclose:
receiving second sensor data representing the physical environment at a second time prior to the first time; and
automatically determining damage to the physical object, based on comparing the first sensor data and the second sensor data.
In same field of endeavor, Flick teaches:
receiving second sensor data representing the physical environment at a second time prior to the first time (Flick; col. 18, lines 1-10: collect and receive sensor data; the sensor data is associated with the impacted area within the property before, during, and/or after the insurance-related event; col. 18, lines 15-25: the sensor data is associated with the interior of the property and personal articles before an insurance-related event); and
automatically determining damage to the physical object, based on comparing the first sensor data and the second sensor data (Flick; col. 18, lines 10-20: a machine learning program is trained to automatically determine or estimate damages to property and personal articles; generate a proposed insurance claim based upon the estimate amount of damages; col. 21, lines 1-10: Flick teaches a machine learning program is trained to automatically identify abnormal conditions; col. 33, lines 10-20: Flick teaches training a machine learning program to automatically identify damaged home features or personal articles).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Liu in view of Schmitt, Lebaredian and Brown to include receiving second sensor data representing the physical environment at a second time prior to the first time; and automatically determining damage to the physical object, based on comparing the first sensor data and the second sensor data as taught by Flick. The motivation for doing so would have been to determine and estimate damages to property and personal articles using a trained machine program; generate a proposed insurance claim based upon the estimate amount of damages as taught by Flick in col. 18, lines 10-20, col, 20, lines 15-25, and col. 21, lines 1-10.
Regarding to claim 12, Liu in view of Schmitt, Lebaredian and Brown discloses the method of claim 11,
The rest claim limitations are similar to claim limitations recited in claim 2. Therefore, same rational used to reject claim 2 is also used to reject claim 12.
Regarding to claim 13, Liu in view of Schmitt, Lebaredian and Brown discloses the method of claim 12,
The rest claim limitations are similar to claim limitations recited in claim 3. Therefore, same rational used to reject claim 3 is also used to reject claim 13.
Regarding to claim 19, Liu in view of Schmitt, Lebaredian and Brown discloses the method of claim 11,
The rest claim limitations are similar to claim limitations recited in claim 9. Therefore, same rational used to reject 9 is also used to reject claim 19.
Conclusion
Any inquiry concerning this communication or earlier communications from the examiner should be directed to Hai Tao Sun whose telephone number is (571)272-5630. The examiner can normally be reached 9:00AM-6:00PM.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Daniel Hajnik can be reached at 5712727642. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/HAI TAO SUN/Primary Examiner, Art Unit 2616
Prosecution Insights