DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claim Status
Claims 1-20 are pending.
Information Disclosure Statement
The IDS filed 02/28/24 is considered.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
Claims 1-3, 5, 7-10, 12, 14-17, and 19 are rejected under 35 U.S.C. 103 as being unpatentable over Rehfeld et al. (US 20230377352 A1 Hereafter “Rehfeld”) in view of Gong et al. (US 20140049659 A1 “Gong”) in further view of Nagata et al. (US 20220212658 A1 Hereinafter “Nagata”).
Regarding claim 1, Rehfeld teaches a system, the system comprising:
a processor ([0028]: “The computer system may comprise a plurality of computer hardware components (for example a processor, for example processing unit or processing network, at least one memory, for example memory unit or memory network, and at least one non-transitory data storage)”); and
a memory storing machine-readable instructions that, when executed by the processor ([0028]: “The computer system may comprise a plurality of computer hardware components (for example a processor, for example processing unit or processing network, at least one memory, for example memory unit or memory network, and at least one non-transitory data storage)”), cause the processor to:
request, in response to a portion of an occupant being occluded in a first sensor data captured from a vehicle sensor in a vehicle cabin, a second ([0045]: “For example, if a person sitting on a rear seat is occluded in the direct line of sight and leaves the vehicle or switches seats while this occlusion persists, a conventional approach only depending on the direct line of side may arrive at detecting a changed state in seat occupancy without any way to explain it. The additional use of detection and tracking of characteristics in the reflective surface resolves this problem by allowing for a continuous monitoring of the state”. The first data is the line of sight data, which is traditionally relied upon for seatbelt detection. In a circumstance where the line of sight is occluded, a second data is relied upon (reflective surface data) to determine seatbelt data); and
determine, in response to the portion of the occupant that is occluded in the first sensor data being visible in the second ([0008]: “In particular, characteristics inside the cabin of the vehicle may be determined, wherein the characteristics may describe, for example, a person or portions of a person, a child-seat, a bag, an empty seat, or the like. The person may be an adult or a child. Also, other kinds of objects like a mobile phone, a laptop, a box or a seat belt may be described by the characteristics”. These characteristics are in the context of vehicle safety “In interior sensing applications, feature functions like seat occupancy detection and seatbelt recognition are fundamental building blocks for both convenience and safety-related system components” [0002]).
Rehfeld does not expressly disclose swapping to a second mobile device camera due to an occlusion.
However, Gong teaches swapping to a second mobile device camera to capture data when the line of sight is occluded (Fig. 2, [0024]: “Once first mobile device 102 has established a persistent communication link with second mobile device 108, first mobile device 102 may control second mobile device 108 to enable media content sensed from a perspective of second mobile device 108 to be consumed using first mobile device 102, and to be captured under control of first mobile device 102. An example of this is seen in FIG. 2. Media content sensed by second mobile device 108 may be streamed to and displayed on first mobile device 102 in real time. This provides the user of first mobile device 102 an unobstructed view of object 104”).
At the time the invention was made, it would have been obvious to one of ordinary skill in the art to modify Rehfeld’s seatbelt detection system for occluded objects to include Gong’s use of a second camera in a mobile device for occluded objects because such a modification is the result of applying a known technique to a known device ready for improvement to yield predictable results. More specifically, Gong’s use of a second camera in a mobile device for occluded objects permits accurate detection of an occluded object by switching to a camera that has line of sight of the object. This known benefit in Gong is applicable to Rehfeld’s seatbelt detection system for occluded objects as they both share characteristics and capabilities, namely, they are directed to imaging systems that deal with occluded objects. Therefore, it would have been recognized that modifying Rehfeld’s seatbelt detection system for occluded objects to include Gong’s use of a second camera in a mobile device for occluded objects would have yielded predictable results because (i) the level of ordinary skill in the art demonstrated by the references applied shows the ability to incorporate Gong’s use of a second camera in a mobile device for occluded objects in imaging systems that deal with occluded objects and (ii) the benefits of such a combination would have been recognized by those of ordinary skill in the art.
While it is presumed that Rehfeld’s seatbelt detection system would raise safety issues for not detecting a seatbelt on an individual since the system is designed for safety-related components ([0002]: ““In interior sensing applications, feature functions like seat occupancy detection and seatbelt recognition are fundamental building blocks for both convenience and safety-related system components”), the combination of Rehfeld and Gong does not expressly disclose determination of safety issue from seatbelt detection.
However, Nagata teaches determination of safety issue by providing a notification ([0040]: “The vehicle 102 may also detect whether the seat belt is being worn correctly. Some occupants may choose to adjust or place both arms on the same side of the shoulder strap of the seat belt or may wear the seat belt such that the shoulder strap is behind the occupant's back. Wearing seat belts improperly reduces the effectiveness of the seat belt and reduces safety of the occupant within the vehicle. Thus, the vehicle 102 may provide an alert or notification to the driver or user when it detects a seat belt is being worn incorrectly”).
At the time the invention was made, it would have been obvious to one of ordinary skill in the art to modify the combination of Rehfeld and Gong’s seatbelt detection system for occluded objects to include Nagata’s determination of safety issues because such a modification is the result of applying a known technique to a known device ready for improvement to yield predictable results. More specifically, Nagata’s determination of safety issues permits accurate detection of safety issues using seat belt detection data. This known benefit in Nagata is applicable to the combination of Rehfeld and Gong’s seatbelt detection system for occluded objects as they both share characteristics and capabilities, namely, they are directed to detection of seatbelts for safety systems. Therefore, it would have been recognized that modifying the combination of Rehfeld and Gong’s seatbelt detection system for occluded objects to include Nagata’s determination of safety issues would have yielded predictable results because (i) the level of ordinary skill in the art demonstrated by the references applied shows the ability to incorporate Nagata’s determination of safety issues in detection of seatbelts for safety systems and (ii) the benefits of such a combination would have been recognized by those of ordinary skill in the art.
Regarding claim 2, the combination of Rehfeld, Gong, and Nagata teaches the system of claim 1, in addition, Rehfeld further teaches wherein the vehicle sensor includes one or more of:
a camera ([0010]: “The sensor may be any kind of a sensor (e.g., digital imaging device) suitable to observe the interior of a vehicle, preferably a sensor configured to capture an image of the interior of the cabin of the vehicle. Therefore, the sensor may be a camera”);
a thermal sensor ([0010]: “The sensor may be any kind of a sensor (e.g., digital imaging device) suitable to observe the interior of a vehicle, preferably a sensor configured to capture an image of the interior of the cabin of the vehicle. Therefore, the sensor may be a camera, preferably an infrared camera”. The “or” limitation means the list is disjunctive and only one of the listed items is needed for a prima facie case of obviousness).
Regarding claim 3, the combination of Rehfeld, Gong, and Nagata teaches the system of claim 1, in addition, Nagata further teaches wherein the safety issue includes one or more of:
positioning of a seatbelt ([0040]: “The vehicle 102 may also detect whether the seat belt is being worn correctly. Some occupants may choose to adjust or place both arms on the same side of the shoulder strap of the seat belt or may wear the seat belt such that the shoulder strap is behind the occupant's back. Wearing seat belts improperly reduces the effectiveness of the seat belt and reduces safety of the occupant within the vehicle. Thus, the vehicle 102 may provide an alert or notification to the driver or user when it detects a seat belt is being worn incorrectly”. The “or” limitation means the list is disjunctive and only one of the listed items is needed for a prima facie case of obviousness); or
The rationale for this combination is similar to the rationale for the claim 1 combination for Nagata due to the incorrect wearing of the seatbelt being part of the original safety determination.
Regarding claim 5, the combination of Rehfeld, Gong, and Nagata teaches the system of claim 1, in addition, Nagata further teaches wherein the machine-readable instructions further include instructions that when executed by the processor cause the processor to:
generate, in response to a safety issue, a notification ([0040]: “The vehicle 102 may also detect whether the seat belt is being worn correctly. Some occupants may choose to adjust or place both arms on the same side of the shoulder strap of the seat belt or may wear the seat belt such that the shoulder strap is behind the occupant's back. Wearing seat belts improperly reduces the effectiveness of the seat belt and reduces safety of the occupant within the vehicle. Thus, the vehicle 102 may provide an alert or notification to the driver or user when it detects a seat belt is being worn incorrectly”).
At the time the invention was made, it would have been obvious to one of ordinary skill in the art to modify the combination of Rehfeld, Gong, and Nagata’s seatbelt detection system for occluded objects to include Nagata’s notification system because such a modification is the result of applying a known technique to a known device ready for improvement to yield predictable results. More specifically, Nagata’s notification system permits notifying the driver when a safety issue is present, improving driver understanding of their vehicle. This known benefit in Nagata is applicable to the combination of Rehfeld, Gong, and Nagata’s seatbelt detection system for occluded objects as they both share characteristics and capabilities, namely, they are directed to detection of seatbelts for safety systems. Therefore, it would have been recognized that modifying the combination of Rehfeld, Gong, and Nagata’s seatbelt detection system for occluded objects to include Nagata’s notification system would have yielded predictable results because (i) the level of ordinary skill in the art demonstrated by the references applied shows the ability to incorporate Nagata’s notification system in detection of seatbelts for safety systems and (ii) the benefits of such a combination would have been recognized by those of ordinary skill in the art.
Regarding claim 7, the combination of Rehfeld, Gong, and Nagata teaches the system of claim 1, in addition, Gong further teaches wherein the mobile device includes one or more of:
a mobile phone ([0003]: “Mobile devices, including but not limited to smart phones, digital cameras, and tablet computers, are now generally capable of capturing media content such as audio, photos and/or video);
a tablet ([0003]: “Mobile devices, including but not limited to smart phones, digital cameras, and tablet computers, are now generally capable of capturing media content such as audio, photos and/or video);
a camera ([0003]: “Mobile devices, including but not limited to smart phones, digital cameras, and tablet computers, are now generally capable of capturing media content such as audio, photos and/or video. The “or” limitation means the list is disjunctive and only one of the listed items is needed for a prima facie case of obviousness).
Regarding claim 8, the content of claim 8 is similar to the content of claim 1, therefore it is rejected for the same reasons of obviousness as claim 1.
Regarding claim 9, the content of claim 9 is similar to the content of claim 2, therefore it is rejected for the same reasons of obviousness as claim 2.
Regarding claim 10, the content of claim 10 is similar to the content of claim 3, therefore it is rejected for the same reasons of obviousness as claim 3.
Regarding claim 12, the content of claim 12 is similar to the content of claim 5, therefore it is rejected for the same reasons of obviousness as claim 5.
Regarding claim 14, the content of claim 14 is similar to the content of claim 7, therefore it is rejected for the same reasons of obviousness as claim 7.
Regarding claim 15, the content of claim 15 is similar to the content of claim 1, with the additional teachings of a non-transitory computer readable medium. Rehfeld also discloses this information ([0028]: “The computer system may comprise a plurality of computer hardware components (for example a processor, for example processing unit or processing network, at least one memory, for example memory unit or memory network, and at least one non-transitory data storage)”). Therefore, claim 15 is rejected for the same reasons of obviousness as claim 1, along with the additional teachings above.
Regarding claim 16, the content of claim 16 is similar to the content of claim 2, therefore it is rejected for the same reasons of obviousness as claim 2.
Regarding claim 17, the content of claim 17 is similar to the content of claim 3, therefore it is rejected for the same reasons of obviousness as claim 3.
Regarding claim 19, the content of claim 19 is similar to the content of claim 5, therefore it is rejected for the same reasons of obviousness as claim 5.
Claims 4, 11, and 18 are rejected under 35 U.S.C. 103 as being unpatentable over Rehfeld et al. (US 20230377352 A1 Hereafter “Rehfeld”) in view of Gong et al. (US 20140049659 A1 “Gong”) in further view of Nagata et al. (US 20220212658 A1 Hereinafter “Nagata”) in further view of Breaux et al. (US 20190052747 A1 Hereinafter “Breaux”).
Regarding claim 4, the combination of Rehfeld, Gong, and Nagata teaches the system of claim 1, wherein the machine-readable instructions further include instructions that when executed by the processor cause the processor to:
The combination of Rehfeld, Gong, and Nagata does not expressly disclose detecting a mobile device from a plurality of mobile devices in the vehicle cabin.
However, Breaux teaches detecting a mobile device from a plurality of mobile devices in the vehicle cabin ([0012]: “In a first aspect of the present invention, a system for determining the location of a mobile device within a vehicle”. This device can be among multiple devices “If there is more than one mobile device in a vehicle, being able to determine which mobile device is in, near, or closest to the driver quadrant or space within the vehicle provides even more valuable data” [0007]).
At the time the invention was made, it would have been obvious to one of ordinary skill in the art to modify the combination of Rehfeld, Gong, and Nagata’s seatbelt detection system for occluded objects to include Breaux’s mobile device detection because such a modification is the result of applying a known technique to a known device ready for improvement to yield predictable results. More specifically, Breaux’s mobile device detection permits identification of a mobile device in a vehicle alongside location. This known benefit in Breaux is applicable to the combination of Rehfeld, Gong, and Nagata’s seatbelt detection system for occluded objects as they both share characteristics and capabilities, namely, they are directed to detection of objects in vehicles. The combination of Rehfeld, Gong, and Nagata teaches a system that can access other mobile devices when capturing images of seatbelts if the seatbelt is occluded from the original camera. Breaux teaches a way to detect possible other mobile device in the vehicle and their location. The combination of Rehfeld, Gong, and Nagata would find it beneficial if a seatbelt was occluded to detect the mobile device closest to the occluded object using Breaux’s method and request a picture from that device. This would allow the system to not accidently take a picture from another device if there are multiple in the vehicle. Therefore, it would have been recognized that modifying the combination of Rehfeld, Gong, and Nagata’s seatbelt detection system for occluded objects to include Breaux’s mobile device detection would have yielded predictable results because (i) the level of ordinary skill in the art demonstrated by the references applied shows the ability to incorporate Breaux’s mobile device detection in detection of object in vehicles and (ii) the benefits of such a combination would have been recognized by those of ordinary skill in the art.
Regarding claim 11, the content of claim 11 is similar to the content of claim 4, therefore it is rejected for the same reasons of obviousness as claim 4.
Regarding claim 18, the content of claim 18 is similar to the content of claim 4, therefore it is rejected for the same reasons of obviousness as claim 4.
Claims 6, 13, and 20 are rejected under 35 U.S.C. 103 as being unpatentable over Rehfeld et al. (US 20230377352 A1 Hereafter “Rehfeld”) in view of Gong et al. (US 20140049659 A1 “Gong”) in further view of Nagata et al. (US 20220212658 A1 Hereinafter “Nagata”) in further view of Park et al. (US 20240336274 A1 Hereinafter “Park”).
Regarding claim 6, the combination of Rehfeld, Gong, and Nagata teaches the system of claim 1, wherein the machine-readable instructions further include instructions that when executed by the processor cause the processor to:
The combination of Rehfeld, Gong, and Nagata does not expressly disclose performing a vehicle action in relation to a safety issue.
However, Park teaches performing a vehicle action in relation to a safety issue ([0022]: “The one or more instructions, when executed by the controller, may further cause the autonomous driving control device to: determine, based on the event, whether a seat belt of the user is fastened; based on not receiving, within the first time period, the user response associated with the transfer of control: output, via the notification device, the first notification based on a determination that the seat belt is fastened; and control the host vehicle to reduce the travel speed of the host vehicle at the second rate based on a determination that the seat belt is not fastened”. Reduction in travel speed is the vehicle action in response to the safety issue of non-fastened seatbelt).
At the time the invention was made, it would have been obvious to one of ordinary skill in the art to modify the combination of Rehfeld, Gong, and Nagata’s seatbelt detection system for occluded objects to include Park’s vehicle action based on safety issue because such a modification is the result of applying a known technique to a known device ready for improvement to yield predictable results. More specifically, Park’s vehicle action based on safety issue permits causing a vehicle to take action when a passenger does not have their seatbelt on improving the overall safety of the passenger. This known benefit in Park is applicable to the combination of Rehfeld, Gong, and Nagata’s seatbelt detection system for occluded objects as they both share characteristics and capabilities, namely, they are directed to detection of seatbelts for safety systems. Therefore, it would have been recognized that modifying the combination of Rehfeld, Gong, and Nagata’s seatbelt detection system for occluded objects to include Park’s vehicle action based on safety issue would have yielded predictable results because (i) the level of ordinary skill in the art demonstrated by the references applied shows the ability to incorporate Park’s vehicle action based on safety issue in detection of seatbelts for safety systems and (ii) the benefits of such a combination would have been recognized by those of ordinary skill in the art.
Regarding claim 13, the content of claim 13 is similar to the content of claim 6, therefore it is rejected for the same reasons of obviousness as claim 6.
Regarding claim 20, the content of claim 20 is similar to the content of claim 6, therefore it is rejected for the same reasons of obviousness as claim 6.
Conclusion
The prior art made of record and not relied upon is considered pertinent to applicant's disclosure:
Otis et al. (US 20240300533 A1) teaches swapping cameras for occluded objects
Cole et al. (US 20180225537 A1) teaches swapping cameras when an object is outside the field of view.
Baltaxe et al. (US 20200231109 A1) teaches seatbelt detection using multiple cameras.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to STEFANO A DARDANO whose telephone number is (703)756-4543. The examiner can normally be reached Monday - Friday 11:00 - 7:00.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Greg Morse can be reached at (571) 272-3838. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/STEFANO ANTHONY DARDANO/Examiner, Art Unit 2663
/GREGORY A MORSE/Supervisory Patent Examiner, Art Unit 2698