DETAILED ACTION
Notice of Pre-AIA or AIA Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Claims 1-8, 10-13, 15, and 17-18 are presented for examination.
Claims 1, 10-13, and 17-18 have been amended.
Claims 1-8, 10-13, 15, and 17-18 are rejected.
Response to Arguments
Applicants’ amendments, see pages 9-13, filed 03/26/2026, with respect to the rejection(s) of claim(s) 1-8, 10-13, 15, and 17-18 under 35 USC § 103, are sufficient to overcome the previous rejections. Therefore, the rejection has been withdrawn. However, upon further consideration, a new ground(s) of rejection is made further in view of Sharma (US 20140266571 A1).
Applicant’s arguments with respect to claim(s) 1-8, 10-13, 15, and 17-18 under 35 USC § 103 have been considered but are moot because the new ground of rejection does not rely on any reference applied in the prior rejection of record for any teaching or matter specifically challenged in the argument. The amendments are overcoming the previously cited art and therefore the arguments are moot because they are directed towards the new amendments in light of the previous references.
Claim Rejections - 35 USC § 103
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
This application currently names joint inventors. In considering patentability of the claims the examiner presumes that the subject matter of the various claims was commonly owned as of the effective filing date of the claimed invention(s) absent any evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1.56 to point out the inventor and effective filing dates of each claim that was not commonly owned as of the effective filing date of the later invention in order for the examiner to consider the applicability of 35 U.S.C. 102(b)(2)(C) for any potential 35 U.S.C. 102(a)(2) prior art against the later invention.
Claims 1-5, 7-8, 10-12, 15, 17-18 are rejected under § 103 as being unpatentable over Yamazaki (JP 2007147300 A) per translated document, in view of Larmo (US 20140142851 A1), and further in view of Sharma (US 20140266571 A1).
Regarding Claim 1, Yamazaki discloses a walking support system, comprising: processing circuitry configured determine a state of the participant [0039] “The guidance information generation unit 30a generates guidance information for guiding the user H to the destination based on the destination information input from the portable terminal 2 via the reception unit 31a, and the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” and [0065] “The control unit 30 of the guidance apparatus 3 receives the signal via one of the reception units 41a to 41d, and can recognize the position of the mobile terminal 2 that has transmitted the signal, that is, the position of the user H holding the mobile terminal 2” and “That is, the four reception units 41a to 41d and the control unit 30 detect the position (direction) of the portable terminal 2…” (i.e., processing circuitry determines a state relating to the participant),
determine a recommended route for a participant in a space where the participant can choose and walk along a route [0030] “a plurality of stores 11 and a passage 13 through which a user can come and go to each store 11 from an entrance 12 of the commercial facility 10 are arranged. A branch point (intersection) or a corner of the passage 13 is a reference position 14” and [0046] “the map data stored in the storage unit 32 is referred to, and the shortest route among the routes that can reach the destination along the passage 13 is specified.” and: “Thus, the traveling direction (in the present embodiment, any one of the + X, - X, + Y, and - Y directions) in which the vehicle should travel from the reference position 14 is specified” (i.e., the shortest route among available passage routes is determined as the recommended route).
and guide the participant to the recommended route without restricting entry of the participant into a non-recommended route, which is a different route to the recommended route [0028] “the guidance device 3 has an image projection unit (projector) as an image display unit, and can generate guidance information indicating a direction and a route to travel in order to reach the destination based on the received destination information and project the guidance information as an image.” and [0030]: “a plurality of stores 11 and a passage 13 through which a user can come and go to each store 11” (i.e., guidance is provided toward the selected route while the other physical passage routes remain available for entry and (i.e., the participant remains able to travel along a route different from the calculated route without restriction).
wherein the processing circuitry for guiding the participant is further configured to control a user interface [0039] “the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” and [0048] “The image generation unit 30b generates an image based on the guidance information and the identification information in order to display the guidance image including the arrow indicating the traveling direction and outputs the image to the image projection unit 33.” (i.e., processing circuitry controls the image projection user interface).
determining the recommended traveling direction [0046] “the shortest route among the routes that can reach the destination along the passage 13 is specified. Thus, the traveling direction in which the vehicle should travel from the reference position 14 is specified” and applying sensory stimulation by the user interface [0048] “The image generation unit 30b generates an image including the arrow indicating the traveling direction and outputs the image to the image projection unit 33. As a result, the guidance image as shown in FIG. 7 a is displayed at the reference position 14.”
control the user interface so that when the participant is in a second state where the participant is oriented toward the non-recommended route [0046] “the shortest route among the routes that can reach the destination along the passage 13 is specified.” Sharma teaches determining when the participant's actual heading differs from the desired route heading [0068] “if the intended or desired heading is known, the difference between the current heading and intended heading is calculated” and [0069] “if the current heading of a user is in the ‘North’ direction, and the calculated route requires the user to be headed in the east direction” and: “if a user is heading off-course, an orientation correction mechanism can be automatically triggered” (i.e., the participant's actual orientation can be determined as differing from the recommended-route heading and corresponding to an alternative route direction).
and control the user interface to … applying sensory stimulation when the participant is in a third state in which the participant is oriented in a direction different from both the recommended route and the non-recommended route [0046] “the control unit 30 stores the received identification information and destination information in the storage unit 32 and generates guidance information for guidance from the reference position 14 to the destination using the guidance information generation unit 30a. Specifically, first, the received destination information (XY coordinates of the destination) is compared with the XY coordinates of the reference position 14 stored in the storage unit 32, and the positional relationship (direction) of the destination with respect to the reference position 14 is confirmed. After that, the map data stored in the storage unit 32 is referred to, and the shortest route among the routes that can reach the destination along the passage 13 is specified. Thus, the traveling direction (in the present embodiment, any one of the + X, - X, + Y, and - Y directions) in which the vehicle should travel from the reference position 14 is specified” (i.e., the walking space permits multiple participant orientations relative to the recommended and alternative routes).
Yamazaki appears to fail to teach the full claims limitations regarding “first sensory stimulation is applied to the participant, second sensory stimulation of a same type as the first sensory stimulation and having a weaker intensity than the first sensory stimulation and wherein the processing circuitry dynamically switches between applying the first sensory stimulation, the second sensory stimulation, and stopping sensory stimulation in response to detecting changes in the orientation of the participant.”
However, Larmo teaches equivalent teaches wherein first sensory stimulation is applied to the participant [0009] “the haptic instruction comprises a vibration signal that is sent in a direction towards the user such that the user is directed to the correct route.” and [0016]: “the haptic instruction corresponds to a vibration signal such that the user can feel the vibration and recognize if he or she is on the right route.” (i.e., sensory stimulation of a vibration type is applied in connection with route guidance).
second sensory stimulation of a same type as the first sensory stimulation and having a weaker intensity than the first sensory stimulation [0009] “The vibration signal is preferably configured for vibrating with a predetermined magnitude” and [0017] “The feedback unit in turn vibrates in certain magnitudes” (i.e., a second vibration can be provided at a weaker intensity than a first vibration while remaining the same sensory-stimulation type).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify the invention of Yamazaki to include the features of Larmo to have the system wherein second sensory stimulation of a same type as the first sensory stimulation and having a weaker intensity than the first sensory stimulation.
A person that is skilled in the art would have been motivated to combine Yamazaki and Larmo teachings to improve the user experience and overall system reliability [0012] “It is thus an idea of the invention to improve the user experience of existing navigation modules. Furthermore, it is secure and reliable to use the inventive idea at hand.”
Yamazaki and Larmo do not expressly teach when the participant is in a first state where the participant is oriented toward the recommended route and wherein the processing circuitry dynamically switches between applying the first sensory stimulation, the second sensory stimulation, and stopping sensory stimulation in response to detecting changes in the orientation of the participant.
However, Sharma teaches when the participant is in a first state where the participant is oriented toward the recommended route [0068] “system 400A can assist a user to point (head/face) in a correct direction” and: “MCU in both insole 400R and 400L can be configured to use corresponding magnetometer readings to compute the current heading of a user.” and [0069] “when a route to be taken by the user is computed, MU 102 can also be configured to compute a desired heading at each turn/direction in the route from the map data.” (i.e., the processing circuitry determines the participant's actual heading and the desired heading corresponding to the recommended route, thereby determining when the participant is oriented toward the recommended route).
control the user interface to stop applying sensory stimulation [0069] “Upon receiving this pattern of vibration, the user while standing in the same position can rotate towards his or her right. When the user is oriented in the correct direction (‘East’ in case of the example above), the vibration stops.” and “system 400A can be configured to check for orientation readings in real-time.” (i.e., sensory stimulation is stopped in response to a detected participant-orientation state).
wherein the processing circuitry dynamically switches between applying the first sensory stimulation, the second sensory stimulation, and stopping sensory stimulation in response to detecting changes in the orientation of the participant [0036] “IMU 221 in WU 104 can be configured to compute and or detect information related to, for example, position, orientation, heading” and “The information gathered by IMU 221 can be further transmitted to MU 102 and various event based decision can be further made by MU 102.” [0069] “Upon receiving this pattern of vibration, the user while standing in the same position can rotate towards his or her right. When the user is oriented in the correct direction (‘East’ in case of the example above), the vibration stops, system 400A can be configured to check for orientation readings in real-time.” and “if a user is heading off-course, an orientation correction mechanism can be automatically triggered” (i.e., processing circuitry detects changes in participant orientation in real time and dynamically changes the sensory-stimulation output, including activating and stopping the output). Sharma further teaches different sensory-stimulation intensities [0033] “one or more vibration(s) of varying intensity” and [0105] “the intensity of the vibration increases and decreases” (i.e., the dynamically controlled sensory output can switch among different intensities of the same vibration type).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Yamazaki's walking support system with Larmo's teaching of providing navigation feedback using vibration-type sensory stimulation at different magnitudes and further modify the resulting system with Sharma's teaching of detecting the participant's actual orientation and heading, comparing the current heading with a desired route heading, checking orientation in real time, providing vibration feedback of varying intensity, automatically triggering orientation correction when the participant is heading off-course, and stopping vibration based on a detected orientation condition. The resulting system would determine whether the participant's detected orientation corresponds to Yamazaki's recommended route direction, an alternative/non-recommended route direction, or another direction, and would control the same type of sensory stimulation at different intensities or stop stimulation according to the detected state, while dynamically switching the output in response to detected changes in participant orientation.
A person of ordinary skill in the art would have been motivated to further modify Yamazaki in view of Larmo with Sharma because Sharma expressly identifies the need for a more efficient and intuitive haptic interaction system. Sharma [0005] “there is a need for a more efficient foot based haptic interaction system that is intuitive to use and non-obtrusive.” Sharma further expressly improves navigation by providing actual orientation assistance [0068] “system 400A can be configured to provide orientation assistance to a user. That is, system 400A can assist a user to point (head/face) in a correct direction” and real-time correction [0069] “if a user is heading off-course, an orientation correction mechanism can be automatically triggered” Accordingly, a person of ordinary skill would have been motivated to incorporate Sharma's actual-heading detection and real-time orientation-responsive haptic control into the Yamazaki/Larmo system to improve the system by providing more accurate and intuitive participant guidance based on the participant's actual orientation rather than merely the participant's position, while dynamically adapting the sensory stimulation as the participant changes orientation.
Regarding Claim 2, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 1,
Yamazaki discloses wherein the processing circuitry for determining a recommended route is further configured to determine a recommended route for the participant based on a distribution of participants in the space [0039] “The guidance information generation unit 30a generates guidance information for guiding the user H to the destination based on the destination information input from the portable terminal 2 via the reception unit 31a, and the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” [0033] “The guidance system 1 installs at least one guide 3 in predetermined zones (i.e., a space) (a theme park, a shopping mall, etc.), such as indoor institutions (a building, an underground center, etc.) and an outdoor institution.” [0049] “Here, since each guidance image includes the arrow indicating the traveling direction and the identification number, each of the plurality of users H can identify the traveling direction of the user H by the identification number.” The system determines recommended routes based on plurality of users (i.e., participants in the space).
Regarding Claim 3, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 1, Yamazaki discloses wherein the processing circuitry for determining a recommended route is further configured to determine a recommended route for the participant such that the participants are dispersed over a plurality of specified routes set in the space [0039] “The guidance information generation unit 30a generates guidance information for guiding the user H to the destination based on the destination information input from the portable terminal 2 via the reception unit 31a, and the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” [0030] “a plurality of stores 11 and a passage 13 through which a user can come and go to each store 11 from an entrance 12 of the commercial facility 10 are arranged.” [0057] “when response signals are received from a plurality of mobile terminals 2, a plurality of guidance images corresponding to respective destinations are simultaneously displayed, and thus it is possible to guide a plurality of users H at the same time.” The system takes into considerations other users in the space and distributes them on multiple routes and passages in which a user can come and go to each store.
Regarding Claim 4, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 1, Yamazaki discloses wherein the processing circuitry for determining a recommended route is further configured to determine a recommended route for the participant based on information relating to the participant [0039] “The guidance information generation unit 30a generates guidance information for guiding the user H to the destination based on the destination information input from the portable terminal 2 via the reception unit 31a, and the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” [0033] “The storage unit 22 stores the control program, identification information for identifying the plurality of mobile terminals 2, and, as shown in FIG. A store list L in which a name, a location (X and Y coordinate values), a store type (a clothing store, a restaurant, a grocery store, or the like) indicating an item handled by a store, and the like of each store 11 in the commercial facility 10 are associated with each other is stored.” [0037] “The identification information may be any information capable of identifying the user H or the portable terminal 2 thereof, and in the present embodiment, a number (identification number) assigned to each portable terminal 2 is used. This identification number is always displayed on the image display unit 23, and the user H can recognize the identification number of his / her own portable terminal 2. A name, a nickname, or the like registered by the user H may be used as identification information. In this case, the user H can easily recognize the identification information of the user H.” The system stores information regarding the mobile terminal of the user and what stores or spaces the user can be guided to or from.
Regarding Claim 5, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 4, Yamazaki discloses wherein the information relating to the participant includes at least one of history information relating to the participant, registered information registered by the participant, attribute information relating to the participant, and state information relating to the participant [0037] “The identification information may be any information capable of identifying the user H (i.e., information of the participant) or the portable terminal 2 thereof, and in the present embodiment, a number (identification number) assigned to each portable terminal 2 is used. This identification number is always displayed on the image display unit 23, and the user H can recognize the identification number of his / her own portable terminal 2. A name, a nickname, or the like registered (i.e., registered historical information and attribute of the participant) by the user H may be used as identification information. In this case, the user H can easily recognize the identification information of the user H.” [0067] “the projection direction of the image projection unit 33 is changed in accordance with the position of the portable terminal 2 (i.e., the state information relating to the participant), that is, the user H holding the portable terminal 2, it is possible to display the guidance image at a position where the user H can easily view the guidance image” The system includes registered history information and position information of the participant when guiding the user.
Regarding Claim 7, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 5, wherein the processing circuitry for determining a recommended route is further configured to determine, as the recommended route, a specific route to which a code indicated in the registered information of the participant is assigned [0039] “The guidance information generation unit 30a generates guidance information for guiding the user H to the destination based on the destination information input from the portable terminal 2 via the reception unit 31a, and the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” [0036] “In addition, the store list L stored in the storage unit 22 is not an essential configuration, and the user H may directly input and designate the destination information (XY coordinates) while referring to a pamphlet or the like, or may input the destination information using a two-dimensional code (i.e., a specific route code in the registered information of the participant) or the like in a case where the portable terminal 2 includes an imaging device.
Regarding Claim 8, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 1, Yamazaki discloses wherein the space includes a plurality of branch areas including a first branch area and a second branch area [0030] “a plurality of stores 11 and a passage 13 through which a user can come and go to each store 11 from an entrance 12 of the commercial facility 10 are arranged. A branch point (intersection) or a corner of the passage 13 is a reference position 14 which is a starting point when guidance is performed by the guidance device 3, and the guidance device 3 is installed above each reference position 14 so that an image projected from the image projection unit is displayed on a road surface of the reference position 14 (see FIG. 1).
wherein the processing circuitry for determining a recommended route is further configured to determine a recommended route for the participant in relation to the branch area at which the participant has arrived [0045] “the guidance apparatus 3 can detect that the portable terminal 2 approaches the reference position 14 by the operation in the steps S100 and S101, the control unit 30 and the communication unit 31 when the steps S100 and S101 are executed function as a detection unit of the present invention.”, and in response to the participant arriving at the second branch area by traversing a first route from the first branch area, determine a recommended route for the participant in relation to the second branch area without referring to information indicating whether the first route was the recommended route or a non-recommended route for the participant in relation to the first branch area [0046] “the control unit 30 stores the received identification information and destination information in the storage unit 32 and generates guidance information for guidance from the reference position 14 to the destination using the guidance information generation unit 30a. Specifically, first, the received destination information (XY coordinates of the destination) is compared with the XY coordinates of the reference position 14 stored in the storage unit 32, and the positional relationship (direction) of the destination with respect to the reference position 14 is confirmed. After that, the map data stored in the storage unit 32 is referred to, and the shortest route among the routes that can reach the destination along the passage 13 is specified. Thus, the traveling direction (in the present embodiment, any one of the + X, - X, + Y, and - Y directions) in which the vehicle should travel from the reference position 14 is specified”
Regarding Claim 10, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 9, Yamazaki discloses wherein the effect device includes at least one of use interface carried by the participant and a user interface disposed in the space [0030] “the guidance device 3 is installed above each reference position 14 so that an image projected from the image projection unit is displayed on a road surface of the reference position 14 (see FIG. 1). When the commercial facility 10 is an indoor facility, the guide device 3 may be suspended from the ceiling. The position at which the guidance device 3 is installed is not limited to directly above the reference position 14, and for example, the guidance device 3 may be projected in an oblique direction from the outer wall surface of the store 11 toward the reference position 14.”
Regarding Claim 11, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 9, Yamazaki discloses wherein the user interface comprises a light source, and the processing circuitry for guiding the participant is further configured to guide the participant by causing the user interface to emit light [0071] “Instead of the image projection unit 33 of the embodiment, various image display devices using a liquid crystal, an LED (Light Emitting Diode), a CRT (Cathode Ray Tube), or the like, or a subtitle type or flap type display apparatus may be used.”
Regarding Claim 12, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 9, Yamazaki discloses wherein the effect device comprises a speaker, and the processing circuitry for guiding the participant is further configured to guide the participant by causing the user interface to output a predetermined voice [0071] “In addition, the method of notifying the guidance information is not limited to the image display, and for example, it is also possible to instruct the direction or the like by voice (i.e., voice instructions through a speaker).”
Regarding Claim 15, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 1, wherein the first state is a state in which the participant is some orientation toward the recommended route. [0048] “The image generation unit 30b generates an image based on the guidance information and the identification information in order to display the guidance image including the arrow indicating the traveling direction (i.e., orientation toward the recommended route) and the identification information (identification number), and outputs the image to the image projection unit 33. As a result, the guidance image as shown in FIG. 7 a is displayed at the reference position 14.”
Yamazaki appears to fail to teach the full the claims limitations regarding “where the participant is oriented toward the recommended route”
However, Larmo teaches equivalent teaches wherein where the participant is oriented toward the recommended route [0003] “The user interaction unit is also responsible for presenting the calculated paths to the user and assisting the user to find a correct route and to stay on the right track.” [0016] “recognize if he or she is on the right route.” [0017] “The feedback unit in turn vibrates in certain magnitudes or patterns which are used to signal the sharpness of the turn and also serves as a warning signal in this first preferred embodiment.” Larmo explicitly teaches that the system helps the user find / stay on the correct route and provides warning-type feedback when guidance needs correction. A person that is skilled in the art would understand that if the system is able to tell if the user is on the correct or wrong routes it is also able to tell if the user is oriented toward the recommended route or the non-recommended route.
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify the invention of Yamazaki to include the features of Larmo to have the system wherein the first state is a state in which the participant is oriented toward the recommended route.
A person that is skilled in the art would have been motivated to combine Yamazaki and Larmo teachings to improve the user experience and overall system reliability [0012] “It is thus an idea of the invention to improve the user experience of existing navigation modules. Furthermore, it is secure and reliable to use the inventive idea at hand.”
Regarding Claim 17, Yamazaki discloses a walking support method, comprising: determining a state of the participant [0039] “The guidance information generation unit 30a generates guidance information for guiding the user H to the destination based on the destination information input from the portable terminal 2 via the reception unit 31a, and the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” and [0065] “The control unit 30 of the guidance apparatus 3 receives the signal via one of the reception units 41a to 41d, and can recognize the position of the mobile terminal 2 that has transmitted the signal, that is, the position of the user H holding the mobile terminal 2” and “That is, the four reception units 41a to 41d and the control unit 30 detect the position (direction) of the portable terminal 2…” (i.e., processing circuitry determines a state relating to the participant),
determine a recommended route for a participant in a space where the participant can choose and walk along a route [0030] “a plurality of stores 11 and a passage 13 through which a user can come and go to each store 11 from an entrance 12 of the commercial facility 10 are arranged. A branch point (intersection) or a corner of the passage 13 is a reference position 14” and [0046] “the map data stored in the storage unit 32 is referred to, and the shortest route among the routes that can reach the destination along the passage 13 is specified.” and: “Thus, the traveling direction (in the present embodiment, any one of the + X, - X, + Y, and - Y directions) in which the vehicle should travel from the reference position 14 is specified” (i.e., the shortest route among available passage routes is determined as the recommended route).
and guide the participant to the recommended route without restricting entry of the participant into a non-recommended route, which is a different route to the recommended route [0028] “the guidance device 3 has an image projection unit (projector) as an image display unit, and can generate guidance information indicating a direction and a route to travel in order to reach the destination based on the received destination information and project the guidance information as an image.” and [0030]: “a plurality of stores 11 and a passage 13 through which a user can come and go to each store 11” (i.e., guidance is provided toward the selected route while the other physical passage routes remain available for entry and (i.e., the participant remains able to travel along a route different from the calculated route without restriction).
wherein the processing circuitry for guiding the participant is further configured to control a user interface [0039] “the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” and [0048] “The image generation unit 30b generates an image based on the guidance information and the identification information in order to display the guidance image including the arrow indicating the traveling direction and outputs the image to the image projection unit 33.” (i.e., processing circuitry controls the image projection user interface).
determining the recommended traveling direction [0046] “the shortest route among the routes that can reach the destination along the passage 13 is specified. Thus, the traveling direction in which the vehicle should travel from the reference position 14 is specified” and applying sensory stimulation by the user interface [0048] “The image generation unit 30b generates an image including the arrow indicating the traveling direction and outputs the image to the image projection unit 33. As a result, the guidance image as shown in FIG. 7 a is displayed at the reference position 14.”
control the user interface so that when the participant is in a second state where the participant is oriented toward the non-recommended route [0046] “the shortest route among the routes that can reach the destination along the passage 13 is specified.” Sharma teaches determining when the participant's actual heading differs from the desired route heading [0068] “if the intended or desired heading is known, the difference between the current heading and intended heading is calculated” and [0069] “if the current heading of a user is in the ‘North’ direction, and the calculated route requires the user to be headed in the east direction” and: “if a user is heading off-course, an orientation correction mechanism can be automatically triggered” (i.e., the participant's actual orientation can be determined as differing from the recommended-route heading and corresponding to an alternative route direction).
and control the user interface to … applying sensory stimulation when the participant is in a third state in which the participant is oriented in a direction different from both the recommended route and the non-recommended route [0046] “the control unit 30 stores the received identification information and destination information in the storage unit 32 and generates guidance information for guidance from the reference position 14 to the destination using the guidance information generation unit 30a. Specifically, first, the received destination information (XY coordinates of the destination) is compared with the XY coordinates of the reference position 14 stored in the storage unit 32, and the positional relationship (direction) of the destination with respect to the reference position 14 is confirmed. After that, the map data stored in the storage unit 32 is referred to, and the shortest route among the routes that can reach the destination along the passage 13 is specified. Thus, the traveling direction (in the present embodiment, any one of the + X, - X, + Y, and - Y directions) in which the vehicle should travel from the reference position 14 is specified” (i.e., the walking space permits multiple participant orientations relative to the recommended and alternative routes).
Yamazaki appears to fail to teach the full claims limitations regarding “first sensory stimulation is applied to the participant, second sensory stimulation of a same type as the first sensory stimulation and having a weaker intensity than the first sensory stimulation and wherein the processing circuitry dynamically switches between applying the first sensory stimulation, the second sensory stimulation, and stopping sensory stimulation in response to detecting changes in the orientation of the participant.”
However, Larmo teaches equivalent teaches wherein first sensory stimulation is applied to the participant [0009] “the haptic instruction comprises a vibration signal that is sent in a direction towards the user such that the user is directed to the correct route.” and [0016]: “the haptic instruction corresponds to a vibration signal such that the user can feel the vibration and recognize if he or she is on the right route.” (i.e., sensory stimulation of a vibration type is applied in connection with route guidance).
second sensory stimulation of a same type as the first sensory stimulation and having a weaker intensity than the first sensory stimulation [0009] “The vibration signal is preferably configured for vibrating with a predetermined magnitude” and [0017] “The feedback unit in turn vibrates in certain magnitudes” (i.e., a second vibration can be provided at a weaker intensity than a first vibration while remaining the same sensory-stimulation type).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify the invention of Yamazaki to include the features of Larmo to have the system wherein second sensory stimulation of a same type as the first sensory stimulation and having a weaker intensity than the first sensory stimulation.
A person that is skilled in the art would have been motivated to combine Yamazaki and Larmo teachings to improve the user experience and overall system reliability [0012] “It is thus an idea of the invention to improve the user experience of existing navigation modules. Furthermore, it is secure and reliable to use the inventive idea at hand.”
Yamazaki and Larmo do not expressly teach when the participant is in a first state where the participant is oriented toward the recommended route and wherein the processing circuitry dynamically switches between applying the first sensory stimulation, the second sensory stimulation, and stopping sensory stimulation in response to detecting changes in the orientation of the participant.
However, Sharma teaches when the participant is in a first state where the participant is oriented toward the recommended route [0068] “system 400A can assist a user to point (head/face) in a correct direction” and: “MCU in both insole 400R and 400L can be configured to use corresponding magnetometer readings to compute the current heading of a user.” and [0069] “when a route to be taken by the user is computed, MU 102 can also be configured to compute a desired heading at each turn/direction in the route from the map data.” (i.e., the processing circuitry determines the participant's actual heading and the desired heading corresponding to the recommended route, thereby determining when the participant is oriented toward the recommended route).
control the user interface to stop applying sensory stimulation [0069] “Upon receiving this pattern of vibration, the user while standing in the same position can rotate towards his or her right. When the user is oriented in the correct direction (‘East’ in case of the example above), the vibration stops.” and “system 400A can be configured to check for orientation readings in real-time.” (i.e., sensory stimulation is stopped in response to a detected participant-orientation state).
wherein the processing circuitry dynamically switches between applying the first sensory stimulation, the second sensory stimulation, and stopping sensory stimulation in response to detecting changes in the orientation of the participant [0036] “IMU 221 in WU 104 can be configured to compute and or detect information related to, for example, position, orientation, heading” and “The information gathered by IMU 221 can be further transmitted to MU 102 and various event based decision can be further made by MU 102.” [0069] “Upon receiving this pattern of vibration, the user while standing in the same position can rotate towards his or her right. When the user is oriented in the correct direction (‘East’ in case of the example above), the vibration stops, system 400A can be configured to check for orientation readings in real-time.” and “if a user is heading off-course, an orientation correction mechanism can be automatically triggered” (i.e., processing circuitry detects changes in participant orientation in real time and dynamically changes the sensory-stimulation output, including activating and stopping the output). Sharma further teaches different sensory-stimulation intensities [0033] “one or more vibration(s) of varying intensity” and [0105] “the intensity of the vibration increases and decreases” (i.e., the dynamically controlled sensory output can switch among different intensities of the same vibration type).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Yamazaki's walking support system with Larmo's teaching of providing navigation feedback using vibration-type sensory stimulation at different magnitudes and further modify the resulting system with Sharma's teaching of detecting the participant's actual orientation and heading, comparing the current heading with a desired route heading, checking orientation in real time, providing vibration feedback of varying intensity, automatically triggering orientation correction when the participant is heading off-course, and stopping vibration based on a detected orientation condition. The resulting system would determine whether the participant's detected orientation corresponds to Yamazaki's recommended route direction, an alternative/non-recommended route direction, or another direction, and would control the same type of sensory stimulation at different intensities or stop stimulation according to the detected state, while dynamically switching the output in response to detected changes in participant orientation.
A person of ordinary skill in the art would have been motivated to further modify Yamazaki in view of Larmo with Sharma because Sharma expressly identifies the need for a more efficient and intuitive haptic interaction system. Sharma [0005] “there is a need for a more efficient foot based haptic interaction system that is intuitive to use and non-obtrusive.” Sharma further expressly improves navigation by providing actual orientation assistance [0068] “system 400A can be configured to provide orientation assistance to a user. That is, system 400A can assist a user to point (head/face) in a correct direction” and real-time correction [0069] “if a user is heading off-course, an orientation correction mechanism can be automatically triggered” Accordingly, a person of ordinary skill would have been motivated to incorporate Sharma's actual-heading detection and real-time orientation-responsive haptic control into the Yamazaki/Larmo system to improve the system by providing more accurate and intuitive participant guidance based on the participant's actual orientation rather than merely the participant's position, while dynamically adapting the sensory stimulation as the participant changes orientation.
Regarding Claim 18, Yamazaki discloses a non-transitory computer-readable walking support program storing computer-readable instructions thereon which, when executed by a computer cause the computer to perform a method, including determining a state of the participant [0039] “The guidance information generation unit 30a generates guidance information for guiding the user H to the destination based on the destination information input from the portable terminal 2 via the reception unit 31a, and the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” and [0065] “The control unit 30 of the guidance apparatus 3 receives the signal via one of the reception units 41a to 41d, and can recognize the position of the mobile terminal 2 that has transmitted the signal, that is, the position of the user H holding the mobile terminal 2” and “That is, the four reception units 41a to 41d and the control unit 30 detect the position (direction) of the portable terminal 2…” (i.e., processing circuitry determines a state relating to the participant),
determine a recommended route for a participant in a space where the participant can choose and walk along a route [0030] “a plurality of stores 11 and a passage 13 through which a user can come and go to each store 11 from an entrance 12 of the commercial facility 10 are arranged. A branch point (intersection) or a corner of the passage 13 is a reference position 14” and [0046] “the map data stored in the storage unit 32 is referred to, and the shortest route among the routes that can reach the destination along the passage 13 is specified.” and: “Thus, the traveling direction (in the present embodiment, any one of the + X, - X, + Y, and - Y directions) in which the vehicle should travel from the reference position 14 is specified” (i.e., the shortest route among available passage routes is determined as the recommended route).
and guide the participant to the recommended route without restricting entry of the participant into a non-recommended route, which is a different route to the recommended route [0028] “the guidance device 3 has an image projection unit (projector) as an image display unit, and can generate guidance information indicating a direction and a route to travel in order to reach the destination based on the received destination information and project the guidance information as an image.” and [0030]: “a plurality of stores 11 and a passage 13 through which a user can come and go to each store 11” (i.e., guidance is provided toward the selected route while the other physical passage routes remain available for entry and (i.e., the participant remains able to travel along a route different from the calculated route without restriction).
wherein the processing circuitry for guiding the participant is further configured to control a user interface [0039] “the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” and [0048] “The image generation unit 30b generates an image based on the guidance information and the identification information in order to display the guidance image including the arrow indicating the traveling direction and outputs the image to the image projection unit 33.” (i.e., processing circuitry controls the image projection user interface).
determining the recommended traveling direction [0046] “the shortest route among the routes that can reach the destination along the passage 13 is specified. Thus, the traveling direction in which the vehicle should travel from the reference position 14 is specified” and applying sensory stimulation by the user interface [0048] “The image generation unit 30b generates an image including the arrow indicating the traveling direction and outputs the image to the image projection unit 33. As a result, the guidance image as shown in FIG. 7 a is displayed at the reference position 14.”
control the user interface so that when the participant is in a second state where the participant is oriented toward the non-recommended route [0046] “the shortest route among the routes that can reach the destination along the passage 13 is specified.” Sharma teaches determining when the participant's actual heading differs from the desired route heading [0068] “if the intended or desired heading is known, the difference between the current heading and intended heading is calculated” and [0069] “if the current heading of a user is in the ‘North’ direction, and the calculated route requires the user to be headed in the east direction” and: “if a user is heading off-course, an orientation correction mechanism can be automatically triggered” (i.e., the participant's actual orientation can be determined as differing from the recommended-route heading and corresponding to an alternative route direction).
and control the user interface to … applying sensory stimulation when the participant is in a third state in which the participant is oriented in a direction different from both the recommended route and the non-recommended route [0046] “the control unit 30 stores the received identification information and destination information in the storage unit 32 and generates guidance information for guidance from the reference position 14 to the destination using the guidance information generation unit 30a. Specifically, first, the received destination information (XY coordinates of the destination) is compared with the XY coordinates of the reference position 14 stored in the storage unit 32, and the positional relationship (direction) of the destination with respect to the reference position 14 is confirmed. After that, the map data stored in the storage unit 32 is referred to, and the shortest route among the routes that can reach the destination along the passage 13 is specified. Thus, the traveling direction (in the present embodiment, any one of the + X, - X, + Y, and - Y directions) in which the vehicle should travel from the reference position 14 is specified” (i.e., the walking space permits multiple participant orientations relative to the recommended and alternative routes).
Yamazaki appears to fail to teach the full claims limitations regarding “first sensory stimulation is applied to the participant, second sensory stimulation of a same type as the first sensory stimulation and having a weaker intensity than the first sensory stimulation and wherein the processing circuitry dynamically switches between applying the first sensory stimulation, the second sensory stimulation, and stopping sensory stimulation in response to detecting changes in the orientation of the participant.”
However, Larmo teaches equivalent teaches wherein first sensory stimulation is applied to the participant [0009] “the haptic instruction comprises a vibration signal that is sent in a direction towards the user such that the user is directed to the correct route.” and [0016]: “the haptic instruction corresponds to a vibration signal such that the user can feel the vibration and recognize if he or she is on the right route.” (i.e., sensory stimulation of a vibration type is applied in connection with route guidance).
second sensory stimulation of a same type as the first sensory stimulation and having a weaker intensity than the first sensory stimulation [0009] “The vibration signal is preferably configured for vibrating with a predetermined magnitude” and [0017] “The feedback unit in turn vibrates in certain magnitudes” (i.e., a second vibration can be provided at a weaker intensity than a first vibration while remaining the same sensory-stimulation type).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify the invention of Yamazaki to include the features of Larmo to have the system wherein second sensory stimulation of a same type as the first sensory stimulation and having a weaker intensity than the first sensory stimulation.
A person that is skilled in the art would have been motivated to combine Yamazaki and Larmo teachings to improve the user experience and overall system reliability [0012] “It is thus an idea of the invention to improve the user experience of existing navigation modules. Furthermore, it is secure and reliable to use the inventive idea at hand.”
Yamazaki and Larmo do not expressly teach when the participant is in a first state where the participant is oriented toward the recommended route and wherein the processing circuitry dynamically switches between applying the first sensory stimulation, the second sensory stimulation, and stopping sensory stimulation in response to detecting changes in the orientation of the participant.
However, Sharma teaches when the participant is in a first state where the participant is oriented toward the recommended route [0068] “system 400A can assist a user to point (head/face) in a correct direction” and: “MCU in both insole 400R and 400L can be configured to use corresponding magnetometer readings to compute the current heading of a user.” and [0069] “when a route to be taken by the user is computed, MU 102 can also be configured to compute a desired heading at each turn/direction in the route from the map data.” (i.e., the processing circuitry determines the participant's actual heading and the desired heading corresponding to the recommended route, thereby determining when the participant is oriented toward the recommended route).
control the user interface to stop applying sensory stimulation [0069] “Upon receiving this pattern of vibration, the user while standing in the same position can rotate towards his or her right. When the user is oriented in the correct direction (‘East’ in case of the example above), the vibration stops.” and “system 400A can be configured to check for orientation readings in real-time.” (i.e., sensory stimulation is stopped in response to a detected participant-orientation state).
wherein the processing circuitry dynamically switches between applying the first sensory stimulation, the second sensory stimulation, and stopping sensory stimulation in response to detecting changes in the orientation of the participant [0036] “IMU 221 in WU 104 can be configured to compute and or detect information related to, for example, position, orientation, heading” and “The information gathered by IMU 221 can be further transmitted to MU 102 and various event based decision can be further made by MU 102.” [0069] “Upon receiving this pattern of vibration, the user while standing in the same position can rotate towards his or her right. When the user is oriented in the correct direction (‘East’ in case of the example above), the vibration stops, system 400A can be configured to check for orientation readings in real-time.” and “if a user is heading off-course, an orientation correction mechanism can be automatically triggered” (i.e., processing circuitry detects changes in participant orientation in real time and dynamically changes the sensory-stimulation output, including activating and stopping the output). Sharma further teaches different sensory-stimulation intensities [0033] “one or more vibration(s) of varying intensity” and [0105] “the intensity of the vibration increases and decreases” (i.e., the dynamically controlled sensory output can switch among different intensities of the same vibration type).
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify Yamazaki's walking support system with Larmo's teaching of providing navigation feedback using vibration-type sensory stimulation at different magnitudes and further modify the resulting system with Sharma's teaching of detecting the participant's actual orientation and heading, comparing the current heading with a desired route heading, checking orientation in real time, providing vibration feedback of varying intensity, automatically triggering orientation correction when the participant is heading off-course, and stopping vibration based on a detected orientation condition. The resulting system would determine whether the participant's detected orientation corresponds to Yamazaki's recommended route direction, an alternative/non-recommended route direction, or another direction, and would control the same type of sensory stimulation at different intensities or stop stimulation according to the detected state, while dynamically switching the output in response to detected changes in participant orientation.
A person of ordinary skill in the art would have been motivated to further modify Yamazaki in view of Larmo with Sharma because Sharma expressly identifies the need for a more efficient and intuitive haptic interaction system. Sharma [0005] “there is a need for a more efficient foot based haptic interaction system that is intuitive to use and non-obtrusive.” Sharma further expressly improves navigation by providing actual orientation assistance [0068] “system 400A can be configured to provide orientation assistance to a user. That is, system 400A can assist a user to point (head/face) in a correct direction” and real-time correction [0069] “if a user is heading off-course, an orientation correction mechanism can be automatically triggered” Accordingly, a person of ordinary skill would have been motivated to incorporate Sharma's actual-heading detection and real-time orientation-responsive haptic control into the Yamazaki/Larmo system to improve the system by providing more accurate and intuitive participant guidance based on the participant's actual orientation rather than merely the participant's position, while dynamically adapting the sensory stimulation as the participant changes orientation.
Claims 6 and 13 are rejected under § 103 as being unpatentable over Yamazaki
(JP 2007147300 A) per translated attached document, in view of Larmo (US 20140142851 A1), in view of Sharma (US 20140266571 A1), and further in Haraguchi (JP 2005037288 A) per translated attached document.
Regarding Claim 6, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 5, Yamazaki does not teach wherein the processing circuitry for determining a recommended route is further configured to determine, as the recommended route, a different route to routes that are indicated in the history information of the participant as having been selected by the participant in the past.
However, Haraguchi teaches equivalent teachings wherein a different route to routes that are indicated in the history information of the participant as having been selected by the participant in the past [0012] “As long as there is room to set a travel route other than a travel route set in the past to the destination A new travel route different from the previously set travel route to the destination can be automatically set, and therefore, the travel route from the departure point to the destination can be easily set as a travel route different from the previously set travel route.”
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify the invention of Yamazaki to include the features of Haraguchi to have the system determine a different route to routes that are indicated in the historical information of the participant as having been selected by the participant in the past.
A person that is skilled in the art would have been motivated to combine Yamazaki and Haraguchi teachings to the ease of use and operation of the system [0036] “As long as there is room to set a travel route other than the travel route set in the past to the specific destination represented by the destination data DT The new travel route different from the travel route set in the past to the destination can be automatically set, and therefore, the travel route from the departure place to the destination can be easily set as a route different from the travel route set before that time.”
Regarding Claim 13, The combination of Yamazaki, Larmo, and Sharma teaches the walking support system according to claim 9, Yamazaki discloses the processing circuitry for guiding the participant is further configured to guide the participant [0039] “The guidance information generation unit 30a generates guidance information for guiding the user H to the destination based on the destination information input from the portable terminal 2 via the reception unit 31a, and the image generation unit 30b generates an image based on the generated guidance information and outputs the image to the image projection unit 33.” [0041] The image projection unit 33 corresponds to a notification unit and an image display unit of the invention.
Yamazaki fails to teach wherein the user interface comprises a video projector causing the effect device to project a predetermined video.
However, Haraguchi teaches equivalent teachings wherein the user interface comprises a video projector causing the effect device to project a predetermined video.
[0021] “In the video signal forming unit 20, a color video signal composed of a red primary color signal R, a green primary color signal G, and a blue primary color signal B is formed based on the image display data DSP, and the color video signal is supplied from the video signal forming unit 20 to the image display unit 21. As a result, in the image display unit 21, image display based on the image display data DSP formed by the display data forming unit 18 is performed. A map image representing a road map, an image representing the current position of the vehicle, an image representing image, an image representing a set route, characters and figures representing a route setting menu, and a pointer image freely moving in a screen are displayed.”
It would have been obvious to one of ordinary skill in the art before the effective filing date of the claimed invention to modify the invention of Yamazaki to include the features of Haraguchi to have the system wherein the user interface comprises a video projector causing the effect device to project a predetermined video.
A person that is skilled in the art would have been motivated to combine Yamazaki and Haraguchi teachings to the ease of use and operation of the system [0036] “As long as there is room to set a travel route other than the travel route set in the past to the specific destination represented by the destination data DT The new travel route different from the travel route set in the past to the destination can be automatically set, and therefore, the travel route from the departure place to the destination can be easily set as a route different from the travel route set before that time.”
Conclusion
The following prior art is considered pertinent to the claimed invention but is not relied upon in the rejection: Zelek (US 20080120029 A1), which generally teaches a wearable tactile navigation system that provides navigation and orientation information to a user through tactile feedback and can orient a user toward a desired landmark; Freitas (US 20110172907 A1), which generally teaches an orientation, navigation, and information system for pedestrian navigation that determines a user's location and provides navigation information through a user interface, including audible guidance; and Stankiewicz (US 20060293839 A1), which generally teaches a navigation assistance system that determines a user's location within an environment, determines a route to a destination based on the user's location and environment data, and provides directional cues to the user through a user interface. These references are considered pertinent because they disclose features generally related to pedestrian navigation, user location and orientation, route determination, user interfaces, and sensory guidance, but are not relied upon to teach the specific claimed combination.
Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any nonprovisional extension fee (37 CFR 1.17(a)) pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this final action.
Any inquiry concerning this communication or earlier communications from the examiner should be directed to HUSSAM ALZATEEMEH whose telephone number is (703)756-1013. The examiner can normally be reached 8:00-5:00 M-F.
Examiner interviews are available via telephone, in-person, and video conferencing using a USPTO supplied web-based collaboration tool. To schedule an interview, applicant is encouraged to use the USPTO Automated Interview Request (AIR) at http://www.uspto.gov/interviewpractice.
If attempts to reach the examiner by telephone are unsuccessful, the examiner’s supervisor, Aniss Chad can be reached on (571) 270-3832. The fax phone number for the organization where this application or proceeding is assigned is 571-273-8300.
Information regarding the status of published or unpublished applications may be obtained from Patent Center. Unpublished application information in Patent Center is available to registered users. To file and manage patent submissions in Patent Center, visit: https://patentcenter.uspto.gov. Visit https://www.uspto.gov/patents/apply/patent-center for more information about Patent Center and https://www.uspto.gov/patents/docx for information about filing in DOCX format. For additional questions, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer Service Representative, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000.
/HUSSAM ALDEEN ALZATEEMEH/Examiner, Art Unit 3662
/CHRISTOPHER GEORGE FEES/Primary Examiner, Art Unit 3662
Prosecution Insights