CN-121994260-A - Route planning mobility system for visual impairment

CN121994260ACN 121994260 ACN121994260 ACN 121994260ACN-121994260-A

Abstract

For visually impaired route planning mobility systems. A computer-implemented method includes (i) determining a current location of a user via location data, (ii) determining a starting location of the user device via the location data based on the current location and a destination location of the user device and based on user input, (iii) identifying a pedestrian route between the starting location and the destination location via a pedestrian route planner of a route planning application in communication with a navigation system, (iv) identifying a waypoint between the starting location and the destination location via the navigation system, (v) transmitting the pedestrian route to the user device, (vi) issuing at least one of i) a haptic feedback protocol and ii) an auditory feedback protocol associated with the waypoint via the route planning application, (vii) receiving the pedestrian route data from the user device, and (viii) processing the pedestrian route data to determine user behavior.

Inventors

J. M. Kulos
J. M. Lakowski
B. A. Newcombe
THOMPSON NEIL
S.J.Yi
C.L. Hay

Assignees

通用汽车环球科技运作有限责任公司

Dates

Publication Date: 20260508
Application Date: 20250107
Priority Date: 20241108

Claims (10)

1. A computer-implemented method that, when executed by data processing hardware, causes the data processing hardware to perform operations comprising: determining a current location of the user device relative to a vehicle location of the vehicle via the location data; determining a starting position of the user device relative to the vehicle location via the location data and based on the current location and the destination location of the user device relative to the vehicle location and based on the user input; identifying, via a pedestrian route planner of a route planning application in communication with the navigation system, a pedestrian route between a starting location of the user device and a destination location of the user device; Identifying, via the navigation system, a waypoint between a starting location of the user device and a destination location of the user device; transmitting the pedestrian route to the user device; Issuing at least one of i) a haptic feedback protocol and ii) an auditory feedback protocol associated with the waypoint via the route planning application; receiving pedestrian route data associated with a pedestrian route from a user device, and Pedestrian route data is processed to determine user behavior.
2. The method of claim 1, wherein the navigation system comprises at least one of a Global Positioning System (GPS), a real-time kinematic (RTK), and a Global Navigation Satellite System (GNSS) chipset.
3. The method of claim 2, further comprising continuously updating the pedestrian route in response to changes associated with the current location of the user device, GPS, GNSS chipset, and RTK.
4. The method of claim 1, further comprising pairing and transmitting between the data processing hardware and the user device via a network.
5. The method of claim 1, wherein the haptic feedback protocol and the auditory feedback protocol are further associated with i) a current location of the user device relative to the pedestrian route, ii) a modification to the pedestrian route, and iii) a deviation of the user device from the pedestrian route.
6. The method of claim 1, wherein the haptic feedback protocol and the auditory feedback protocol include a plurality of intensities associated with one or more of a current location of the user device relative to the pedestrian route, a modification to the pedestrian route, a deviation of the user device from the pedestrian route, and a waypoint.
7. The method of claim 1, further comprising identifying a pedestrian route based on user behavior.
8. The method of claim 1, wherein the waypoints comprise at least one of i) an obstacle in a pedestrian route, ii) a change of direction in a pedestrian route, and iii) an intersection in a pedestrian route.
9. The method of claim 1, wherein the current location of the user device is equivalent to a starting location of the user device.
10. The method of claim 1, wherein the starting location of the user device is manually entered.

Description

Route planning mobility system for visual impairment Introduction to the invention The information provided in this section is for the purpose of generally presenting the context of the disclosure. Work of the presently named inventors, to the extent it is described in this section, as well as aspects of the description that may not otherwise qualify as prior art at the time of filing, are neither expressly nor impliedly admitted as prior art against the present disclosure. The present disclosure relates generally to a route planning system supporting visually impaired people through the use of tactile or audible feedback on a user device. When a user navigates to a new area or if the user requires assistance in navigation due to some form of injury, the user may often use a mobile application equipped to provide pedestrian navigation. For example, some mobile applications may be used to determine a travel path based on a current location and a destination, and rely on a user to reach the destination along the travel path. The user typically looks at the screen of the user device to see the path of travel displayed within the mobile application. The travel path displayed within the mobile application may be updated to maintain the current location of the user as the user travels along the travel path. In some cases, navigation speech configured within the mobile application may provide audible feedback to inform the user of the navigation direction along the walking path. For example, if the walking path encounters a left turn, the navigational speech may provide audible feedback to the user to indicate the left turn. Many mobile applications associated with pedestrian navigation require a user to hold a user device in the user's hand to maintain visual and audible interaction with the mobile application. If the user's vision is impaired, the user may have a crutch in one hand and a user device in the other hand to properly use the mobile application in navigating the travel path. Visually impaired users may be tired by keeping both the crutch and the mobile device in close enough proximity to follow the auditory navigation, which is cumbersome and challenging. Furthermore, if there is a road construction or an obstacle along the walking path, the mobile application may not update the walking path to avoid the obstacle. As a result, the travel path may no longer reflect a viable path to the destination location. If the user is visually impaired, the user may unexpectedly encounter an obstacle and fail to reach the destination location if the mobile application fails to update the travel path. It is therefore desirable to have a mobile application that can seamlessly accommodate visually impaired users. Disclosure of Invention One aspect of the present disclosure provides a computer-implemented method. The method, when executed by data processing hardware, causes the data processing hardware to perform operations. The operations include (i) determining a current location of the user device relative to a vehicle location of the vehicle via the location data, (ii) determining a starting location of the user device relative to the vehicle location via the location data and based on the current location and destination location of the user device relative to the vehicle location and based on user input, (iii) identifying a pedestrian route between the starting location of the user device and the destination location of the user device via a pedestrian route planner of a route planning application in communication with the navigation system, (iv) identifying a waypoint between the starting location of the user device and the destination location of the user device via the navigation system, (v) transmitting the pedestrian route to the user device, (vi) issuing at least one of i) haptic feedback protocols and ii) auditory feedback protocols associated with the waypoint via the route planning application, (vii) receiving pedestrian route data associated with the pedestrian route from the user device, and (viii) processing the pedestrian route data to determine user behavior. Implementations of this aspect of the disclosure may include one or more of the following optional features. In some examples, the navigation system includes at least one of a Global Positioning System (GPS), a real-time kinematic (RTK), and a Global Navigation Satellite System (GNSS) chipset. In some further examples, the method further includes continuously updating the pedestrian route in response to changes associated with the current location of the user device, the GPS, the GNSS chipset, and the RTK. In some implementations, the method further includes pairing and transmitting between the data processing hardware and the user device via the network. In some configurations, the haptic feedback protocol and the auditory feedback protocol are further associated with i) a current location of the user device relative to the pedestrian route, i