DE-102024139762-A1 - Computer-implemented method for route planning for visually impaired people

DE102024139762A1DE 102024139762 A1DE102024139762 A1DE 102024139762A1DE-102024139762-A1

Abstract

A computer-implemented procedure comprises: (i) determining a user's current location using location data, (ii) determining, using location data, a user device's starting point based on the current location and a user device's destination based on user input, (iii) identifying, via a pedestrian route planner of a route planning application communicating with a navigation system, a pedestrian route between the starting point and the destination, (iv) identifying, via the navigation system, waypoints between the starting point and the destination, (v) transmitting the pedestrian route to the user device, (vi) outputting, via the route planning application, i) a haptic feedback protocol and/or ii) an acoustic feedback protocol associated with the waypoint(s), (vii) receiving pedestrian route data from the user device, and (viii) processing the pedestrian route data to determine user behavior.

Inventors

Joseph Michael Culos
John Marshall Lackowski
Bradley Allen Newcomb
Nathan Thompson
Steven Jon Yik
Curtis L. Hay

Assignees

GM Global Technology Operations LLC

Dates

Publication Date: 20260513
Application Date: 20241227
Priority Date: 20241108

Claims (10)

Computer-implemented method that, when executed by data processing hardware, causes the data processing hardware to perform an operation. to perform tasks that include: determining, via location data, the current location of a user device relative to the vehicle location; determining, via location data, a user device's starting point relative to the vehicle location and based on the current location, and a user device's destination relative to the vehicle location and based on user input; identifying, via a pedestrian route planner of a route planning application communicating with a navigation system, a pedestrian route between the user device's starting point and the user device's destination; identifying, via the navigation system, waypoints between the user device's starting point and the user device's destination; transmitting the pedestrian route to the user device; outputting, via the route planning application, i) a haptic feedback protocol and/or ii) an acoustic feedback protocol associated with the waypoint(s); receiving pedestrian route data associated with the pedestrian route from the user device; and processing the pedestrian route data to determine user behavior.
Procedure according to Claim 1 , wherein the navigation system includes at least one of the following systems: Global Positioning System (GPS), Real Time Kinematic Positioning (RTK) and a GNSS (Global Navigation Satellite System) chipset.
Procedure according to Claim 2 , furthermore comprehensively: continuous updating of the pedestrian route in response to changes associated with the current location of the user device, GPS, GNSS chipset and RTK.
Procedure according to Claim 1 , furthermore comprehensively: coupling and transferring data between the data processing hardware and the user device over a network.
Procedure according to Claim 1 , wherein the haptic feedback protocol and the acoustic feedback protocol are further linked to i) the current location of the user device in relation to the pedestrian route, ii) changes to the pedestrian route and iii) deviations of the user device from the pedestrian route.
Procedure according to Claim 1 , wherein the haptic feedback protocol and the acoustic feedback protocol comprise a variety of intensities associated with one or more of the following: the current position of the user device in relation to the pedestrian route, changes to the pedestrian route, the deviation of the user device from the pedestrian route, and the waypoints.
Procedure according to Claim 1 , furthermore, comprehensively identifying the pedestrian route based on user behavior.
Procedure according to Claim 1 , wherein the waypoints include at least one of the following: i) obstacles on the pedestrian route, ii) changes of direction on the pedestrian route and iii) intersections on the pedestrian route.
Procedure according to Claim 1 , where the current location of the user device corresponds to the starting point of the user device.
Procedure according to Claim 1 , where the starting point of the user device is entered manually.

Description

INTRODUCTION The information in this section serves to present the general context of the disclosure. Works of the inventors mentioned herein, insofar as they are described in this section, as well as aspects of the description that may not have been prior art at the time of filing, are neither expressly nor implicitly admitted as prior art against the present disclosure. The present disclosure relates generally to a route planning system for assisting visually impaired people through haptic or auditory feedback on a user device. Users can often utilize a mobile application that provides pedestrian navigation when orienting themselves in a new area or when a user requires navigational assistance due to a disability. For example, some mobile applications can be used to determine a sidewalk based on a user's current location and destination, relying on the user to follow the sidewalk to reach their destination. The user typically looks at their device screen to view the sidewalk displayed in the mobile application. As the user moves along the sidewalk, the sidewalk displayed in the mobile application can be updated to reflect the user's current location. In some cases, a navigation voice configured within the mobile application can provide audible feedback to inform the user about navigation instructions along the sidewalk. For instance, if the sidewalk encounters a left turn, the navigation voice can provide audible feedback to alert the user to the turn. Many mobile pedestrian navigation applications require the user to hold the device to maintain visual and auditory interaction. If the user is visually impaired, they may need to hold a cane in one hand while holding the device in the other to properly use the mobile application while navigating the sidewalk. For a visually impaired user, keeping both a cane and a mobile device close enough to follow the audio navigation can be cumbersome and difficult. Furthermore, the mobile application may fail to update the sidewalk route to avoid obstacles or roadworks. This can render the sidewalk unsuitable as a viable route to the destination. If the mobile application doesn't update the route, a visually impaired user could unexpectedly encounter an obstacle and be unable to reach their destination. Therefore, it is desirable to have a mobile application that can seamlessly adapt to the needs of a visually impaired user. SUMMARY One aspect of the disclosure provides a computer-implemented procedure. When executed by data processing hardware, this computer-implemented procedure causes the data processing hardware to perform operations. The operations include (i) determining, via location data, the current location of a user device relative to the vehicle location; (ii) determining, via location data, a starting point of a user device relative to the vehicle location and based on the current location, and a destination of the user device relative to the vehicle location and based on user input; (iii) identifying, via a pedestrian route planner of a route planning application communicating with a navigation system, a pedestrian route between the starting point of the user device and the destination of the user device; (iv) identifying, via the navigation system, waypoints between the starting point of the user device and the destination of the user device; (v) transmitting the pedestrian route to the user device; (vi) outputting, via the route planning application, i) a haptic feedback protocol and/or ii) an acoustic feedback protocol associated with the waypoint(s); (vii) receiving pedestrian route data associated with the pedestrian route from the User device, and (viii) processing pedestrian route data to determine user behavior. Implementations of this aspect of the disclosure may include one or more of the following optional features. In some examples, the navigation system includes at least one of the following systems: Global Positioning System (GPS), Real-Time Kinematic Positioning (RTK), and a GNSS (Global Navigation Satellite System) chipset. In some other examples, the method also includes continuously updating the pedestrian route in response to changes associated with the current location of the user device, the GPS, the GNSS chipset, and RTK. In some embodiments, the method also includes coupling and transferring data between the data processing hardware and the user device over a network. In some configurations, the haptic feedback protocol and the acoustic feedback protocol are further linked to i) the current location of the user device in relation to the pedestrian route, ii) changes to the pedestrian route, and iii) deviations of the user device from the pedestrian route. In some examples, the haptic feedback protocol and the acoustic feedback protocol include a variety of intensities associated with one or more of the following: the current position of the user device relative to the pedestrian route, changes to the pedestrian route, deviations of