EP-4738222-A1 - PERSONALIZED ACCESSIBILITY FOR SELF-CHECKOUTS

EP4738222A1EP 4738222 A1EP4738222 A1EP 4738222A1EP-4738222-A1

Abstract

Methods and a system for personalizing accessibility in retail environments use facial recognition to identify customers at self-checkout terminals. Upon recognition, the system retrieves the customer's pre-registered accessibility profile from a cloud-based loyalty solution. This profile contains customized settings for various disabilities and sensitivities. The self-checkout terminal automatically configures its interface based on the retrieved profile, adjusting visual elements, audio features, and other accessibility settings to meet the customer's specific needs. This approach eliminates the need for manual activation of accessibility features, creating a seamless and inclusive shopping experience. The system includes privacy safeguards through an opt-in process and can adapt over time by learning from customer interactions and suggesting additional accessibility settings.

Inventors

MORGAN, KIP OLIVER
MASSEY, JERRY STEVEN
KENNEDY, JOHN
MASON, TIMOTHY EDWARD
Bennett, Gina Torcivia

Assignees

NCR Voyix Corporation

Dates

Publication Date: 20260506
Application Date: 20251024

Claims (15)

A method, comprising: receiving a request from a user to register for at least one personalized self-checkout terminal accessibility feature; presenting a user interface to enable selecting accessibility preferences; receiving a selection of at least one accessibility preference from the user; storing a selected accessibility preference in association with a user profile; receiving a facial image of the user; and associating the facial image with the user profile.
The method of claim 1, wherein presenting further comprises presenting preset templates for various disabilities and sensitivities.
The method of claim 1 or claim 2, wherein presenting further includes presenting predefined templates associated with known sight, sound, and sensory sensibilities.
The method of any preceding claim, wherein receiving the selection further comprises receiving at least one selection relevant to one or more of a visual interface customization, an audio interface customization, or data input customization; and/or wherein storing further comprises storing metadata local or cloud associated with configuring a user interface of a self-checkout terminal for the selected accessibility preference to enable customizations for one or more of a data input feature, an audio feature, or a visual feature on the self-checkout terminal.
The method of any preceding claim, wherein associating further includes generating biometric measurements from the facial image and linking the biometric measurements to the user profile; and/or the method further comprises: receiving usage data indicating frequently used accessibility features by the user; and updating the user profile based on the usage data.
The method of any preceding claim, further comprising: obtaining a loyalty identifier for the user; and associating the loyalty identifier with the user profile.
The method of any preceding claim, further comprising: receiving an indication of user consent for facial recognition; and storing the indication of user consent in association with the user profile; and/or further comprising: providing an option for the user to enable automatic activation of the selected accessibility preference for future visits to self-checkout terminals.
The method of any preceding claim, further comprising: receiving a candidate facial image associated with the user at a self-checkout terminal; matching the candidate facial image to the user profile; and providing the selected accessibility preference to the self-checkout terminal to enable automatic user interface configuration by the self-checkout terminal during a checkout transaction by the user.
A method, comprising: capturing a facial image of a user at a terminal for a self-checkout transaction; transmitting the facial image to a cloud-based accessibility personalization service; receiving at least one accessibility preference associated with the facial image from the cloud-based accessibility personalization service; configuring an interface of the terminal based on the at least one accessibility preference; presenting a configured interface on the terminal to enable the user to conduct the self-checkout transaction with the at least one accessibility preference; and processing the self-checkout transaction for the user on the terminal using the configured interface.
The method of claim 9, wherein capturing further comprises using one or more of a camera, a light detection and ranging (Lidar) sensor, or an infrared (IR) sensor.
The method of claim 9 or claim 10, wherein configuring further comprises adjusting, in the configured interface, one or more of visual elements, audio features, or data input features based on the at least one accessibility preference.
The method of any of claims 9 to 11, further comprising: presenting an opt-in prompt for facial recognition before capturing the facial image; and/or further comprising: transmitting usage data indicating usage of particular accessibility features by the user during the self-checkout transaction to the cloud-based accessibility personalization service.
The method of any of claims 9 to 12, further comprising: receiving a loyalty identifier associated with the user from the cloud-based accessibility personalization service; and applying the loyalty identifier to the self-checkout transaction; and/or further comprising: reverting the interface to default settings after the self-checkout transaction completes.
A system, comprising: at least one cloud or server comprising at least one processor and a memory, the memory storing instructions representing a cloud-based accessibility personalization service, the instructions when executed by the at least one processor, cause the at least one cloud or server to: receive a request from a user to register for personalized self-checkout terminal accessibility features; present a user interface for selecting at least one accessibility preference; receive at least one selection of accessibility preferences from the user; store a selected accessibility preference in association with a user profile; receive a facial image of the user; associate the facial image with the user profile; receive a candidate facial image from a terminal; identify the user profile associated with the candidate facial image; and transmit the selected accessibility preference associated with the user profile to the terminal; and a terminal comprising at least one processor and a memory, the memory storing instructions that, when executed by the at least one processor, cause the terminal to: capture the candidate facial image of a user; transmit the candidate facial image to the cloud-based accessibility personalization service; receive the selected accessibility preference from the cloud-based accessibility personalization service; configure an interface of the terminal based on the selected accessibility preference; present a configured interface to the user; and process a self-service transaction for the user using the configured interface.
The system of claim 14, wherein the cloud-based accessibility personalization service is further configured to: receive usage data from the terminal indicating particular accessibility features used during the self-service transaction, and update the user profile based on the usage data.

Description

Background Laws regarding accessibility are constantly evolving, with new regulations set to take effect in the near future. Many retailers are working diligently to meet upcoming deadlines and make their customer-facing solutions more compliant with these changing requirements. However, most existing software solutions do not adequately accommodate individuals with diverse abilities. This presents a significant challenge for retailers who aim to provide an equitable and satisfactory experience for all customers. The retail environment often lacks personalized accessibility features, making it difficult for people with different needs to interact effectively with self-service technologies. Additionally, the process of enabling accessibility features is frequently unintuitive, especially for those who would benefit most from them. These issues contribute to a retail experience that is not equitable for all customers, despite most retailers' desire to maximize customer satisfaction across their entire customer base. Summary According to a first aspect of the present invention there is provided a method, comprising: receiving a request from a user to register for at least one personalized self-checkout terminal accessibility feature; presenting a user interface to enable selecting accessibility preferences; receiving a selection of at least one accessibility preference from the user; storing a selected accessibility preference in association with a user profile; receiving a facial image of the user; and associating the facial image with the user profile. Aptly, wherein presenting further comprises presenting preset templates for various disabilities and sensitivities. Aptly, wherein presenting further includes presenting predefined templates associated with known sight, sound, and sensory sensibilities. Aptly, wherein receiving the selection further comprises receiving at least one selection relevant to one or more of a visual interface customization, an audio interface customization, or data input customization. Aptly, wherein storing further comprises storing metadata associated with configuring a user interface of a self-checkout terminal for the selected accessibility preference to enable customizations for one or more of a data input feature, an audio feature, or a visual feature on the self-checkout terminal. Aptly, wherein the metadata is stored locally on the self-checkout terminal and/or on a cloud or server. Aptly, wherein storing further comprises storing metadata local or cloud associated with configuring a user interface of a self-checkout terminal for the selected accessibility preference to enable customizations for one or more of a data input feature, an audio feature, or a visual feature on the self-checkout terminal. Aptly, wherein associating further includes generating biometric measurements from the facial image and linking the biometric measurements to the user profile. Aptly, the method further comprises: receiving usage data indicating frequently used accessibility features by the user; and updating the user profile based on the usage data. Aptly, the method further comprises: obtaining a loyalty identifier for the user; and associating the loyalty identifier with the user profile. Aptly, the method further comprises: receiving an indication of user consent for facial recognition; and storing the indication of user consent in association with the user profile. Aptly, the method further comprises: providing an option for the user to enable automatic activation of the selected accessibility preference for future visits to self-checkout terminals. Aptly, the method further comprises: receiving a candidate facial image associated with the user at a self-checkout terminal; matching the candidate facial image to the user profile; and providing the selected accessibility preference to the self-checkout terminal to enable automatic user interface configuration by the self-checkout terminal during a checkout transaction by the user. According to a second aspect of the present invention there is provided a method, comprising: capturing a facial image of a user at a terminal for a self-checkout transaction; transmitting the facial image to a cloud-based accessibility personalization service; receiving at least one accessibility preference associated with the facial image from the cloud-based accessibility personalization service; configuring an interface of the terminal based on the at least one accessibility preference; presenting a configured interface on the terminal to enable the user to conduct the self-checkout transaction with the at least one accessibility preference; and processing the self-checkout transaction for the user on the terminal using the configured interface. Aptly, wherein capturing further comprises using one or more of a camera, a light detection and ranging (Lidar) sensor, or an infrared (IR) sensor. Aptly, wherein configuring further comprises adjusting, in the configured