Search

US-12625670-B2 - Sound randomization

US12625670B2US 12625670 B2US12625670 B2US 12625670B2US-12625670-B2

Abstract

Causing output of various audio feedback in response to detecting various input events.

Inventors

  • Danielle M. PRICE
  • Hugo D. Verweij

Assignees

  • APPLE INC.

Dates

Publication Date
20260512
Application Date
20240123

Claims (20)

  1. 1 . A computer system configured to communicate with one or more audio output generation components and one or more input devices, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting, via the one or more input devices, a first input event corresponding to a first type of input that activates a first virtual control; in response to detecting the first input event corresponding to the first type of input that activates the first virtual control: performing a respective user interface operation that corresponds to the first type of input that activates the first virtual control; and causing output, via the one or more audio output generation components, of first audio feedback for the first type of input that activates the first virtual control, wherein: the first audio feedback is indicative of activation of the first virtual control that causes the respective user interface operation to be performed; and the first audio feedback for the first type of input that activates the first virtual control is within a first range of a respective characteristic audio feedback for the first virtual control; subsequent to causing output of the first audio feedback for the first type of input that activates the first virtual control, detecting, via the one or more input devices, a second input event corresponding to the first type of input that activates the first virtual control; and in response to detecting the second input event corresponding to the first type of input that activates the first virtual control: performing the respective user interface operation that corresponds to the first type of input that activates the first virtual control; and causing output, via the one or more audio output generation components, of second audio feedback for first type of input that activates the first virtual control, wherein: the second audio feedback is indicative of activation of the first virtual control that causes the respective user interface operation to be performed; the second audio feedback is different from the first audio feedback for the first type of input that activates the first virtual control; and the second audio feedback for the first type of input that activates the first virtual control is within the first range of the respective characteristic audio feedback for the first virtual control and is based on one or more random or pseudorandom values that cause the second audio feedback to vary from the first audio feedback.
  2. 2 . The computer system of claim 1 , the one or more programs further including instructions for: detecting, via the one or more input devices, a third input event corresponding to a second type of input at the first virtual control that is different from the first type of input that activates the first virtual control; and in response to detecting the third input event corresponding to the second type of input at the first virtual control, causing output, via the one or more audio output generation components, of third audio feedback for the second type of input at the first virtual control, wherein the third audio feedback for the second type of input at the first virtual control is within a second range of a second respective characteristic audio feedback for the first virtual control, wherein the second respective characteristic audio feedback is different from the respective characteristic audio feedback.
  3. 3 . The computer system of claim 2 , wherein the first range and the second range are the same range.
  4. 4 . The computer system of claim 2 , wherein the second type of input at the first virtual control is a selection input.
  5. 5 . The computer system of claim 2 , wherein the second type of input at the first virtual control is a hover input.
  6. 6 . The computer system of claim 2 , wherein the second type of input at the first virtual control is a button press input.
  7. 7 . The computer system of claim 2 , wherein the second type of input at the first virtual control is a cancel input.
  8. 8 . The computer system of claim 2 , wherein the second type of input at the first virtual control is a grab input.
  9. 9 . The computer system of claim 2 , wherein the second type of input at the first virtual control is a release input.
  10. 10 . The computer system of claim 2 , wherein the second type of input at the first virtual control is based on gaze.
  11. 11 . The computer system of claim 2 , wherein the second type of input at the first virtual control is based on a detected movement of a hand.
  12. 12 . The computer system of claim 1 , the one or more programs further including instructions for: detecting, via the one or more input devices, a fourth input event corresponding to the first type of input at a second control that is different from the first virtual control; and in response to detecting the fourth input event corresponding to the first type of input at the second control, causing output, via the one or more audio output generation components, of fourth audio feedback for the first type of input at the second control, wherein the fourth audio feedback for the first type of input at the second control is within a third range of a third respective characteristic audio feedback for the second control, wherein the third respective characteristic audio feedback is different from the respective characteristic audio feedback.
  13. 13 . The computer system of claim 12 , wherein the second control is a hardware control.
  14. 14 . The computer system of claim 12 , wherein the first range and the third range are the same range.
  15. 15 . The computer system of claim 12 , wherein the first virtual control is a button that is not part of a keyboard and the second control is a key of a keyboard.
  16. 16 . The computer system of claim 12 , wherein the first virtual control is displayed as part of a home screen user interface and the second control is displayed as part of a user interface that is not a part of the home screen user interface.
  17. 17 . The computer system of claim 1 , wherein the one or more random or pseudorandom values that cause the second audio feedback to vary from the first audio feedback include a first random or pseudorandom value used set a pitch of the second audio feedback.
  18. 18 . The computer system of claim 1 , wherein the one or more random or pseudorandom values that cause the second audio feedback to vary from the first audio feedback include a second random or pseudorandom value used to set a volume of the second audio feedback.
  19. 19 . The computer system of claim 1 , wherein the respective characteristic audio feedback is randomly or pseudorandomly selected from among a plurality of characteristic audio feedback.
  20. 20 . The computer system of claim 1 , wherein the second audio feedback is based on one or more input characteristics of the first type of input that activates the first virtual control of the second input event.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to U.S. Provisional Application Ser. No. 63/470,892, entitled “SOUND RANDOMIZATION,” filed Jun. 3, 2023, and claims priority to U.S. Provisional Application Ser. No. 63/455,493, entitled “SOUND RANDOMIZATION,” filed Mar. 29, 2023, the content of each application is hereby incorporated by reference in its entirety. TECHNICAL FIELD The present disclosure relates generally to computer systems that are in communication with one or more audio output generation components and one or more input devices that provide computer-generated experiences, including, but not limited to, electronic devices that provide virtual reality and mixed reality experiences via a display. BACKGROUND The development of computer systems for augmented reality has increased significantly in recent years. Example augmented reality environments include at least some virtual elements that replace or augment the physical world. Input devices, such as cameras, controllers, joysticks, touch-sensitive surfaces, and touch-screen displays for computer systems and other electronic computing devices are used to interact with virtual/augmented reality environments. Example virtual elements include virtual objects, such as digital images, video, text, icons, and control elements such as buttons and other graphics. SUMMARY Some methods and interfaces for providing audio feedback are cumbersome, inefficient, and limited. For example, systems that provide insufficient audio feedback are complex, tedious, and error-prone, create a significant cognitive burden on a user, and detract from the experience with the virtual/augmented reality environment. In addition, these methods take longer than necessary, thereby wasting energy of the computer system. This latter consideration is particularly important in battery-operated devices. Accordingly, there is a need for computer systems with improved methods and interfaces for providing audio feedback more efficient and intuitive for a user. Such methods and interfaces optionally complement or replace conventional methods for providing audio feedback to users. Such methods and interfaces reduce the number, extent, and/or nature of the inputs from a user by helping the user to understand the connection between provided inputs and device responses to the inputs, thereby creating a more efficient human-machine interface. The above deficiencies and other problems associated with user interfaces for computer systems are reduced or eliminated by the disclosed systems. In some embodiments, the computer system is a desktop computer with an associated display. In some embodiments, the computer system is portable device (e.g., a notebook computer, tablet computer, or handheld device). In some embodiments, the computer system is a personal electronic device (e.g., a wearable electronic device, such as a watch, or a head-mounted device). In some embodiments, the computer system has a touchpad. In some embodiments, the computer system has one or more cameras. In some embodiments, the computer system has a touch-sensitive display (also known as a “touch screen” or “touch-screen display”). In some embodiments, the computer system has one or more eye-tracking components. In some embodiments, the computer system has one or more hand-tracking components. In some embodiments, the computer system has one or more output devices in addition to the display generation component, the output devices including one or more tactile output generators and/or one or more audio output devices. In some embodiments, the computer system has a graphical user interface (GUI), one or more processors, memory and one or more modules, programs or sets of instructions stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI through a stylus and/or finger contacts and gestures on the touch-sensitive surface, movement of the user's eyes and hand in space relative to the GUI (and/or computer system) or the user's body as captured by cameras and other movement sensors, and/or voice inputs as captured by one or more audio input devices. In some embodiments, the functions performed through the interactions optionally include image editing, drawing, presenting, word processing, spreadsheet making, game playing, telephoning, video conferencing, e-mailing, instant messaging, workout support, digital photographing, digital videoing, web browsing, digital music playing, note taking, and/or digital video playing. Executable instructions for performing these functions are, optionally, included in a transitory and/or non-transitory computer readable storage medium or other computer program product configured for execution by one or more processors. There is a need for electronic devices with improved methods and interfaces for providing audio feedback. Such methods and interfaces may complement or replace conventional methods for providing audio fe