EP-4742012-A2 - DEVICES, METHODS, AND SYSTEMS FOR MANIPULATING USER INTERFACES

EP4742012A2EP 4742012 A2EP4742012 A2EP 4742012A2EP-4742012-A2

Abstract

Various implementations include systems, methods, and devices for manipulating user interfaces. For example, in some implementations, a method includes moving a drawing palette based on a corresponding request. A movable drawing palette enables a larger portion of the display to be available for content modification operations. As another example, in some implementations, a method includes displaying a screenshot editing interface for editing a captured screenshot, based on an input type of a detected input. By displaying the screenshot editing interface in response to performing a screenshot capture, the method provides an enhanced user experience that utilizes fewer system resources. As yet another example, in some implementations, a method includes selectively erasing portions of an object using a multi-mode eraser tool. A pixel erase input deletes a portion of a displayed object, whereas an object erase input deletes the entirety of the displayed object.

Inventors

SOLI, CHRISTOPHER D.
GRIFFIN, BRADLEY W.
PRESTON, DANIEL T.
JON, TIFFANY S.

Assignees

Apple Inc.

Dates

Publication Date: 20260513
Application Date: 20200410

Claims (15)

A method comprising: at an electronic device with one or more processors, a non-transitory memory, an input device, and a display device: displaying, via the display device, a first drawing palette at a first location within a first application interface, wherein the first drawing palette has a first appearance at the first location in which the first drawing palette includes a plurality of content manipulation affordances, the plurality of content manipulation affordances including a representation of a currently selected drawing tool concurrently displayed with one or more representations of other available drawing tools; detecting, via the input device, a first input that corresponds to a request to move the first drawing palette within the first application interface; and in response to detecting the first input: in accordance with a determination that the first input corresponds to a request to move the first drawing palette to a second location within the first application interface, displaying the first drawing palette at the second location with the first appearance; and in accordance with a determination that the first input corresponds to a request to move the first drawing palette to a third location within the first application interface that is different from the second location, displaying the first drawing palette at the third location with a second appearance that is different from the first appearance, in which the first drawing palette includes a single content manipulation affordance, the single content manipulation affordance including a representation of a currently selected drawing tool, wherein the first drawing palette with the second appearance does not include representations of other drawing tools in the first drawing palette.
The method of claim 1, wherein the first location corresponds to a first location type, the method further comprising: in accordance with a determination that the first input corresponds to a first input type, displaying the first drawing palette at the second location with the first appearance based on the first location type and the first input type; and in accordance with a determination that the first input corresponds to a second input type that is different from the first input type, displaying the first drawing palette at the third location with the second appearance based on the first location type and the second input type.
The method of claim 1, wherein the determination that the first input corresponds to the request to move the first drawing palette to the second location includes determining that the second location corresponds to a first location type, and wherein the determination that the first input corresponds to the request to move the first drawing palette to the third location includes determining that the third location corresponds to a second location type that is different from the first location type.
The method of claim 1, further comprising: while displaying the first drawing palette at the second location with the first appearance and having a first orientation, wherein the second location corresponds to a first location type: detecting, via the input device, a second input that corresponds to a request to move the first drawing palette to a fourth location within the first application interface, wherein the fourth location corresponds to the first location type; and in response to detecting the second input: in accordance with a determination that the fourth location is on an opposite side of the display as compared with the second location, displaying the first drawing palette at the fourth location with the first appearance and having the first orientation; and in accordance with a determination that the fourth location is not on the opposite side of the display as compared with the second location, displaying the first drawing palette at the fourth location with the first appearance and having a second orientation different from the first orientation.
The method of any of claims 1-4, further comprising, in response to detecting a second input corresponding to a drawing operation on the first application interface, ceasing to display the first drawing palette.
The method of any of claims 1-5, wherein the first appearance corresponds to the first drawing palette being in a first expanded state, and wherein the second appearance corresponds to the first drawing palette being in a condensed state.
The method of claim 6, further comprising: while displaying the first drawing palette in the condensed state at the third location: detecting, via the input device, a touch input directed to the first drawing palette; and in response to detecting the touch input, displaying the first drawing palette in a second expanded state that is different from the first expanded state, wherein the first drawing palette in the second expanded state includes more representations of drawing tools than the first drawing palette in the condensed state.
The method of claim 7, further comprising: detecting, via the input device, a second input directed to a particular content manipulation affordance within the first drawing palette in the second expanded state; and in response to detecting the second input, setting a current editing setting associated with the first drawing palette according to the particular content manipulation affordance.
The method of any of claims 1-8, further comprising: while displaying the first drawing palette at the second location or the third location: detecting, via the input device, a tap input directed to the first drawing palette; and in response to detecting the tap input, moving the first drawing palette to the first location.
The method of any of claims 1-9 further comprising: in accordance with a determination that the first input satisfies a first distance threshold, determining that the first input corresponds to the request to move the first drawing palette to the second location and displaying the first drawing palette at the second location with the first appearance; and in accordance with a determination that the first input does not satisfy the first distance thresholds, displaying the first drawing palette at the first location with the first appearance.
The method of any of claims 1-10, further comprising: in accordance with a determination that the first input satisfies a velocity threshold, determining that the first input corresponds to the request to move the first drawing palette to the second location and displaying the first drawing palette at the second location with the first appearance; and in accordance with a determination that the first input does not satisfy the velocity threshold, displaying the first drawing palette at the first location with the first appearance.
The method of any of claims 1-11, further comprising: displaying, via the display device, a second application interface concurrently with the first application interface, wherein the second application interface includes a second drawing palette; in accordance with a determination that the first application interface has a respective dimensional characteristic that does not satisfy a threshold size, setting the first drawing palette as unmovable within the first application interface, and setting the second drawing palette as movable within the second application interface; detecting, via the input device, a second input; and in response to detecting the second input: in accordance with a determination the second input corresponds to a request to move the first drawing palette to a fourth location within the first application interface, maintaining a current position of the first drawing palette; and in accordance with a determination the second input corresponds to a request to move the second drawing palette to a fifth location within the second application interface, moving the second drawing palette to the fifth location.
The method of claim 12, further comprising: detecting, via the input device, a third input directed to the first application interface; and in response to detecting the third input, deemphasizing the second drawing palette relative to content displayed on a canvas of the second application interface.
An electronic device, comprising: one or more processors; a non-transitory memory; an input device; a display device; and one or more programs, wherein the one or more programs are stored in the non-transitory memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods of claims 1-13.
A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with one or more processors, an input device, and a display device, cause the electronic device to perform any of the methods of claims 1-13.

Description

TECHNICAL FIELD This relates generally to electronic devices with user interfaces, and, in particular, to electronic devices with one or more input devices that detect inputs in order to manipulate the user interfaces. BACKGROUND Using inputs for manipulating user interfaces of an electronic device has become ubiquitous. For example, in various embodiments, an electronic device uses peripheral-type input devices (e.g., a touch-screen input, mouse, keyboard) in order to affect the display of one or more displayed user interfaces. However, many of these input devices provide limited and inefficient control for manipulating the user interface. Accordingly, repetitive, complex, and/or cumbersome inputs or input types may be needed to manipulate the user interface in order for the electronic device to perform a particular operation. SUMMARY Accordingly, there is a need for a robust and efficient mechanism for manipulating the user interface of a display at an electronic device. In particular, there is a need for the electronic device to have faster, more efficient methods and interfaces for user interface manipulation. Such methods and interfaces optionally complement or replace conventional methods for manipulating user interfaces. Such methods and interfaces reduce the number, extent, and/or nature of the inputs from a user and produce a more efficient human-machine interface. Accordingly, for battery-operated devices, such methods and interfaces conserve power and increase the time between battery charges. The above deficiencies and other problems associated with user interfaces for electronic devices with touch-sensitive surfaces are reduced or eliminated by the disclosed devices, systems, and methods. In some embodiments, the electronic device is a desktop computer. In some embodiments, the electronic device is portable (e.g., a notebook computer, tablet computer, or handheld device). In some embodiments, the electronic device is a personal electronic device, such as a mobile phone or a wearable device (e.g., a smartwatch). In some embodiments, the electronic device has a touchpad. In some embodiments, the electronic device has a touch-sensitive display (also known as a "touch screen" or "touch-screen display"). In some embodiments, the electronic device has a graphical user interface (GUI), one or more processors, memory and one or more modules, programs or sets of instructions stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI primarily through stylus and/or finger contacts and gestures on the touch-sensitive surface. In some embodiments, the user interacts with the GUI primarily through user interactions with the stylus while the stylus is not in physical contact with the touch-sensitive surface. In some embodiments, the user interacts with the GUI primarily through finger and/or hand contacts and gestures on the stylus while the user is holding the stylus. In some embodiments, the functions optionally include image editing, drawing, presenting, word processing, spreadsheet making, game playing, telephoning, video conferencing, e-mailing, instant messaging, workout support, digital photographing, digital videoing, web browsing, digital music playing, note taking, and/or digital video playing. Executable instructions for performing these functions are, optionally, included in a non-transitory computer readable storage medium or other computer program product configured for execution by one or more processors. In accordance with some embodiments, a method is performed at an electronic device with one or more processors, a non-transitory memory, an input device, and a display device. The method includes displaying, via the display device, a first drawing palette at a first location within a first application interface. The first drawing palette has a first appearance at the first location in which a representation of a currently selected drawing tool is concurrently displayed with one or more representations of other available drawing tools. The method further includes detecting, via the input device, a first input that corresponds to a request to move the first drawing palette within the first application interface. The method further includes, in response to detecting the first input: in accordance with a determination that the first input corresponds to a request to move the first drawing palette to a second location within the first application interface, displaying the first drawing palette at the second location with the first appearance; and in accordance with a determination that the first input corresponds to a request to move the first drawing palette to a third location within the first application interface that is different from the second location, displaying the first drawing palette at the third location with a second appearance that is different from the first appearance, wherein when the first drawing palette has the second appearan