Note: Descriptions are shown in the official language in which they were submitted.
CA 02846482 2014-02-25
1
WO 2013/032234 PCT/KR2012/006914
Description
Title of Invention: METHOD OF PROVIDING OF USER
INTERFACE IN PORTABLE TERMINAL AND APPARATUS
THEREOF
Technical Field
[1] The present invention relates to a method of providing a user interface
of a portable
terminal, and an apparatus thereof, and more particularly, to a method and an
apparatus
for providing a user interface for the touch input device when approach of a
touch
input device is sensed.
Background Art
[2] In recent years, with the significant development of information,
communication and
semiconductor technology, the availability and use of all types of portable
terminals
has rapidly increased. In particular, recent portable terminals have been
developed that
converge traditional portable terminal functions as well as functions that
were
previously not available on portable terminals. As a representative example of
the
portable terminal functions, a mobile communication terminal can provide
various
functions such as a TV watching function (e.g., mobile broadcasting such as
Digital
Multimedia Broadcasting (DMB) or Digital Video Broadcasting (DVB)), a music
playing function (e.g., MPEG Audio Layer-3 (MP3)), a photographing function,
and an
Internet access function as well as a general communication function such as
speech
call or text/multimedia message transmission/reception.
[31 As more and varied functions are provided, there is a need to enable
the user to
control the portable terminal rapidly and conveniently. Due to this need,
portable
terminals with a touch screen have recently developed. The touch screen may
sense
contact of a touch input device such as a finger or a stylus to generate an
output at a
contacted location. For example, when a touch occurs on an electromagnetic
induction
touch screen, the capacitance of a touched point varies. When the variation of
ca-
pacitance exceeds a preset threshold, it is determined that a touch event is
occurring.
Through an algorithm that receives a signal of the capacitance variation, the
location of
the touch event may be determined by the algorithm.
Disclosure of Invention
Technical Problem
[4] Typically, a conventional portable terminal has provided the same user
interface
without discriminating a finger or a stylus being a touch input scheme of a
touch
screen. Accordingly, there is a problem in that a function of a user interface
provides
2
WO 2013/032234 PCT/KR2012/006914
on the touch screen or an image of a corresponding function has an unnecessary
complex configuration. For example, when touch input is performed using a
finger, un-
necessary functions specified in a stylus having a small touch region may be
displayed.
[51 There is inconvenience that the conventional portable terminal needs
to perform a
plurality of touch operations such as a touch for display a function screen of
a user
interface and a touch for executing a desired function on a function screen to
execute
the desired function.
Solution to Problem
[6] The present invention has been made in view of the above problems, and
provides a
method and an apparatus of providing a user interface of a portable terminal
that
outputs an affordance image when approach of a touch input device is sensed.
[71 The present invention further provides a method of providing a user
interface of a
portable terminal that may output different affordance images according to
types of
input devices utilized on the portable terminal by the user.
[81 In accordance with an aspect of the present invention, a method of
providing a user
interface of a portable terminal with a touch screen, includes: checking
whether
approach of a touch input device is sensed on the touch screen; determining a
type of
the sensed touch input device when the approach of the touch input device is
sensed;
and outputting a first affordance image corresponding to at least one function
ex-
ecutable using a stylus at a sensed region of the approach of the stylus when
the touch
input device is the stylus as the determination result.
[91 In accordance with another aspect of the present invention, an
apparatus for
providing a user interface of a portable terminal, includes: a touch panel
recognizing
approach and touch of a touch input device; a controller determining a type of
the
touch input device when approach of the touch input device is sensed, and
controlling
such that a first affordance image corresponding to at least one function
executable
using a stylus is displayed at a side of a sensed region of approach of the
stylus when
the touch input device is the stylus as the determination result; and a
display panel
outputting the first affordance image.
[10] In accordance with still another aspect of the present invention, a
method of
providing a user interface of a portable terminal with a touch screen,
includes: sensing
approach of a stylus; and outputting an affordance image corresponding to at
least one
function executable using the stylus at a sensed region of the approach of a
stylus when
the approach of the stylus is sensed.
[11] In accordance with yet another aspect of the present invention, an
apparatus for
providing a user interface of a portable terminal, includes: a touch screen
sensing
approach of a stylus; and a controller for controlling the touch screen to
output an af-
CA 02846482 2014-02-25
3
WO 2013/032234 PCT/KR2012/006914
fordance image corresponding to at least one function executable using the
stylus at a
sensed region of the approach of the stylus when the approach of the stylus is
sensed.
Advantageous Effects of Invention
[12] As illustrated above, in a method of providing a user interface of a
portable terminal
and an apparatus thereof according to embodiments of the present invention,
when
approach of a touch input device is sensed on a touch screen, an affordance
image is
output and one of icons included in the affordance image is touched to perform
a
desired function. Therefore, the present invention may rapidly perform a
desired
function without processing a plurality of steps. Further, the present
invention may
output an affordance image corresponding to types of touch input devices. Ac-
cordingly, the present invention may provide a suitable affordance image
according to
situations to enhance the convenience for the user.
Brief Description of Drawings
[13] The objects, features and advantages of the present invention will be
more apparent
from the following detailed description in conjunction with the accompanying
drawings, in which:
[14] FIG. 1 is a block diagram illustrating an exemplary configuration of a
portable
terminal and a stylus according to an embodiment of the present invention;
[15] FIG. 2 is a view illustrating an exemplary method of sensing approach
of a touch
input device according to an embodiment of the present invention;
[16] FIG. 3 is a flowchart illustrating an exemplary method of providing a
user interface
of a portable terminal according to an embodiment of the present invention;
[17] FIG. 4 is a view illustrating an exemplary screen for expressing an
example of an
interface providing an affordance image when a stylus approaches a schedule
management screen according to an embodiment of the present invention;
[18] FIG. 5 is a view illustrating an exemplary screen for expressing an
example of an
interface providing an affordance image when a stylus approaches a home screen
according to an embodiment of the present invention; and
[19] FIG. 6 is a view illustrating an exemplary screen for expressing an
example of an
interface providing an affordance image when a stylus approaches a screen of
an
address book.
Mode for the Invention
[20] Exemplary embodiments of the present invention are described with
reference to the
accompanying drawings in detail. The same reference numbers are used
throughout the
drawings to refer to the same or like parts. Detailed descriptions of well-
known
functions and structures incorporated herein may be omitted to avoid obscuring
ap-
preciation of the present invention by a person of ordinary skill in the art
with un-
CA 02846482 2014-02-25
CA 02846482 2014-02-25
4
WO 2013/032234 PCT/KR2012/006914
necessary detail of the well-known functions and structures. Also, the terms
used
herein are defined according to the functions of the present invention as
would be un-
derstood by a person of ordinary skill in the art. Thus, the terms may vary
depending
on user's or operator's intension and usage. That is, the terms used herein
must be un-
derstood based on the descriptions made herein in view of the ordinary level
of skill in
the art.As utilized in this detailed description, a portable terminal
according to an em-
bodiment of the present invention may bean electronic device with a touch
screen, and
may include a mobile communication terminal, a personal digital assistant
(PDA), a
smart phone, a tablet personal computer (PC), and a Portable Multimedia Player
(PMP), although this description is not limited to only such terminals. One
skilled in
the will recognize that a portable terminal may include other portable
electronic
devices incorporating a touch screen with a processor for computing and/or
commu-
nication
[21] FIG. 1 is a block diagram illustrating a configuration of a portable
terminal 100 and a
stylus 200 according to an exemplary embodiment of the present invention. FIG.
2 is a
view illustrating the variation of capacitance or electric current in a touch
panel for a
method of sensing approach of a touch input device according to an embodiment
of the
present invention.
[22] Referring to FIG. 1 and FIG. 2, a portable terminal 100 according to
an embodiment
of the present invention may include a radio frequency (RF) communication unit
140, a
touch screen 130, a memory 120, and a controller 110. The touch screen 130 may
include a display panel 131 and a touch panel 132.
[23] The stylus 200 is a touch input device in the form of a pen which may
be used on an
electromagnetic induction touch panel. To do this, the stylus 200 may include
a
resonance circuit. The resonance circuit may resonate by electromagnetic field
generated on the touch screen 130, and generate an induction current due to
the
resonance. The induction current generated by the resonance may cause current
variation in the touch screen 130. That is, the touch screen 130 may recognize
and
react to the approach and touch of the stylus 200 through current variation
due to the
induction current. The design and construction of foregoing stylus 200
including a
resonance circuit will be apparent to a person having ordinary skill in the
art to which
the invention pertains and is known in the art, and thus the detailed
description thereof
is omitted.
[24] The RF communication unit 140 may form a communication channel for
calls (voice
and image calls) with a base station and a data communication channel for data
transmission. To do this, the RF communication unit 110 may include a
transmitter
(not shown) for up-converting a frequency of a transmitted signal and
amplifying the
signal, a receiver (not shown) for low-noise-amplifying a received signal and
down-
5
WO 2013/032234 PCT/KR2012/006914
converting the signal, and a transmission/reception separator (not shown)for
separating
the received signal from the transmitted signal.
[25] The touch screen 130 may perform an input function and an output
function. To do
this, the touch screen 130 may include a display panel 131 for performing an
output
function and a touch panel 132 for performing an input function. The touch
panel 132
may be configured as a combination touch panel being a combination of an
electro-
magnetic induction scheme and a capacitive scheme. Further, the touch panel
132 may
be configured by a combination touch panel being a combination of the electro-
magnetic induction scheme and a resistive scheme.
[26] The touch panel 132 is provided in a front surface of the display
panel 131, and
generates a touch event according to touch of a touch input device, for
example, a user
finger or the stylus 200, and transfers the generated touch event to the
controller 110.
The touch panel 132 may recognize touch through variation in a physical
property
(e.g., capacitance, electric current, etc.), and transfer the type of touch
(tap, drag, flick,
double touch, long touch, multi touch, etc.) and touched positional
information to the
controller 110. The foregoing touch panel 132 will be apparent to a person
having
ordinary skill in the art to which the invention pertains, and thus the
detailed de-
scription thereof is omitted. In particular, the touch panel 132 of the
present invention
may sense approach, touch, approach release, and touch release of the touch
input
device. This will be described with reference to FIG. 2, the touch input
device is
slowly approached, contacts and then a contact is released, capacitance C or
an electric
current I vary as illustrated in FIG. 2. Here, if the variation in capacitance
C or the
electric current I is equal to or greater than a first reference value A, the
touch panel
132 recognizes approach (e.g., 1 ¨ 2 cm) of a touch input device. If the
variation in the
capacitance C or the electric current I is equal to or greater than a second
reference
value B, the touch panel 132 may recognize that a touch input device contacts
(touches) the touch panel 132.
[27] Meanwhile, the variation in the capacitance C and the electric current
I has been
described using the same graph of FIG. 2. It will be apparent to those skilled
in the art
that a variation graph of the capacitance C and a variation graph of the
electric current
I have the same form but are not perfectly identical with those of FIG. 2.
[28] In this case, when the touch panel 132 is a combination touch panel
including a ca-
pacitive touch panel and an electromagnetic induction touch panel, the
capacitive touch
panel may sense the approach contact (touch) and contact (touch) release of a
finger,
and the electromagnetic induction touch panel may sense the approach, contact
(touch), and contact (touch) release of the stylus 200.
[29] In accordance with the present invention, so as to output an
affordance image only
when approach of the stylus 200 is sensed, the touch panel 132 may become a
com-
CA 02846482 2014-02-25
6
WO 2013/032234 PCT/KR2012/006914
bination touch panel in which an electromagnetic induction touch panel and a
resistive
touch panel are combined with each other.
[30] The display panel 131 displays information input by the user or
information provided
to the user as well as various menus of the portable terminal 100. That is,
the display
panel 131 may provide various screens according to utilization of the portable
terminal
100. For example, an idle screen (home screen), a menu screen, a message
creation
screen, a call screen, a schedule management screen, and an address book
screen. In
particular, when approach of the touch input device is sensed, the display
panel 131 of
the present invention may output an affordance image under the control of the
controller 110. This will be described in detail with reference to an example
of a
screen. The display panel 131 may be configured in the form of a flat panel
display
such as a Liquid Crystal Display (LCD), an Organic Light Emitted Diode (OLED),
or
an Active Matrix Organic Light Emitted Diode (AMOLED).
[31] The memory 120 may store an Operating System (OS) of a portable
terminal 100,
and an application program necessary for enabling other options and functions.
Other
options and functions may include, for example, a voice playback function, an
image
or moving image playback function, a broadcasting playback function, a user
data
communication function. For example, the memory 120 may store a key map or a
menu map for operating the touch screen 130. Here, the key map or the menu map
may
be configured in various forms, respectively. For example, the key map may
become a
key board map, a 3*4 key map, a QWERTY key map, or a control key map for con-
trolling operation of a currently activated application program. Furthermore,
the menu
map may become a menu map for controlling an operation of a currently
activated ap-
plication program. The memory 120 may store character messages, game files,
music
files, movie files, and contact information.
[32] Particularly, when a touch input device approaches, the memory 120
according to the
present invention may store a program outputting an affordance image. The
affordance
image may be changed according to a type of approached item or a type of touch
input
device. For example, when the stylus 200 approaches a certain schedule of a
screen,
the affordance image may becomes a time change image to which a time change
function of a schedule is set. When the stylus 200 approaches a certain icon
of a home
screen, the affordance image may become a moving affordance image to which a
moving function of an icon is set. When the stylus 200 approaches certain
contact in-
formation of an address bock screen, the affordance image may become a
function af-
fordance image including frequently used functions, namely, a call icon, a
character
icon, an e-mail icon, and an instant message icon. Alternately, if a finger
approaches a
certain schedule of the schedule management screen, the affordance image may
become a delete affordance image to which a schedule delete function is set.
When a
CA 02846482 2014-02-25
7
WO 2013/032234 PCT/KR2012/006914
finger approaches a certain icon of a home screen, the affordance image may
become a
copy affordance image to which an icon copy function is set. When the finger
ap-
proaches certain contact information of the address book screen, the
affordance image
may not be output. However, this is one exemplary embodiment but does not
limit the
present invention. That is, a function set to an affordance image output upon
ap-
proaching the touch input device for any particular application may be
variously
changed according to intention of a designer.
[33] In the meantime, the memory 120 may set ON/OFF of an affordance
display mode
displaying the affordance image, and store a program changing a function set
to the af-
fordance image. That is, if the touch input device approaches when the user
activates
an affordance image display mode, then program may output the affordance
image.
Moreover, the program may change a function set in the affordance image to a
function requested by the user.
[34] The controller 110 may control an overall operation of the portable
terminal 100 and
signal flow between internal blocks of the portable terminal 100, and perform
a data
processing function processing data. Particularly, when approach of the touch
input
device is sensed, the controller 110 according to the present invention
outputs preset
affordance image. When a touch event occurs on the affordance image, the
controller
110 may control the respective structural elements such that a function in the
af-
fordance image is performed. In this case, the controller 110 may output
another af-
fordance image according a type of a touch input device (e.g., finger or
stylus 200) ap-
proaching the touch screen 130. The controller 110 will be described in
detailed with
reference to FIG. 2 to FIG. 6.
[35] The portable terminal 100 according to the present invention may
selectively include
structural elements for providing additional functions such as a camera module
for
taking images or moving images, a transmitting/receiving module for receiving
or
broadcasting data or voice communications, a digital sound source playback
module
such as an MP3 module, a near distance wireless communication module such as a
Bluetooth transmitter, and a proximity sensor module for proximity sensing.
Since the
structural elements can be variously changed according to the particular
requirements
of a particular digital device, no elements can be listed. However, the
portable terminal
100 may include structural elements equivalent to the foregoing structural
elements.
[36] FIG. 3 is a flowchart illustrating a method of providing a user
interface of a portable
terminal according to an embodiment of the present invention. Hereinafter, a
com-
bination touch panel in which a capacitive touch panel and an electromagnetic
induction touch panel are combined will be explained by way of example.
[37] Referring to FIG. 1 to FIG. 3, a controller 110 of a portable terminal
100 according
to an embodiment of the present invention may control power from a power
supply
CA 02846482 2014-02-25
8
WO 2013/032234 PCT/KR2012/006914
that is supplied to respective structural elements of the portable terminal
100 (301).
Next, the controller 110 may check whether approach of a touch input device
(e.g.,
stylus 200, finger, etc.) is sensed (303). In detail, if the touch input
device approaches a
touch screen 130, capacitance or an electric current varies. The touch panel
132 senses
variation in the capacitance or the electric current and transfers the sensed
variation to
the controller 110. When the transferred variation in the capacitance or the
electric
current is equal to or greater than a first reference value, the controller
110 may
determine that the touch input device approaches a predetermined region of the
touch
screen 130. In this case, the controller 110 may output a location in which
approach of
the touch input device is sensed. If the approach of the touch input device is
not
sensed, the controller 110 may maintain step 303 and continue to monitor for
the
approach of a touch input device. Conversely, if the approach of the touch
input device
is sensed, the controller 110 may determine a type of the touch input device
in which
the approach is sensed (305). For example, the controller 110 may determine
whether
the sensed touch input device is a stylus 200 or a finger. Determination of a
type of the
touch input device may use various known technologies. To do this, when
approach is
sensed in a capacitive touch panel, the controller 110 determines that a
finger ap-
proaches. When approach of an electromagnetic induction touch panel is sensed,
the
controller 110 may determine that the stylus 200 approaches. However, the
present
invention is not limited thereto. That is, the present invention may use other
various
known techniques as a technology determining a type of the touch input device.
[38] After reaching a determination result, that the sensed touch input
device is the stylus
200, for example, approach of the stylus 200 is sensed through electromagnetic
induction touch panel, the controller 110 may output a first affordance image
at a
sensed location of the approach (307). The first affordance image may include
at least
one icon for inducing execution of a function (function for which precise
touch is
requested) specified in the stylus 200. This will be described in detail with
reference to
FIG. 4 to FIG. 6.
[39] Conversely, when the sensed touch input device is not the stylus 200,
for example,
when approach of a touch input device distinguished from said stylus (e.g. the
finger)
is sensed through a capacitive touch panel, the controller 110 may output a
second af-
fordance image distinguished from the first affordance image (309). The second
af-
fordance image may include functions that do not require precise handling or
touch
like the stylus 200.
[40] Next, the controller 110 may determine whether a touch input signal is
generated
(311). To do this, the controller 110 may check whether variation in the
capacitance or
electric current occurs by greater than the second reference value to
determine touch.
In this case, after performing step 307, in step 311 it is determined whether
a touch
CA 02846482 2014-02-25
9
WO 2013/032234 PCT/KR2012/006914
event occurs within an image display region or in another region. After
performing
step 309 or 307, in step 311 it is determined whether a touch event occurs
within a
second affordance image display region or another region.
[41] If the touch input signal is not generated, the controller 110 may
determine whether a
signal corresponding to an approach release of the touch input device is input
(315).
When the signal corresponding to the approach release of the touch input
device is
input, the controller 110 eliminates the first affordance image or the second
affordance
image (317), and the process returns to step 303, and the forgoing procedure
may
repeat iteratively in accordance with the application or function being
accessed by the
user.
[42] Conversely, when the touch input signal is generated, the controller
110 may control
such that a function corresponding to a touch signal input is performed (313).
For
example, when a touch event occurs on the first affordance image, the
controller 110
may execute a function set in the first affordance image. When a touch event
occurs on
the second affordance image, the controller 110 may execute a function set in
the
second affordance image. When a touch event occurs on another region (e.g.,
item), the
controller 110 executes a function set in another region. If the function
corresponding
to the input touch signal is terminated, the process returns to step 303 and
the
controller 110 may repeat the foregoing procedures.
[43] In a state that approach of the touch input device is sensed to output
the first af-
fordance image or the second affordance image, and when touch of the touch
screen
130 is not sensed however movement of the touch input device is sensed, the
controller
110 may control the first affordance image or the second affordance image is
moved
according to movement of the touch input device.
[44] Further, when the touch input device is moved, the affordance image
may be
changed according to an attribute of an item existing in a location which
approach of
the touch input device is sensed. For example, when approach of the touch
input device
is sensed on a music file item, an affordance image including a function
(playback,
stop, addition in a playback file list) is outputted. When the touch input
device is
moved on a shortcut item with respect to a contact point of an individual
user, the
controller 110 may output an affordance image including a function (call,
character
message, e-mail, etc.) associated with the contact point.
[45] Further, the foregoing embodiment has illustrated that the controller
110 controls
such that the second affordance image is output when a touch input device
approaching
the touch screen 130 is not the stylus 200 for example, when approach of a
finger is
sensed through a capacitive type touch panel. However, another embodiment of
the
present invention may process such that approach of the touch input device,
other than
the stylus 200 is disregarded. For example, when the touch input device other
than the
CA 02846482 2014-02-25
10
WO 2013/032234 PCT/KR2012/006914
stylus 200 is approached, the controller 110 may control such that no image is
outputted. That is, in another embodiment of the present invention, only when
approach of the stylus 200 is sensed, the controller 110 may control such that
a preset
affordance image may be output. When the affordance image is output only where
approach of the stylus 200 is sensed, the touch panel 132 may be configured by
a com-
bination touch panel being a combination of an electromagnetic induction type
touch
panel for sensing approach of the stylus 200 and a touch panel of various
schemes
(e.g., capacitive type, resistive type) capable of sensing a touch of a
finger. The touch
input device distinguished from said stylus may include touch gloves,
capacitive
stylus, and conductive stylus, etc.
[46] The present invention may further include a step of determining
whether an af-
fordance image display mode is activated after step 301 or step 303. To reach
the de-
termination result, when the affordance image display mode is activated, the
controller
110 performs following procedures. When the affordance image display mode is
not
activated, the controller 110 may sense only a touch event generated on the
touch
screen 130, and perform a function according to the sensed touch event.
[47] FIG. 4 is a view illustrating an example of a screen for expressing an
example of an
interface providing an affordance image when a stylus approaches a schedule
management screen according to an embodiment of the present invention.
[48] Referring to FIG. 1 to FIG. 4, a display panel 131 according to an
embodiment of the
present invention may be utilized such that a schedule management screen is
displayed. As illustrated in an example of a screen of reference numeral 410,
the user
may display a plurality of registered schedules to be divided into dates and
times.
[49] If approach of the stylus 200 is sensed in a displayed location of a
meal schedule 1,
the controller 110 may control the display panel 131 to output a time change
af-
fordance image 41 in the form of "-" capable of adjusting a due of the meal
schedule 1
as illustrated in an example of a screen of reference numeral 420. The time
change af-
fordance image 41 is not limited to be displayed in the form of "-". That is,
the time
change affordance image 41 may be expressed in various forms according to
intention
of a designer.
[50] To change a time of the meal schedule 1 in an output state of the time
change af-
fordance image 41, as illustrated in an example of a screen of reference
numeral 430,
the user may touch the time change affordance image 41 by the stylus 200, and
moves
the touch (e.g., drag) to change an end time of the meal schedule 1.
Conversely, when
a touch is sensed on a region other than a time change affordance image 41
among a
display region of the meal schedule 1, the controller 110 may control such
that a corre-
sponding function (e.g., view of detailed specification) is performed.
[51] Meanwhile, the foregoing embodiment has illustrated that the
controller 110 controls
CA 02846482 2014-02-25
11
WO 2013/032234 PCT/KR2012/006914
such that a time change function is performed when the time change affordance
image
41 is touched. Furthermore, it has illustrated that when the region that the
time change
affordance image 41 is not outputted among a display region of the meal
schedule 1 is
touched, the controller 110 controls such that a function (output of details)
corre-
sponding to selection of the meal schedule 1 is performed. However, the
present
invention is not limited thereto. For example, another embodiment of the
present
invention may set a region spaced apart from an edge of the display region of
the meal
schedule 1 by a predetermined distance as a first virtual region of a display
region of a
meal schedule 1 and set a region except for the first virtual region included
in the
display region of the meal schedule 1 as second virtual region. When it is
determined
that a stylus 200 approaches the first virtual region, the controller 110 may
control
such that a time change affordance image 41 indicating that a time may be
changed is
displayed. When the stylus 200 approaches the second virtual region, the
controller
110 may control such that a selection affordance image indicating that the
meal
schedule 1 may be selected is displayed or display of the affordance image is
omitted.
[521 When approach of the stylus 200 is sensed, the present invention
mentioned above
may display a time change affordance image 41 at one side of the display
region of the
meal schedule 1 to easily change a time period of the meal schedule. However,
the
related art needs to change a due date of a schedule through a plurality of
steps. For
example, the related art long-touches the schedule to activate a time change
mode, and
changes, when the time change mode is activated, a due date of the schedule
through
an additional touch input. Further, the related art needs to touch the
schedule to output
a detailed report and change a due date of the schedule on a detailed report
screen.
That is, the present invention may change a due date of the schedule rapidly,
easily,
and conveniently as compared with the related art.
[531 In the meantime, FIG. 4 illustrates that only a time change affordance
image capable
of changing an end time of a schedule is displayed. However, the present
invention is
not limited thereto. That is, for example, the controller 110 may further
output a time
change affordance image capable of changing a start time, a start date, and an
end date
when approach of the stylus 200 is sensed.
[541 Further, although not shown in FIG. 4, when approach of a touch input
device (e.g.,
finger) other than the stylus 200 is sensed, the controller 110 may disregard
sensing the
approach. That is, when a touch input device (e.g., finger) other than the
stylus 200 is
approached, the controller 110 may control such that no image is outputted.
This
reason is because it is difficult to touch an affordance image having a
relatively small
size displayed on a side of a display region. In this case, the user may touch
a schedule
to confirm a detailed report or long-touches the schedule to active a
predetermined
time change mode.
CA 02846482 2014-02-25
12
WO 2013/032234 PCT/KR2012/006914
[55] In another embodiment of the present invention, when approach of a
touch input
device (e.g., finger) other than the stylus 200 is sensed, the controller 110
may output
another affordance image distinguished from an affordance image (e.g., time
change
affordance image) displayed when approach of the stylus 200 is sensed. For
instance,
the controller 110 may output an affordance image indicating that the schedule
may be
selected.
[56] FIG. 5 is a view illustrating an example of a screen for expressing an
example of an
interface providing an affordance image when a stylus approaches a home screen
according to an embodiment of the present invention.
[57] Referring to FIG. 5, a controller 110 according to an embodiment of
the present
invention may control the display panel 131 to display a home screen. As
illustrated in
an example of a screen in reference numeral 510, a plurality of icons may be
arranged
and displayed in multiple-rows and multiple-columns.
[58] If approach of the stylus 200 is sensed on the home screen, as
illustrated in an
example of a screen of reference numeral 520, the controller 110 may provide
output
of a moving affordance image 51 to which an icon moving function is set at one
side of
the music icon 2 which is approached by the stylus 200. FIG. 5 illustrates
that the
moving affordance image 51 has a form of " A ", and is displayed at a lower
right end
of the music icon 2. However, the present invention is not limited thereto and
the
moving affordance image may take any number of forms as determined by a
designer.
That is, a form and a display location of the moving affordance image 51 may
be
variously set.
[59] In a state that the moving affordance image 51 is output at one side
of the music icon
2, as illustrated in an example of a screen of reference numeral 530, the user
may touch
the moving affordance image 51 by a stylus 2 and moves the point of contact of
the
stylus and screen (e.g., drag) to change a location of the music icon 2. In
the meantime,
when a touch is sensed on a display region of the music icon 2, the controller
110 may
control such that a music play function set to the music icon 2 is performed.
[60] As described above, unlike the related art, the present invention may
easily move an
icon without using a plurality of steps. In detail, the related art long-
touches a music
icon 2 to activate an icon moving function and moves the icon through a drag.
However, when approach of the stylus 200 is sensed, the present invention
touches and
then drags a moving affordance image displayed on one side of an icon to
perform an
icon moving function rapidly, easily, and conveniently.
[61] Meanwhile, as illustrated in FIG. 4, the controller 110 classifies a
display region of
the music icon 2 into a first virtual region and a second virtual region. When
approach
of the stylus 200 is sensed on the first virtual region, the controller 110
may control
such that a time change affordance image 41 displaying that the due data can
be
CA 02846482 2014-02-25
13
WO 2013/032234 PCT/KR2012/006914
changed can be displayed. When approach of the stylus 200 is sensed on the
second
virtual region, the controller 110 may control such that a selection
affordance image
corresponding to selection is outputted or no image is outputted.
[62] In the meantime, FIG. 5 illustrates that a location of an icon
displayed on the home
screen is changed. However, the present invention is not limited thereto. For
example,
when approach of the stylus 200 is sensed, the controller 110 may display a
size
change affordance image for changing the size of the icon. In the size change
af-
fordance image, a widget whose the size is changed such as a weather widget or
a
schedule widget is applicable to a home screen.
[63] Moreover, although not shown in FIG. 5, when approach of a touch input
device
(e.g., finger) is sensed, the controller 110 may disregard sensing the
approach. That is,
when the approach of the touch input device (e.g., finger) is sensed, the
controller 110
may control such that no image is outputted. This reason is because it is
difficult to
touch an affordance image having a relatively small size displayed on a side
of a
display region. In this case, the user may long-touch an icon to perform an
icon
moving function.
[64] In another embodiment of the present invention, when approach of a
touch input
device (e.g., finger) other than the stylus 200 is sensed, the controller 110
may output
another affordance image distinguished from an affordance image (e.g., moving
af-
fordance image) displayed when approach of the stylus 200 is sensed. For
instance, the
controller 110 may output an affordance image indicating that the music icon 2
may be
selected.
[65] FIG. 6 is a view illustrating an example of a screen for expressing an
example of an
interface providing an affordance image when a stylus approaches a screen of
an
address book.
[66] Referring to FIG. 6, a controller 110 according to an embodiment of
the present
invention may control a display panel 131 to display an address book screen.
As il-
lustrated in an example of a screen of reference numeral 610, the address book
screen
may display contact information registered in the portable terminal 100 in the
form of a
list.
[67] If a stylus 200 approaches a first contact information field 3, as
illustrated in an
example of a screen of reference numeral 620, the controller 110 may provide
control
such that a function affordance image 61 is output to a side of the first
contact in-
formation field 3. The function affordance image 61 may include icons
indicating ex-
ecutable functions, for example, a call icon, a character icon, an e-mail
icon, and an
instant image icon using information (phone number, e-mail address, instant
message
ID, etc.) registered in corresponding contact information.
[68] When the touch screen is in a state that the function affordance image
61 is output,
CA 02846482 2014-02-25
14
WO 2013/032234 PCT/KR2012/006914
the user may touch one of icons included in the function affordance image 61
by the
stylus 200 to perform a corresponding function. For example, when the user
touches a
call icon, the controller 110 may request a call using a phone number of the
corre-
sponding contact information.
[69] Meanwhile, when the user touches a region on which a function
affordance image 61
is not displayed among display regions of the first contact information field
3, the
controller 110 may output a detailed information screen of the first contact
point.
[70] In the meantime, when the user does not touch an icon included in a
function af-
fordance image 61 but moves the stylus 200 to another contact information
field, the
controller 110 may move the function affordance image 61 to another contact in-
formation field. For example, as illustrated in an example of a screen in
reference
numeral 630, when the user moves the stylus 200 to a second contact
information field
4, the controller 110 may control such that the function affordance image 61
is
displayed at a side of the second contact information field 4.
[71] As described above, unlike the related art, the present invention may
easily perform a
certain function without using a plurality of steps. In detail,
conventionally, after
touching or long-touching a contact point field to output a function list in
the form of a
pop-up window, the user should select a desired function (character message,
call, e-
mail, etc.). However, when approach of the stylus 200 is sensed, the present
invention
touches one of icons included in a function affordance image displayed on one
side of
a contact point field to perform a desired function rapidly, easily, and
conveniently.
[72] In addition, although not shown in FIG. 6, when approach of a touch
input device
(e.g., finger) other than the stylus 200 is sensed, the controller 110 may
disregard
sensing the approach. That is, when the touch input device (e.g., finger)
other than the
stylus 200 is approached, the controller 110 may control such that no image is
outputted. The reason is because it is difficult to touch an affordance image
having a
relatively small size displayed on one side of a display region of the icon
using the
finger. For example, when the user attempts touching a character message icon
using
the finger, the user firstly touches a call icon due to the finger having a
relatively large
size.
[73] In the present invention mentioned above, when approach of the stylus
200 is sensed,
an affordance image having a controlling function through a stylus with a
small touch
region, namely, a function for which a precise touch is requested is output.
When
approach of the stylus 200 is not sensed, that is, when approach of a finger
is sensed, it
may control a display panel 131 to output an affordance image including a
function for
which a precise touch is not requested. Accordingly, the present invention may
output
a suitable affordance image according to situations but not output unnecessary
image
on a screen to improve convenience for the user. When the touch approach other
than
CA 02846482 2014-02-25
15
WO 2013/032234 PCT/KR2012/006914
touch sensing is sensed, the present invention may rapidly perform a desired
function
of the user according to output of an affordance image.
[74] As illustrated above, in a method of providing a user interface of a
portable terminal
and an apparatus thereof according to embodiments of the present invention,
when
approach of a touch input device is sensed on a touch screen, an affordance
image is
output and one of icons included in the affordance image is touched to perform
a
desired function. Therefore, the present invention may rapidly perform a
desired
function without processing a plurality of steps. Further, the present
invention may
output an affordance image corresponding to types of touch input devices. Ac-
cordingly, the present invention may provide a suitable affordance image
according to
situations to enhance the convenience for the user.
[75] The above-described methods according to the present invention can be
implemented
in hardware, firmware or as software or computer code that can be stored in a
recording medium such as a CD ROM, an RAM, a floppy disk, a hard disk, or a
magneto-optical disk or computer code downloaded over a network originally
stored
on a remote recording medium or a non-transitory machine readable medium and
to be
stored on a local recording medium, so that the methods described herein can
be
rendered in such software that is stored on the recording medium using a
general
purpose computer, or a special processor or in programmable or dedicated
hardware,
such as an ASIC or FPGA. As would be understood in the art, the computer, the
processor, microprocessor controller or the programmable hardware include
memory
components, e.g., RAM, ROM, Flash, etc. that may store or receive software or
computer code that when accessed and executed by the computer, processor or
hardware implement the processing methods described herein. In addition, it
would be
recognized that when a general purpose computer accesses code for implementing
the
processing shown herein, the execution of the code transforms the general
purpose
computer into a special purpose computer for executing the processing shown
herein.
[76] Although exemplary embodiments of the present invention have been
described in
detail hereinabove, it should be clearly understood that many variations and
modi-
fications of the basic inventive concepts herein taught which may appear to
those
skilled in the present art will still fall within the spirit and scope of the
present
invention, as defined in the appended claims.
CA 02846482 2014-02-25
