Note: Descriptions are shown in the official language in which they were submitted.
`` 2 ~ 3
COMPUTERIZED ENCYCLOPEDIA
AND USER INTERFACE THEREFOR
BACKGROUND OF THE INVENTION
;~ 1. Fleld of the Invention.
j 5 This invention relates in general to an information
`~ presentation apparatus, and in particular to a
~ computerized encyclopedia and user interface therefor.
,~
,~ 2. Description of Related Art.
Computerized encyclopedias are well known in the
art, for example, as provided by online services such as
CompuServe and Prodigy. Howeve:r, prior attempts at
computerized encyclopedias suffer from many
shortcomings. A primary shortcoming is that prior
computerized encyclopedias are not easily used by young
children. ~ -
Prior computerized encyclopedias do not take into ;-
account that young children are just beginning to learn
the order of the alphabet, how to read, and how to -~
write. As a result, the encyclopedia may not be
accessible to young children who have not yet fully
developed their reading and writing skills.
Prior computerized encyclopedias also are difficult
~,r to use by non-readers or beginning readers because they
use text-only instructions. A user with no access to
screen instructions has no control over the sys~em.
The user interface design is often complex and
confusing. Further, the user interface may implement
cryptic commands and non-obvious search techniquas. By
making the systems difficult to use for children, they
do little to entice the child in uncovering information
contained therein. Children may quickly tire of
attempting to use the system.
~ ~ '- `~'
SUMMARY OF THE INVENTION
To overcome the limitations in the prior art
described above, and to overcome other limitations that
will become apparent upon reading and understanding the
present specification, the present invention discloses
"~
- an information presentation apparatus comprislng a
computer program executed by a computer for accessing an
, .
encyclopedia stored in an electronic format in the
;j computer~s data storage. The encyclopedia comprises a
l~ 5 database of articles and associated multimedia elements,
,~ including graphics, animations, and sounds. The
computer program provides four pathways for accessing
the articles in the encyclopedia, including an
`j alphabetical list pathway, a topic hierarchy pathway, a
`~ lO search and retrieval pathway, and a multimedia browser
pathway.
The alphabetical list pathway organizes articles
from the encyclopedia alphabetically on the monitor.
~ The alphabetical list pathway displays a list of
'`~ 15 graphics on the monitor which represent each letter in -
an alphabet, so that when the user selects one of the
graphics, a list of articles related thereto is
displayed on the monitor. The alphabetical list pathway
assists users in learning their "ABCs"; because the
article titles are indicated by graphics corresponding
~ to the letters of the alphabet, so that every graphic
i~ displayed on the monitor corresponds to a let~er in the
, alphabet. The alphabetical list pathway voices a ~
' description of the graphics through the speaker so that
users who do not know their ABCs can hear the letter
names. The graphics can comprise c~igitized speech and `-~
animations illustrating the subject matter of the
graphics.
The topic hierarchy pathway organizes articles from
the encyclopedia on the monitor by topic groups which
are indicated graphically on the monitor. The topic
hierarchy pathway displays topic groups designed for
young children, so that the organizational structure
corresponds to objects recognizable by the young
children. The topic hierarchy pathway displays a list
of graphics which represent each topic group, so that
when the user selects one of the graphics, a list of
` 3
articles related thereto is displayed on the monitor.
~ These graphics are menus which are presented as a series
;~ of picture scenes, so that the list of article titles
can be put in pictorial context. The article titles are
organized by picture menus corresponding to the -topic
groups. The series of picture menus map topics to
recognizable places. A picture menu can be "zoomed in
on~ to display a more detailed article list
corresponding thereto.
The search and retrieval pathway generates a list of
~l article titles using questions answered by the user to
i~3 determine the scope of the articles. The search and
retrieval pathway can also generate a list of article
titles using search terms entered by the user into the
computer. When a title is selected from the list, the
opening screen of the selected article is displayed on
the monitor. The search terms are highlighted in the ii
article, table, picture caption, and sound captioned
text as they are displayed.
, 20 The multimedia browser pathway organizes articles
from the encyclopedia on the monitor according to the
multimedia elements contained therein, so that the
corresponding articles are displayed when the multimedia
elements are selected. Users can select a multimedia
feature from a list of similar features, and displays
the opening screen of the corresponding article on the
monitor. The multimedia browser pathway permits
articles to be perused by previewing the multimedia
elements therein. Included in the multimedia browser
pathway are a picture browser, speech browser, animation
browser, map browser, and sound browser.
BRIEF DESCRIPTION OF THE DRAWINGS
Referring now to the drawings in which like
reference numbers represent corresponding parts
throughout:
~ ~'
~I
, ~ , .
~ 4 2 ~ ~
. .,
~ Figure 1 illustra-tes one possible embodiment of the
j- hardware comprising the present invention;
~ Figure 2 is a flow chart describing the method of
i.^l creating the encyclopedia as a multimedia database and
directory therefor;
Figure 3 show.s the format of the database and its
directory after compilation; .:`
~-il Figure 4 shows the format of the file linking topics
sl to articles;
Figure 5 shows the format of a file linking topic
titles to suggested questions;
~, Figure 6 shows the format of a file linking
suggested questions to articl~s;
Figure 7 is a flow chart defining the overall logic
of the computer program which directs the operation of
the present invention;
Figure 8 illustrates the Main Nenu screen of the : ~i
present invention;
~3 Figure 9 is a flow chart describing the functions :
performed whenever the menu items, control buttons,
earphones icon, or pathway graphics are selected by the
user at the Nain Menu screen;
Figure 10 illustrates the opening screen for the
ABCs pathway which is displayed when the user selects
25 the ABCs pathway graphic on the Main Menu screen; ~:
Figure 11 is a flow chart describing the functions
performed whenever the block letters, arrows, earphones -`ic
! icon, or labeled graphics are invoked by the user at the
ABCs opening screen; ::
Figure 12 illustrates an ABCs article list that is
displayed when the user selects a block letter on the .
ABCs opening screen; -::
Figure 13 is a flow chart describing the functions
i~ performed whenever a control element is selected by the
~ 35 user from the ABCs article list screen; :
,!
~ . ~ ~
~ . ':
3~1'`J'
:a~
5 ~ ~ t,3 ~ 3
h' Figure 14 illustrates the opening screen for the
`:; World of Words pathway which is displayed when the user
'. selects the World of Words pathway grapnic on the Main
~' Menu screen;
. 5 Figure 15 is a flow chart of the relationships
~ between the topic menus illustrated in Figures 16-33.
:, Figures 16-33 illustrate examples of the picture
( scenes and the topic groups associated therewith;
`~I Figure 34 is a flow chart describing the functions :
performed whenever a control element is selected by the
! user at the World of Words opening screen;
Figure 35 illustrates the World of Words article
list screen that is displayed when the user selects a
labelled picture screen on the World of Words graphic
that has an article list assigned to it;
~'!e Figure 36 is a flow chart describing the functions
performed whenever a control element is selected by the :~
user from the World of Words article list screen;
Figure 37 illustrates the opening screen for the
ABCs pathway which is displayed when the user selects
the ABCs pathway graphic on the Main Menu screen;
Figure 38 is a flow chart illustrating how the
j Choose A Question interface, Make Up A Question
interface, and Question Starters interface relate to one .:
another;
Figure 39 is a flow chart describir~g the functions
performed whenever a control element is selected by the
user at the Seek and Find opening screen;
Figure 40 illustrates the Choose A Question screen : ~
.', 30 that is displayed when the user selects the Choose A :
Question door on the Seek and Find opening screen;
.~ Figure 41 is a flow chart describing the functions
,?;`~
performed whenever a control element is selected by the
user from the Choose A Question screen;
Figure 42 illustrates the Suggested Questions screen
that is displayed when the user selects a topic card
:~ icon on the Choose A Question screen;
r::
.:~
. ;1 ~
;``: ` ~
: 6
`-` Figure 43 is a flow chart describing the functions
.,
. performed whenever a control element is selected by the
~- user from the Suggested Questions screen;
Figure 44 illustrates the Suggested Rrticles screen .
~! 5 that is displayed when the user selects a question from . .
.~. the Suggested Questions screen;
Figure 45 is a flow chart describing the functions
performed whenever a control element is selected by the .~
user from the Suggested Article screen; -~:.
Figure 46 illustrates the Make Up A Question screen
that is displayed when the user selects the Make Up A
Question door graphic on the Seek and Find opening
screen;
~;;.,~ Figure 47 is a flow chart describing the functions
~, 15 performed whenever a control element is selected by the
user from the Make Up A Question screen;
Figure 48 illustrates the Alternate Spelling screen
that is displayed when a misspelled word is identified
in the Make Up A Question screen;
Figure 49 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Alternate Spellings screen;
Figure 50 illustrates the Dictionary screen that is
displayed when the user selects the Dictionary icon on ~:
. 25 the Make Up A Question screen;
Figure 51 is a flow chart describing the functions
performed whenever a control element is selected by the ~.:
user from the Dictionary screen;
Figure 52 illustrates the Question Starters screen
that is displayed when the user selects the Question
' Starters icon on the Make Up A Question screen;
Figure 53 is a flow chart describing the functions
,~ performed whenever a control element is selected by the
user from the Question Starters screen;
~s` ! 35 Figure 54 illustrates the Seek and Find article list
3 screen that is displayed when a search of the database
has successfully generated an article list;
- Figure 55 is a flow char-t describing the functions
i~, performed whenever a control element is selected by the
~:. user from the Seek and Find article list screen;
Figure 56 illustrates the opening screen for the
Sights and Sounds pathway which is displayed when the
user selects the Sights and Sounds pathway graphic on
the Main Menu screen;
Figure 57 is a flow chart describing the functions
performed whenever a control element is selected by the
user at the Sights and Sounds opening screen;
Figure 58 illustrates the Picture Browser screen
.~3 that is displayed when the user selects the Picture
graphic at the Sights and Sounds opening screen;
., Figure 59 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Picture Browser screen;
Figure 60 illustrates the Speech Browser screen that
~i is displayed when the user selects the Speech graphic at
the Sights and Sounds opening screen;
Figure 61 is a flow chart describing the functions
.` performed whenever a control element is selected by the
user from the Speech Browser screen;
¦ Figure 62 illustrates the Animation Browser screen
~'~ that ls displayed when the user selects the Movie
graphic at the Sights and Sounds opening screen;
Figure 63 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Animation Browser screen;
.~ Figure 64 illustrates the Map Browser screen that is
displayed when the user ielects the Map graphic at the
7, ! Sights and Sounds opening screen;
Figure 65 is a flow chart describing the functions
performed whenever a control element is selected by the
`! user from the Map Browser screen;
~ 35 Figure 66 illustrates the Sound Browser screen that
,~r;~j is displayed when the user selects the Sound graphic at
~ the Sights and Sounds opening screen; ~:
' -
2 ~ ~3 ~ f~ ; -
.~.. i
',.~,
-`~ Figure 67 is a flow chart describing -the functions
performed whenever a control element is selected by the
~` user from the Sound Browser screen; and
~ Figure 68 is a flow chart describing the functions
,A,.'j, 5 performed whenever the robot control button iB selected.
DETAILBD DESCRIPTION OF THE PREFERRED EMBODIMENT
`. In the following description of the preferred
embodiment, reference is made to the accompanying
drawings which form a part hereof, and in which is shown
by way of illustration a specific embodiment in which
the invention may be practiced. It is to be understood
that other embodiments may be utilized and structural
changes may be made without departing from the scope of -
the present invention.
OVERVIEW
The present invention discloses an information
presentation apparatus comprising a software program
executed by a computer which accesses an encyclopedia
.l stored in electronic format on a data storage device.
;`j The present invention is designed principally for use by `
children in the kindergarten through third grade (K-3)
age groups. The goals for children in these g-3 age
groups are primarily to learn the order of the alphabet,
~`l how to read, and how to write.
- At the same time, the computer environment of the
present invention presents a unique opportunity for very
.~ young students who are just beginning to acquire the
literacy skills to grow intellectually without these
~ I skills being in place, simply by making easily
,,,!,'1 accessible the information which the child is already
interested.
Notivated by self discovery, children are less
~ 35 inhibited than adults when it comes to using computers,
-31~ mostly because they are not afraid to make mistakes. In
~ addition, children exhibit a far greater spectrum of
``l .
: . `
....
. ~
i -i
't'~ 9 ;~ 3
, .
abilities than adults. The presen-t invention provides a
flexible system that can respond to students who have
not yet fully developed their reading and writing
skills, as well as to students who just need quick
~O~ 5 access to informa-tion.
The pedagogical and methodological intent of the
present invention comprises a number of different goals.
~l One goal is to exploit the benefits of ~active
t'~ ' learning", i.e., learning by doing, by allowing a user
to explore the encyclopedia at their own rate. Another
~` goal is to teach a child/user simple research
i~ strategies, such as recognizing alphabetical and numeral
order, as well as formulating and expressing questions.
Still another goal is to teach the child/user to
~`i 15 recognize the links between concepts and make a
, deliberate progression from article to article. Yet
another goal is to allow the child/user to easily
manipulate the computer by designing a simple, straight-
forward, and versatile user interface.
A number of different guidelines were designed for
the present invention with the R-3 age group in mind.
One guideline was to get the children involved in
exploring thè knowledge contained in the database by
enticing the child to explore at their own rate.
Further, the child can be encouraged to make new
b connections in the database by rewarding their actions
with serendipity, surprise, action~ events and humor.
Another guideline was a conscious effort never to
isolate a non-reading user by usiny text-only
instructions. Thus, the present invention will voice
the instructions using a speaker attached to the
computer to make sure that non-reading users are ~
accommodated by the invention. Understandably, a user -
- with no access to screen instructions has no control
over the software.
~ .-.
~.~ .~
,.~1.`,.'.~;
I' ' '"
. Another guideline was to make the interface of the
; computer program as easy to manipulate as possible. A
conscious decision was made that user interfaces which
must be learned, such as selecting text or holding down
a menu, wil~ be used sparingly to minimize the amount of
;~, time and skill required to learn to use the program.
Yet another guideline was to provide a common "look
and feel" to the interface elements, i.e., lists,
windows, text input, and menu options, so that it is
~l 10 easier for the user to use similar software products.
Yet another guideline for the present invention was
the linking of non-instructional animations and sound to
~, function to avoid creating tedious delays in the
~-; interface.
Yet another guideline for the present invention was
~ to make the instructions straight-forward and easy to
;~ bypass once they are understood, so that a user is not
constantly instructed on how to use the program and thus
can proceed at their own pace.
Yet another guideline for the present invention was
s to maintain the user's attention during system delays by ~`
; keeping them informed with meaningful messages. It may
be unavoidable to prevent users from "tuning out", but
they should know when to tune back in again as well.
i~ OPERATING ENVIRONMENT
`51~: Figure 1 illustrates one possible embodiment of the
hardware comprising the present invention. The present
invention is a computer program operating on a personal
i~i 30 computer (PC) 10, preferably an Apple MacIntosh personal
;i~. ' computer 10, although MS-DOS computers could be used as
~, well. It is envisioned that a monitor 12 and data
`~l storage peripherals will be attached to the PC 10.
Preferably, the data storage peripherals will include a
CD-ROM disk drive 14 for storing the encyclopedia and a
standard hard disk drive 16 for storing the program and
other data. Also included in the preferred embodiment
, ,~
.,~ .,.
`1 .
2 ~
are input devices, for example, a mouse poin-ting device
-- 18 and a keyboard 20. In addition, preferably the
- computer will have a speaker 22 for digitized speech and
-`~ sound.
~i 5 In the preferred embodinent oE present inven-tion,
the computer 10 uses the Apple MacIntosh operating
j~i system, although other operating systems such as
! ~ Microsoft Windows or UNIX X-Windows could be used as
., ~
~-` well. However, the present specification does not go
' 10 into details on how the operating system works nor how
' ,3 to program in the environment, as these details are well
~ known in the art. The present specification assumes
;-! that the reader has an understanding of basic concepts
for programming within these "windowing" environments,
`~ 15 such as selecting objects, editing text, working with
; menus and dialog boxes, etc.
~ ~G` . ~
DATABASE
~Gj~ The encyclopedia of the present invention provides a
unifying theme wherein the student becomes a detective
while using the encyclopedia. The user decides which
mystery to solve by deciding which questions to ask and
then trying to answer them. The encyclopedia is
designed to be a world of its own, with articles that
may be linked together via key word "cluesn or trails.
At the article level, text, graphics, sound and
cross references help the user discover the desired
information. Text can feature column tables, text
3'l tables and color fact tables. Graphics can include
~j 30 pictures, a series of pictures, maps and animation
sequences. Sound includes such audio enhancements as
;~ special affects, speeches, music, or attention grabbing
i.;~ article captions.
~ The pictures, animations and sounds are embedded in
;~ 35 article screens in the electronic encyclopedia of -the
present invention to avoid the pitfalls of "hidden
t.. , fea-tures" which take time to be discovered. In the
'~`'it'` , -
1 ,
~ ` 12
'~:
; presen-t invention, as soon as the user opens up an
article for viewing, all of its enhancements are
displayed without further manipulation.
Cross-references in the articles consist of "see~'
-~ 5 references that direct a user to more information
,~ explaining a previous paragraph, and "see also"
li references that direct a user to an article related to
the topic of the current article.
Figure 2 is a flow chart describing the method of
creating the encyclopedia as a multimedia database and
directory therefor. Block 202 represents the
`;il construction of an intermediate multimedia document file
-~ on the computer for each article which is to be included
in the multimedia database. Preferably, the
construction step is performed using widely-available
commercial word processors on a personal computer.
The intermediate multimedia document file comprises
.':`3! ASCII text 204, references to multimedia resources 208,
and hypertext linkages providing branches to related
20 articles. The references to the multimedia resources ;
208 contain a media type identifier and a unique
identifier to at least one multimedia resource file.
Because the references are text-based, more information
can be added at any time to add more functionality,
`' 25 thereby providing extensibility.
Editing of the intermediate multimedia document
files is easy and typically can be performed on any
computer using a commercial word processing package.
Such packages that implement word-wrapping, spell-
checking and many other useful features are ideal.Because such packages are maintained by someone else,
more time and resources can be devoted to creating the
database itself. Further, such packages have the
advantage of being reliable because wide circulation and
many revisions have eliminated most of the bugs.
,~
'`"I ~:;.
1`'', , :
`~1 , .
~ ` ` 2 ~ 3
. 13
:,:
- Block 206 represents the creation of multimedia
l~ resource files on the computer containing the multimedia
resources referred to by the intermediate multimedia
document file. The creation and editing of multimedia
resources 208 typically occurs using commercially
`, available systems. Using such systems, multimedia
resources 208 can be created comprising animations,
graphics including pictures and tables, sounds and
associated caption text. As multimedia resources 208 -
are created, an entry in a mult,;media captive text file
is created, the entry containing a title, caption and
credit for the resource.
Block 210 represents the compilation of the
~i;, intermediate multimedia document and multimedia files.
As each intermediate multimedia document file is read,
the article therein is initialized with a unique
sequential object number. The article is then compiled
into a specific format for the database 21~.
The ASCII text of the database 212 has little
formatting information embedded therein. The exceptions
are:
Return - separates paragraphs
Tab - separates the columns in a `-:
table
M~ltimedia Escape Code - a control character
indicating that a
multimedia interface (or
embedded graphic) appears
here in the text.
A Style Run Table is created that mark where the
text style changes. Each style run entry marks the
beginning of the style that it points to in a Style
Table. ,
The Style Table contains the actual text attribute
information such as font and size.
~,, - ~ ~
,"'
~,t~.
:r~
; -
` ~ 2 ~ 3
; 14
A Format Run Table is similar to the Style Table.
IThe Format Run Table marks changes in the paragraph
-~ formatting attributes. However, each entry therein
:.marks the end of its run of influence, rather than the
, . '
v~j5 beginning.
Format Table contains entries that are related to
~-lentire lines or paragraphs of text. For example, line
spacing and paragraph indents may be specifiPd.
A Line Run Table marks the text position where each
line in the document begins. It also keeps other
information about the line, for example, how tall it is
and where it is positioned vertically. The Line Run
Table represents the formatted portion of the document.
It is recomputed whenever the document width changes or
the text is altered.
Multimedia Table is used to identify the
application programming interface to call to handle
~¦multimedia escape codes embedded within the text. A
lookup is performed when formatting, to position the
resource on the screen. Typically, separate interfaces
are provided for Tables, Animations, Sounds, Pictures,
Picture Series, Naps, and Graphics.
A HyperText Links Table marks the start and end
offsets of the linked text in the article and contains
an identification of the destination article.
'~For each reference to a multimedia resource file
encountered during the compilation of the article, block
210 finds the multimedia resource file using the ~;
reference embedded in the article. The multimedia
resource 208 is retrieved from the multimedia resource
file and assigned the next sequential object number,
which is then incremented. A Multimedia Escape Code
identifying the multimedia resource is added to the text
of the article at the correct position in the article,
and the contents of the multimedia resource are added to
the database 212. The location of the multimedia
resources 208 is preferably mapped during compilation so
,: .1 .
.,~
~ '
! that they follow -the corresponding articles in sequence
in the database 212, thereby allowing faster access to
7~ the multimedia resources 208 after the article has been
read because the distance of the seek of the compact
,'. ,.'`1
~j 5 disc is minimized.
; Each multimedia resource 208 is stored in the
database 212 in its own prescribed format depending on
its multimedia type, e.g., pictures and other graphics
~! are in "GIFn format, sounds resources are in Apple "SND"
~ ~J
! lo format, and animations are in Apple "QUICRTIME" format.
~ The format for multimedia resources 208 also stores
~lj certain information regarding the contents, for example,
associated article object number, height and width of
the display, and number of text fields. Each multimedia
resource is further classified according to its type,
for example, a sound classification identifies methods
unique to the handling of sound resources. These
methods conform to standard MacIntosh programming
techniques, and thus are not discussed further herein.
Refer to a MacIntosh programming guide for more
-~ information on such programming techniques. '`'`;t'
Figure 3 shows the format of the database 212 and
its directory 304 after compilation. The database 302
stores all articles and multimedia resources 208 as
objects therein. The directory 304 has entries for all
articles and multimedia resources 208 stored in the
database 302, wherein each entry 306 includes the offset `
~ to the beginning of the object in the database 302, the 't`''7~ object type which, for the preferred embodiment,
specifies the application programming interface to use
when displaying or playing the object, and the article `
~ number to which this object belongs.
~ Once the database 302 has been compiled, a user
-~ interface, discussed in more detail below, formats and ~`
displays the articles and multimedia resources 208 on
the monitor attached to the computer. The display
process involves the translation of the objects in the
~ . .,
~ ,.
.~
,: .. .
"
16
,. ~ .
database 302 into the formatted articles viewed through
the user interface, as discussed further below.
Additional databases are used with the present
~- invention, including a dictionary, help files, first and
second topic files and a suggested question file. The
~-' dictionary file is supplied from a third party
commercial vendor, ~s are the routines for accessing it.
The help files consist of two types of datat context
~ll sensitive and general help, wherein implementation of
help follows the standard Macintosh implementation.
Figure 4 shows the format of the first topic file 402
linking topics 404 to articles 406. Figure 5 shows the
format of the second topic file 502 linking topic titles
504, topic icons 506, and suggested questions 508.
Figure 6 shows the format of the suggested questions
file 602 linking suggested questions 604 to articles
~ 606.
'.1`',`,~ ~.
INTERNAL OPERATION
Figure 7 is a flow chart defining the overall logic
of the computer program which directs the operation of
the present invention. The computer program defines a .
set of states and operations, so that a particular input
while the computer program is in a particular state
causes a transition to another state, which invokes a
corresponding function. The input used to determine
these state transitions includes not only the identity
of the input but its location on the monitor 12 as well.
Block 702 represents the wait for input from the
operator. Block 704 reprasents the decoding of the
~, ! input and the mouse location when the input is received
s~, from the operator. Block 706 represents the
determination of the current state of the computer
program. Block 708 represents the determination of the
new state based on the current state and the operator
input. Block 710 represents the transition to the new
~" ~.~ : . ,
~ state wherein the computer program performs a transition ; ~-
: 17
function. slock 712 represents the saving of the new
state as the current state. Control then returns to
block 702 to await further input from the operator.
j:' I
N~IN MENU SCREEN
Figure 8 illustrates the Main Menu screen of the
present invention. The Nain Menu screen is displayed
i~ whenever activates the present invention. The Main Menu
screen comprises a number of different features
-~l10 including a menu bar, control buttons, an Inspector
.3~Golden character, an earphones icon, textual
iinstructions, and a large graphic with four labeled
;-scenes representing the four different pathways for
, . .. .
retrieving information from the encyclopedia. The
,,!~,.1 15 functions associated with these elements are invoked
.' whenever the user "clicks" on the ftature using a mouse
input device, or otherwise invokes the feature.
The four different pathways shown on the Main Menu
screen help the user search out desired articles using
four different strategies. The user can use an
alphabetical list (known as Inspector Golden's ABCs), a
topic hierarchy (known as Inspector Golden's World of
Words), a search and retrieval pathway (known as
Inspector Golden's Seek and Find), or a multimedia
ll~i25 browser ~known as Inspector Golden's Sights and Sounds)
,;to locate interesting articles in the encyclopedia.
The ABCs pathway organizes article titles
alphabetically. The user can choose a letter and then
see which article titles begin with that letter. When
~!30 the user finds an interesting title, they can branch to
the opening screen of that article.
The World of Words pathway organizes article titles
by topic groups. The user can explore the encyclopedia
using a series of picture menus. Opening menus map
topics to recognizable places, i.e., a city, land,
playground, arts center, etc. The user can zoom in one
any one of these pictures to see a more detailed picture
''.';'.
,,';.j
,.,.,~
~ 18 ~ 3
or article list. When the user finds an interesting
title in an article list, they can branch to the opening
screen of that article.
Th2 Seek and Find pathway generates a list of
~ 5 article titles using search terms entered by the user.
;`1 When the user finds an interesting title in an article
list, they can branch to the opening screen of that
' article and see their search terms highlighted in the
article, table, picture caption and/or sound caption
10 text.
The Sights and Sounds pathway presents article
features such as pictures, animations and sounds, from a
it variety of unrelated articles. When a user sees an
i~ interesting article they can branch to the opening
15 screen of the article from which it came.
A cartoon character called "Inspector Golden" is
provided to entice and support the user's perusal of the
encyclopedia. Inspector Golden is a detective who runs
s the Seek and Find Detective Agency. Throughout the four
1 20 pathways which access the encyclopedia, Inspector Golden
travels with the student offering digitized spoken
,~ instructions.
When the Main Menu screen is displayed, a digiti~ed
speech recording asks the user: "Do you know how you
25 want to use the encyclopedia? Click a pathway to find
~'¦ articles." The user can click anywhere on the screen to
interrupt the digitized voice. Further, if there is no
action, then after a fifteen second delay, the
~l instruction at the bottom of the screen is presented as
30 a digitized speech recording which instructs the user: ;
Click a pathway to find articles." The user can also
~3 click on the earphones icon to have the digitized speech
~~ .
.,`''3 of the instructions repeated.
Whenever the user selects on one of the four
35 pathways, the pathway is highlighted, a digitized speech
recording is played for the user, and the opening screen
of the pathway is displayed. For the ABCs pathway, the
...... 1 . :.i
3 ~ 3
,'':' 19
user is told: "Lets look at the names o~f all the
~ articles in the encyclopedia. You can use the ABCs to
;- find the ones that interest you." For the World of
Words pathway, the user is told: "Lets look at a map of
the encyclopedia world. You can use topic pictures to
decide what articles you want to read." For the Seek
and Find pathway, the user is told: "Lets go into my
detective agency. Your word clues will help find
~i interesting articles." For -the Sights and Sounds
pathway, the user is told- nCome and look at some of my
favorite pictures and sounds. Maybe you will find some
.,~ ~j .
~ interesting articles, too."
.~
MENU BAR AND CONTROL BUTTONS
The menu bar appears horizontally across the top of
~1; every screen of the present invention, in a manner
typical of MacIntosh or Windows applications. In the
~-j present invention, the menu bar includes an Apple menu,
a File menu, an Edit menu, a "Learn a Word" menu, and a
Help menu. These menus and functions associated
therewith are implemented in a manner typical of
MacIntosh or Windows applications, and thus are not
described further herein.
The six control buttons arranged in a vertical
manner along the left border of the screen include, from
top to bottom, a Main Nenu screen button, a path button,
a trails button, a bookmark button, a notes button, and
a robot button. The Main Menu screen button allow the
user to move "jump" back to the Main Menu screen from
.~ 30 any point within the program. The path button allows
the user to ~'jump" back to last pathway opening screen.
~ The trails button displays a trails graphic comprising
!~ .,i scrollable boxed lists of article titles (if any)
~¦ previously accessed within each pathway, the boxed lists
~ 35 being in the same position as the corresponding pathway
-~ on the Nain Mlenu screen and including the title of the
pathway. The bookmark button to add, delete or "jump~
;,;,i.
::
r`
`'''`1
.; j~'l .
~ 3
. ~ .
to previously set bookmarks within the encyclopedia.
The notes button allows the user to enter note~ at any
point in the perusal of the encyclopedia. The robot
~ button converts any text displayed on the screen to
- 5 digitized speech, which is especially useful for users
who cannot read. Refer to Figure 68 for more detailed
information on the robot button.
. . I .
. ~
MAIN MENU SCREEN FLOW CHART
Figure 9 is a flow chart describing the functions
~ performed whenever the menu items, controL buttons,
,~ earphones icon, or pathway graphics are s~lected by the
'` :a, user at the Main Menu screen.
!~'i Block 902 displays the Main Nenu screen on the
monitor and plays the instruction audio for the user:
"Do you know how you want to use the encyclopedia? Click
a pathway to find articles." Block 904 waits for input
from the user identifying the selec~ed function, i.e., a~ -
mouse click. Blocks 906-932 determine what type of ~-
20 input has been received, i.e., what element on the Main ;~
Menu screen has been selected.
Blocks 906 and 908 represent the selection of a menu
item. These blocks indicate that the function
l~ associated with the menu item, i.e., the Apple menu, the
ilv~ 25 File menu, the Edit menu, the "Learn a Word" menu, or
the Help menu, should be performed. However, because
these menus and functions associated therewith are
implemented in a manner typical of MacIntosh or Windows
applications, the functions associated with the menus
30 are not described further herein. :~
Blocks 910 and 912 represent the selection of a
control button. These blocks indicate that the function
associated with the selected control button the Main
Nenu screen button, the path button, the trails button,
the bookmark button, the notes button, or the robot
button, should be performed. The Main Menu screen
button causes the program to move "jump" back to the
.~ ", ~.
.'~ . ': ,'
,r,
"~
:i ,: ,`
21
Main Menu screen from any point within the program. The
:, path button causes the program to "jump" back to last
~`i pathway opening screen. The trails button displays a
trails graphic comprising scrollable, bo~ed lists of
5 article titles (if any) previously accessed within each
' ~ ~ j " !
¦ pathway, the boxed lists being in the same position as
j the corresponding pathway on the Main Menu screen and
incl~ding the title of the pathway. The bookmark button
allows the user to add, delete or "jump" to pre~iously
i 10 set bookmarks within the encyclopedia. The notes button
allows the user to enter notes at any point in the
~, perusal of the encyclopedia. The robot button converts
any text displayed on the screen to digitized speech,
which is especially useful for users who cannot read.
~- 15 Refer to Figure 68 for more detailed information on the
i--- robot button.
!,,~',,~ Blocks 914 and 916 represent the selection of the
`;I earphones icon,`i.e., the instruction voicing function.
These blocks cause the instruction speech to be played
s~ 20 again.
~- Blocks 918 and 920 represent the selection of the
~ ABCs pathway graphic. These blocks indicate that the
1';l ABCs opening screen should be displayed. Refer to
s Figures 10 and 11 for more detailed information on this
~,~ 25 function.
i :~ Blocks 922 and 924 represent the selection of the
-I World of Words pathway graphic. These blocks indicate
that the World of Words opening screen should be
displayed. Refer to Figures 14-34 for more detailed
30 information on this function.
Blocks 926 and 928 represent the selection of the
Seek and Find pathway graphic. These blocks indicate
that the Seek and Find opening screen should be
displayed. Refer to Figures 37-39 for more detailed
35 information on this function.
~,',^',
~1
1,,~
2 ~ 3
,.~.! 22
~;j slocks 930 and 932 represent the selection of the
Sights and Sounds pathway graphic. These blocks
indicate that the Sights and Sounds opening screen
should be displayed. Refer to Figures 37-39 for more
5 detailed information on this function.
ABCs OPENING SCREEN
~¦ Figure 10 illustrates the opening screen for the
~1 ABCs pathway which is displayed when the user selects ~ ~;
-~ 10 the ABCs pathway graphic on the Main Menu screen. Like
the Main Menu screen, the ABCs opening screen includes a -~
;y~i menu bar at the top of the screen and six buttons along
c the left edge of the screen. Large block letters and
~ arrows appear to the right of the control buttons and
,,, j .
15 labeled graphics appear to the right of each letter.
Figure 11 is a flow chart describing the functions
performed whenever the block letters, arrows/ or labeled .
graphics are invoked by the user at the ABCs opening ~ -~
screen. Note that the menu bar and buttons may also be
20 selected by the user, but these functions are identical
to the ones performed at the Main Nenu screen and thus j--
are not described further herein.
Block 1102 displays the ABC opening screen on the
monitor and plays the instruction speech for the user:
25 nClick a letter to see article names. Click an arrow to
see more letters." Block 1104 waits for input from the
user identifying the selected function, i.e., a mouse
click. Blocks 1106-1124 determine what type of input
has been received, i.e., what element on the ABCs
30 opening screen has been selected.
Blocks 1106 and 1108 represent the selection of the
Up Arrow, i.e., a scroll up function. These blocks
cause the list of block letters to be re-displayed to
~' r scroll up through the list of letters, at least until -
l 35 the block letter "A" is reached. The user can hold down
the mouse button on an arrow to continuously scroll
letters into view.
,: - :
,. :
~,,.~,,,~
~ 23 2 ~ s~
~ Blocks 1110 and 1112 represent the selec-tion o-f a
;-- block letter. These blocks cause an article list
- corresponding to the selected block letter to be
j' displayed on the monitor. Refer to Eigures 12 and 13
`;` 5 for more detailed information on this function.
,~, slocks 1114 and 1116 represent the selection of a
labelled graphic. These blocks cause digitized speech
~j and animation (if available) for the label gxaphic to be
5$~ performed. An example of digitized speech would include
;~ 10 the voicing of the phrase: "A is for alligator". The
`~ graphic is typically animated in the space on the screen
`l in which it resides.
`~ Blocks 1118 and 1120 represent the selection of the
Down Arrow, i.e., a scroll down function. These blocks
cause the list of block letters to be re-displayed to
scroll down through the list of letters, at least until
the block letter "Z" is reached. The user can hold down
the mouse button on an arrow to continuously scroll
letters into view.
Blocks 1122 and 1124 represent the selection of the
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruction speech to be played
~ for the user.
.,
.~,.,,~.
ABCs ARTICLE LIST SCREEN
....
Figure 12 illustrates an ABCs article list that is
displayed when the user selects a block letter on the
ABCs opening screen. Like the Main Menu screen, the
i`3 ABCs article list screen includes the menu bar at the
top of the screen, and the six control buttons along the
left edge of the screen. Note that the large black
letters and arrows still remain to the right of the
~^' control buttons with the selected letter block
highlighted. A box is displayed that covers the rest of
the screen, wherein the box comprises a heading,
instructions, a list of article titles, an earphones
icon, as well as open and close buttons.
. j, ", ¦ .
2 ~ 3
~; 24
~ Figure 13 is a flow chart describing the functions
3;~ performed whenever a control element is selected by the
t~ ~, user from the ABCs article list screen. Note that the
t 3 menu bar and buttons may also be selected by the user,
5 but these functions are identical to the ones performed
~: .
at the Main Menu screen and thus are not described
further herein.
slOck 1302 retrieves the articles from the database
r ,, beginning with the selected block letter from the ABCs
~', 3 10 opening screen and creates the ABCs article list. Block
3c~ 1304 displays the ABCs article list screen on the : -
3`',i~ monitor and plays the instruction speech for the user:
"Click the article you would like to see. Then click
Open. n Block 1306 waits for input from the user
15 identifying the selected function, i.e., a mouse click.
~r'~ Blocks 1308-1330 determine what type of input has been
~ received, i.e., what control element on the ABCs article
!3'`:~ list screen has been selected.
Blocks 1308 and 1310 represent the user single
20 clicking on a title in the article list, i.e., a
selection function. These blocks cause the selected
~il title to be highlighted on the monitor to indicate its
1 selection.
-¦ Blocks 1312 and 1314 represent the user double
25 clicking on a title in the article list, i.e., a display
~'3 article function. These blocks cause the article
corresponding to the selected title to be displayed on
the monitor. ~ `
Blocks 1316 and 1318 represent the selection of the
30 Open button, i.e., an open article function. These
blocks cause the article corresponding to the selected
title highlighted in the article list to be displayed on
the monitor.
Blocks 1320 and 1322 represent the selection of the
~ 35 Close button, i.e., a close screen function. These -
j~ blocks cause the ABCs opening screen to be re-displayed.
~ Blocks 1324 and 1326 represent the selection of the ~ ;;
1~` '' .:
~ .
~, scroll bar, i.e. a scroll-up or scroll-down function.
`~ These blocks cause the article list to be re-displayed
i to scroll up or down through the list of titles, at
least until the beginning or end of the list is reached.
'"~6 5 Blocks 1328 and 1330 represent the selection of the
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruction speech to be played
again.
~3
, `. 10 NORLD OF WORDS OPENING SCREEN
~- Figure 14 illustrates the opening screen for the
s~ World of Words pathway which is displayed when the user
selects the World of Words pathway graphic on the Main
~ Menu screen. Like the Main Menu screen, the World of -
i~3 15 Words opening screen includes a menu bar at the top of
~ the screen and six control buttons along the left edge
'6 .~ of the screen. Nine different labelled graphics
representing topic menus appear to the right of the
control buttons.
Designed for younger users, the World of Words maps
topic groupings of articles to recognizable objects in
the child's world. The topic groups are presented as a
series of labelled picture scenes. Figure 15 is a flow
chart of the relationships between the topic menus ~-
illustrated in Figures 16-33. Examples of the picture
.~ scenes and the topic groups associated therewith are
illustrated in Figures 16-33.
When a labelled picture scene is selected, either
another level of topic groups illustrated as labelled ~'
picture scenes or an appropriate article list is
displayed on the screen. If another level of labelled
picture scenes is displayed, then the user can traverse
downward again until an article list is finally reached.
Figure 34 is a flow chart describing the functions
performed whenever a control element is selected by the
user at the World of Nords opening screen. Note that
the menu bar and buttons may also be selected by the
;'''' '.
: .~
-` 2 ~
~- 26
user, but these functions are identical to the ones
-1 performed at the Main Menu screen and thus are not
",.',! described further herein.
Block 3402 displays the World of Words opening
screen on the monitor and plays the instruction speech
,'!, for the user: "A detective does a lot of exploring.
You can use this map to explore the encyclopedia. Click
a part of the picture to see more." Block 3404 waits
for input from the user iden~iEying the selec~ed
function, i.e., a mouse click. Blocks 3406-3412
determine what type of input has been received, i.e.,
what element on the World of Words opening screen has
-~l been selected.
!. Blocks 3406 and 3408 represent the selection of a
~i; 15 labelled picture scene. These blocks cause either
another screen of labelled picture screens to be
,~l displayed, or an article list corresponding to the
selected topic group to be displayed on the monitor. `~
Refer to Figure 15 for more detailed information on the
hierarchy of picture screens. Refer to Figures 35 and
36 for more detailed information on the article list
screen. -
Blocks 3410 an 3412 represent the selection of the --
~¦ earphones icon, i.e., the instruction voice and
~3'~ 25 function. These blocks cause the instruction speech to
played again.
~t~ WORLD OF WORDS ARTICLE LIST SCREEN
¦j~ Figure 35 illustrates the World of Words article
list screen that is displayed when the user selects a ~ ;
labelled picture screen on the World of Words graphic
that has an article list assigned to it. Note that the
`~ menu bar and control buttons remain along the left edge
of the screen. A box is displayed that covers the rest
~3 of the screen, wherein the box comprises a heading,
instructions, list of article titles, and earphones
icon, as well as Open and Close buttons.
, :~
~',. -~ t-
,.. 1 .
. ...
:
`i, 27
. . ~ .
Figure 36 is a flow chart describing the functions
(;performed whenever a control element is selected by the
;user from the World of Words article list screen. Note
~;that the menu bar and buttons may also be selected by
i5 the user, but these functions are identical to the ones
performed at the Main Menu screen and thus are not -~
described further herein.
. . j .
Block 3602 retrieves the articles from the database
corresponding to the selected topic group and creates
,i10 the World of Words article list. Block 3604 displays
the World of Words article list screen on the monitor
:!and plays the instruction speech for the user: "Click
the article you would like to see. Then click open.'~
Block 3606 waits for input from the user identifying the
selected function, i.e., a mouse click. Blocks 3608-
~`3630 determine what type of input has been received,
i.e., what control element on the World of Words article
list screen has been selected.
Blocks 3608 and 3610 represent the user single
Jll20 clicking on a title in the article list, i.e., a
;~,selection function. These blocks cause the selected
title to be highlighted on the monitor to indicate its
selection.
Blocks 3612 and 3614 represent the user double
,~25 clicking on a title in the article list, i.e., a display
~ù
article function. These blocks cause the article
corresponding to the selected title to be displayed on
the monitor.
Blocks 3616 and 3618 represent the selection of the
Open button, i.e., an open article function. These
blocks cause the article corresponding to the selected
title highlighted in the article list to be displayed on -~-
the monitor.
Blocks 3620 and 3622 represent the selection of the
Close button, i.e., a close screen function. These
blocks cause the ABCs opening screen to be re-displayed.
', ~'.
"'~'.
,,~,,; .,
~ '~
` ` 21010~3
slocks 3624 and 3626 represent the selection of the
scroll bar, i.e. a scroll-up or scroll-clown function.
These blocks cause the article list to be re-displayed
to scroll up or down through the list of title~, at
-~ 5 least until the beginning or encl of the list is reached.
-l Blocks 3628 and 3630 represent the selection of the
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruction speech to be played
again.
. :1 .
:~ 10
SEEK AND FIND OPENING SCREEN
igure 37 illustrates the opening screen for the
~ ABCs pathway which is displayed when the user selects
b the ABCs pathway graphic on the Main Menu screen. Like
15 the Main Menu screen, the ABCs opening screen includes a -
~`. menu bar at the top of the screen and six buttons along
the left edge of the screen. A large graphic having two
doors labelled as Choose A Question and Make Up A
Question appears to the right of the control buttons.
The Seek and Find pathway provides a search and
retrieval interface from the encyclopedia which is
designed to support a spectrum of users with varying
levels of ability. Users who are weak on structure, ~;
users who are weak on reading or writing, and users who ~
25 simply need quick access to the article database, can ~ ?
; exploit the benefits of the search and retrieval
interface. The search and retrieval engine operates on ~.
three assumptions that: (1) the user can internally form
a question, (2) the user can express that question, and
(3) the user can match their vocabulary to the
vocabulary of the database. The search and retrieval
interfaces, comprising a Choose A Question interface,
Make Up A Question interface, and Question Starters
interface, fill the gaps between the student's `
35 individual ability and these underlying assumptions. ~;
Figure 38 is a flow chart illustrating how these
interfaces relate to one another.
~.` ..
! ~' 29
Figure 39 is a flow chart describing the functions
performed whenever a control element is selected by the
user at the Seek and Find opening screen. Note that the ~`
menu bar and buttons may also be selected by the user,
j 5 but these functions are identical to the ones performed
`'i at the Main Menu screen and thus are not described
-~! further herein.
lock 3902 displays the Seek and Find opening screen
on the monitor and plays the instruction speech for the
`;~ 10 user: nInstead of Hide and Seek, let's play Seek and
Find. Let's find articles using the questions or words
-~ you make up. Click the door that says Choose A Question
-~. to see some finished questions. Click the door that
.~ says Make Up A Question if you want to type in your own
~i~. 15 question." Block 3904 waits for input from the user
identifying the selected function, i.e., a mouse click.
Blocks 3906-3916 determine what type of input has been
received, i.e., what element on the Seek and Find
opening screen has been selected.
Blocks 3906 and 3908 represent the selection of the
~I Choose A Question graphic, i.e., the Choose A Question ~ -
function. Refer to Figures 40 and 41 for more detailed
information on this function.
Blocks 3910 and 3912 represent the selection of the
Make Up A Question graphic, i.e., the Make Up A Question
function. Refer to Figures 46 and 37 for more
,~ information on this function.
Blocks 3914 and 3916 represent the selection of the -~
~' earphones icon, i.e., the instruction voicing function. ~-
These blocks cause the instruction speech to be re-
played for the user.
~ . ~",.
CHOOSE A QUESTION SCREEN
Figure 40 illustrates the Choose A Question screen
that is displayed when the user selects the Choose A
Question door on the Seek and Find opening screen. Note
that the menu bar and control buttons remain along the
~:1. ;~.5
~iS~
~ .... ' ! i . i _
~' 30 ~ 3
left edge of the screen. A box is displayed tha-t covers
the rest of the screen, wherein the box comprises a
~J! heading, instructions, a list of topics represented as
,~ topic card icons, earphones icon, and a ~go back" icon.
~-~ 5
This interface helps the user master the skills of
i!''~ internally forming questions and then expressing them by
presenting the user with complete, well-formed questions
while only requiring them to respond to a choice of
~3 10 topics. The user, through the choice of topics,
'' controls which questions are presented so that their
task is simplified to recognize the question they want
to ask and then click the screen to generate an article
list. The topic choices for this screen assume a
vocabulary of broad terms, but each topic is developed
so that it generates a manageable, meaningful list of :~
questions and articles.
Figure 41 is a flow chart describing the functions ;`
performed whenever a control element is selected by the '`
user from the Choose A Question screen. Note that the
menu bar and buttons may also be selected by the user,
but these functions are identical to the ones performed
at the Main Menu screen and thus are not described
further herein.
Block 4102 displays the Choose A Question screen on
the monitor and plays the instructlon speech for the
user: "These are the cases I am investigating. Click a
card to see the question I have about these topics~ Use
the scroll bar to see more topics." Block 4104 waits
for input from the user identifying the selected
function, i.e., a mouse click. Blocks 4106-4120
determine what type of input has been received, i.e.,
what control element on the Choose A Question screen has
been selected.
Blocks 4106 and 4108 represent the user clicking on
a topic card icon, i.e., a selection function. These ~;
blocks cause the icon to be animated so that it appears
~.
~ ....... .:
~ : ~
;,.,.;j, . .
31 2 ~
to turn over on the screen. The blocks then cause the
~ Suggested Questions screen to be displayed for the
`~ associated topic. Refer to Figures 42 and 43 for more
detailed information on the Suggested Questions screen.
slocks 4110 and 4112 represent the selection of the
;!!`i ~go back~ icon. These blocks cause the Seek and Find
opening screen to bè re-displayed.
slocks 4114 and 4116 represent the selection of the
scroll bar, i.e., a scroll up or scroll down function.
These blocks cause the list of topics to be re-displayed
to scroll up or down through the list, at least until
;,' the beginning or end of the list is reached.
Blocks 4118 and 4120 represent the selection of the
~;} earphones icon, i.e., the instruction voicing f~nc-tion.
`~, 15 These blocks cause the instruction speech to be re-
played for the user.
~Y ,-,
SUGGESTED QUESTION SCREEN
Figure 42 illustrates the Suggested Questions screen
that is displayed when the user selects a topic card
icon on the Choose A Question screen. Like the Nain
Menu screen, the Suggested Questions screen includes the
menu bar at the top of the screen, and the six control
buttons along the left edge of the screen. A box is
displayed that covers the rest of the screen, wherein
the box comprises the selected topic card icon, the
title of the topic, a scrollable boxed list of 3-5
questions about the selected topic, an OK button, an
earphones icon, and a "go back" icon. ~ ~t
Figure 43 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Suggested Questions screen. Note that the
menu bar and buttons may also be selected by the user,
but these functions are identical to the ones performed
at the Main Menu screen and thus are not described
further herein.
J
r ~
~' .:
~1 ,'
32 2~
~ Block 43n2 retrieves questions corresponding to the
`~ selected topic from the database. Block 4304 displays
the Suggested Questions screen on the monitor and plays
the instruction speech for -the user: "These questions
will help me finish my investigation. Click the
~ question you want to answer. Then click OK." Block
.~1 4306 waits for input from the user identifying the
~i selected function, i.e., a mouse click. slock 4308
determine what type of input has been received, i.e.,
what control element on the Suggested Questions screen
has been selected.
Blocks 430&3 and 4310 represent the user single
clicking on a question in the list, i.e., a selection
function. These blocks cause the selected question to
be highlighted on the monitor to indicate its sele~tion.
slocks 4312 and 4314 represent the user double ~-
clicking on a question in the list, i.e., a display
article function. These blocks cause the Suggested
Articles screen corresponding to the selected question
to be displayed on the monitor. Refer to Figures 44 and
45 for more detailed information on the Suggested
Articles screen.
Blocks 4316 and 4318 represent the selec-tion of the
~`¦ OR button, i.e., a display article function. These
blocks cause the Suggested Articles screen corresponding
to the selected question to be displayed on the monitor.
Refer to Figures 44 and 45 for more detailed information
on the Suggested Articles screen.
Blocks 4320 and 4322 represent the selection of the
"go backn icon. These blocks cause the Choose A
. ',;":1
Question screen to be re-displayed.
Blocks 4324 and 4326 represent the selection of the
scroll bar, i.e. a scroll-up or scroll-down func-tion.
These blocks cause the question list to be re-displayed
to scroll up or down through the list of questions, at
least until the beginning or end of the list is reached.
..... ~ .
`.~`:, 1 .
`' `,`,i `
33
^ Bloclcs 4328 and 4330 represent the selectlon o-f the
~' earphones icon, i.e., the instruction voicing function.
These blocks cause the ins-truction speech to be re-
' played for the user.
~i~ SUGGESTED ARTICLE SCREEN
~L~ Figure 44 illustrates the Suggested Articles screen
!s; that is displayed when the user selects a question from
~:J~ the Suggested Questions screen. Like the Main Menu
screen, the Suggested Articles screen includes the menu
'"7~ bar at the top of the screen, and the six control
buttons along the left edge of the screen. A box is
displayed that covers the rest of the screen, wherein
the box comprises the selected topic card icon, the
selected question, a scrollable boxed list of articles
answering the selected question, an Open button, an
earphones icon, and a ~go back" icon.
Figure 45 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Suggested Article screen. Note that the
menu bar and buttons may also be selected by the user,
but these functions are identical to the ones performed
~¦ at the Main Menu screen and thus are not described
further herein. ~-`
Block 4502 retrieves the articles from the database ~1
,~3 corresponding to the selected question from the
Suggested Questions screen and creates the article list.
Block 4504 displays the Suggested Article screen on the
monitor and plays the instruction speech for the user:
"These articles will answer the question you chose.
Click an article title. Then click Open." Block 4506
~j waits for input from the user identifying the selected
,I'i,!'``j function, i.e., a mouse click. Blocks 4508-4530
determine what type of input has been received, i.e.,
what control element on the Suggested Article screen has
been selected.
: ,..
. `~ .
;: ~
.... i ' -
.l,'.'!```i ' ' :
~ !`i 3~ 2 ~
Blocks 4508 and 4510 represent the user single
clicking on a title in the article list, i.e., a
selection function. These blocks cause the selected
~i~ title to be highlighted on the monitor to indicake its
selection.
slocks 4512 and 4514 represent the user double
clicking on a title in the article list, i.e., a display
article function. These blocks cause the article
corresponding to the selec-ted title to be displayed on
the monitor.
Blocks 4516 and 4518 represent the selection of the
Open button, i.e., an open article function. These
.~ blocks cause the article corresponding to the selected
~i~ title highlighted in the article list to be displayed on
the monitor.
slocks 4520 and 4522 represent the selection of the
~go back" icon, i.e., a close screen function. These
blocks cause the Suggested Questions screen to be re-
displayed.
Blocks 4524 and 4526 represent the selection of the
scroll bar, i.e. a scroll-up or scroll-down function.
These blocks cause the article list to be re-displayed
; to scroll up or down through the list of titles, at -
least until the beginning or end of the list is reached. ~
Blocks 4528 and 4530 represent the selection of the ~i-
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruction speech to be re-
played for the user.
MAKE UP A QUESTION SCREEN ~;`
Figure 46 illustrates the Make Up A Question screen
that is displayed when the user selects the Nake Up A
Question door graphic on the Seek and Find opening
screen. Note that the menu bar and control buttons
remain along the left edge of the screen. A box is
displayed that covers the rest of the screen, wherein
the box comprises a heading, instructions, input area,
~i~x~
jF.~
~.. ,.`1 ,,: ,
! 35
^~ OK button, earphones icon, dictionary icon, question
starters icon, and "go back" icon.
This interface works on the assumption tha-t the user
. :....
wants to pit their vocabulary against the vocabulary of
~i 5 the database. This interface assumes that the user
knows what topic they are looking for and can identify
it using keywords. The user, through the choice of
entered keywords, controls the topics which are
presented.
Figure 47 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Make Up A Question screen. Note that the
menu bar and buttons may also be selected by the user,
, but these functions are identical to the ones performed
..j
~` 15 at the Main Menu screen and thus are not described
~- further herein.
~i Block 4702 displays the Make Up A Question screen on
the monitor and plays the instruction speech for the
user: "The computer can use word clues in your questions
to find articles that may interest you. Type the words
you want to find. Then click OK." Block 4704 waits for
input from the user identifying the selected function,
i.e., a mouse click. Blocks 4706-4728 determine what
type of input has been received, i.e., what control
:~ 25 element on the Make Up A Question screen has been
'r.' l selected.
Blocks 4706 and 4708 represent the user typing
characters on the keyboard, i.e., entering the keywords.
These blocks cause the entered keywords to be saved in a
~i 30 buffer area in memory for later searching in the
!~ ~ database.
Blocks 4710 and 4812 represent the selection of the
OK buttont i.e., a display article function. These `
~.~ blocks cause a "wait" message to be displayed on the
; ~ 35 screen, a search to be performed of the database for all
articles containing the keywords, and then the display
~¦ of the Article List screen with the found articles.
"' ''
' ' ` .1
`,.,~
~ 3
Refer to Figures 44 and 45 for more~etal ~d information
:~ on the Suggested Articles screen. Alternatively, if no
articles are found containing the keyword, the keywords
are spell-checked and the Alternative Spellings screen
3 5 is displayed if there is an error. Refer to Figures 48
and 49 for more detailed information on the Alternative
Spellings screen.
~, Blocks 4714 and 4716 represent the se'ection of the
Dictionary icon. These blocks cause the Dictionary
10 screen to be displayed. Refer to Figures 50 and 51 for
more detailed information on the Dictionary screen.
Blocks 4713 and 4720 represent the selection of the
~;, Question Starters icon. These blocks cause the Question ; :~
Starters screen to be displayed. Refer to Figures 52
~j 15 and 53 for more detailed information on the Question -~
.~ Starters screen.
Blocks 4722 and 4724 represent the selection of the
"go back" icon. These blocks cause the Seek and Find -
opening screen to be re-displayed.
Blocks 4726 and 4728 represent the selection of the
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruction speech to be re-
played for the user.
ALTERNATE SPELLINGS SCREEN .
Figure 48 illustrates the Alternate Spelling screen
that is displayed when a misspelled word is identified
in the Make Up A Question screen. Note that the menu
bar and control buttons remain along the left edge of
30- the screen. A box is displayed that covers the rest of
`~ the screen, wherein the box comprises a heading,
instructions, input area, scrollable display area, OK
button, Close button, earphones icon, dictionary icon,
question starters icon, and 'rgO back" icon.
~;i,'
Figure 49 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Alternate Spellings screen. Note that the
~ ":
:~ 37
menu bar and buttons may also be selected by the user,
but these func-tions are identical to the ones perfGrmed
3 at the Main Menu screen and thus are not described
further herein.
Block 4902 retrieves words from the dictionary that
are similar to the misspelled word.
Block 4904 displays the Alternate Spellings screen
on the monitor, with the misspelled word in the input
area and a list of possible alternative words is
. '.'.1
displayed in the display area. It also plays the
instruction speech to be played for the user- "The word
in blue is misspelled. Click a word to replace it.
~!~,', Then click OK." Block 4906 waits for input from the
user identifying the selected function, i.e., a mouse
j 15 click. Blocks 4908-4938 determine what type of input
;~ has been received, i.e., what control element on the
Alternative Spellings screen has been selected.
Blocks 4908 and 4910 represent the user single
clicking on a word in the list of possible alternative
`, 20 words displayed in the display area, i.e., a selection
function. These blocks cause the selected word to be
highlighted on the monitor to indicate its selection.
Blocks 4912 and 4914 represent the user double
clicking on a word in the list of possible alternative
words displayed in the display area, i.e., a replacement
function. These blocks cause the Make Up A Question '~
screen to be re-displayed on the monitor, with the
misspelled word replaced with the selected word.
Blocks 4916 and 4918 represent the selection of the
OK button, i.e., a replacement function. These blocks
cause the Make Up A Question screen to be re-displayed
on the monitor, with the misspelled word replaced with
the selected word.
~;~ Blocks 4920 and 4922 represent the selection of the
close button, i.e., a close screen function. These
blocks cause the Suggested Questions screen to be re-
¦ displayed.
,, ~;. j
:",`,7 38
`~i Blocks 4924 and 4926 represent the selection of the
7 scroll bar, i.e. a scroll-up or scroll-down function.
-, These blocks cause the list of possible alternative
words displayed in the display area to scroll up or
5 down, at least until the beginning or end of the list is
~','7, reached.
Blocks 4928 and 4930 represent the selection of the ~ ;~
ictionary icon. These blocks cause the Dictionary
screen to be displayed. Refer to Figures 50 and 51 for
10 more detailed information on the Dictionary screen.
~ Blocks 4932 and 4934 represent the selection of the
'-~ Question Starters icon. These blocks cause the Question ~ ;
Starters screen to be displayed. Refer to Figures 52
and 53 for more detailed information on the Question
15 Starters screen.
Blocks 4936 and 4938 represent the selection of the
,;~i
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruction speech to be re-
played for the user.
DICTIONARY SCREEN
Figure 50 illustrates the Dictionary screen that is
displayed when the user selects the Dictionary icon on
the Make Up A Question screen. Note that the menu bar
~ 25 and control buttons remain along the left edge of the ~-
.'~',7 screen. A box is displayed that covers the rest of the
screen, wherein the box comprises a heading,
,~ instructions, input area, scrollable definition display
~ area, Lookup button, Copy Word button, Word Before
,,7`,~'`7 30 button, Word After button, Close button, earphones icon, ~ -
(disabled) dictionary icon, question starters icon, and
;` "go back" icon.
7~' Figure 51 is a flow chart describing the functions
performed whenever a control element is selected by the
,,,. ~
35 user from the Dictionary screen. Note that the menu bar
and buttons may also be selected by the user, but these
functions are identical to the ones performed at the
.~ '' `',
2 ~
39
~ Main Menu screen and thus are not described further
1~1 herein.
, Block 5102 displays the Dictionary screen on the
-~ monitor and plays the instruction speech for the user:
~ S "You can use the dictionary to find interesting words.
's Type a word. The click Look Up.'~ Block 5104 waits for
-l input from the user identifying the selected function,
-~l i.e., a mouse click. slocks 5106-5140 determine what
,1~ type of input has been received, i.e., what control
~: 10 element on the Dictionary screen has been selected.
Blocks 5106 and 5108 represent the characters from
~ the keyboard, i.e., a date acceptance of typed entry
b `~ function. These blocks cause the entered keywords to be
~ saved in a buffer area in memory for later searching in
`l 15 the database.
Blocks 5110 and 5112 represent the selection of the
Lookup button. These blocks cause the display of the
~ word definition which most closely matches the user's
;~ input in the definition area.
Blocks 5114 and 5116 represent the selection of the
Copy Word button. These blocks copy the entered word in
the input area to the input area of the Make Up A
Question screen.
Blocks 5118 and 5120 represent the selection of the
Word Before button. These blocks cause the display of
~; the word definition which immediately precedes the
t current entry in the dictionary database.
~;~ Blocks 5122 and 5124 represent the selection of the
Word After button. These blocks cause the display of
the word definition which immediately follows the
current entry in the dictionary database.
Blocks 5126 and 5128 represent the selection of the
close-button. These buttons cause the redisplay of the
make-up-a-question screen.
Blocks 5130 and 5132 represent the selection of the
Question Starters icon. These blocks cause the Question
Starters screen to be displayed. Refer to Figures 52
,,, ~ ~
.`: ~ ,.
` ~ 2 ~ 3
and 53 for more detailed information on the Question
Starters screen.
Blocks 5134 and 5136 represent the selection of the
go back" icon. These blocks cause the Make Up A
Question screen to be re-displayed.
Blocks 5138 and 5140 repres~ent the selection of the
earphones icon, i.e., the instruction voicing function.
`~ These blocks cause the instruction speech to be re- -~
played for the user.
,~ QUESTION STARTERS SCREEN ;
Figure 52 illustrates the Ouestion Starters screen
that is displayed when the user selects the Question
Starters icon on the Make Up A Question screen. Note
that the menu bar and control buttons remain along the
left edge of the screen. A box is displayed that covers ~-
the rest of the screen, wherein the box comprises a
heading, instructions, input area, scrollable boxed list
of fill-in-the-blanks questions, OK button, Close
button, earphones icon, (disabled) dictionary icon,
` (disabled) question starters icon, and (disabled) 'go ~ -
back" icon.
~` The "Question Starters'~ interface forms a bridge
between the Choose A Question interface and the Make Up
/~ 25 A Question interface. This interface provides basic
i~ question structures for the user who may feel
comfortable typing single words but not entire
,~ sentences.
' Figure 53 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Question Starters screen. Note that the
menu bar and buttons may also be selected by the user,
but these functions are identical to the ones performed
at the Nain Menu screen and thus are not described
~, 35 further herein.
2~
4 1
; Block 5302 retrieves fill-in-the-blank questions
; ~
from the database. Block 5304 displays the Question
, Starters screen on the monitor and plays the instruction
speech for the user: ~You can f:inish a question I
`l 5 started. Click the question you want to finish. Then
click OK." Block S306 waits for input from the user
identifying the selected function, i.e., a mouse click. !'
Blocks 5308-5334 determine what type of input has been
'`~' :1
~¦ received, i.e., what control element on the Question
Starters screen has been selected.
Blocks 5308 and 5310 represent the acceptance of the
! typed characters from the keyboard, i.e., a data entry
function. These blocks cause the entered keywords to be
-~. saved in a buffer area in memory for later concatenation
with the fill-in-the-blanks question.
" ~
Blocks 5312 and 5314 represent the user single
;3 clicking on a fill-in-the-blank question in the question
list, i.e., a selection function. These blocks cause
the selected question to be highlighted on the monitor
~ 20 to indicate its selection.
`~ Blocks 5316 and 5318 represent the user double
~ clicking on a fill-in-the-blanks question in the
j~ question list, i.e., a copy question function. These
blocks cause the Make Up A Question to be re-displayed
with the selected question copied to the input area of
the Make Up A Question screen with the user's input
filling in the blank.
Blocks 5320 and 5322 represent the selection of the
OK button, i.e., a copy question function. These blocks
cause the Make Up A Question to be re-displayed with the
~': a selected question copied to the input area of the Make ~;
Up A Question screen with the user's input filling in
the blank.
Blocks 5324 and 5326 represent the selection of the
Close button, i.e., a close screen function. These
blocks cause the Make Up A Question screen to be re-
displayed.
~'r . ~
L ~
~ 4~
.. .
~, Blocks 5328 and 5330 represent the selection of the
scroll bar, i.e. a scroll-up or scroll-down function
These blocks cause the question list to be re-displayed
to scroll up or down through the list, at least until
-1 5 the beginning or end of the list is reached. - Blocks 5332 and 5334 represent the selection of the
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruct:ion speech to be re- -
;i played for the user.
~, :
SEEK AND FIND ARTICLE LIST SCREEN
Figure 54 illustrates the Seek and Find article listscreen that is displayed when a search of the data~ase
has successfully generated an article list. Note that
the menu bar and control buttons remain along the left
edge of the screen. A box is displayed that covers the
rest of the screen, wherein the box comprises a heading,
instructions, an input area where the user's keywords
which were used in the search are displayed, a list of
~ 20 article titles containing the keywords, and earphones
l~ icon, as well as Open and Close buttons.
Figure 55 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Seek and Find article list screen. Note
that the menu bar and buttons may also be selected by
the user, but these functions are identical to the ones
performed at the Nain Menu screen and thus are not
~ described further herein.
3-~ I Block 5502 retrieves the articles from the database -
corresponding to the selected keywords entered by the
user and creates the Seek and Find article list. Block
5504 displays the Seek and Find article list screen on
the monitor a;nd plays the instruction speech for the
user: "The computer found these articles using the words
you typed. Click the article you want to read. Then
: click Open." Block 5506 waits for input from the user
identifying the selected function, i.e., a mouse click. ~ ;~
~ 3
.~i
`~ Blocks 5508-5530 determine what type of input has been
~-~ received, i.e., what control element on the Seek and
Find article list screen has been selected.
slocks 5508 and 5510 represlent the user single
~, 5 clicking on a title in the article list, i.e., a
selection function. These blocks cause the selected
title to be highlighted on the monitor to indicate its
selection.
~1 Blocks 5512 and 5514 represent the user double
j~ 10 clicking on a ti-tle in the article list, i.e., a display
~t;i article function. These blocks cause the article
corresponding to the selected title to be displayed on
`- the monitor.
slocks 5516 and 5518 represent the selection of the
~, ...
Open button, i.e., an open article function. These
blocks cause the article corresponding to the selected
title highlighted in the article list to be displayed on
the monitor.
Blocks 5520 and 5522 represent the selection of the
Close button, i.e., a close screen function. These
`~ blocks cause the Make Up A Question screen to be re-
displayed.
Blocks 5524 and 5526 represent the selection of the
scroll bar, i.e. a scroll-up or scxoll-down function.
These blocks cause the article list to be re-displayed
to scroll up or down through the list of titles, a~
~!~ least until the beginning or end of the list is reached.
Blocks 5528 and 5530 represent the selection of the
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruction speech to be re-
played for the user.
,...
SIGHTS AND SOUNDS OPENING SCREEN
Figure 56 illustrates the opening screen for the
Sights and Sounds pathway which is displayed when the
user selects the Sights and Sounds pa-thway graphic on .
~! the Main Menu screen. Like the Main Menu screen, the
~x~`
,,~ ;
~'
:
:., 5
44
l Sights and Sounds opening screen includes a menu bar at
1 the top of the screen and six control buttons along the
left edge of the screen. Five different labelled
;' graphics representing various multimedia browsers appear
to the right of the control buttons.
~he Sights and Sounds pathway helps the user find
~¦ articles by allowing them to preview pictures, speeches,
~, movies (animation), maps and sounds contained therein.
Thus, rather than forcing the user to actively seek out
`~ 10 articles by some formal organizational scheme, i.e.,
alphabetically or topically, articles are presented to
the user in a random order. This browsing interface is ~ -~
designed to appeal to young users by making big things ;-
happen, i.e., boxes popping up, when little actions, `~
15 i.e., mouse clicks, are taken. The boxes and the . -
multimedia elements from the database surprise the user,
yet the user retains complete control over the screen by
deciding when to make the boxes appear and disappear. ~-
~- Figure 57 is a flow chart describing the functions
performed whenever a control element is selected by the
user at the Sights and Sounds opening screen. Note that
the menu bar and buttons may also be selected by the
~ user, but these functions are identical to the ones
,~ performed at the Main Menu screen and thus are not
described further herein.
Block 5702 displays the Sights and Sounds opening
screen on the monitor and plays the instruction speech
for the user: "Click the words in the bookcase to
~ ! explore." Block 5704 waits for input from the user
'~ 30 identifying the selected function, i.e., a mouse click.
Blocks 5706-5728 determine what type of input has been ~ t~
received, i.e., what element on the Sights and Sounds
opening screen has been selected.
Blocks 5706 and 5708 represent the selection of the
Picture graph.ic, i.e., the picture browser function.
Refer to Figures 58 and 59 for more detailed information
~i~ on this function.
~ ' 1'`
.',,'~. ,
- 45
slocks 5710 and 5712 represent the selection of the
~` Speeches graphic, i.e., the speeches browser function.
Refer to Figures 60 and 61 for more detailed information
on this function.
Blocks 5714 and 5716 represent the selection of the
Mcvies graphic, i.e., the animation browser function.
Refer to Figures 62 and 63 for more detailed information
on this function.
i ^l
I Blocks 5118 and 5720 represlent the selection of the
Maps graphic, i.e., the map browser function. Refer to
'`~ ?` Figures 64 and 65 for more detailed information on this
; function.
Blocks 5722 and 5724 represent the selection of the
Sounds graphic, i.e., the sound browser function. Refer
to Figures 66 and 67 for more detailed information on
this function.
Blocks 5726 and 5728 represent the selection of the
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruction speech to be re-
played for the user.
~' ,
PICTURE BRONSER SCREEN ~;
~¦ Figure 58 illustrates the Picture Browser screen
that is displayed when the user selects the Picture
25 graphic at the Sights and Sounds opening screen. Like --
the Main Menu screen, the Picture Browser screen
includes the menu bar at the top of the screen, and the
~i six control buttons along the left edge of the screen.
A box is displayed that covers the rest of the screen,
~,J~ 30 wherein the box comprises a picture element from the
database, a caption for the picture identifying both the
picture and the article to which it is related, a Close
button, an Open button, a left arrow button, a right
~ arrow button, and an earphones icon.
,~j 35 Figure 59 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Picture Browser screen. Note that the
~``` 2 ~
r ~ ~ ~ 46
~, .
j3 menu bar and buttons may also be selected by the user,
-~ but these functions are identical to the ones performed
at the Main Nenu screen and thus are not described
further herein.
Block 5902 retrieves the first picture from the
database. slock 5904 displays the Picture srowser
Il~ screen with the first picture on the monitor and plays..-, "
the instruction speech for the user: "Click Open to go
to an article that tells more about this picture. Click
the right arrow to see the next picture. Click the left
arrow to see the previous picture." Block 5906 waits
for input from the user identifying the selected
function, i.e., a mouse click. Blocks 5908-5926
determine what type of input has been received, i.e., ; :
~ 15 what control element on the Picture Browser screen has
`;~ been selected.
Blocks 5908 and 5910 represent the selection of the
~¦ Close button, i.e., a close screen function. These
blocks cause the Sights and Sounds opening screen to be
20 re-displayed.
Blocks 5912 and 5914 represent the selection of the
Open button, i.e., an open article function. These
blocks cause the article corresponding to the picture to
be displayed on the monitor. .
Blocks 5916 and 5918 represent the selection of the
left arrow function, i.e., a previous picture function.
These blocks cause the previous picture in the database ~`
to be displayed.
Blocks 5920 and 5922 represent the selection of the
right arrow function, i.e., a next picture function.
~ These blocks cause the next picture in the database to
Z~ be displayed.
.~rr~ .
JX Blocks 5924 and 5926 represent the selection of the
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruction speech to be re-
played for the user.
.
,,.
. . ;
. '~ . .
47
~.~ SPEECH BROWSER SCREEN
'~:! Figure 60 illustrate~ the Speech Browser screen that
~i is displayed when the user selects the Speech graphic at
~;~ the Sights and Sounds opening screen. Like the Main
`" 5 Menu screen, the Speech Browser screen includes the menu
;~ bar at the top of the screen, and the six control
buttons along the left edge of the screen. A box is
displayed that covers the rest of the screen, wherein
the box comprises a speech element from the database, a
caption for the speech identifying both the speech and
the article to which it is related, a Close button, an
Open button, a left arrow button, a right arrow button,
an earphones icon at the top of the screen, and an
earphones icon at the bottom of the screen.
Figure 61 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Speech Browser screen. Note that the menu
bar and buttons may also be selected by the user, but
these functions are identical to the ones performed at
,! 20 the Main Menu screen and thus are not described further `;
herein.
i. Block 6102 retrieves the first speech from the
j~; database. Block 6104 displays the Speech Browser screen
~ with the first speech on the monitor and plays the
P`j 25 instruction speech for the user: "Click Open to go to an
article that tells more about this speech. Click the
right arrow to see the next speech. Click the left
arrow to see the previous speech." Block 6106 waits for
!.'" input from the user identifying the selected function,
30 i.e., a mouse click. Blocks 6108-6130 determine what ~ i
type of input has been received, i.e., what control
element on the Speech Browser screen has been selected.
:~t Blocks 6108 and 6110 represent the selection of the
Close button, i.e., a close screen function. These
blocks cause the Sights and Sounds opening screen to be
re-displayed.
`!`'~' .
'!, ¦ .
~`,. . .
_ 48 -
slocks 6112 and 6114 represent the selection of the
Open button, i.e., an open article function. These
blocks cause the article corresponding to the speech to
be displayed on the monitor.
`i~ 5 Blocks 6116 and 6118 represent the selection of the
left arrow function, i.e., a previous speech function.
~3 These blocks cause the previous speech in the database
to be displayed.
Blocks 6120 and 6122 represent the selection of the
right arrow function, i.e., a next speech function.
These blocks cause the next speech in the database to be
.~ displayed.
Blocks 6124 and 6126 represent the selection of the
earphones icon at the top of the screen, i.e., the
speech voicing function. These blocks cause the
digitized speech to be played for the user.
Blocks 6128 and 6130 represent the selection of the `-
earphones icon at the bottom of the screen, i.e., the
instruction voicing function. These blocks cause the
~ 20 instruction speech to be re-played for the user.
9~ ANIMATION sRowsER SCR~EN
Figure 62 illustrates the Animation Browser screen
that is displayed when the user selects the Movie
graphic at the Sights and Sounds opening screen. Like
the Main Menu screen, the Animation Browser screen
includes the menu bar at the top of the screen, and the
six control buttons along the left edge of the screen.
A box is displayed that covers the rest of the screen, `
~ 30 wherein the box comprises an animation element from the
:.! database, a caption for the animation identifying both
. the animation and the article to which it is related, a
,~ Close button, an Open button, a Start button, a left
arrow button, a right arrow button, and an earphones
~¦ 35 icon.
"j,~
f,,~ .
S,~ .
~ 2 ~ 3
49
Figure 63 is a flow chart describing the functions
performed whenever a control element is selected by the
user f~om the Animation srowser screen. Note -that the
menu bar and buttons may also be selected by the user,
but these functions are identical to the ones performed
at the Main Menu screen and thus are not described
~j further herein.
Block 6302 retrieves the first animation from the
~ database. Block 6304 displays the Animation Browser
.~ 10 screen with the first animation on the monitor and plays
the instruction speech for the user: "Click Open to go
to an article that tells more about this movie. Click
Start to begin the movie. Click the right arrow to see
the next movie. Click the left arrow to see the ~`
15 previous movie." Block 6306 waits for input from the -~
~ user identifying the selected function, i.e., a mouse
,i.. !~ click. Blocks 6308-6330 determine what type of input
has been received, i.e., what control element on the
Animation Browser screen has been selected.
Blocks 6308 and 6310 represent the selection of the ~;
Close button, i.e., a close screen function. These
blocks cause the Sights and Sounds opening screen to be -
re-displayed.
Blocks 6312 and 6314 represent the selection of the
~ 25 Open button, i.e., an open article function. These
i~`i blocks cause the article corresponding to the animation
"'!'i~ to be displayed on the monitor.
Blocks 6316 and 6318 represent the selection of the
Start button, i.e., an animation function. These blocks ~ ;
~ 30 cause the animation to be played.
!i', Blocks 6320 and 6322 represent the selection of the
left arrow button, i.e., a previous animation function.
These blocks cause the previous animation in the
database to be displayed.
'.
;`'',1 . . ~
:~:
.
:`:
210~0~
Blocks 6324 and 6326 represent the selection of the
right arrow function, i.e., a next animation function.
These blocks cause the next animation in the database to
t
~j be displayed.
dl 5 Blocks 6328 and 6330 represent the selection of the
earphones icon, i.e., the instruction voicing function.
These blocks cause the instruction speech to be re-
played for the user.
MAP BROWSER SCREEN
;I! Figure 64 illustrates the Map Browser screen that is
displayed when the user selects the Map graphic at the
~,. il .
~ Sights and Sounds opening screen. Like the Main Menu
5~ screen, the Map srowser screen includes the menu bar at
the top of the screen, and the six control buttons along
the left edge of the screen. A box is displayed that
covers the rest of the screen, wherein the box comprises
a map element from the database, a caption for the map
t!~j identifying both the map and the article to which it is
~j 20 related, a Close button, an Open button, a left arrow
l button, a right arrow button, and an earphones icon.
;~ Figure 65 is a flow chart describing the functions
performed whenever a control element is selected by the
user from the Map Browser screen. Note that the menu
bar and buttons may also be selected by the user, but
these functions are identical to the ones performed at
the Main Nenu screen and thus are not described further
~ herein.
.j~ ` Block 6502 retrieves the first map from the
database. Block 6504 displays the Map Browser screen
with the first map on the monitor and plays the
instruction speech for the user: "Click Open to go to an
article that tells more about this map. Click the right
.~ arrow to see the next map. Click the left arrow to see
the previous map." Block 6506 waits for input from the
user identifying the selected function, i.e., a mouse
~'~ click. Blocks 6508-6526 determine what type of input
.. . .
~ ~ .
f ~
` ` 2 1 ~ 3
:..... ~ . .
51
¦ has been received, i.e., what control element on the Map
srowser screen has been selected.
slocks 6508 and 6510 represent the selection of the
Close button, i.e., a close screen function. These
`~ 5 blocks cause the Sights and Sounds opening screen to be
re-displayed.
`:l Blocks 6512 and 6514 represent the selection of the -
;~ Open button, i.e., an open article function. Theise
blocks cause the article corresponding to the map to be
displayed on the monitor.
Blocks 6516 and 6518 represent the selection of the
,
~ left arrow button, i.e., a previous map function. These
!,~'`'~ blocks cause the previous map in the database to be
displayed.
Blocks 6520 and 6522 represent the selection of the
right arrow function, i.e., a next map function. These
blocks cause the next map in the database to be ;
~` displayed.
Blocks 6524 and 6526 represent the selection of the
20 earphones icon, i.e., the instruction voicing function. --
These blocks cause the instruction speech to be re-
; played for the user.
~ ,~
;s~ SOUND BROWSER SCREEN
Figure 66 illustrates the Sound Browser screen that
is displayed when the user selects the Sound graphic at
the Sights and Sounds opening screen. Like the Nain
Menu screen, the Sound Browser screen includes the menu
bar at the top of the screen, and the six control
buttons along the left edge of the screen. A box is
displayed that covers the rest of the screen, wherein ~;
the box comprises a sound element from the database, a .
caption for the sound identifying both the sound and the
article to which it is reIated, a Close button, an Open
button, a left arrow button, a right arrow button, and
an earphones icon.
- 2 ~ 3 ~ ~
,.;.,~
;~i 52
::!
~ Figure 67 is a flow chart describing the functions
i~ performed whenever a control element is selected by the
`~ user from the Sound Browser screen. Note that the menu
bar and buttons may also be selected by the user, but
these functions are identical to the ones performed at
the Main Menu screen and thus are not described further
~! herein.
Block 6702 retrieves the first sound from the
database. Block 6704 displays the Sound Browser screen
with the first sound on the monitor and plays the
instruction speech for the user: "Click Open to go to an
~i article that tells more about this sound. Click the
,.~ .
i right arrow to see the next sound. Click the left arrow
to see the previous sound." Block 6706 waits for input
from the user id~ntifying the selected function, i.e., a
mouse click. Blocks 6708-6726 determine what type of
.~j ,.,
input has been received, i.e., what control element on
~j the Sound Browser screen has been selected.
Blocks 6708 and 6710 represent the selection of the
Close button, i.e., a close screen function. These
blocks cause the Sights and Sounds opening screen to be
re-displayed.
Blocks 6712 and 6714 represent the selection of the
i`~ Open button, i.e., an open article function. These
,~ 25 blocks cause the article corresponding to the sound to
be displayed on the monitor.
slocks 6716 and 6718 represent the selection of the
left arrow button, i.e., a previous sound function.
These blocks cause the previous sound in the database to
be displayed.
Blocks 6720 and 6722 represent the selection of the
~¦ right arrow function, i.e., a next sound function.
-~ These blocks cause the next sound in the database to be
displayed.
~ 35
; .~
1 .
!, '' ` .
2 ~ ~ ~ f~
~,
53
~`i Blocks 6724 and 6726 represent the selection of the
~; earphones icon, i.e., the instruction voicing function.
~,l These blocks cause the instruction speech to be re-
j~ played for the user.
~1 ROBOT CONTROL BUTTON
;~ Figure 68 is a flow chart alescribing the functions
performed whenever the robot control button described
above, on page 28 line 6, is selected. The robot button
is called the "Say It" robot icon and appears on every
screen. Nhen selected, the robot icon invokes a
function which converts selected textual information
displayed on the monitor to digitized speech which is
played through the speaker attached to the computer, one
sentence at a time beginning with the first word on the
page and ending with the last word on the page, but not
including any text associated with any multimedia
features, i.e., pictures, map and animation titles and
captions, text in tables, sound captions, or cross-
references.
~ In an article without text selected, the user must
;j~Y; scroll more of an article into view and click the robot
again to hear a new block of text read. In a boxed list
without text selected, the user must scroll more of the
list into view and click the robot again to hear a newblock of text read.
~i,
~ When no textual information has been selected on the
s~i~ monitor with a boxed list, the list is voiced one item
at a time beginning with the first item currently
displayed in the list and ending with the last item
currently displayed in the list. The user may stop the
~ voicing by clicking anywhere on the screen to de-
'`t~`- highlight the robot icon, perform another action, or
select a block of text. Nhen the voicing is completed,
the robot icon and the text selection are de-
highlighted. .
' '
;.
Ij': ~, '
:
'2 ~ Q ~
...
..,~
54
:,
slock 6802 represents the selection of the roboticon indicated by highligh-ting the robot icon.
~ Decision Block 6804 determines whether text has been
; selected. If none selected, slOck 6806 represents the
voicing of all text on the screen. If text is selected,
slock 6808 represents the ~oici;ng of only selected text.
Block 6810 represents de-highlighting of the robo-t
icon.
.c: 1
10CONCLUSION
This concludes the description of the preferred
~:;j embodiment of the invention. In summary, an information
;~, 1
presentation apparatus has been described comprising a
computer program executed by a computer for accessing an
-J 15 encyclopedia stored in an electronic format in the
computer s data storage. The encyclopedia comprises a
database of articles and associated multimedia elements,
including graphics, animations, and sounds. The
~, computer program provides four pathways for accessing
the articles in the encyclopedia, including an
j alphabetical list pathway, a topic hierarchy pathway, a
search and retrieval pathway, and a multimedia browser
I pathway.
~ The alphabetical list pathway organizes articles
`~ 25 from the encyclopedia alphabetically on the monitor.
The alphabetical list pathway displays a list of
graphics on the monitor which represent each letter in
an alphabet, so that when the user selects one of the
graphics, a list of articles related thereto is
displayed on the monitor. The alphabetical list pathway
~r. assists users in learning their "ABCs", because the
article titles are indicated by graphics corresponding
to the letters of the alphabet, so that every graphic
~!~` displayed on the monitor corresponds to a letter in the
alphabet. The alphabetical list pathway voices a
description of the graphics through the speaker so that
users who do not know their ABCs can hear the letter
~`'.
~ 2 ~ 3 ~ ;
..,:
~-,
- names. The graphics can comprise digi-tized speech and
animations illustrating the subject matter of the
graphics.
The topic hierarchy pathway organizes articles from
the encyclopedia on the monitor by topic groups which
`; are indicated graphically on the monitor. The topic
hierarchy pathway displays topic groups designed for
young !children, so that the organizational structure
corresponds to objects recognizable by the young
children. The topic hierarchy pathway displays a list
of graphics which represent each topic group, so that
when the user selects one of the graphics, a list of
articles related thereto is displayed on the monitor.
These graphics are menus which are presented as a series
of picture scenes, so that the list of article titles
~I can be put in pictorial conte~t. The article titles are
organized by picture menus corresponding to the topic
groups. The series of picture menus map topics to
recognizable places. A picture menu can be "zoomed in
on" to display a more detailed article list
corresponding thereto.
The search and retrieval pathway generates a list of
article titles using questions answered by the user to -~
~!' determine the scope of the articles. The search and -~
~, 25 retrieval pathway can also generate a list of article
`` titles using search terms entered by the user into the
I~y computer. When a title is selected from the list, the
i~ opening screen of the selected article is displayed on
~ the monitor. The search terms are highlighted in the
i~-;3 30 article, table, picture caption, and sound captioned
1 1
`~:31 text as they are displayed.
:3 The multimedia browser pathway organizes articles
from the encyclopedia on the monitor according to the
multimedia e].ements contained therein, so that the
~`~ 35 corresponding articles are displayed when the multimedia
elements are selected. Users can select a multimedia
feature from a list of similar features, and displays
~ ! .
.~ ~'`".
2 ~
~-`. 56
. i
the opening screen of the corresponding article on the
monitor. The multimedia browser pathway permits
; Jj articles to be perused by previewing the multimedia
j elements therein. Included in the multimedia browser
,i 5 pathway are a picture browser, speech browser, animation
:, browser, map browser, and souncl browser.
The foregoing description of the preferred
embodiment of the invention has been presented for the
,~j purposes of illustration and d~scription. It is not
intended to be exhaustive or to limit the invention to
the precise form disclosed. Many modifications and
` variations are possible in light of the above teaching.
It is intended that the scope of the invention be
~',i`~ limited not by this detailed description, but rather by
the claims appended hereto.
.. ... . ..
Ç
",,-
,, Ç,
~..3
,.
.`
~,.,.i ,
~; ~.,!
iy .;,
r
4~."
~ . ~'
~,.,,
