Note: Descriptions are shown in the official language in which they were submitted.
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
TITLE OF THE INVENTION
Method and System for Controlling and Enhancing the Playback of
Recorded Audiovisual Programming
FIELD OF THE INVENTION
The present invention relates to the field of video recording and playback.
More specifically, the present invention relates to the field of prepared
video
productions for educational and entertainment use. The present invention
encompasses a novel software package for controlling and enhancing the
playback
Z o of a pre-recorded video program, where the software package allows the
viewer to
edit the playback of the video program for selected content, access
supplemental
information about the program content and monitor the effect of the editing
decisions on the playback of the program.
15 BACI~.GROUND OF THE INVENTION
Television and cinema provide a vast array of available video
programming. By watching a television broadcast or attending a film showing, a
viewer can experience almost any type of video programming he or she desires.
Additionally, in order to make such video programming even more accessible to
2o viewers, such video programming may be recorded on such media as video
cassettes or optical discs for playback using an appropriate recording and
playback
device at the viewer's convenience.
Being able to play back a recorded video program also provides the viewer
with greater control over how that video program is viewed. For example, if a
25 viewer wishes to replay a portion of the video program, he or she may do so
using
the playback device. Similarly, if the viewer wishes to skip over a portion of
the
video program he or she may fast forward through the program using the
playback
device.
1
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
If the video programming is on an optical disc, such as a CD-ROM, laser
disc or Digital Video(Versatile) Disc ("DVD"), the reader of the playback
device
can quickly access any portion of the video program. If the optical disc
playback
device is incorporated into a computer, for example, and controlled by the
computer, the user may specify what portions of the video program and in what
order those portions should be played by the playback device.
For example, U.S. Patent No. 5,109,452 to Bohrman discloses a video
playback and control system in which the viewer may access all the frames in a
recorded video program, and specify segments of the program by a starting and
Zo ending video frame such that only those segments specified by the viewer
are
replayed. Moreover, the viewer may indicate the order in which segments are to
be replayed and associate with each segment textual comments relating to the
segment.
Similarly, U.S. Patent No. 5,434,675 to Abecassis discloses a system for
controlling the playback of a video program in which segments of the program
are
specified and rated as to potentially objectionable subject matter they
contain.
Using a computer or other user interface device for controlling playback under
the
principles of the Abecassis system, the user specifies a rating for categories
of
potentially objectionable subject matter above which the viewer does not wish
to
z o see rated material. The video program, as recorded, contains alternative
sequences
and video segments which have various ratings of potentially objectionable
content contained therein. The playback device will then automatically select
and
substitute those segments of the video program which match the preferences
established by the user for objectionable content in the replay of the video
2 5 program.
While systems such as those disclosed by Bohzman and Abecassis provide
viewers with a great deal of control over the playback and content of a
recorded
video program, they fail to allow the viewer to monitor the impact such
editing has
2
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
on the video program. Consequently, there is a need in the art for an improved
video playback control system which allows the viewer great flexibility in
controlling potentially objectionable content in a video program, but also
allows
the viewer to monitor the impact any editing has on the video program.
Additionally, the prior art systems generally require that any supplemental
information or commentary regarding the various scenes of the video program be
input by the user or recorded on the same medium as the video program.
Consequently, there is a need in the art for a more flexible way of providing
a user
with supplemental information about the segments and segment content of a
s o recorded video program, particularly where no such information was
originally
included on the same recording medium as the video program.
In connection with these aspects of the art, the prior art systems present the
recorded video program and any divisions thereof in a flat, linear list.
Consequently, there is a need in the art for a method and system of better
i 5 organizing a structure associated with a recorded video program to~ permit
more
rapid and easy navigation by the user among the segments of the program and
any
information associated therewith.
Other systems related to the use of video programming have addressed the
desire of viewers to edit out objectionable content. One such device is a
program
2 o for dynamically editing the content of a video program which is broadcast
to the
viewer's television set. In these systems, a signal which indicates the
presence
potentially objectionable subject matter in each segment of~the broadcast
program
is included in the broadcast signal in a field which is also used for carrying
close-captioned text for the video program. The system then monitors this
signal
2s from the close-captioning field and compares the objectionable nature of
the
program as indicated by the incoming signal with a preset preference provided
by
the user that defines a rating above which programming content should be
avoided.
When the signal from the closed-captioning field of the video broadcast signal
3
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
indicates material in conflict with the preference setting provided by the
user, the
system may appropriately mute the audio or blank the video output to remove
the
objectionable content from the video program.
This system, unfortunately, only works if the appropriate rating information
s is provided in the closed-captioning portion of the video programming
signal. If
this is not the case the system will have no ability to edit the programming
according to the desires of the user. Moreover, this system must simply divide
potentially objectionable subject matter into relatively broad categories
which can
then be selected or refused by the user. The user has very little control to
precisely
so define what he or she may consider objectionable and remove only that
material
from the video program. Finally, the use of video rating information in the
closed-captioning portion of the video signal requires additional processing
of the
signal by the receiver and playback equipment and prevents the full use of
that
portion of the signal for closed-captioning or other information that may be
carried
15 there.
Consequently, there is a need in the art for an improved method and system
of allowing a user to remove those scenes or audio portions of a video program
which that user finds objectionable. There is a further need in the art for
such a
system to allow the user great flexibility in determining precisely that
subject
2o matter which he or she finds objectionable and removing only that subject
matter
from the video program.
SUM11~IARY OF THE INVENTION
The present invention meets the above-described needs and others.
~ s Additional advantages and novel features of the invention will be set
forth in the
description which follows or may be learned by those skilled in the art
through
reading these materials or practicing the invention. The advantages of the
invention may be achieved through the means recited in the attached claims.
4
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
In summary, the present invention may be embodied and described as a
novel video playback system for playing back a video program recorded on an
optical disc or other recording medium. This system includes a video playback
device connected to a reader for reading the video program stored on the
recording
medium, the readerbeing controlled by the video playback device. The video
playback device controls playback of the video pxogram in accordance with a
user-
editable electronic data file existing in the video playback device
independent of
data recorded on the recording medium.
The electronic data file includes a user-editable playlist that specifies a
s o division of the segments of the video program as recorded on the recording
medium. The electronic data file preferably also includes supplemental
information associated with the specified segments of the video program.
The video playback device also preferably includes a user interface
including a display device on which the playlist is displayed. The displayed
15 playlist provides a listing of the segments of the video program and may
also
provide a coding system that indicates what types of the supplemental
information
are associated with each segment. The playback device can then access and
display the supplemental information under control of a user operating the
user
interface.
2 o Using the user interface, the user can also make changes to the playlist.
The playback device records the changes to the playlist made by the user
through
the user interface. Thus, the electronic data file may include an original and
an
edited playlist.
The electronic data file may also provide a description of each of a number
a 5 of audio segments of the video program. The user can edit the playlist to
remove
any of the audio segments from the playlist so that the removed audio segment
is
omitted from a playback of the video program. The playback device also records
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
such deletions of audio segments from the playlist in the edited playlist of
the
electronic data file.
The system may also preferably generate a statistical analysis of
characteristics of the video program as played back in accordance with the
edited
playlist. This analysis may be conducted directly on the edited playlist or in
comparison with an unedited version of the playlist. This analysis will
provide
such data as the running time of the edited program, damage to the plot of the
program arising from the editing and types of supplemental information
associated
with remaining video segments.
1 o The present invention also encompasses the methods of making and
operating the system described above and the method of generating the
electronic
data file described above. For example, the present invention encompasses the
method of controlling and enhancing playback of a video program recorded on an
optical disc or other recording medium by controlling playback of the video
15 program with a video playback device in accordance with a user-editable
electronic data file existing in the video playback device independent of data
recorded on the recording medium.
The present invention also encompasses the method of providing an
electronic data file for use in controlling playback of a corresponding video
2 o program recorded on an optical disc or other recording medium. This method
includes dividing the video program as recorded on the recording medium into a
hierarchy of segments; and storing the hierarchy in an electronic data file
independent of data recorded on the recording medium. This method, consistent
with the description above, may also include the addition of supplemental
25 information stored in the electronic data file and associated with various
video
segments.
The present invention also encompasses a method of doing business in
which customers are provided with a means for controlling and supplementing
6
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
playback of a video program recorded on a recording medium. This method
includes selling an electronic data file that corresponds to the video program
on the
recording medium, where the electronic data file includes a user-editable
playlist
that divides the video program into video segments and includes supplemental
information associated with one or more of the video segments. This data file,
as
described above, is usable to control playback of the video program on a video
playback device.
BRIEF DESCRIPTION OF THE DRAWINGS
s o The accompanying drawings illustrate the present invention and are a part
of the specification. Together with the following description, the drawings
demonstrate and explain the principles of the present invention.
Fig. 1 is diagram of a system according to the present invention for
producing a mufti-platform file that supplements and facilitates editing of a
pre-
recorded video program.
Fig. 2 is a flowchart illustrating the operation of the software of the system
of Fig. 1.
Fig. 3 is a diagram of the content of a pre-recorded video program and the
hierarchical structure of that content according to the mufti-platform fzle of
the
2o present invention.
Fig. 3a is a diagram of a second division of the content of a pre-recorded
video program and the hierarchical structure of that content according to the
multi-
platform file of the present invention.
Fig. 4 is a diagram of a video program playback system according to the
present invention.
Fig. 5 is a diagram of a second embodiment of a video program playback
system according to the present invention.
7
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
Fig. 6 is an illustration of the editing system, mufti-platform file and
playback devices of the present invention.
Fig. 7 is a flowchart illustrating the operation of the software of the
playback system of Figs. 4-6 according to the present invention.
s Fig. 7a is an illustration of a hierarchical tree of the playlist of the
present
invention.
Fig. 8 is a diagram of additional divisions of the content of the pre-recorded
video program for supporting the audio editing features of the present
invention.
Fig. 9 is a flowchart illustrating an additional analysis feature of the
1 o software of the present invention.
DETATLED DESCRIPTION OF THE PREFERRED EMBODIMENTS
The present invention provides a method and system for controlling and
enhancing the playback of recorded audiovisual programming. More specifically,
15 the present invention provides systems for generating and using an
electronic data
file that divides the recorded audiovisual program into segments and provides
supplemental information about the various segments of the program. This
electronic data ale can be used by a number of different playback platforms
and
allows the user to easily edit the playback of the program for appropriate
content
a o and access supplemental information about program segments.
Fig. 1 illustrates a system according to the present invention for generating
the mufti-platform data fle that corresponds to and supplements a recorded
video
program. This file is referred to herein as an Electronic Film Review or "EFR"
file.
25 As shown in Fig. 1, the system of the present invention for generating an
EFR (100) preferably includes a computer (108) with an optical disc drive
(107).
As will be understood by those skilled in the art, the principles of the
present
invention can be applied to recorded video programming that is recorded on,
for
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
example, a CD-ROM, a laser disc or a Digital Video(or Versatile) Disc ("DVD").
The term "optical disc" will be used to refer generally to these and any
equivalent
video storage media.
The invention may also be applied to a recorded video program stored on
other data storage media including, but not limited to, a magnetic disc, a
magneto-
optical disc, or semiconductor memory. The term "recording medium" will be
used herein to refer to all such recording media on which a video program can
be
recorded, including, but not limited to, optical discs, magnetic and magneto-
optical
discs, and semiconductor memory unit.
1 o The computer ( 108) preferably includes a modem and connection ( 102) to
the Internet or World Wide Web (101). Consequently, the EFR may be sold and
distributed over the Internet (101).
The computer (108) also has a monitor (103) on which the video program,
recorded on the optical disc (106) and retrieved by the optical disc drive
(107), is
Shown. With user input devices, such as the keyboard (104) and mouse (105), a
user can divide the recorded video programming into a hierarchy of segments.
Additional data can then be associated with each segment which supplements the
segment, describes the segment or identifies potentially objectionable subject
matter in the segment. As used herein, a "segment" refers to any specified
portion
z o of the recorded video program at any hierarchical level, including the
entire video
program.
The divisions of the video programming into segments and the additional
information associated with each segment are written to an EFR file (100)
which
exists independently of the programming recorded on the disc (106). The EFR
file
(100) is preferably written in a multi-platform markup language, such as
Extensible Markup Language (XML) using Unicode to encode the characters.
The creation of the EFR (100) is done using a video software package
running on the computer (108). Fig. 2 is a flowchart of this softwaxe package
and
9
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
illustrates the method of creating an EFR (100) under the principles of the
present
invention.
As shown in Fig. 2, the optical disc drive, under control of the video
software package, reads the data for the video program from the optical disc
(201).
The program, under control of the user, is then displayed on the monitor of
the
computer. The video program consists of a series of frames, still images, that
are
displayed in rapid succession to give the illusion of motion. The user can
specify a
video segment by indicating a starting frame and an ending frame. Each frame
may be numbered to facilitate selection and identification by a user who is
defining video segments.
As the user defines video segments (203), the segment parameters, i.e., an
identification of the frames that begin, end and axe included in the segment
are
written to the EFR ale (204). After a segment is identified, the user may
provide
additional data associated with any of the segments (205). This information
may
be background or critical information about the film or the particular
segment,
cultural or linguistic information about the segment, a synopsis of the
segment, an
identification of potentially objectionable content in the segment, a rating
of the
importance of the segment to the plot of the program, etc. Any information the
user wishes to associate with that segment may be input (205), including
numeric
2o values or alphanumeric codes that characterize aspects of the segment. The
user
may also designate various types or categories of such additional information.
This additional data is then written to the EFR (100). All such information,
whether graphic, textual, animated, etc., is referred to herein as
"supplemental
information."
This process continues until the user has finished (207), i.e., has defined
all
the video segments desired and entered all the desired supplemental
information.
When the process is finished, the software completes the EFR file (20~), which
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
includes the divisions of the video programming and all the supplemental data
provided by the user.
Fig. 3 illustrates in more detail the hierarchical division of the video
program written to the EFR (100). The example illustrated in Fig. 3 is that of
a
DVD (320). When manufactured, the DVD (320) already includes some division
of the recorded programming into various segments. As shown in Fig. 3, the
material on a DVD is generally divided into a preview section (302), a main
segment consisting of the video program (301) and a trailer segment (303)
which
may include out-takes from the video program, director's notes or comments,
1 o behind the scenes footage, explanations of how the film was made, etc. The
video
program's main segment (301) is usually divided in to a number of chapters
(304).
Consequently, when a user plays a commercial DVD, he or she can choose to
watch a preview, a trailer or the main program and, within the main program
(301), can select a particular chapter (304) at which to start watching. Thus,
box
(330) indicates the hierarchical structure provided on a conventional DVD.
Box (331), however, illustrates additional hierarchical structure and
divisions of the main program (301) provided in the EFR (100) of the present
invention. Each of these segments is preferably defined by identifying a first
and
last frame for that segment. The hierarchical structure is for the convenience
of
2o the user in navigating through the defined segments of the program (301).
As
shown in Box (331), each chapter (304) is divided into a number of scenes
(305).
Each scene (305) is divided into a number of sub-scene segments (306).
Finally,
each sub-scene (306) is divided into a number of clips (307). As used herein,
the
term "clips" refers generally to segments of the video program at the bottom
level
of the hierarchy illustrated in Fig. 3. The divisions between the preview
(302),
main segment (301) and trailer (303), and between the chapters (304) in the
main
segment (301) may also be written into the EFR (100).
11
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
The user may choose to provide supplemental information for any segment
(304-307) at any hierarchical level in the system (33 I). However, information
supplementing each clip (307) is preferred and gives the user the most
detailed
information and control over the video program (301).
Fig. 3a illustrates a second embodiment of the hierarchical structure of the
segmentation of the video program. According to the principles of the present
invention, there may be more than one hierarchical structure dividing a
recorded
video program, with all alternate hierarchical structures being stored in the
EFR
(100). As shown in Fig. 3a, a chapter (304) may have a first hierarchical
structure
Zo of segments (331) as illustrated and described in Fig. 3. The same chapter
(304)
may also have a second hierarchical structure of segments (331a) that divides
the
chapter in a different way.
One segmentation scheme (e.g., 331) may be best suited to editing the
video program for presentation in an educational context. The alternative
15 segmentation scheme (e.g., 331a) may be best suited to editing the video
program
for entertainment use. Consequently, two or more alternate segment hierarchies
may be produced and include in the EFR (100) of the present invention.
Fig. 4 illustrates a system according to the present invention for using an
EFR (100) to support and control the playback of the corresponding video
2 o programming. The exemplary system of Fig. 4 includes a computer (408)
which
includes an optical disc drive (107), e.g., a DVD drive, for playing back
video
programming recorded on an optical disc (106), e.g., a DVD. The video
programming from the disc (106 is displayed on a monitor (403) of the computer
(408). As will be understood by those skilled in the art, the computer (408)
may
2 s be, for example, a desk-top computer, a lap-top computer, a server or
other
computer system. The computer (408) is controlled through its user interface,
e.g.,
the keyboard (104), mouse (105) and display (103).
l2
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
Under the principles of the present invention, the user of the optical disc
(106) will also want to acquire an EFR file (100) that corresponds to the
programming on the optical disc (106), i.e., the EFR (100) delineates a
hierarchical
structure of segments of the video program on the disc (106), such as that
shown in
s Fig. 3, and provides supplemental information about various segments of the
video
program recorded on that disc. As will be described in detail below, a video
playback software package running on the computer (408) will use the data from
the EFR (100) to enhance the user's enjoyment of the programming on the disc
(106) and allow the user to better control the playback of that programming.
to The EFR file (100) may be provided to the computer (408) in any of a
number of ways. As illustrated in Fig. 4, the EFR file ( 100) may be
transmitted to
the computer (408) via the Internet (101) and connection (102). Alternatively,
the
EFR file (100) may be recorded on some medium readable by the computer (408).
For example, the EFR file (100) may be recorded on a floppy disc (411) or CD-
15 ROM (410) from which the EFR file (100) can be read into the computer
(408).
Fig. 5 illustrates an alternative playback platform under the principles of
the present invention. As shown in Fig. 5, the playback device for the optical
disc
(106) may be an intelligent video disc player (500). As used herein, the (term
"intelligent video disc player" refers to a playback device for reading video
2 o programming from an optical disc, which playback device operates under the
control of a software package that accepts and utilizes an EFR file (100) to
enhance the user's enjoyment and control of the playback of the programming on
the disc (106).
The intelligent video disc player (500) shown in Fig. 5 includes a video
25 disc drive (501) that can read video programming from a video disc and
output
that programming to a connected television set or monitor (550). The player
(500)
also preferably includes a user interface device (505), such as a keypad and
display
on the housing of the player (500), with which the user can control the player
13
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
(500). The user interface device (505) is preferably supplemented by a remote
control unit (405) which communicates wirelessly with a transceiver (503) in
the
intelligent player (500).
The EFR file (100) may be delivered into the player (500) in any of a
number of ways. Similar to the computer.system described above in Fig. 4, the
intelligent player (500) may have a connection (502) to an external network,
such
as the Internet or a cable television system. This connection (502) may be
used to
transmit an EFR file (100) to the player (500). Alternatively, the player
(500) may
include a disc drive (507) which can accept a floppy disc (411) or CD-ROM
(410)
to bearing an EFR file (100). In yet another alternative, the video disc
driver (501)
may be able .to read a CD or CD-ROM and may read an EFR file (100) from such
a disc prior to accepting the optical disc (106) from which the corresponding
video
program is read.
Fig. 6 illustrates the important principle that the EFR file (100), generated
s5 on the system (108) illustrated in Fig. 1, can be accepted and used by a
number of
playback platforms (601). Examples of potential playback platforms (601)
include, but are not limited to, a personal computer with a DVD drive, an
Apple~
computer, an intelligent DVD player, a Sony~ Playstation2 or a Microsoft~
Xbox.
2o Fig. 7 is a flowchart detailing the playback software package of the
present
invention that accepts and utilizes an EFR file (100). As noted above, this
software package may be adapted to run on any playback platform with
appropriate modification. This adaptation does not affect the package's
ability to
accept and utilize any EFR file (100). This is due, in the preferred
embodiment, to
2 5 the fact that the EFR file ( 100) is an XML file.
As shown in Fig. 7, the playback platform running the playback software
package of the present invention (e.g., 408) will display a playlist using the
data
from the EFR (100). The playlist is a hierarchical listing of the divisions of
the
14
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
video program illustrated in Fig. 3. Because this data is stored in the EFR
(100),
the playlist may be reviewed and edited with or without the corresponding
optical
disc (320).
Preferably, the playlist is displayed using a tree structure as shown in Fig.
7a. With the tree structure, the user can expand or close any branch of the
hierarchy that the user wishes to see or work with. As shown in Fig. 7a, the
user
interface of the software package diagramed in Fig. 7 preferably displays the
playlist (750) as a listing of divisions of the video program on the optical
disc.
Below each listed segment, an indented listing of the subdivisions of that
segment
Zo can be accessed by selecting the icon (753, 754) associated with the
listing for that
segment.
As shown in Fig. 7a, the listing for the "Main Segment" has a "boxed
minus" icon associated therewith. This indicates that the listing of
subdivisions
within the "Main Segment," i.e., the "Chapters," is displayed. The user could
hide
, the listing of Chapters and subsequent subdivisions by selecting the "boxed
minus"
icon associated with the listing "Main Segment."
Similarly, the listing for Chap 1 includes a "boxed plus" icon (753),
indicating that the subdivisions within Chap 1 are not presently listed in the
playlist (750). These subdivisions of Chap 1 could be shown in an indented
list
a o under "Chap 1" if the user selects the "boxed plus" icon (753). In
contrast, the
icon (754) associated with the listing for Chap 2 is a "boxed minus"
indicating that
an indented listing of "Subscenes" within Chap 2 is displayed.
The playlist (750), if partially or wholly expanded to list tie various
subdivisions of the video program segments, may exceed the capacity of the
monitor (751) on which the user interface is being displayed. Consequently, a
scrolling mechanism for moving through the display playlist on the monitor
will
preferably be provided. Such mechanisms are well-known in the art and would be
controlled through the user interface of the playback device.
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
The playlist (750) may also include a coding device that advises users when
and what type of supplemental material is associated with the various
subdivisions
of the video program. In the example shown in Fig. 7a, each listing for a clip
may
include a number of differently colored dots (752). Each color of the dots
(752)
may represent a different type of supplemental information that is associated
with
. that clip. For example, a red dot may be included with the listing for any
clip fox
which there is a textual plot summary included in the EFR. A blue dot may be
included with the listing for any clip in which there is potentially
objectionable
subject matter. A green dot may be included in the listing for any clip for
which
1 o there is historical or cultural background information included in the
EFR.
Any type of information associated with a clip may be designated by a
particular color of dot or any other distinguishing character, symbol, icon,
graphic,
etc. Additionally, the coding system may be applied at any level of the
hierarchy
and not just at the "Clip" level. At any hierarchical level, the elements of
the
i5 coding system (e.g. colored dots) may have associated therewith a number
that
gives an indication of how may subdivisions within that listing include
supplemental data of that type or how much data,of that type is included
within
those subdivisions.
Returning to Fig. 7, the playback platform running the playback software
2o package of the present invention (e.g., 408) will display a playlist using
the data
from the EFR. (70I ). The user may then select a clip or other division of the
hierarchy to work with (702). At the clip level, a menu or listing of the
supplemental information associated with that clip will be displayed (703).
The
user may then explore the additional information associated with the clip
(704).
25 As noted above, the supplemental information may be of almost any type
including, but not limited to, cultural notes, linguistic notes, plot summary,
reviews and critiques, historical or other background notes, and a description
of
potentially objectionable subject matter. (705).
16
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
In addition to accessing the supplemental information, the user may also
edit the playlist (706). In editing the playlist, the user may rearrange the
order of
segments or remove segments from the playlist so that those segments are
skipped
during playback of the video program. , The user may also specify that some of
the
s supplemental information contained in the EFR be displayed during playback
to
supplement or replace a corresponding video segment.
When the user has finished editing the playlist (707), the edited playlist is
stored (711). If the user makes no edits to the playlist of the EFR (708) and
then
initiates playback of the unedited playlist (709), the entire video program is
played
Z o (710) in the manner recorded on the optical disc. In other words, if the
user does
not edit the playlist and if the initial playlist is complete, a playback of
the video
program is the same as would be the case if the user had no ability to edit
the
playlist and were not using an EFR of the present invention.
It should also be noted that the user can edit the playlist and store an
edited
15 playlist using an EFR (100) of the present invention without having
possession of
the corresponding optical disc containing the video program. Portions of the
video
program itself, except perhaps single frames or quotations for indexing
purposes,
are preferably not included in the EFR (100).
If an edited playlist is produced and stored in the EFR (100), and the user
2 o then initiates playback (712) of the corresponding video program from an
optical
disc using the playback software package diagrammed in Fig. 7, the video
program
is played back subject to any changes in the sequence of segments ox omission
of
segments dictated by the edited playlist (713). This may also include
displaying a
textual description of a segment or information regarding that segment
included in
~5 the EFR (100) to supplement or replace the segment itself.
Consequently, the EFR and playlist of the present invention may be of great
use to parents and educators who are displaying a video program for children
or
younger age groups and who may consequently wish to remove potentially
17
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
objectionable content from the playback. This gives the user great flexibility
in
deciding precisely what type of content in the video program is objectionable
and
allows the user to remove only that content. Moreover, the user need not
experience the content he or she finds objectionable during editing, but can
instead
s read a textual description of that content in the information associated
with that
clip or video segment in the EFR (100) of the present invention.
Fig. 8 illustrates an additional feature of the present invention. The EFR
(100) may, in addition to the hierarchical divisions of the video program on a
corresponding optical disc, also include a division of audio segments (310)
within
s o each clip. Each audio segment (310) will correspond to a word or phrase
within
the clip (307). The EFR (100) may contain a non-specific description of the
language or a verbatim listing of the language in each audio segment (310).
Consequently, any inappropriate word or phrase can be removed from the
playlist
as edited by the user.
z 5 Finally, Fig. 9 illustrates another feature of the playback software
package
of the present invention. As shown in Fig. 9, the user may initiate an
analysis of
an edited playlist (801). The analysis feature of the software will then
provide an
assessment of the edited playlist. The analysis may be on the edited playlist
alone
or on the edited playlist in comparison to the original unedited playlist
(802).
2 o Without a comparison to the original playlist, a number of important
analyses can be performed on the edited playlist. For example, an indicator of
the
relevance of each video segment to the plot of the video program may be
associated with that segment in the EFR (100) of the present invention. This
indicator may be a numeric value or an alphanumeric code. Consequently, the
25 analysis feature can assess and quantify damage done to the plot of the
program by
the removal of various video segments from the playlist. Additionally, the
analysis feature may provide statistics on the edited playlist such as the
amount of
time required for playback. The analysis feature may also indicate the number
of
18
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
segments remaining that include any one or all of the various types of
supplemental information. For example, the analysis feature may indicate that
a
particular number of the included segments contain indications or descriptions
of
potentially objectionable subject matter and may divide that potentially
objectionable subject matter in categories and degrees. These statistics are
generated (806) and then displayed for the user (807).
If the user desires a comparison to the unedited playlist, the original
playlist
is retrieved (803) and analyzed in comparison with the edited playlist. For
example, the amount of running time for each playlist, edited and unedited,
may be
so compared. These statistics are generated (804) and then displayed for the
user
(805).
In another aspect of the present invention, if the user has deleted a clip or
segment from the playlist, and that deleted segment has associated therewith
an
indicator of relevance to plot that is greater than a predetermined threshold,
i.e.,
15 the deleted segment is highly relevant to the plot, the playback software
package
of the present invention may automatically display a textual description of
the
deleted segment in place of the segment to prevent the gap in plot that would
otherwise occur in playback due to the deletion of the segment. Additionally,
it
should be understood that at any point in time during playback, using the
playback
2 o software package of the present invention, the user can pause the playback
and
access the supplemental information associated with that or another segment of
the
video program.
Finally, using the playback software package of the present invention, the
user may designate one or more types of supplemental information that are of
a 5 particular interest in the purpose for which the user is playing back the
video
program. The playback software may then advise the user during playback when a
particular segment of the video program has supplemental information of the
designated type or types associated therewith. The user may then pause the
19
CA 02429782 2003-05-21
WO 02/062061 PCT/USO1/47062
playback and access the information or instruct the playback software to
automatically pause at such a point and display the relevant supplemental
information.
This feature may also be tied to an indicator as to the significance of the
supplemental information such that only supplemental information of the
designated type which is coded as having a particular level of significance is
advertised to the user during playback. This can minimize disruption to the
playback if so desired by the user.
The preceding description has been presented only to illustrate and describe
s o the invention. It is not intended to be exhaustive or to limit the
invention to any
precise form disclosed. Many modifications and variations are possible in
light of
the above teaching.
The terms "playback platform" are "video playback device" are used herein
to refer generally to those devices, such as the computer (408) and
intelligent
video player (500), that run the playback software package of the present
invention
and control an optical disc drive to playback a recorded video program in
accordance with an edited or unedited playlist of an EFR of the present
invention.
The preferred embodiment was chosen and described in order to best
explain the principles of the invention and its practical application. The
preceding
2o description is intended to enable others skilled in the art to best utilize
the
invention in various embodiments and with various modifications as are suited
to
the particular use contemplated. It is intended that the scope of the
invention be
defined by the following claims.