Note: Descriptions are shown in the official language in which they were submitted.
W O 96/278~3 PCTrUS96/03137
CA 02214711 1997-09-04
COUPONING ISSUANCE AND TRACKING SYSTEM FOR A
COMMUNICATIONS NETWORK
FIELD OF THE INVENTION
The present iu~ llivu relates to a cvl~n~ c~l;ons nelwvlk and more
particularly the present iu~enlion relates to the iulel aclive t- dllsrel of multimedia
information for couy;>ù issuance l.acLug-within such a nelwulL.
BACKGROUND OF THE INVENTION
There are many types of co~~ ~l ons UetWUll~. What is meant by
cou~ s r_twvll~ in the co~t~,~l of this appl;e~ n are n~lwvl~ which
allows for the l~ on of i~o~ n t~'e~. For .~ ~le, a hotel or
hospital would contain such netwu.l~. In such l-t,tWUll~, there are a series of
cGnue~,Lons to each room or the like for ~ L~ of ~ ,us multimedia
i~c-..-qtion. ort~,u~ s this i..~c,.ulalion takes the form of video lllatellal that
is provided to each of the ~ o-..ers or patients.
The cha~a~,lelislic of these types of nelwulL~ is that there is a fee.lb~cl~
path that provides the owner of the ulf~ JlL with knowledge of the - ti~Les of
the particuhr user on the nc,twulL. Hence, in the case of a hotel system, if a
person orders a service there is a way for the owner of the nelwulL to know thatthe service has been or~ ~ed by that ~al L.,ular person.
The major pro~l-r~ with ~ 5 CGu~u~nir-q-~Qn~ nelwul}~ are that they
are not fully interactive. That is, there is no way to actively select multimedia
information from ~.. ls;de of the nelwulL in real time. This has ~ onal
~;g~ir;c~nce when ~ i.lg to produce coupons or other products to eucou~age
a cl.-stc.mer to buy a particular product or the like. In addition, these buyingpatterns of a particular co~ ...er can not be adequately tracked within most
cu..lulunications netwol}~. Finally, there is no way to determine any additionaldemographic information or other information from the user.
-1-
~ ~ W O 96/2~8~3 CA 02214711 1997-09-04 PCT~US96103137 J
Accor~lingly, what is needed is a system for allowing a user of such a
network to interactive}y access information outside of the network without
requiring additional equipment within each user location. In addition, the system
should be one that does not affect the normal operation of the
$ Cv.~ nie~tions system. The system should be one that can fq.~ilit~te the 11 ac~ing
of info mqtion about the user. The present i~entiol. addles~es such a need.
SUMMARY OF THE INVENIION
A cuul,u,~ q"Ge and lldC~ing system for use in an interactive
mulli.. ~edia trq-ncmi~;on network is ~i~l~sed The system Cu~p~ g a
m~ iTnedia call l,.oce~ system lc,s~ns;.~, to t~ ~~ mate,.ials for provi~hlg
multimedia inf~rmqtion. The system fulll~er incll~des means il~e,~l;.~ly
r~,s~u~;._ to the mllltimedia call ~roce-~.;a~ system for controlling the flov of
multimedia ;~rc~ s~r-n to the multimedia call p.o~e--~:ug system. The system
also includes a plurality of interactive mrhi~e~ de.ic~s (IMDs) for rece;~il,g
and 1~ ;~ m~ ;~o ..~-h~n to and from the multimedia call
~,oce--~- -~ system. FinaLly the system i~~h~des a ~ ler which is le~ûnai.e. to
multimedia inf rmP1;on from at least one of the plurality of IMDs for generating coupons.
In a.. ~ er aspect, the cc,--pc-. inrlu~ e,lcoded information thereon. In
yet anD1Le aspect, the enr~letl informqtion is utilized for llacl~i.lg demographic
informDtion In yet ~--o~her aspect, the e~ o~ed information is utilized for
providing antifraud irfQrmqt~n
The illte~a~ dc.;ces are utilized to vast~ .ease the amount of
inform-q-1;nn that can be ~ioce~ l to allow for a cu.~po.ling system that includes
ll ac~ g i~[ol IllâtiOII.
3. W 0 96/278~3 CA 02214711 1997-09-04 P ~ rUS96/03137
BRIEF DESCRIPIION OF THE DR~WINGS
Figure 1 is a block diagram of a prior art co~unications network.
Figure 2 is a block diagram of a general embodiment of an iul~na~
multimedia system for use in a co~n;c~ttons network.
S Figure 2A is a block diagram of an embodiment of an int-,l aclive
multimedia system for use in a hotel n~ twvlL.
Figure 3 is a block l~r~l.latiGn of the multimedia call ~ g system
(MCPS) in accordance with the p.~t i~ nlio~.
Figure 4 is a first ~r-:rc ~nlbo~liment of an inlclacli.., ml~lt~medja system
for use in a Cv.~ nehNulL
Figure S is a second sl~u :rc P~ nt of an interactive ml~l1imedja
system for use in a comm. .~ t;ons n~t~ JlL
Figure 6 is a flow chart of a first embodiment of the o~ ' ;on method
which is utilized in the c~ nc nuh J.~ in ~ da..c~ with the p ~1
i~._nlion.
Figure 7 is a representation of the ~ .liv~l of primary and secondary
mulLl.lc.l;a inform~h~n
Figure 8 is a flow chart of a second embodiment of the o~ ;on
method showing the cov"_,aLo~ of a cv~l~l~;on algv.ill..,- with a t~ ol.
alg~,.;th". in ~ d~ce with the pr~l.l m~ Lon.
Figure 9 is a block that shows the covy-l~ticn of a cc,~.-yre~; ~n algo~ilh~
with a l~ ;r--on al~G.;~ in ~ cewith the pr~.,t i~ m
Figures 10A and 10B are a block f~r~nlalions of informqhQn within a
cuupon in accordance with the plc~nt i~ l;on.
Figure 10C is a diagram of one embodiment of a cvul)on pro~lnced by th
intela~ e system.
Figure 10D is a block rc~.~r~ ;on of the inforrn~t~Qn in the cou~,on of
Figure 10D.
Figure 10E is a block reprcsentation of a coupon verifier in accordance
with the present invention.
-3-
y ~ W 0 96/278~3 CA 02214711 1997-09-04 PCTrUS96/03137
Figure 10F is a flow chart of the operation of the coupon verifier of Figure
10F.
Figure 10G is a flow chart of an antifraud detection scheme in accordance
with the present in~clllion.
S Figure 11 is a block diagram of a general embodiment of an inte.a~,livc
multimedia device (IMD) in accordance with the present i~.cnliv~.
Figure 11A is a block diagram of an embodiment of an IMD in which the
IMD is coupled to a ~lintcl in accordance with the present i~ nlivn.
Figure 11B is a block diagram of an embodiment of an IMD in which the
IMD is c~ ~pl~1 to a fa1c in ~ec~lance with the present i~e~t*~
Figure 12 is a rcp~ of a re_~te control utili~d in cv~ lion
with the system al~h;lc~t~-re of the ~,~9--~t h-._nLvn.
Fi~5~.res 13A and 13B are flow eharts of a cv--~ system that utilizes
~ - the i~lc,~li._ system in accordance with the p.~..l i~ ivn~
Figure 14A is a bloek diagram of an ele l,o~ic i.. ~_.. lc.,~ control system
utilized in the interactive system in aceordance with the ~ t h.._~lion.
Figure 14B is a block diagram of a pl~ical i~._nlv ~r control system
utilized in the ~lel ~*e system in accordance with the ~ t ill.enlion.
Figure 15 is a block liagr~ of a store KIOSK system in accordance with
the ~resent i.. ~_~liol
DETAILED DESCRI~ON OF THE INVENTION
The pr~l.t i~ liv relates to an int,.Lcli.e system for a
co~..;c~;ons netwv,L. The follvwi~g de2~ )liv~ is presented to enable one
of ordinary skill in the art to make and use the i~_.. l;o" and is provided in the
conte~t of a patent applic..lio~ and its requirements. Various mo~lifi~tiQns to the
y~ efe~,_d embo~li~ent will be readib apparent to those skilled in the art and the
generic ~ ,iples and fcatures described herein may be applied to other
embodiments. Thus the present invenlion is not intended to be limited to the
' W 0 96/278~3 CA 02214711 1997-09-04 PCTrUS96103137
embodiment shown but is to be accorded the widest scope consistent with the
principles and features described herein.
Refell,ng now to Figure 1, what is shown in simple block diagram form is
a prior art cv~unic,s-t~ons network. In the following .licc~Ccion, the pl,es--~tS invention will be ~liC~--e~ in the context of a hotel system. It should be
undel~lood hc,..~,~er that there are other 'ypes of communications nelwolL~ suchas hospitals, e~ c-t;~ al ;..'l;~ ..C and many conire~lLional head end ndwurl~
or the l ke where the ~m~"~les of the l,r~t i~ . would apply.
The system 10 inclu~es a hotel PBX system 12 for receivillg and
trana~iuillg t ~ le~honc calls~ l,rc~el ~ management system 14 and a video control
system 16 which could be used to access the pay pcr view movies or the lilce. The
video control system 16 ~' ~ s an in-room remote link and is Co~ G~ to the
Scl~iCeS O~e~la ~ n platform 14. The l,ro~cl~ ms~agement system (PMS) 14
keeps track of the users that order the movies.
The system 10 as above ~ eJ is not ful~ er~ In tbis type of
system there are a ~ of video units or VCRs l~te~l within the system and
they are switched in when the a~;o~lialc ~,..sl~--..er or client wants to use t_e
vidco unit. Hence, these video units cannot be indiviA~ 7P~l to a ~J&l ~.,lar user
l.e~,,- ~ there are simply not eroll~h units. For . ~le, there may be a bank
of 64 VCRs which would se.~ice a 500 room hotel. Each of the VCRs would
have a separate movie. Accordingly, in this case there is a l,os~ll,ility that apal ~ular movie would not be available. In addition, this type of arrangement
s~ cly limits the number of choices available.
Before the ~ r~c~t inv~ ion is deswibed in detail certain background
i~fo.. ~.~t;o-- should be ~licc~ ~' to clarif~ the utility of the present invention in
terms of ~ ;~; c~ ..ic~tions networks. In a multimedia system, various
sensory info....s~ion is provided to a receiver. In the case of video information,
this i.lfc.. ahon takes the form of foreground and background images that display
a l,a, L~;ular scene. In the case of audio information, the foreg. ound and
~ WO 961278~3 CA 02214711 1997 - 09 - 04 PCTrUS96/03137
background signals are such that the foreground information is speech and the
background information is music.
TypicaDy, multimedia systems in whatever form provide this information
over a single tr~q-ncmicQion line. In so doing, the amount and quality of the
5multimedia inform-qtion is s_.,. rcly limited by the bandwidth of the tr~ncmi~;on
line.
The ~;~sent i~ nli~>n first di~f~re-~t;atGs l,~t~,~ell i~pvlldnt and less
h l~V- lant multimedia informqh~n by separating the i~vnlllalio . into primary and
secondary layers through the use of a plv~al,l model to .-.;.~;...;,~ the bandwidth
~ ;v~S. In such a system each layer will have its v~n set of ~&la.. cters that
are important p~l~o~l~hically, ho.._._., the sec~d~ry layer will not vary as
much as the primary layer.
What is meant by a program model refers to psychographic parameters
vithin the mul~ clia system, that is l,al~ete.~ that relate to an individual's
15sensory ~ccptions when enco~te~ g multimedia infonnation. These
pa~te ~ Cv~ ~ a set of unique and c - -;ctent elements for a ~ ~ular dass
of ml~ltimedia ~ h~n In accordance wit-h the ~rc5e~ tion, its
multimedia informqh~n is separated into dif~cle~.l layers in a~ da.lce with the
~ro~sl~u model. T~c lcfo~c, by way of c~k, in the inct5-nce of video images,
2() the fole~oulld and l,acLglvund ~.. I;~.. ~I;Qn might be divided into di~len-
layers. ~ rly, in the case of audio inf rm~hon~ the news inform~h~n, ~ _all.el
fQrm~hon, or the like may be one layer ~h_leas the bac~jlvu~ music may be
the other layer. In the case of cou~ns, the fol~.vul,d may be te~t ~ccocj~e~l
with coupon offer. The b~c~l~,ulld may be a layer image or the lil~e.
25In the present invention, these layers will be divided into primary and
secondary layers in accorda.~ce with the information's i.l~l,v. ~..ce relative to the
l,ro 1 ~l model. The most i. l~l k.nt information is i~entified and enhance~i toprovide the best quality inform~hon to the receiver of the multimedia
information.
WO96/27813 CA 02214711 1997-09-04 PCTIUS96/03137
In the preferred embodiment, the primary layers will be enhanced in such
a way to provide a perceived improvement in quality of the multimedia
information presented. In one embodiment the secondary layers are presented
that may or may not be enhanced. Thereby the important information or the
S primary layers that are to be tl,.. ~.. ~itt~-l can be identified and sele~ rely
enl~ce~1 in accordance with the ~reseut in~/cntion.
In ~ ition~ the primary layers generally can be enh~nceA through critical
psycho~,la~ ic parameters take the form of ~p~ti~1, color, audio, and te~polal
variables that occur in the primary or seconda~y layers.
In a ~~ ;r -.c ûetwo~k it is illl~. ~l that the multimedia
infonnqffon that is produced, I~ ted and r~i~ed is enh~r~A in some
manner. This is neccs~l~ to ensure that high ~idclilr, high quality il~ro~ l Q-~is ~r~ted to the viewer. Thefefore, it will be possible to bring a ~ pel;o.
I)rc ~ t into the ret~ ~ L It is known, for ~ le, it has been possible to
provide video i.-fo.~ n over the telephone lines. H~ " it has been a
problem sending high quality video ii~r.. ~ due to the bandwidth
re.luil~nents that are needed to provide such high quality video ;..ro~ ;on.
The ~:e~~t h~ iG~ iS .lil~c~d tonralds a method and al,l)alalus for
l,lo~.lillg a co..~ c and ~acl~i-,g system. To more ful~ ~k~in such a
method and apparatus, refer now to rigurcs 2-5 which sh~ws a block diagram of
a general c~l~~ ent and block dia~allls of ~.:r~ e~l~li.llents of the overall
system ~r~hi~<~lure for an enhqnre~ tc.~t~e mnl~nedia system for a
;~ns network. The overall arch;lc~ c would be connected to a
telcphone neh~lk or thc like so as to readily access the ~ iCcion lines
lo~atcd therein.
Figure 2 is a block diagram of the overall system archite~h~re 40 for an
enh~.~ccA il~te~ ~ive multimedia system. The overall architecture 40 would be
cc,mlc~l. d to a telephone n~ k or the like so as to readily access the
;on lines l~lcd therei'n. Referring now to Figure 2, the system
architecture 40 C~ Jli~S an interactive multimedia mastering system (IMM) 42
-7-
-
, WO 96/278~3 CA 02214711 1997-09-04 PCTAUS96/03137
which receives yrG~dlll source material. The IM~ system provides information
from the telephone network to a multimedia call procc~;..g system (MCPS) 44
and an ~q,l~Yiliqry system 46. The multimedia call proceCcinE system 44 will provide
and receive information from int~acli~e multirnedia devices (IMDs) 52. The
S MCPS 44 is also cvu~ to a p~L~ter 29 to provide the couyons. In this fashion,
a system could be con~ul~d and no sper-iql equipment is required. All that is
nccessary is the telephone to select c~,up~us. Therearler, MCPS can create
1 direct mail for the .;.:~lo-~er, which can inr.lude the unique co~ponC
encode~l with idc"~i~ier inf~nnqhon which has been selected by the cl~ct.mer
utilizing the tPlepl~one. The ~Iru~.lulc of the IMDs 52 can take on many diL~ IC~.t
forms dependent upon how much intell;6. ~ce is located in an IMD 52 relative to
the syctem ou~h~ ie 40.
The ~ystem &l~ki~cv~ 40 provides l~ro~,l~ material which will enh-nc~
thc interactinty of inf~ nqhon that is l~ lc.1 along the telephone n~ .L
Ac~ol.lin~, what the system architecture 40 1~)r~S-nt~5, in fact, is an additional
nch.J~l~ which would ~ from the ~lG~ alll source which would
also be part of the ~ telephone system. The system alck;~e~ re 40 will
then be utilized to provide for çnhqn.~ multimedia information through
psychographicmq~irl~lqtions or other ~nl~ c~ el~ls to the ~I~,ms to provide for
a C~ which can be issued and l~._c~.i in a ~,cu;_l~, of ways. The system 40
as above-~,.li.~ned includes an IMM 42 that provides much of the ol,t;~ hon
of the ~ro~,,~ source n--qPnql for pr~cent-qhon to MCPS 44.
Refc,~ , now to Figure 2A, a general embodiment of an architecture 100
for a hotel is shown that includes a multimedia ~roce-~in~ system (MPS) 102
which is c.,u~l~ ' to receive information from and transmit information to a video
control system 104, an r ~ ~ _ nt c~-p.-tcr 106, a service opel a~ .s platform SOP
107, and a telephony ~wil4hillg system 108. The MPS 100 is also C~U1JIed to an
interactive multimedia ~1ecoder (IMD) 110, a CD/I device 112, a laser disk 117,
video camera 121, c~ p~- l disk (CD) player 125, pelsol,al computer (PC) 119,
video camera recorder (VCR) 123, a printer 129 and other devices 114. In this
WO 96/278~3 CA 0 2 2 14 7 1 1 19 9 7 - O 9 - O 4 PCT/US96103 137
system each of these devices can be utilized to provide ~lp~t~ble multimedia
information. For example, a comr~ct disk player 125 can be utilized to jump to
difl~ rent places to provide multimedia information. It could be utilized in
conjunction with an IMD to augment the fixed media with ~teldclivG material
(~pd~t~ble video source) material.
The cable feed line of the system 100 in turn is c-,-")lcd to the video
controlsystem 104. The ~rc ,,~nt c~ y..ter 106 and the SOP 107 are also dile~
coupled to the telephone ~wil~ g system 108 via line 120. The telephone
~wi~hillg system 108 is capable of sending and r~cc;Yi~g outside calls. The video
control system 104 is capable of 5~-- t;. g and recc.~g a remote signal from a
cable system, I<lcc ~--.. u~;~, . systcm or the lilce.
Another yG LG~ of the i~ n is an interactive voice ~ system
111. This system il~rlntes a ~l~h~ne 113 which cc--.~c~ to the telephony
switching 108 via telephone links. The tele~llone 113 also could ir~ v~e a credit
card slot. There is also included within the system 111, a remote control 900
which will be descnbed in detail later and a tel~ ;o.. 115 which is ~ c~t to thecable 116.
In this SIJC- - I ;G eml~odh.lc ~,t, the m.~ ,rocc ~ ystem (MPS) 102
lec. ;~_s y.ogl~ source ~atelial from the SOP 107 and from the control system
104. The MPS can also Op-,lalC, an ~le.dcli._ voice le~o~ ~lG~
lepen~e~tly or int~;laled into other interactive multimedia y:O~aluS.
The SOP 107 is utili~d for lecci~ g facsimile and voice me~C~ges. The
SOP 107 can also be utilized in cc.~ljul,,lion with pagers and the like to relaymcssages. By linlring the -~ nt cc,~n~ul~ r 106 to MPS 102 messages can be
displayed on a monitor within the guest room. In addition, fa~ces can be displayed
on the tel-,~i;.ion and could be fo.n,alded to other locations.
A master multimedia y~eis;~ center (MPC) 109 is also coupled to the
closed cable system 100 via co..-~c~;on to the MPS 102. The MPC 109 is coupled
to a plurality of closed cable systems to provide enhanced int-,..._li~il~ thereto.
A critical portion of the system 100 is the telephone ~wilching system 108
g
' W O 96/278~3 CA 02214711 1997-09-04 PCTrUS96/03137
interface. Through the use of this archite~ re the s~vitching system 108 can be
controlled to provide the a~,ro~,liate information to the user. Through the use
of the interface devices (IMD 110, CDlI 112 and the other device 114) and the
MPS 102, the ,wil~ g system 108 can be controlled in such a manner that the
user doesn't have to remember a telephone number to obtain the desired
information. This control can be ~ccc.mrlished through either a digital link that
is dile~ interfaced to the telephone awilclling system 108 or through an analog
link where on}y a normal phone con ~c~,l;o-~ to the system. Through either of the
L~ S an em~lqh~n of the cl~tc.mer, honc would be undert. ken.
In a typical ~ple, a call is made by the user to order a c.. ~o.- The
MPS 102 places call to the room through control of the s3rstem 108. The room
telephone will ring and the MPS 102 will send a me~a~e to the awil~ g system
108 that the customer would lilce to access a ~,~.. Ii ,.,lar coupon to make
r~,valions. All of these ac,L~it;es are done l~ c,.lLb to the user.
The MPS 102 will provide and rc~;._; ~rc - .. ~ I :o-~ relating to the couplers
from and to interface devices 110, 112, and 114. The interface de~;ces 110, 112,and 114 are in the hotel f~t.ilities co--.-~ct~l either to the hotel video cable system
through use of the vi't~udio o..~ t~ or connected via digital links from
interface d~,~i~s 110, 112 and 114 in each guest's room.
Refe~ now to Figure 3 what is shown is the prefel.ed embodiment of
a MPS 102. The MPS 102 co~l,.~s a diallll,uled cvl..puLng archi~ ,c. The
d~~ ed CV1~ ~& ar~ c i~,lv~s a master node 200 that has, in this
case, threc server nodes 204, 206, and 208 for the IMD, CD/I and the other
dc~iccs r~,L~e~r. The other dcv;ccs that could be ~>.,~lcd to MPS 102 are,for
e~cample, but not limitef1 to video games, a CD ROM device, a ~craonal
cv~ uler~ or a spe~qlty device such as a trqn~lqtor or ~ming device such as a
video slot m~chine or the like.
Each of the server nodes 204, 206 and 208 have client nodes 210, 212, 214,
216, and 218 co-...ccle-l to the rc~e~ re intcra~ c devices. Attached to each
of the clients nodes 210, 212, 214,216, and 218 are ports 220. When connected
~ WO 961218~3 CA 02214711 1997-09-04 PCTrUS96/03137
via the f ' ;~ , networks or the MPC 109 (Figure 2a) and then on to connection
to the inte,a-ilive devices 110, 112, and 114 (Figure 2) which has its own
yroce~ g storage and computing structure the entire network ean be operated
as a massive di~ lJuled colllyu~ g e~viro~ ent. This system could be operated
S using a voice rcsyo~ system in the server or elient modes for which ports ~o
~r~e.lt telephone ports eonneeted to the cv~ nir~ffons neL..~,~k.
This~ irv~entsharesalldim- ~i,;vl,sofcv ~uli~g~storage,tr~n~ ;Qn
and pel;yhe al ~eso..l~s (printing, product ordering, m~ilin~ funcliv~s, ete.).
This type of cv~yuli~ archite~t~re would inrl-~de ~ ic port alloeation and
would inr11 ~le ineremental failure ehalachli~lics to allow for rvl,~-cl~e~ of the
MPS 102.
In r'~ through the use of this interaetive system 100 of the y.CK~t
liv~ a multiplieity of .l;~E~.ent interactive de..c~s ean be utilized and no
mo~;r; ~;o~ to the deviee need be made to allow for 1~;c~' use within the
~srstem Accold;n~ the link 1~ n the MPS 102 and the interactive ~
can be a serial lin~, a CD/I link, a cable link such as etl~e,net or telephone
cc~ e~ via a simple i~o~d relay controi link.
In a first more ~e .;r;~ embv lh. e ,.t shown in Figure 4, the mul~ edia
~r~ g system (MPS) 102 ~ s p. o~ ~ source material from the ~, ~,;ces
op~ ,alio~ pl~tf rm (SOP) 106' and from a pay video control system 104'. The
conLIvl system 104' can begin cv.,l~-- o~de~ g.
The SOP 106' is utilized for r~i~ g COVpQnC The SOP 106' can also be
utilized in conj--~cLion with pagers and the like to relay messages. By linlrin~ the
SOP 106' to MPS 102 a CUUP~ can be displayed on a monitor within the guest
room or print a cou~on at the printer 129.
The multimedia ~r~ ~ .g system 102 wiil provide and rec~ information
relating to the c~wy~S from to hlLe,~Li~e devices 110' and 112'. The ;lltc,~li~edevices 110' and 112' will be located in the hotel f~ilities connecte~i either to the
hotel video cable system through use of the video/audio outputs or connected viadigital links from interactive devices 110' and 112' in each guest's room.
W O96/278~3 CA 02214711 1997-09-04 PCTrUS96103137
In a second more specific embodiment shown in Figure 5 the architecture
is similar except that there is an IMD 110 in each guest room. The IMD 110 can
also be used within an interactive voice response system 119 to provide a more
complete i~tela.~ e system. In this embodiment, the IMDs 110" can be utilized
to prv~ride the i. ter~livil~ for each room. The structure of the IMDs 110" willbe de~ lil,ed in detail later in this ~ec-ific~tion.
The IMDs 110 can take on many diL~elent forms dependent upon how
much inte11i~ence is ~oc~te~ in an IMD 110 relative to the system architer.tnre
100. The system a..~1.;le~ ie 100 shown in .liLrele~t ~e~l~ in Figures 2-5
provides program material which will enh~nt,e the i~ aCtivil~ of infarm~hon on
the cv.~vn that is h .r~ e-1 along the video n~,~vv,}. Accor.li~ly, what the
ystem architecture 100 le~;~nts, in fact, is an s~ itional ~_tWVl~ which would
r~;~_ infarm~ n from the ~,v~ source which would also be part of the
; dosed cable ~ystem. The ~tem ars1i;~1.,i e 100 will then be ~1t 1i7ed to
prvvide for er~ ~d mulh~s ;.................. r -.. ~ t-- through psychc~lapl~c
hQ~ or other enhancements to the coupons.
Within each of the IMDs 110 of the system 100 is an o~t;.~;,At;
ter-hn;que for enhancing the quality of the multimedia information that is pl esel~t
To more ~ lly de~. ' s this o~,t; .;~t;on teçl~n;T~e, refer now to Figure 6
which is a block dia~ of an o~l;~.. ;--t;on method in accordance with the
present ,u~,enlioll. This ~1~ ;~ ~ t~k..; l~-~ has been ~1FS ib~d in detail in
U.S. Patent Appl P~- ~ ;o-~ Number 07/976,941, elililled, "Method for the Production
and Tl~ of F.nh~ l Multimedia Information~. having a filing date of
November 16, 1992, assigned to the assignee in the present il~/G~LVII, and that
patent appli~Lo.- is inco.~v.~ted by ~efele.. ce in this applicalioll. The following
pal~jla~>hs along with the - ~ c ~p~nying figures will provide the details regard~g
the o~ hon method and hv~ it will be used advantageously to provide an
enl~nce~l interactive multimedia system.
The ~ OSe of the IMD 110 is to provide m~lul.J interactivity while at
the same time providing maximum retention of the t~rG~ model of the coupon.
-12-
. W O 96/278~3 CA 02214711 1997-09-04 PCTrUS96/03137
It is also inl~)ol ktnt that there be minimum transit time for the interactivity while
the information within the coul~on has maximum replication. There~orc, it is veTi~po. ~lle that the 1'~ GOIaln model psychographic parameters be well dcselil,cdFor e~ample, the sp~qt~-q-l, color, tcml~olaL audio response, mateAal concept,
S conlcnlioll ~clc~liùll all should be very well der ,il)ed and defined in the
plo2;l~ model of the cou~on.
Rerc;lling again now to Figure 6 what is sho~-vn is a first embodiment of a
flow chart for ~rovid~g an enl~qnr~l int~,acl;~c multimedia CuupOII that utilizes
the p.i~ci~lcs of the p,esent h~ nlioll. The flow chart 300 co~p~s the steps
of l,ro.idiug a program model of the co--~o-- to a ~al~lol. The ~cpa~ato~ 302
will divide the ;.~r..,...~ ,. of the Cu~ into primary and ser~nllqry layers of
~le, ~: t*e m~ q inforr~qt~n For e~ample, the primaTy layer may be the
te~ct on the coupon. The ~e~ n~lq~ layer on the other hand may be the logo
;..r..~ on the coupon. The sc~l.,lion is ~--t~ t;c and can be
~ ~cr.. l-li~hed in a var;cLr of ways. For ~ ,p2e, the layers can be ~l~al.. ted by
productionso..lccs. In~olhel; l~le~ alaLi~-canbe~ mrl~ edthrough
Icey c4d;..~ the layers. In yet a third e~p!e, the layers can be sp~h~11y
sc~a~ d or s~l,alatcd by the ValivuS colors. Finally, layers of information could
be Se~a~atCd by a Ç~kli~g p:occ~~.
The primary layers are provided to the compression generation block 304.
There are a variety of ways that the multimedia data can be changed or generatedto use less bandwidth. For ~ , cv~re- ;on algo~iLl~ms or their equivalents
could be utilized to reduce the bandwidth used. In addition generators, such as
in a tone geneMtor system, could be utilized to reduce the bandwidth required.
Finally, key coding ~l~ms could be utilized to reduce bandwidth use. Such
systems will be d;~ eA in more detail later in the ~eciLication.
In this embodiment, the primary layer of the coupon is provided to an
enColler where the primary layer of the cùu~n is p.~ared for tr~n~mi~ion via
step 308. Thereafter the primary layer of the CO.,p~l. is ~1eco...~les:,ed via step
110. The primary layer of the coupon is then decoded and mixed with the
-13-
~ W 0 96/27813 CA 02214711 1997-09-04 PCTrUS96103137
secondary layer of the C~JUPOn via step 312 to provide an enhanced interactive
multimedia image of the cuu~on to the printer.
~ ;imilsrly, the seCon~qTy layer of the cu..l~on is co~")ressed via step 314,
encoAeA (via step 316) and then hransmitted via step 318 and to Aec~....press and
S mix, via step 310. The two signals (primary and secondary) are then sent to the
printer via step 312.
In this embodiment, for ~ ~plc, for the ophmi7shon of a coul,ou~ the
primary layer can be the fole~uuJ-d image, the seCon~qry layer can be a
backgroulld image. Through the use of this type of ophmi7qt~ technique
mulli~c~ia informqtiQn can be ~ s. r~ l while at the same time utilizing
~- 6. il; -. 1~ less bandwidth.
To more fully understand this î~l~.lc refer now to the following
;o . In a typical interactive ml~lhmedia s,vstem the il,[c,lm~Lion is all sent
along one layer. The information that can then be tran.~ J is l; .;t~d by the
bandwidth of that layer.
In the prior art, the interac~ve m~ lia infn~m-q-hor that could be
11_-. --.;l~ A along typical nch ~lu or l~ r~ paths that are very limi~f~A
be~..se, for e~qtnrle, in the case of video images the bandwidth is not adequateto provide a high quality image to a ~ r.
Hence, in the p.~.. l h.. nliul" by separating the mul~e.lia informq-hon
into l,li~aly and secondary layers and Ihercaltcr co~l,r~;~g the more im~ol ~nt
informqt~n utilizing well known ~l~;O_ alg,c,lill~s, a system is desclil,ed
that can produce an enhanced coupon that easily be tr-q-n~mitteA over ~ I;..g
~eh. Jl~
To more fully dcselil,c the psychographic enl~Pr~ement feature of the
present il.~_~llion refer now to Figure 7 which shown the various ~ossll,ilities from
a IJ81 L. ular 1~ O~a.~l modeL The ~ Ul model is provided to the separator 302
of the multimedia system.
P~h~l~hic enhqncçnnents are critical to t_e ~pro.cment in interactive
multimedia trqncmi~c;on and reception enh-q-nc~ments in the context of the
-1~
, W0 96/27813 CA 02214711 1997-09-04 PCTrUS96/~3137
present application is information that is not transmitted but operates on,
o~)el atcs in conjunction with, or operates as a supplement to transmitted
multimedia information. There are three separate categories that will be
desc~il,cd that relate to psychographic enh~ncements.
S The first catego.~ will be de3c.il,ed as a cross correlation l,~ cn the
informq~on that is bcing tr~n-cmit~ecl and being enh-q-"ce~l due to the presence of
information that is not l~ led. Dithering of image is an eA~ JIe of this in
that dithering masks allif~l~ of images that are present and that imprv~es the
image quality. This type of system does not remove the al lif _b but actually just
masks i~e.f~liv~. A se~n~l ~,~pl~ in the audio arena where secondary
audio l.lat~lials such as a sound of an ocean or the like which might mask
~;ob'-mc in the audio quality of the pr;mary sound (voice, music or the like).
The seco ~ t~c.. ~ is where the signal is actual}y changed willlv~l the use
of any control signal; for cA~p~e~ through inte~olalion or some other te~hn;1ue.The typical ~ le of that i_ a ~.~hic e~q~ er in which cel L~in frequencies are
~.nl-~ ,.r~l depending on the range of the l,al ~ular device. Another example ofthe sccond category is to freq -~n~y or ~mrlit~-le co.~ ~s a ce~lain signal so as
to fullLer enhqnce the fie~ ;cs that are being 1. ~ It is also known
to use ~ ,..s filters to sharpen or provide certain information that will actually
modify the signal willn~l controlling it per se.
Finally, the third c~tcgo.~ is using the primary and secondary information
to drive the other geneldto.~ that might be l~r~ut within the multimedia system.This can be utilized to either cnhqnre the multimedia information or enh-q-n~e the
pr~a.,l model of t_e cv.~pv~
As is seen in Figure 7, the primary multimedia information layer can be
CG.~lCS~d to reduce the bandwidth utilizing well known algolill.ms. It is also
seen that the signal can be replaced by a generator that is res~vn~i~G to the
primary/secondary layers ci~nqlc Finally, a key code could be used to cause
information to be provided from a look-up table or the like.
~ W 0 96/278~3 CA 02214711 1997-09-04 PCT~US96103137
Although all of the above methods provide advantages in accordance with
the present invcntion, key coding has some additional non-obvious advantages
when utilized in the optimi7~hon system of the present invention. In the
following paragraphs the use of various key coding systems will be desc~ibcd
S generally along with their attendant advantages.
Typically, when looking at an intela~,ti._ multimedia information signal
there are several components of that infnrn~hon The first component is the
data or the mnlt~media inform~hon itseLf that is being co~ ~l. The second
component is re~e.led to as l,lo~a~ model dr~mirs That is the changes that
occur in the inle,~a~iL~_ mnltimedia infnrm~qt on due to for ~ a fade that
allows for a transition from one scene in the g~à~ a or video image to another
CO.I~_~ ely, if you want to wipe away an image there is ;..f~.-. .qtion ~ te.
with the ml~ltimedia data that would call out for that lld~sili;>n to change
~rr;r;.~
Finally, the third cdtego.~ of i~ t;~_ m~ltimetliq infonn-t on is what
will be ref~.le~ to in ~s s~ ;on which will allow a ~al~ular device or
system to go from one cat~go.~ to qnother. In a typical i~ m~lhmedia
infc-rmqtion system all this infQrmqt on is required to -q-~leTIqtely ~ slnil such
information.
In its ai~ est form, a key has an ;~ I;r;~ble code which .l;rl~tes the
cc.. ~ c on the other side of the device. The clealcal eY-.nple of such a keying
system would be the very simple dual tone mulff-frequency (DTMF) signal. This
type of signal can be used in the t~ t;ons area to provide keying for
low bandwidth p.ot,ocol. These keys would then c~mm~nd a code table on the
side of the n- twc,lk to provide certain information about the multimedia
information to be displayed without ~e~luh i~g actual tr~n~mi~;on of the
multimedia inform~-1ion
A more spc~ :r;c version of this type of key coding is what will be referred
to in this sl,ec:lic~hon as control information keying. What is meant by
controlled information keying is where a key code is utilized to access particular
-1~
~ W O 96/278~3 CA 02214711 1997-09-04 PCTrUS96/03137
types of c~mmq-nds which can then be used to control other items on the other
side of the n- Iwol}.
Such a table would then be utilized to access a Ccl ~LI set of multimedia
information in the network. A final version of key coding will be called progl d~n
S brqnrhing keying is des~libed by each of the keys re~rese~lting a certain branch
;r;ca~ion. Thus in this type of key coding the key is cross rer~renced to a
particular branch of the inte,dctivc mull;."cdia ~iGg~ where each of the
branches allows plur.,lity of fi~nc~r~nc or cmnmqn lc to be ~~~e~ in order to
replicate the p:o~a~ model of the cou~
The h~ lant fealure that is provided by all of these types of keying
coding all~E,e~ ntc is that il~ on already ~ ~lt on the l.elwv~k can be
utilized. Tl~ ore, the ~r~ ~ power inherent in the l.clwull~ or the systein
being ~ce.s~eA can be utilized rather than having to have to provide that
powerwithin the ~! -~ t ---- system it~celf.
It is also important to develop means to il.. p.o._ the h -;on quality
of the multimedia ;.lû- . .gl ~ ~, for e~ample, the informq1i~ n may be lla--A., jl~.1
utili~ng a typical lla~ O algolill~ with s~qr~ q-rd cou~~ ;cn file data
L~ ~l p.otocols. The h~1e.a~1;._ multimedia informqtion could also utilize
speciqli7~A ~ro~ols that are ol)t;...;~e.l for the ps~ ular interactive multimedia
information that is to be t~ eA In so doing the algo~ for the
CC)~I~pl. ;on al~,<,~ill.lu can be in1~ 1y lnqtn ed with the l~ c;on
al&o~ to provide the ~igh~st quality informqti~n with the m&~
interaclin1y with the mi l...,lu~ O~I line.
Rcre~ ; now to Figure 8, what is shown is a flow chart that shows the
cool,elaLo.. of the tr-q-nnni-Cc;c!n al6o,i~ wit_ the complessi~n algorithm toproduce a high quality multimedia image for a coul~on. The flow chart cc~
providing a ~-G~I model in w_ich the primary and secondary layers are
separated via step 402. The primary layer is compressed and enco~1eA via steps
404 and 406.
' W 0 961278~3 CA 02214711 1997-09-04 PCTrUS96/03137
A control element via step 410 is utilized to control a compression matrix
and a tr~n-cmie-cion matrix. These two matrices comprise a plurality of
cc~ rcsshu algo~ and tr~ncmi~cion alg~ rc~c~L~e}y that are
i~tcla~ c}y controlled such that as the various algolilhms are detected the
S quality of the m~llhmedia inform~hon and the speed of the tr~n-e-mie-~ion are
interactively ~let~ ed.
The quality of the information could be determined manually or through
the use of some control c~.;uill~. It should be understood that these same
matrices could also be used on the secondary layer. It was not shown or
describcd for purposes of clarity and ei~nrli~Aty.
R--f,~ . ~ ;aE, now to Figure 9 what is shawn is a block r~resc..~lion of a
matri~c of COD~yl~ ;on al~o.ilh,.l with 1~ al~ that could be
utilized in ~ rdancc with the ~.csent ill~cnLon. The circles 502 ~ligred in the
vertical dil~tion are the cc,~r~-~;on algo. i~ c The rec~ es 504 ~lign~rl in
the horizontal .li~ ion are the 1,~ al~ ........... c
For .~ the c~ ;on algo, ;lh~ ..c could be JPEG, a generatorwith
MIDI, and a key for a weather map bac~lvund. ~ rly, the t~ U
algc .i~ .s could be c,p~ for JPEG, data c~ yre~;on for MIDI, or DTMF
for Iccy 1~ - ou type al~,c,.ilh~s. To pravide the highest quality mnltimedia
informqtion while at the same ti_e utilizing ~i~u.. l bandwidth the .liLlelc.lt
alRc,.ill....g can be sele ~e ~ in an inte.L~ manner.
Hence, a first C0..~1~1 ~ ;Gn alg~,.ill~ could be s~l~t~ d along with the first
h,--- ~...;--:-~n alg,o,ill~. The multimedia in~c - ...~1i. n is ~c~,i .ed either for image
or audio quality than a second c~ plc~i;on al~,~,.ill,.,l is selecte~ Th
2~ multimedia inform~t~ n is reviewed and if the quality is not ?-cel~table then a
secon~ OIl algo.ilL... is select~A The quality of the information is
r~ _l This l,.occss is rCpcatc~l until the hi~ or desired quality multimedia
inform~tion and i~t_~a~,livil~ speed are provided.
The multimedia information derived from the c.,~.lprcssi~"~/tr~ncmi~cion
algo,ill~ls can be analog or digital in nature. H~ c., in a digital signal there
-1~
, ~ W O 96/2~8~3 CA 02214711 1997-09-04 PCTrUS96/03137
are certain other features that can be taken to advantage that can be utilized in
accordance with the present ill~,elltion.
It is known that digital data informaffon is typically sent in a file which
specifies certain parameters of that data and the data informaffon itself and
within the data informaffon itself is informaffon which may not change for a
certain set of files. In the case of an image file, the header inform~hon may
specify the di lle~i~,~s, pi~cel depth, and certain other fealu,es of the pal licular
image. This file may. take up a much as twenty percent of the data file.
Cc,.~ c3y, in a file such as text file which com~ ,e, a plurality of text
i~lo~ h~n, the header may include ~ .. 1 i~u~ t;on related informqholl
and chara~ hcs of that parffcular file. In both of the above ~ nhQned
lcs, the headcr infnnn~hi~n may not Ç)'-~b-- through the use of the
~~ t ~n method the amount of i~c.~ - may be si~ re l -c~l over
ffme.
Hence, in the ca_e of the image file, the header could be sent first with no
co~r~ ;~n or with k~ ss data C~ n as the secondary file l,e~-~ it will
always le..~a~in the same. The data file itself can then be c~.n~lcs3ed down to its
~qller size.
Another method for enhsnrin~ the psychcs~l~ylLc parameters ~ to provide
2l) some form of error det~ .. and ~ lj--sl--.cnl. As has been menli~.. ed before the
~letechQn and adju~l~enl can be ~ hed via i~ sti~n of the error. An
alle~nah~. method of error co,l~l~r is through an error cc..l~chon/h ~ iC~ n
algc,~ . What ic meant by this, is relating the l~ to the compressio
to enh~nce il le.a. Iivily.
In this type of system before the file is sent the base file is co~ es~d and
then d&co...pres~d. This dcc~ .re~d file is called an e~Ts-n~le~l cc,l.l~re~ed
base file. The ~gr~l~' c~, I,re~d base file is then co..-p~ed to the original
base file and an error file is then developed (the error file being the difference
between the base file and the ~ s-n~ed compressed base file). The error file is
colllpl es~ed and sent along with the conll)rcssed version of the base file down the
-19-
~ W O 96/278~3 CA 02214711 1997-09-04 PCTrUS96103137
line. These files are then combined and decol.l~ressed to provide an enhanced
mage.
Refelliug now to Figures 10A and 10B, it is seen that a data file utilizing
this technique could initially be separated into primaly and secondary layers. The
primary layer of the cc,ul~on could be com~res;e:~ using a first cGIllpre~ion
algo,ill.. ~, the header inform~on of the C.J.~ could be sent first along a first
on path and the c~,,.ll)ressio,. signal could be sent along a second
.. path.
Tl~e,~ole, the amount of storage ne~ess~ly for the file is significalllly
re~ ed through s~ d:~ry co~r~i~,ll terhni1nes This inf rm~hrn can then
be t.--.~--.;l~c-~ or stored across the ~t~.J~L rather than having to have all the
inf~rm~ht~n stored wi~in a ya,L~ lar device within the oyl;...; ~h -~ system.
In the case of the co~ n 500, lefe~ , now to Figure 10C, the
500 in~ des a logo 510, test i.-r .. 5~ .. 512, bar code hlr~.lllalio~ 502 and 504.
In a ~ fe,l~.l embodiment, the co--~-- 500 would have e.,co'~' the~ h~
traclcing i~r~ o ~ in this emb~- -r~t, bar code 502. This c--~li. g allows
deh~o.layllic info~l~lahon to be provided back to the system when the cou~on is
utilized. In this way, additional products can be COOl~ te'l with the C~ O.l
y." ~ ~ ~
In ~3.1;~ .. there is an anli~raud code 506 placed on the C~,u~.l to ensure
that these c~lpon~ are not CO--.~If--~i~ In this e--.bo~l;.-.ent, the ~nliLaud code
506 is a bar code. H~ " one of ordinary skill in the art will readily rcco
that either the h~c~iug informqh~ code 502 or the anliLaud code 506 could be
a wide variety of types and their use would be within the spirit and scope of the
present hl~ ion.
As is seen in Figure 10D, the header information 562, text date 564, logo
data 566 and bar code control data 568 is ~lloc~te-l to certain portions of the
memory. This information can be compressed in the ap~lo~liate manner to
provide the enh~nce~l multimedia information.
-20
WO 96/278 13 CA 0 2 2 14 7 1 1 19 9 7 - O 9 - O 4 PCI /US96103 137
Accordi~,gly, this system can be utilized effectively in a voice response
system. Through the present invention a voice response can activate or operate
in conjunction with a multimedia pl ~l ~ to provide a fully interact*e
co.,ll-.unication system.
An i~ la.~t feature of the cuu~ ing system is vclirjillg the authenticity
of the cou~,on. Figure 10E is a diagram of cv~~u verifier 600 in accordance withthe present i ~ liGu. The verifier Col~ ~s, a scanner 602 for sc~nning the bar
code and the lilce and a ~lo teclor 604 for detectirlg the information.
Rcfe,lillg now to Figure 10F is a flow chart of the opelalio~l of the verifier
600. As has been above mç~ e.l the co~ qn is sc~cd, via step 652. The
delec or then ~t~nircs if the co..~.. is authentic, via step 654. If the C~)u~
iS ~..tl~ then the tracking data is recorded, via step 656. The coul~.l is then
det~-...;ncd to be a-lho~l~, via step 658, prefelably by a green light on the
~-~t~lor. If, on the hand, the CO~ n is not ~ c-.~ via step 654, a bad c.,ul~on
indi~atol is provided, via step 660, r~efe.al/ly by a red light on the ~loteclor 602.
ANTIFRAUD DETECIION
Antifraud dct~ can be p~ ed in a ~alicl~ of ways. One c ~ e
is shown by the flow chart in Figure 10G. First, a COupOIl i~lentifier is specified
by the system via step 670 and a l~ --, number of predetermined digits is
sP l~le~1 by the system via step 671. Tll~ rearler, the random number is logged in
a ~l~t~b~ce within the MCPS along with the c~ cs~,-.~ing cou~,on idenliCier and
other inform~1;on to create a co- ~,.u record, via step 672. Next, elements of the
c~uyo~ record arc either genelated and embe~ e~l in the coupv~. or given to the
c~lct. mer via audio, graphics or by some similar method via step 674. The
ulu inf~rm~hon provided is the code (i.e. the random number or the ID,
dependent upon the user). The above steps describe the inih~li7~tion for the
antifraud dete~l;n.. system.
Next data embedded vithin the c~uyon or given to the customer is entered
into the verification system, i.e. MPS, KIOSK or otherwise via step 676. The
coupon is then read by the bar code reader, entered on a keypad, or by a voice
-21-
W 0 96/278~3 CA 02214711 1997-09-04 PCTrUS96/03137
response system via step 678. The relevant elements of coui~on records are readyfor verification. Nelct, the Cvu~vll is cross referenced in the cc.uyon data base for
corresponding CO~,Ol~ record via step 680. If there is no record then it is not a
valid coupon via step 682. If there is a record, then it must be determined if the
cvu~on has been used before via step 684. If it has been used, then fraud i
~etecte-l and al,pl O~l iate action is taken via step 686. If the cou~on has not been
used then the system changes Cuupv~l from nn~ to used via step 688. Then
infnrm-q-t~on for v-q~ lq~ng coul~v.l is sent via step 690.
One of ordil~alr slcill in the art will rccc~ e that the cvu~, cou~on
~el;~ier and the allli~aud .l~tec~on system are not limite~ to those shown in the
L6.,les. In -q~ n it should be ~ that the ~l~c~-n of the CvupO.
inf~rmq~- could be changcd and that would be within the spi;rit and scope of
the present in~enliv_.
The ~r~_nt i~ lio has been ~l;~ A in terms of Cv~u~lC~_ g the
primary layer or layer and by CV~ l~illg and 1~ that primary layer in
a pall~ular way the interactivity of the system is enhqnr~e~ It should be
ulld~ lood that it may be equally i..l~V~ to enhqnce se~ qry layers to
produce the same effect.
Tl~erefvre, it may be ~. IanI to enh-q-~c~ the secondary layer, it may be
V~ lant to enh-q~ the primary layer or it may be ill~JVl lant to enhq-nr-e both.Therefore, the present iu._nLon through the use of cv~npr~;G~. and trq-ncm;~;on
al~o~ us and through the ~a~chO~,laphic enh-q-nr~ment of the p~o~a..l model
can enhqnee inte~a~ livily of a multimedia system.
It should also be understood that the function of the co~ re;,sion and
tr-q-ncmic~;on algo.illllus can also be done t_rough other means; for e~a~ JIc~ a
signal gene.atol could be used to provide the same information. That is, a signal
generator res~vns;._ to a ~a~ ,ular layer or layer of information could be utilized
to provide that information or some level of information that is re~,rc~ntative of
that layer. For example, a tone generator res~,onai~e to a signal from th
~ W O 96/278~3 CA 02214711 1997-09-04 PCT/US96/03137
secondary layer to provide the tone that would be rel)rcsentative of that
secondary layer.
Cc~el~ly, some type of graphics generator could be utilized to respond
to that same type of signal to provide a certain type of graphic image or logo of
S the C~JU~OI1. Finally, it should also be understood that the ~rcho~laphic
parameters can be adju~l~d by human opelalor or in the alternative can be
adjusted or modified by an autc.m~t~& means.
As has been before mentioned, it also is very important in this system
ar~h;le~ .e to have an inl~ .a~ r. multimedia device 110 which will allow for the
recei~t of high quality multimedia inform~ n for the cvu~v,. from the system
c~ -e. The IMDs 110 can bc either 1OeA~e~ in the facility in the b~Pment
or are utilized with each of the t~ .Oion monitors within the hotel or hospital
room to provide çnl~..r~ audio, video and graphic h,l~ hon within the
CO~l~ 'A ~ ;O~S ~t. ~ l}.
Figure 11 is a ~refe~ -.ent of an i~tela. Ii.~ multimedia ~le~er
(IMD) 110. The IMD 110 cv l,li~s several co ~r -nts. The cable or
telephone line is ~.plcA to a mulli.~ modem 1102. The multimedia modem
1102 is ~u~,lc.~ to a multimedia memory 1104 which can be an .~ ble
~ ,ic random access memory (DRAM) 1104. The multimedia modem chip
1102 provides data to a multimedia ~lec-~- .prcs~l device 1106. The multimedia
memory 1104 provides data to ~,al)hics/character generator 1108, speech
generàtor 1110 and music synthesizer 1112.
In ~jtion, the output of the genc,..tc,l~ 1108, 1110, and 1112 are
provided to a video control chip 1114. Video control chip 1114 provides signals
to a standard television display and Icceivcs signals from a standard televisionsource. The multimedia modem 1102, the mulL~,cdia memory 1104, the
multimedia clcc~ re~or 1106, the multimedia digital/audio control 1108, the
video control chip 1114 and music synthesizer 1112 are all ultim~tely controlledby an intela~ e control inter&ce 1116 which manages the opelalioll of all of theabove elements. The video control chip 1114 is coupled to a standard telephone
-23-
, W O 961278~3 CA 02214711 1997-09-04 PCTrUS96/03137
keypad input or for a television remote-type device or a special IMD remote can
be utilized in a variety of ways which will be ~ e~l in detail hereinafter.
Person~li7erl and Demographic information can be stored on the IMD 110,
the MCPS, or the MPS in~h~tling age, sex of the user alone vith tc~h~
information (IMD serial no, generators available). Thererore, upon connecPng
to the MPS 102, the IMD 110, or PMS can both fo,war.d this stored infnrm:~hon
either at the l~e,g;.. i.~ of the session or anytime arl~lw~dS. This ;.-r.. I;~ n can
thcn be updated thr,ough the MPS 102 or di,~ll~ at the IMD 110 through
sel~chon using the keypad or remote or by l_cel~ing the data from the MPS 102.
Accordill61y this info~mqho~ provides the basis for highly accuratc ll.all~t
e5c~ and commercial n~ 5,. Through the IMDs and MCPS real time
h,l~al;o~ can be provided to the s~pplier of the ;-~f~ -- This ;.~rO....~I O~
can also be utilized to provide intc,.d~;li._ a~e,llis~6 based on the choice of the
a~e.l~r as well as the demographics of the viewer. The type of info~mqhQ
that could be useful for e~cample would be the log~png of each key stroke made
on a remote conl~ol lh e~b~ monilo~ ; the "~ ,E," or vi~ illg habits of the
~--el~--.cr in res~ollYc to either inl~L~_ mqteriql sl~rrli~l by the IMD or
~J~chro~.i .I~atel;al from the cable head-end 122.
The f~.. cl;.-. of each of the dirÇ~,ic~ mpc.n~nts in a ~c~lcd
embodiment is descnbed in a sun~qry r~chio~l bdow.
Multimedia Modem 1102
A. Rc~o..sible for all ~.lll.l~ I o. c bch _c., cable or phone line, optional
serial port, interface to mulli.,~cLa memo~y, multimedia decode, audio controL
and ~JiOCC~;Ol control modules,
B. Suppo, b st-qr~lqrds plotocol for half-duplex, full duple~c, and half-duplex
high spccd O~C,~ali~
C. On-chip cncode/~eco~le capability, D/A, A/D forvoice, f:~eimil~, and data
functions.
D. Dual tone multi-frequency (DTMF) detect and generation.
-24-
, W O 961278~3 , CA 02214711 1997-09-04 PCTrUS96/03137
E. Auto-detect voice/f~cimile/data switch for transparent mode hransition.
F. Incorporates controller unit with binary ile hransfer, f~ cimile, data, and
voice modes, and optional pl~r;Ctary multimedia l,rocessor control optimi7e¢~
I,lotocol ~i. .~are.
G. rilm. t.rc allows IMD to use mulli~c.lia modem to ~clro.lll call
.oce~ function including telephone call dialing and c~ lion, ~-nqttended
recei~t of data and fa~c among other *In.~h~ nc
H. Include abilit,v to ~leco~le data from video cable signal in~ lin~ VBI
encode~t data or data e~ eo~e~l in the video signal itself outside the VBI.
Multimedia Memory 1104
A. N~ir~l DRAM or VRAM for image ..; ;.~ ,oc~ , and ~q,~l itiqry
.c~i& data storc.
B. No~irql ROM for r.~ ~tent IMD control program.
C. Optional co-resident DRAM for mulLIueJi& data store and ~.o~/data
store.
D. OI~Lv al non-vol&lile st~ e (~t~n-lible).
E. Memory control unit for VRAM/ROM~DRAM and non-volatile storage.
Multimedia Decode 1106
A. Responsible for real-time ~tc~. .~w ;on of images t, ~f~.. ed to or stored
in the IMD 110.
B. On chip i~ te cosine 11~- rO.... pr~ rOI~ C. R e v e r s e
q~ r decoder/tables.
D. Built-in zoom, pan, chroma key, mix from cv..ll)rcs~ data il coll.olates
interfaces to video data bus, mulliu,c;lia memoly, multimedia modem, video
controL and ~ roy/~r control ~c~i~,.. s.
Video Control 1114
A. Responsible for all IMD 110 video mi~ing, enl-~ ~c~--.ents, and display
func~ons.
B. Pixel procc~sor for mix, zoom, pan, chroma key, transform on pixel data,
transitions.
-2S-
W O 96/278J3 CA 02214711 1997-09-04 PCTrUS96/03137
C. Graphics p~ocessor for figures (e.g., rectRngles with color fill) generation,sprites, text with foreign chalaelc~a, and scrolling.
D. Digital to analog con~~.~io~, analog to NTSC, NTSC video plus stereo
audio to RF.
Graphics/Char - 1~ . Speech Generator. Music Synthesizer 1108. 1110 and 1112
A. Responsl~le for enh~nri~ rcce;~_d analog/digital audio, music synthesis
generation, and overall analog mixing and audio effPctc.
B. Incolpo,àl~s d~co~ g burden.
C. Sampled i~ah~ent synthesic from C~...pl~,i!;C.l MIDI input.
D. Built-in miero~.. l.oller for multi-task generation.
E. Dual analog source mi~t, digital audio and synti -r;7Pr mi~, analog audio
eontrol (volume, bass, treble, bRlRnee) for output to analog lcrl/~i~ht audio.
Interaetive Multi-Task P~oe- ~Ol 1116
A. Responsible for multi-task ~ fl of resident and downl~R~le l IMD
eode for ol~elalion in co.,ju~tion or independently of the MCPS.
B. Master/slave ~iwocollholler ~k;~:t~.~e for multi-task eontrd of
c~.-.. --.~;~z~i .. ~, m~ c~ia ~C~ m~ imedja ~eeo~, digital video co~hoL
digital audio/s~ sis, and interface mana~
In a ~.~fe~l~d ~ ;...ent, the IMD 110 will be utilized with a ~,i. tcr to
ha~ ~ il and ~ multimedia inf~nPt~on. Th~ ~rorc through the use of the
~Ds in the system a ful}y interacL._ system for l,rovi.ii. g c~Yt o ~c is provided.
Figure 1LA shows an IMD 110' which has an output to a piinter 507 and
a telephone h~ c.t S09. The printer 507 then is utilized to print cvupo~s
~wpo~ _ to the telephone handset.
Figure 11B shows a f~rcimjl~ 700 which could be coupled to print the
COhpOll. The f~rcimile 700 may in some in~ces be the plcrc~d method for
l ccch~ing COu~)nS for 1,~ e-~s
Another critical feature of the IMD 110 is to have a remote control that
will work in conjunction with the television or other display to provide enh~nced
multimedia information. To more fully explain this feature refer now to Figure
-2~
~ WO96/278.~3 CA 02214711 1997-09-04 PCT/US96/03137
12. The remote control 900 looks much like a telephone keypad. It has the
numerals (0-9) and symbols (*-#) that are part of an ordinary telephone keypad
It includes an enter key 902 that is typically utilized to change information orchange chqnnçl~ in the case of a television set. The control 900 would also
S include a volume key 904 and a ch~nnel or memory select key 906, a connect key
908, a telephone call key 909 and a multimedia toggle button 910. The telephone
call key 909 is utilized to place a call to a ~e .;~-~te~ telephone number or to a
l~umber ~c~:~t<~ with the mulli...c.iia il~fo~nqti~ being viewed. The remote
control 900 also indu l~s a keys 911, 913, 915 t_at will control the fast folward,
re~el~, and slow motion of a video device. A sper;ql key 914 is provided to
provide a C'J~ ' at a p~intel or the like.
The remote control 900 could also include a credit card slot 912. This
credit card slot 912 would be utilized by the viewer to allow for the i~c~uqnce of
the CV!'~'' dil_l~ while vi~ 5 the television screen. The credit card slot 912
could also be utilized as an indicalor that a c~ ~ room is being oc~ ~ic.l by a
particular person. This ;" l~;o.~ would preclude the need for a sepa,~.te
iL~..Ili~g of the ~c,l~,~aL~l user information for billing inform-q~ n Finally, the
control 900 includes spe~;ql effect keys 916, for ~ ,le, for allv~ing for the
blvw~ g of a multimedia .l~eclc.r while simultaneously dis~la~ing a picture in
the picture of the .,.. lleJ.t br~dc-q-~t TV channel. The remote control 900 can
o~ le in an emulated keystroke mode in which ~r~g one key may be utilized
to çm~ qte a coml~i.,alion of }_~ o?-r-s. In addition a call button may be
provided which would allow for s~n~lin~ valid .~ b_rs to anoll~er location. The
remote control 900 also has the capability of emulating other remote controls.
For e-Aample, through the MPS .liLf~rellt ~pes of signals can be mapped with theremote control. The MPS provides the tr-q-nClqtion of the signals of a CD/I device
for cAal~lple.
The remotc control 900 could utilize a radio frequency signal or audio
signal to h~t_lacl with the recc;~er and/or IMD 110 for the control of the IMD
110, control the selection of multimedia information, and for the control of other
-27-
~ W 0 96t278~3 CA 02214711 1997-09-04 PCT~US96/03137
devices. It is also known that a more conv~llLional remote control could be
utilized such as one that controls a VCR or a television and its use would be
within the spirit and seope of the present invention. The remote control 900 also
ineludes a positioning function. Aeeordingly, a motion deteetor or the like can
S be utilized within the remote to allo~v for l,viulil.~ the remote at the television
monitor to ll~u ,mil certain iurO~
Another fealule of the al~v~-ide~ ied system arehitP~t lre is that the
pi~la~ i;nform~tion ean be linked to the n< twulk to provide for enh~nce~
iutera~ v~ and l,.vg~ quality. For ~qmpl- the l.rogl~ souree ean follow
or be ?~llcllrvni~d with ~e eable or bro lcqct feed to provide for enhqnr~l
distnbution of p:~a~ inf~nnP1;~.n One s~ ;I;c c~ple of this to take a new
program, like CNN bl~ - k ~ 5, whieh co--r: '~ of several short news items. For
eaeh news there could be stored lqrge ~i~_s or l~rGol ~ n~pteriq-l rdated to a
I,all~ular story. Henee, through m~ll;...E~iq inl~ ivll with for, .~ ,~e, the
lc~te control 900 the stored l~.o~al~, mqte~iql can be -~c~ . This would
allow the user to review the mqteri~q-l in wLat_~_r detail was desired.
Another ~ " is in an a~ellisil~g feed if a ~ ular item was
a~_l Lisc.l, there would be the ability to refer to more ~et-q~ 5 ~ about
the product.
Yet another .~ ple of such a system is to have one service linked to
~oll~er. An adv l li~ . -~t could be linked to a means for ordering the particular
luel being a~h_.L~d ircl~ ing the p'~c~ent of a phone call by the IMDs to
the desi~d telephone n~b~.. In so doing, the linked system allows for
additional services to be ~ce~
The illl~.~nl requirements for this linked fealul~ is that there is a
kno~lc~c of the contcnls of the system p~O~,I~ re~lui~ ents and there is a
knowledge of where the user is in the l,rG2;l~. For example, an IMD could be
used for ch-q-nnel ~,rGb,~l idc~t;r;-~ion in which the telephone call is linked to
a particular ch-qnnel that has been selecte~1 Another example is link
demographics for targeted interactive adve~ hlg.
-28
W 0 96/278~3 CA 02214711 1997-09-04 PCTrUS96/03137
Hence, in an advel lisement for a diaper, for example, there would be the
facility to access a~elLi~ents for related items such as baby powder, baby oil
or the like through the use of this linked approach.
In one embodiment, a code is utilized by the telephone, either activates as
a single button on the telephone keypad or remote control on a plurality of
alph~m~meric l~ullo,.s on the telephone keypad or remote control is utilized as
the linkage bcl~.~,en the c~ctQmer and the l~all~ular service to be utilized. The
code would then allow for user s~lçct-q-ble, remote access to goods and services.
RPfel~ ;, now to Figure 13 what is shown is a flow chart of the o~elal;o
of cuch an ~"xl~k multimedia infor~qti~.~ syctem when icc~linS~ cc.. pons is
viewed by a customer via step 1302 on the television monitor. Therear~r the
mer can select from a .~ . of .li~ e,,l coupons via step 1304.
TJ~ere~ftcr, the MPS generates a cou~o~ order via step 1306. Whether the
interactive de~;ccs are in a central locs ~ or in a each room the "--cl~-..er can
order by the device interacting with a c-q-t-q-log order desk l ac~c~l in the facility,
via step 1308. The cvYpo-~ can be ~.vv;~led dh~lly through the Ar~--
p..lel of the facility or on the other hand can be provided to the user in the
room. That transaction can be completed step via the remote control 900, a
il~te~ t*e device or telephone.
A cc.u~ can then be ~1, te.l at the front desk through a special printer
be delivered via steps 1312. Finally, the co--~- could be delivered either to the
hotel f~r.iliti~ to the ~ ....e.~ home or to her place of l,~ine~ via step 1314.Finally, there could be ~ of methods of delivery and there use would be
within the spirit and scope of the prc~l,t iu~e~llion.
Refellil g now to Figure 13A what is shown is an automated call
oeec -~ system utilized to iulpl~ ulent the col.~o~ g system of Figure 13. In
this embodiment the system places a call to the telephone number of the cou~on
source via step 1306-1, then the MPS 102 connects to the catalog source via step1306-2 and send, an auton~te~ message such as "You have reached the cable
nelwolk for ABC hoteL press 1 to conSrm." After the connection is confirmed
-29-
W O 96/278~3 CA 02214711 1997-09-04 PCTrUS96/03137
the MPS 102 it will then send order information to the coupon source via step
1308-1. The source will then acknowledge the order via step 1308-2. The source
could for e~cample confirm demographic information and the like during this step.
This system would have particular utility in conjunction with multimedia
yellow pages. Hence, the customer can review through advertising typical vendor
information as found in the yellow pages except now this information is reviewedfrom a tele.ision. Sele~l;ol.s can be made using the remote control 900 to obtain
certain inforn~ n and. thereby c~ g several related actions to occur. By
pls~cement of the telephone call a vendor could issue a ticket or coupon for a
product or a sc,,~icc. An i."~.l~l ~ealure, for the printing of ~ ments is the
need for an i~ y control system in which the ~ .cl can gain access to
infQ ~ that pertains to her transactions.
Rcf~llilg now to ~ C.S 14a and 14b what are shown is an el~11~, .c
lo~ control system 1400 and a ~h~ al in. ~ control system 1400'.
R~f<.,;.~g first to Figure 14a the el~L.o~ic co.. l.ol system in.~ s a pel onal
n,tel 1402 with an ~ teA dis~)la~ in this case a CRT display 1406. Also
c~,u~led to the ~e~ âl c~ t~r is a key~ad 1408 and a l,l~t~r 1404. The
pl .Icr in turn is coupled to an IMDV output device 1410.
In such a systcm the keypad 1408 can be utilized by the .,..sl~ er in much
the same way as an ~ 1;c teller m-~hine (ATM) in which the cl.~tQmer has
a security code t_rough the use of a room Icey to allow the ~ -.el to order
c~,upons via the ~ersc,~al CC~ 1402. The c., -puter is linked to the MPS 102
to allow for secure access to the various sources of information. The display 1406
can be utilized to interactively oyclale with the pelso-lal cc-ull3uter to cause the
ylhlling out of the ap,o~ ale coupons via the printer 1404. The pri-nter 1404,
typical}y a laser yli lte~ or speci~li7e~ c~upon printing m-chine prints the
information and provides that printed c.,.lpon information to a secure output
device 1410.
Figure 14b has similar elements to Figure 14a, however the physical s,vstem
includes a tray for receiving the tr~n~ctional information. Therefore each
-30
W O 96/278~3 CA 02214711 1997-09-04 PCTrUS96/03137
customer can have access to an individual tray of information by using their hotel
key or the like. Through the inventory control systems shown in Figures 14a and
14b the cl-stomer has secure access to inteld~ e multimedia tr~n~qctions.
It should be understood that the IMD 110 itself could be utilized as a call
S proce~-;.. g system. Finally, it should be understood that there could be multiple
MPS 102 to provide for very large scale call procc~ through the MPC 109.
The above-described CG~l~v.lhlg system has si~ifir-q-nt utility in the linking
of ccju~u..in~ inf nnqtion with other informq1ion. For example, the c.~u~o~ can
be linked to di~c~ t cat~,oli~s in the store which in turn can be linked to the
iu~ ~lu- ~ in real time. In anol]~ A~u~l~, demographic informqhon or the like
can be linked to the f ~ ;lJt of a c.~upo~. In a third ~ Ip~ the is~uallc~ of a
can be linked to a &~ c!;~;.e profile of a user. In this eml.odi~c~t, the
user makes a choice based upon the a.h_.Li~ nt l,.~L~ted. A co-.~o.. is then
gene,~te.l which is either related to the product a~-.l;3ed or is c~ ivc with
that product. In so doing, a fully interacthe co l~ g system is provided.
Fi'nal~y, this system could be utilized for in store lin~ . To more
~al l~ular}y ~ nl~e the advantages of this fcalure, refer now to Figure 15 whichis a store KIOSK in which the user can order the coupo.. desired. The KIOSK
1500 includes a video screen 1502 with a keyboard 1504 or the like to input the
dcsn~,d info~nq~ - In a first e.. ,b~li~ent, the coupun is code based, that is a
cl~t--mer enters the store and orders a I,arli iular co..~ or set of cv.ll.vns based
upon a code that he/she enters on the keypad.
In a second c ~bcsdiLu ~t the cvupon is issued based upon an
all~el lise"~ent. The ~ ....er would hear and see a particular advertisement prior
to the issuance of the coul,ou. In this embodiment, a particular brand is ordered
at the KIOSK 1500 and a coul on is printed that allows for a discount on that
brand.
In yet another embodiment, the KIOSK 1500 includes a plurality of food
recipes. The user orders a particular recipe via the keyboard and there would bea variety of cOu},olls generated based upon that particular recipe.
-3l-
~ W O 961278~3 CA 02214711 1997-09-04 PCT~US96/03137
This type of in-store couponing system can also be utilized in a store
without the KIOSK 1500 descl il,cd above. For example, the code information for
the coupons could be provided directly at the ckecl~out stand. Accord~gly, when
the cl~stc.mer purchases the ~l,;o~liate product, the COu~o,l codes or one code
S re~.~l.li.lg a plurality of coul,o~.s would also be provided directly to the sales
person at the check out stand. For exarnple, one code could ~ esellt four
pro~uct~. A shopper may order 10 items, that inrl~les three of the four items
te-l with the code, within the POS system of the store, the C~U1JOJ1 values
A~ with those three items would then be ~,eLled utili~ng the code, rather
than le.~ , a ~p~d~ code for each item. In so doing, the c~ vn
;..fo .-.zl:-.., is provided ~ e~ at the point of sale (POS).
Although the present i~ n has been descnbed in - cc !~rda~ce with the
eml~li~ .,t, shown in the figures, one of ordi~ skill in the art reco~ e~5
there could be v~ lions to the ~ - .bo~ ts and those ~,aliali~ns would be
within the spirit and scope of the l,r~nt i~.e li~ . A~oldi....... gly, many
~o l;r~ ons may be made by one of ordinary slcills in the art ~ o.. l depa~ g
from the spirit and scope of p:~nl in~e~Lon, the scope of which is d- filled
solely by the Appe~ e-l claims.
