CA 02306713 2000-OS-02
MULTI-IMAGE COMPOSITING
Reference to Related Application
This application is related to U.S. Patent No. 5,311,357, filed
December 3, 1992, by Susan Kasen Summer and Burkhard Katz for DEVICE
FOR THE CREATION OF THREE-DIMENSIONAL IMAGES. Also of
interest are U.S. Patents Nos. 4,802,750 to Welck, entitled REAL IMAGE
PROJECTION SYSTEM WITH TWO CURVED REFLECTORS OF
PARABOLOID OF REVOLUTION SHAPE HAVING EACH VERTEX
COINCIDENT WITH THE FOCAL POINT OF THE OTHER, and
5,257,130 to Monroe, entitled APPARATUS AND METHOD FOR
CREATING A REAL IMAGE ILLUSION, and of Swiss Patent No. CH
679342 A5, entitled APPARATUS FOR PROJECTION OF OBJECTS.
Background and Summary of the Invention
The present invention relates to apparatus and methodology for the
compositing of multiple, viewable phenomena/sight-stimulators, such as
multiple images and real objects, and in particular, to such apparatus and
methodology which includes the incorporation into such compositing
formation of at least one projected real image.
CA 02306713 2000-OS-02
WO 9s/19s8a
PCT/US9Sl00512
The power of visual ima~en~ has fascinated and captured people for
decades, and as new visual-imagery technology has emerged in recent years, the
possibilities for presenting startling, dramatic visual phenomena have leapt
onto
the communicating landscape with powerful, attention-getting boldness. Long
recognized, for example, have been the striking, attention-capturing power of
motion pictures, of television, of three-dimensional graphics and displays, of
magical floating-in-space images, and of others, and this attention-getting
capability is widely recognized as a powerful tool in the creative
communication
"playing" fields of amusement, advertising, basic information conveyance,
clarification of hard-to-otherwise-visualize phenomena and relationships,
medical
diagnostics, and many, many others.
In this setting, the present invention steps onto the "communication
stage" with a highly innovative and advanced systemic apparatus and
methodology
that allows for the selective compositing, in a defined viewable volume of
space,
of wonderfully innovative multiple-layer, adjustably positionable composite
images, including at least one three-dimensional real image, which advance
opens
important doors in all of the fields mentioned above (as well as many others)
neither openable, nor even approachable with prior art technology.
Described hereinbelow, and illustrated in the plates of drawings
which form pan of this invention disclosure, are numerous key embodiments of
the system and methodology of the invention, with all embodiments offering the
core capability of compositing, in three-dimensional space, multiple images,
including at least one real image, where any two images (or visual phenomena)
are organized, at any given point in time, with at least one of formats (a)
front-to-
rear, (b) side-by-side and (c) overlapping and intersecting, adjacency. If
desired,
these formats may be combined in different ways. Each of these formats is, of
f course, taken with reference to the specific point of view of an observer.
So, for
example, the front-to-rear format may exist with respect to a viewer looking
at the
created composite ima~erv generall along a horizontal axis, as well as such a
person view ng the composite imagew alon<_ a more upright axis. The ima«crv,
or am~ component thereof may he moveable in the composite settin~_. eiti~er by
\ ii iU~ of i.7~ l:W , ,:~::lt ill: i C ~::.~ ~ JW .ii t: iius,i.'vLJ IiiO1
L117Li7t, ()f lO\ \.. _ ,
ii :ut ()1 tilt
CA 02306713 2000-OS-02
WO 95/19S8a PCTIUS95100512
_ ;_
provision of moveable optical structure which plays a role in the creation of
the
composite whole.
A special feature of the present invention includes the cooperative
relationship, for example, between: (a) a source of three-dimensional imagery
' S (other than a real object source), which source includes a visual-image
database
itself containing "entrained" psychological optical cues that dramatically
promote
the perception of real three dimensionality; (b) a two-dimensional screen
device,
such as a video monitor, which forms from a data stream provided by this
database a related image (rnoving or still) which contains the relevant three-
dimensional cues; and (c) a real-image optical projection system that acquires
such a screen-device-borne image and projects the same into space in a setting
which is free of (unencumbered by) physiological impediments, such as a frame
or a border, that might detract from the apparent, real, three-dimensionality
of
the projected real image.
Still another important feature of the invention described and
claimed herein is the presence of an organization, in certain embodiments, of
a
system which allows a viewer/user to interact directly with a projected real
image,
in effect to manipulate one or more characteristics or aspects of the image.
For
example, and to illustrate this notion, one can imagine the projection into
space
of a real image of a piece of fruit, such as a pear, in a setting which
permits the
viewer/user to "grasp" the pear, and to rotate or otherwise move it, for
example.
One of the extraordinary capabilities of the system of the present
invention, as will be described and illustrated more fully hereinbelow, is
that it is
possible to composite, in essentially or approximately a single plane,
slightly
staggered/offset pixelated or rastered, images (and the like), as, for
example,
might be derived from a video source, in a manner resulting in a composite
projected real image having greatly enhanced image resolution. In such an
application, of course, the several sources which result in the end-result
composite
image would be dra~-n from nreciselv the same foundation image source
material.
t 30 In other words, were, for example, three video images composited in this
fashion
and to this end, the ssme i~m«~ III:.VCr1! would he uccurrin~~ at tile same
inument
r ;_.. o r .i_ , .t_. ~
l~. im:~ ~)o ..=~. Ui W m:..v t):: ..~:i vidl'W lii.ir~C~.
CA 02306713 2000-OS-02
- 4-
As will be apparent from a reading of the description which follows,
along with a viewing of the respective, different drawing plates, each of the
systems described herein has, as a part of what is referred to as viewing-
enabling
structure, one or more optical elements which are common to other disclosed
systems though each system specifically shown herein has, generally speaking,
an
optical arrangement or organization which is specifically different from the
arrangements of the other systems. Also, and with respect to the illustrated
and
described systems, various sources (image-effecting, sight-stimulator-
effecting) of
ultimately viewable imagery, occupying suitable location stations, are common
from one system to another, but somewhat differently arranged in order to
cooperate appropriately with related optical elements (system optical
structure).
The different optical elements (arrangements) which are combined in the
systems
described are individually known and understood in the world of optics, and
accordingly, great detail about the positioning, sizing and relative locating
of these
elements, which is well understood by those skilled in the art, is omitted
from this
text. The prior patents referred to above, taken together with the drawings
and
description herein, afford an abundant base of information for one of ordinary
skill
in the art fully to appreciate the respective operations of the several
systems shown
and discussed, as well as to understand the powerful potential for the core
contribution of this invention in enabling the spatial compositing of multiple
images as contemplated by the invention.
Further explaining something in general terms about the apparatus
descriptions which are to follow, it will be immediately evident that the
various
optical elements and imagery sources in each disclosed system must be, and
are,
integrated interactively and operatively with one another so that their
respective
positions relative to one another result in the placement and compositing of
images
in a spatial station (visual staging station) which is easily viewable by an
observer.
In some instances, it will be immediately apparent from the drawing figures
that
the nature of this system integration structure takes the form of a cart or a
housing
or some other evident kind of framework, but in certain other illustrations of
_ CA 02306713 2000-OS-02
-5-
systems, the details of specific system integration structure are omitted in
favor of a bracket
in the figure which is presented there specifically to symbolize the presence
of such
structure.
This invention provides visual display apparatus including:
a visual staging station defining a space for viewing images from a vantage
point
along a viewing axis, and
viewing enabling structure associated operatively with said station and with
said
space for enabling placement therein of a composite organization of at least
two viewable
phenomena, one of which takes the form of an optically-projected real image
that appears to
float in space in front of the staging station without aid of a stereoscopic
device, each of
said at least two phenomena being located along the viewing axis and viewable
by both eyes
of a viewer positioned at the vantage point.
This invention also provides visual display apparatus including:
a visual staging station defining a space for viewing images from a vantage
point
along a viewing axis, and
viewing enabling structure associated operatively with said station and with
said
space for enabling placement therein of a composite organization of at least
two images, one
2 0 of which takes the form of an optically-projected real image that appears
to float in space in
front of the staging station without aid of a stereoscopic device, each of
said at least two
images being located along the viewing axis and viewable by both eyes of a
viewer
positioned at the vantage point.
This invention also provides a real image interaction system incorporating a
visual
2 5 display apparatus as described above, said system including:
a source for displaying a visual image,
a real image generating optics device associated with the source so that a
real image
version of the visual image can be generated in a defined spatial location,
a sensor capable of generating a data stream relatable to a person's physical
or
3 o verbal expression and
a processor capable of interpreting the data stream then generating and
transmitting
corresponding image modification signals to the source so that the system can
enable the
person to indirectly manipulate the real image through verbal or physical
expression.
CA 02306713 2000-OS-02
-Sa-
This invention also provides a visual display system incorporating a visual
display
apparatus, said system including:
a source station occupiable by a source for a projected real image,
said visual staging station occupying a location spaced from said source
station,
a beam splitter optically interposed between said source station and said
staging
station, and
optical co-acting structure co-actable with said stations and said beam
sputter to
1 o create in said staging station a real image of any source material present
in said source
station.
This invention also provides a visual display method including:
selecting multiple sources for display of viewable phenomena;
by means of a viewing-enabling structure, placing in a visual staging station
which
defines a space for viewing images from a vantage point along a viewing axis,
a composite
organization of at least two viewable phenomena derived from selected sources,
one of such
phenomena taking the form of an optically projected real image that appears to
float in
space in front of the staging station without aid of a stereoscopic device,
and
organizing such phenomena in such station in a manner whereby each of said at
least
2 o two phenomena is located along the viewing axis and viewable by both eyes
of a viewer
positioned at the vantage point.
This invention provides a visual display apparatus comprising
a visual staging station defining a space for viewing images from a vantage
point along a viewing axis,
2 5 a beam sputter located along the viewing axis in said space, the beam
sputter
having a front side partially facing the vantage point, and a back side
opposite from the
front side, wherein the beam sputter is oriented obliquely relative to the
viewing axis,
a first image source equipped and positioned to display a first image directed
toward the front side of the beam sputter so that, to a person viewing the
staging station
3 o from the vantage point, the first image appears to be a background image
located behind the
beam sputter substantially along the viewing axis,
_. _ _ ~ _ __.__._
_ CA 02306713 2000-OS-02
-Sb-
a second image source equipped and positioned to display a second image
directed along the path leading toward and through the backside of the beam
splitter along
the viewing axis toward the vantage point, and
an optical structure located along the path between the second image source
and the beam splitter, wherein the optical structure causes divergent rays
from the second
image to converge substantially along the viewing axis in front of the beam
splitter, so that,
to a person viewing the staging station from the vantage point, the second
image appears as
1 o a floating real image in front of both the beam sputter and the background
image.
In the aforementioned visual display apparatus, the optical structure may
include at
least one curved mirror, plural mirrors, or at least one parabolic mirror. The
beam sputter
may form about a 45-degree angle relative to the viewing axis. The first image
source may
face in a direction substantially perpendicular to the viewing axis. The
optical structure
may include an element which is at least partially light transmissive. The
.display apparatus
may further comprise a housing for substantially encasing the image sources
and optical
structure .
In the aforementioned display apparatus, the second image source may be
provided
with a data stream containing three-dimensional image cues selected from the
group
2 o consisting of shading, occlusion, perspective, motion parallax, size
versus depth, light
versus depth and definition versus depth, and combinations thereof, so that
the floating real
image in front of the beam sputter appears to be three-dimensional from the
vantage point
along the viewing axis.
The aforementioned display apparatus may further comprise a control mechanism
2 5 which allows a viewer to interact with the floating real image in front of
the beam splitter.
The various objects and important advantages sought for and offered by the
apparatus and methodology of the present invention, alluded to above, will
become apparent
as the description which follows is read in conjunction with the accompanying
drawings.
- CA 02306713 2000-OS-02
-Sc-
Description of the Drawings
The several drawings which form part of this disclosure are schematic in
nature, and are not presented herein with any precise scale, or exact
dimensional relative
inter-relationship of components.
Fig. 1 is a schematic illustration of one embodiment of an image compositing
system constructed in accordance with the present invention, with this
embodiment
including a dual-sector real image projector and a piano beam sputter, with
two video
1 o sources, to create a composite image including a projected foreground real
image and a
background virtual image.
Fig. 2 is a schematic illustration of another embodiment of the invention
employing a dual-sector real image projector and a piano beam splitter, along
with a video
source and a projected-onto-screen source, to create a composite image
including a
foreground projected real image and a background virtual image.
Fig. 3 illustrates schematically another embodiment of the invention which
employs a dual-sector real image projector, along with a video source and a
three-
dimensional object display, to create compositing between the real object
display and an
overlying projected real image.
2 o Fig. 4 illustrates another embodiment of the invention employing a
dual-sector real image projector and a piano beam splitter, along with two
video sources, to
create a composite image including a projected real image foreground and a
virtual image
background.
Fig. 5 shows a somewhat modified form of the invention appearing in
2 5 Fig. 4 - here illustrating the cooperative use of a single-sector optic
portion ~of a real image
projector along with a piano beam sputter, and two video sources.
- CA 02306713 2000-OS-02
WO 9511958 pC'T/iJS95/00512
-ri-
to create a composite image including a foreground projected real image and a
background virtual image.
Fig. 6 illustrates another embodiment of the invention employing
a dual-sector real image projector and two video sources to create a composite
image including a projected real image and an underlying screen-borne image
which appears on the screen of one of the two video sources.
Fig. 7 depicts another invention embodiment which is somewhat
similar to that illustrated in Fig. 6, except that here there is employed a
single-
sector optic portion of a real image projector along with a piano beam
splitter to
create the same kind of composite image discussed above in relation to the
embodiment of Fig. 6.
Fig. 8 illustrates another modified embodiment of the invention
which is related to the embodiment shown in Fig. 2, except that it differs
from
that embodiment in the same structural way that the embodiment of Fig. 7
differs
from the embodiment of Fig. 6. This system, as does the system of Fig. 2,
creates
a composite image including a foreground projected real image and a background
virtual image.
Fig. 9 displays another embodiment of the invention which employs
a dual-sector real image projector, a spherical mirror, and a pair of piano
beam
splitters to create a composite image which includes a foreground projected
real
image and a background expanded/collimated virtual image.
Fig. 10 shows an embodiment of the invention which is somewhat
similar to that drawn in Fig. 9 -- here including a dual-sector real image
projector,
a spherical mirror, and a pair of piano beam sputters, along with three video
sources, to create a composite image including a foreground projected real
image,
and two, front-to-rear-separated, background virtual images, including an
expanded/collimated virtual image.
FiQ. 11 illustrates another embodiment of the invention which can
be thousTht of as a modification of the embodiment shown in Fi~. 9, differing
in
respect of the fact that it empiovs but one sin«ie-sector optic portion of a
real
lIlid'~C p1()~c'.Ct01- slrllClU)-e CO;:)i)IIIc.Ii uyii7 s i~i:nl~i I)C3117
a,,)i111c'f, ;iillj W'ltll Llic'
i
- CA 02306713 2000-OS-02
V1'O 95/1958-t
PC?NS95/00512
_'7 _
overall system creating a composite image including a foreground projected
real
image and a background expanded/collimated virtual image.
v . Fig. 12 illustrates yet another embodiment of the system of the
invention, which can be thought of as a modification of the embodiment shown
in Fig. 10, with this modification differing from the structure in Fig. 10 in
the
same manner that the structure illustrated in Fig. 11 differs from the
structure
shown in Fig. 9, and with the further difference that the system organization
of
Fig. 12 creates a composite image including two front-to-rear-relatively-
displaced,
projected real images against a background virtual image.
Fig. 13 shows a modified embodiment of the system which creates
a composite image organization like that created by the system illustrated in
Fig.
12, with the system of Fig. 13 including a pair of single-sector optic
portions of a
real image projector, each combined with a respective piano beam splitter,
along
with three video sources.
Figs. 14 and 15 are directly related schematic drawings of one form
of a theater-environment system constructed in accordance with the invention,
with Fig. 14 illustrating a plan view, and Fig. 15 illustrating a section/side
elevation. The system of Figs. 14 and 15 includes three projection sources
along
with three additional video sources, in combination with a cascaded
interleaving
organization including two piano beam splitters, three screen/scrim structures
(image-forming surface structures), and a dual-sector real image projector, to
create a composite image which, in addition to a projected real image, can
include up to five other distributed images.
Figs. 16 and 17 are related to one another, and show another form
of a theater-environment system constructed in accordance with the invention,
which system also uses herein three projection sources along W th three
additional
_ video sources, and a somewhat different arrangement of cascaded interleaved
beam splitters and screen/scrim structures, along with a spherical mirror, to
create another kind of mufti-layered composite image somewhat line th;7t
creatahle by the s\~stem illustrated in Figs. 14 and 1 ~.
Fi~~. l<s illustrates still anther emhodimen; of th: waem of the
pr~J~Ii; 111\C171iUi7. \sillOi7 C177I1~;1177c_171 11W iUOe~, it)lll-\-lllC()
s~rUllt~. ;:~tlli_ \slill I\lv),
CA 02306713 2000-OS-02
WO 9~/1958.i pCT/US95/00512
-
dual-sector, real image projectors, and a plano beam splitter, to create a
composite image including a pair of projected real images, a screen-borne
image
beneath the two real images, and a virtual image beneath all of the other
images.
Fig. 19 illustrates yet a further embodiment of the invention, here
taking the form of a distributed array of dual-sector, real image projectors
and
plano beam splitters, organized with an object source for each projector, and
with
one, additional video source, with this embodiment enabling the creation of a
composite stack of real images, one for each of the sources, overlying and
thus
composited with a screen-borne viewable image generated by the video source.
Fig. 20 illustrates still another embodiment of the invention which
includes a dual-sector, real image projector disposed on one side of a
screen/scrim structure, and a pair of sources including a video source and a
projector, all cooperating to create a composite image including a foreground
projected real image (projected through the screen/scrim structure) displayed
against a background image projected onto the "viewing", image-forming side of
the screen/scrim structure.
Fig. 21 shows another embodiment of the invention which includes
a dual-element, spherical-component, real image projector, and behind one of
the
elements in the projector, which element is at least partially transmissive to
light,
a video source which presents a screen-borne image. All of this cooperating
structure creates a composite image including a foreground projected real
image
displayed against a background screen-borne image, which screen-borne image is
thus viewable through one of the optical elements in the real image projector
which is effective to create the projected real image.
Fig. 22 illustrates still another modification of the invention which
is somewhat similar in its organization to that illustrated in Fig. 20, with
the
structure of Fig. 22 including a dual-sector real image projector, a
scrim/screen
structure through which a real image is projected, and a projector for
projecting
and creating a screen-borne image on the "view no" side of the screen/scrim
3U structure. This embodiment results in the production of a composite imaee
includin~_ a foreground ~r<yecteci real ~ma~e ciisplaved a~ain~t :.~
haci;«ronnd
pr~ieceu-onto-,..rcu for >mco-io>ro~~~ im,i~~c_
~ ~,. ,
- CA 02306713 2000-OS-02
_ v
,. WO 95/19581 pCT/US95HH1512
_Q_
Fig. ?3 illustrates another form of the invention which includes a
real-image projector in the form of a single-element spherical mirror, and a
cooperating piano beam splitter, both of which work together to create a
composite image including a foreground-projected real image and a background
virtual image.
Fig. 24 illustrates a fragmentary plan view of an amusement system
characterized by an amusement ride having, distributed along its ride path,
several
(three in the drawing) image-co;npositing systems constructed, for example, in
accordance with any one of the embodiments specifically illustrated in other
drawing figures herein.
Fig. 25 is a view which relaxes to Fig. 24, and shows, in side
schematic form, viewers in an amusement sidecar approaching one of the image-
oompositing systems depicted in Fig. 24, with the particular kind of
oompositing
system which is shown in Fig. 25 including a dual-sector, real image projector
IS which projects, as de 'rived from a rear-projection screen, a foreground
real image
through a screen/scrim structure, onto which structure is projected a screen-
borne
image derived from a projector disposed on the "viewing" side of the
screen/scrim
structure.
Fig. 26 is a view of a system very much like that which is illustrated
in Fig. 19, but differing in the fact that here what is shown is a system for
greatly
enhancing the resolution of a video image provided simultaneously ~on each of
three spaced video monitors, with there resulting from this arrangement a
composite, approximately single-layer projected real image which is formed by
effective staggering of the images drawn specifically from each of the three
video
sources to enhance greatly the resulting image resolution. For the purpose of
clarity in this figure, the three components of the resulting projected real
image
are actually show in a significant)v out-of-single-plane manner in order to
clarify
understanding of what is occurring in the operation of this system.
Fio. 27 is a schematic/block view' of a modified form of the system
3U wherein an aeriallv suspended three-dimensional-appearing image is
projected a
ii rc'.ai ima~~C U:(.~c:U U~)Uii VisUaii ~VU~ic: il:ii:: Vs171CI) ll7CIUdC:S
U17~' UnC or iliUi-C Ui ;a
~~;::i:i~ ('Ji E)W'Cru)iU~:;:,''.ii:v ;iiv:::'~';::. s :;;:~:-
i~iil~:rlSiO:~~.i li~;;''~,' ~:1:~..
CA 02306713 2000-OS-02
' wo 9:vi9sa.~ r~r~s~osiz
-14-
Fig. ?$ is a perspective schematic view illustrating a system allowing
viewer/user interaction with an image in a setting whereby the user employs a
trackable, worn glove in a region adjacent the location of the image. .
Fig. 29 is a schematic view of a system, somewhat like that
illustrated in Fig. 28, wherein a user, wearing a trachable glove interacts
with a
P~j~ed real image, such as the imago of a pear.
Fig. 30 is a schematic view of a system, somewhat like that depicted
in Fig. 29, wherein a user, without the employzaeat of a trackablc glove, can
interact directly, as far example by grasping, a projected real image to
manipulate
the orientation, position, etc. of the same.
F3g. 31 is a schematic illustration of the projocted real image o~ for
example, a board game, with rrspect to which a user is permitted to interact
in
s fashio~a moviag, as indicated by vertical and h~ixontal arrows is the f
gore, a
player, piece, etc., which forms part of the $ame. ,
Turning atteation now to the drawit~, atui referring 5rst of all to
Fig. 1, indicated generally at 100 is one form of visual display apparatus
constructed in accordance with the invention. Apparatus 100 operates, as will
be
explained, to create, in a visual staging station shown gener$lIy at 102 which
occupies a defined volume of viewable space, a composite organization of
awltiple viewablc phenomena, and specifically here, a pair of images.
including
a real image 104' in the foreground and a virtual image 106 iu the
badcgs'ound.
The point of view of an observer is laterally to the left of the apparatus
iilustratod
in this figure.
This same terminology ("visual staging station", "defined volume of
viewable space" and "composite organization of multiple viewable phanomena").
and general organization, charactcriu all of the other spec system
embodiments which are shown in the other drawing figures. Accordingly, all of
this terrninolog_v m'll not necessarily be repeated in the respective
descriptions of
the other drau~ng fi~urc~. Apparatus 100, as is true for the other system
apparatus disclosed herein, is also referred to ac a system for establishing
- CA 02306713 2000-OS-02
-11-
viewability of sight stimulators, and further as a system for producing a
composite
organization of multiple images. Where the terms viewable phenomena and sight
stimulators are used, it is intended that these phrases be understood to
include real,
three-dimensional objects as well as images. Where the term image is used,
this is
intended to include real images, screen-borne images (i.e., projection-based
images as from a film projectors, a slide projector, a video unit) and virtual
Images.
The key operative components which make up apparatus 100 are
suitable fixed and contained within the frame 108 of a cart, which is also
referred
to herein as system integration structure.
Two sources of imagery are included in apparatus 100, and these are
a large-screen, rear projection video unit 110 which faces nearly straight
downwardly in Fig. 1, and another, smaller-screen video source 112 which faces
upwardly in Fig. 1. Located intermediate these two sources are a dual-sector,
parabolic, concave real image projector 114, and a plano, reflective beam
splitter
116, positioned and oriented relative to one another, and to the two imagery
sources, as illustrated in Fig. 1.
Projector 114 is constructed precisely in accordance with the
teachings of the aforementioned Welck patent, and works exactly as is
described in
that patent. This projector includes two concave, optically confronting,
cooperative, reflective surfaces which extend in space in a manner
discontinuous
from one another (i.e., their extensions intersect). While in many instances,
it is
preferable to use, as a real image projector, a structure based upon parabolic
optics, such as the one shown in the structure of Fig. 1, other concave
reflecting
surface structures, such as spherical structures, elliptical structures, and
others,
may be used.
Beam sputter 116 is a reflectively coated sheet of glass (or the like)
which allows light transmission through it.
With operation of the system shown in Fig. l, projector 114 creates,
from the screen of source 112, real image 104, and beam splitter 116 creates,
from
the image appearing on the screen of source 110, virtual image 106. From
' CA 02306713 2000-OS-02
WO 95/1958)
PCT/US95/00511
_l
the point of view (mentioned above) of an observer, real image 104 resides in
the
foreground, and virtual image 106 in the background.
Fig. 2 shows at 118 another form of visual display apparatus
constructed in accordance with the invention, with this system creating, in a
viewing station 120 which is somewhat like previously mentioned viewing
station
102, a composite of multiple images including a foreground real image 122 and
a background virtual image 124.
Forming part of apparatus 118 are two imagery sources including
a video source 126 and a projected image source including a projector 128 and
an overhead screen 130. Also included in apparatus 118 are a dual-sector real
image projector 132, which is like previously mentioned projector 114, and a
piano beam splitter 134 which is like previously described beam splitter 116.
Hereinafter, where reference is made to a dual-sector real image projector,
and
to a piano beam splitter, it should be understood that these respective
structures
have the same characteristics, respectively, as projectors 114, 132 and beam
splitters 116, 134.
Light from projector 128 passes through beam splitter 134 to form
an image on screen 130, and the image on this screen is reflected to the
viewer
via beam sputter 134 to create virtual image 124. The viewer's point of view
in
Fig. 2 is laterally to the right of the structure shown in this figure.
From the image which appears at the site of video source 126,
projector 132 creates foreground real image 122.
Turning attention now to Fig. 3, here there is shown at 136 another
visual display system embodying the present invention, and including a housing
138 in which are mounted a dual-sector real image projector 140, a video
source
142, a real object display 144 u-hich takes the form of an imaginary playing
field,
and a piano beam splitter 146 w-hich directly overlies this object-organized
playn~
field.
~'Vith operation of system 136, projector 140, deriun~ information
from video source 14?, pr~iectc a foreground real image 148 which is thus
visually
comnosite~ won the hack~~r~>;mc, v;u;jl in~;i«ew nr nhenomer~a re~ultin« from
the
_. _.. _ _ ..-__ _ _~_ __ _.
,.. i , I ~~ ~ ,...
CA 02306713 2000-OS-02
r
WO 95/t958a
PGTIUS95/(10512
-13-
objects in field 144. The point of view of an observer relative to the
apparatus
of Fig. 3 is downwardly toward image 148 and field 144.
. In Fig. 4 there is shown at 150 visual display apparatus including
two video sources 152, 154, a dual-sector real image projector 156 and a piano
' S beam splitter 158.
This system, when operated, creates, in a visual staging station lfi0,
a foreground real image 162 and a background virntal image 164. Real image
162 is derived from the display of source 154 and is projected toward the
location
shown by projector 156. Virtual image 164 is created by reflection from beam
splitter 158 of what appears at video source 152. The point of view of an
observer is laterally to the right of the apparatus shown in Fig. 4.
The system illustrated in Fig. 5 creates, from the point of view of
a viewer (which is laterally to the left of the apparatus in Fig. 5) a mufti-
image
composite in a visual staging station 166. This image composite organization
is
similar to that which is produced by the apparatus of Fig. 4, but is
accomplished
by a very different optical and imagery-source structural organization.
Included in the apparatus of Fig. 5 are a downwardly pointing video
source 168 and an upwardly pointing video source 170.
Directly interposed these two sources, as the same arc shown in Fig.
S, is a piano beam splitter 172. Also included in the system optical structure
of
Fig. 5 is a single-sector optical (or optic) portion 174 of a real image
projector,
which portion basically takes the form of one-half the structure of the
previously
described real image projectors. With optic portion 174 combined as shown with
beam sputter 172, the two cooperate to create a virtual, confronting,
reflective
surface, shown at 174, which cooperates with optic portion 174 to create an
effective, whole real image projector. This very same kind of structure is
fully
. described and explained in the referenced Welck patent.
With operation of sources 168, 170, the cooperative interaction of
beam splitter 172 and optic portion 1 74 create a real imaee 176 derived from
source 170. Beam sputter 172 creates a background virtual image 17F from what
:~pp~~;~ at the loc;.~:ion of uicco source :(;~. T':~e pc3int of view o' ~,:n
obacwer it
T r'', .' l: :: r:.»: !11 !1,' 1 ~~'! iy ~~,' y:~i'._~::::'.' .
!:i?1°.T :t
CA 02306713 2000-OS-02
WO 95/1958-1 pLT1US95/00512
_la_
The system of Fig. 6 is one in which a composite image is formed
with a projected real image and a background screen-borne image. This
apparatus, designated generally 180, includes two video sources 182, 184, a
piano
beam splitter 186 which substantially directly overlies the face of source
184, and
S a dual-sector real image projector 188.
With respect to the apparatus of Fig. 6, the point of view of an
observer is indicated at 190. Through beam splitter 186, the observer is
provided
with a direct view of the screen-borne image created by source 184, with this
view
residing as a background to a real image 192 which is projected by projector
188
as derived from source 182.
The display apparatus shown in Fig. 7 is very similar in many
respects to that shown in Fig. 6. This apparatus, which is designated
generally
194, includes a pair of video sources 196, 198, a pair of piano beam splitters
200,
202, and a single-sector optic portion 204 of a real image projector. Sector
optic
204 coacts with beam splitter 200 in the same fashion that previously
mentioned
optic portion 174 coacts with beam splitter 172 in the apparatus of Fig. 5.
Beam
splitter 202 directly overlies the face of video source 198, which source is
directly
viewable through this beam splitter by an observer, whose point of view is
substantially the same as that illustrated in Fig. 6. Composited with this
screen-
borne image is a foreground real image 206 which is projected by coaction
between beam splitter 200 and sector optic 204 as the same derive information
from video source 196.
Turning attention now to Fig. 8, indicated generally at 208 is a
visual display apparatus including, as one imagery source, a video source 210,
and
2~ as another imagery source, a projector 212 and an overhead screen 214.
Further
included in apparatus 208 are a piano beam splitter 216, and coacting
therewith,
as has previously been described, a single-sector optic portion 218 of a real
image
projector.
With operation of display apparatus 205. the image which i
projected by projector ?1? onto screen ~'l~ results in a background virtual
image
~~0 (re~3?i\'~ tW Ihc ~7C11t71 (!f wj,'W f1f ,.;, rs!,c~ ~-\ ; - y'111C11 1~
~,ileral~',' 1r11nledl;??e)\' 1c?
L
f
~ ;., 4 :
CA 02306713 2000-OS-02
Ya
t\
WO 9511958a PCTNS9S/(10512
_l;_
the right of the apparatus in Fig. 8). Cooperation of beam splitter 21b with
sector
optic 218 results in the projection of a foreground real image 222.
In Fig. 9 there is shown at 224 yet another apparatus embodiment
of the invention. Apparatus 224 includes two video sources 226, 228, a dual-
' S sector real image projector 230, two substantially right-angularly
disposed piano
. beam sputters 232, 234, and a spherical mirror 236. The point of view of an
observer in Fig. 9 is immediately to the left of the apparatus shown in this
figure.
From that point of view, projector 230 creates a projected
foreground real image 238 derived from video source 228, and coaction between
beam sputters 232, 234 and mirror 236 creates a background, composited,
expanded/collimated virtual image 240 derived from video source 226.
Display apparatus 242 shown in Fig. 10 is similar in many ways to
the apparatus shown in Fig. 9, except that it includes three sources of
imagery,
and produces for an observer, whose point-of view position is laterally to the
left
of the apparatus of Fig. 10, a mufti-planar composite image including a
foreground real image 244, and two, depth-offset, background, virtual images
24b,
248. Image 248 is expanded/collimated.
Thus, included in apparatus 242 are video sources 250, 252, 254, a
dual-sector real image projector 256, a pair of piano beam splitters 258, 260
and
a spherical mirror 262.
With operation of apparatus 242, the composite of images 244, 246,
248 comes about as follows. Mirror 262 coasts with beam sputters 258, 260 to
create the furthest background virtual image 248, derived from video source
250.
T'he two beam splitters coast with imagery at the location of source 254 to
create
the intermediate background virtual image 246. Projector 256 derives
information
from video source 252 to create foreground real image 244.
Fig. l l shows at 264 an embodiment of display apparatus which
includes two video sources 200, 268, two piano beam splitters 270, 272, a
single-
sector optic portion of a real image projector 274 which coasts with beam
splitter
272, and a spherical mirror 2 7d.
~'~IIII ()~l~railoli t>i Ilie iil)Jar~iIUs t)f 1'1;~. i i, ;(Ilu irUl7i tli::
~)Ulil: t~:
\'IC:\\- l)I .li) l)i)ll:i~\v \iilv)\v vi,.W it~;ili1).u tlliiii: 1
il:ii~iss::.:.ui.\~ tl) li:'v'. ivr. (~
i~ ~ .,
CA 02306713 2000-OS-02
<,
~ , ~ WO 9:S/i9:~8.t pCT/US9.'SH10512
-16-
apparatus in Fig. 11, there is created, in the same kind of visual staging
station
previously mentioned, a composited multiple-image display including a
background expanded/collimated virtual image 278, and a projected foreground
real image 280. Coaction between beam sputter 272 and sector optic 274
projects, from information derived from video source 268, real image 280. The
two beam splitters, in cooperation with spherical mirror 276, create virtual
image
278 from source material derived from video source 266.
At 282 in Fig. 12 there is shown yet another embodiment of the
present invention, with this embodiment having some strong structural
similarity
to the embodiment shown in Fig. 11. Structurally, the Fig. 12 embodiment
differs
from the Fig. 11 embodiment by the presence of a third video source.
Functionally, and from the point of view of a viewer, which is to the left of
the
apparatus shown in Fig. 12, a three-level composite image results, which
composite includes an outer foreground real image 284, an intermediate
foreground real image 286, and an background virtual image 288.
The three video sources contained the apparatus of Fig. 12 are
shown at 290, 292, 294. Cooperating with these three video sources are two
piano
beam splitters 296, 298, a single-sector optic portion 300 of a real image
projector,
which portion coasts with beam splitter 298, and a spherical mirror 302.
u1 Beam sputter 298 and sector optic 300, deriving imagery from video
source 292, create outer foreground projected real image 284. Cooperative
action
between the two beam spliiters and spherical mirror, deriving information from
video source 290, create background virtual image 288. Cooperative interaction
between the two beam splitters and video source 294 results in intermediate
foreground projected real image 286.
Addressing attention now to Fig. 13, here there is shown generally
at 30~ still another embodiment of visual display apparatus constructed in
accordance with the present invention. The point of view of an observer
relative
to the apparatus of Fig. 13 is immediately to the left of this apparatus. The
composite image v~~hich results from operation of apparatus s44 is very much
like
-,
j lii:ii l:t:::W ()y l)~)W:lillll7 l)i 117e :lppiir:.'i:::i U. 1'1''. l_.
~117U~ hill ~U~ii%v)s:iv 1117;i'~e
i;.;:~:_. :.,,..: .... ;o);,:, c.' .w of ;:.. u~~:~~.~r ,:: ;~~:
r~:1:::;;::.~.. ..:7. to,:::r
f
~. p
CA 02306713 2000-OS-02
~ ~ WO 93/19_'S8.i pCTlUS9:5100512
-17-
foreground real image 3(;t6, an intermediate foreground real image 3Ub, and a
bac:;ground virtual image 310.
. Included in apparatus 304 are three video sources 312, 314, 31b, two
piano beam sputters disposed as shown at 318, 320, and two single-sector optic
portions 322, 324 of a real image projector, which portions cooperate,
respectively,
directly with beam splatters 318, 320.
With video source 314 providing the relevant source information,
beam splatter 320 coasts with sector optic 324 to create outermost foreground
projected real image 306. Deriving information from video source 311, sector
optic 322 cooperating with the two beam splatters, create intermediate
foreground
projected real image 308. Interactive cooperation between the two beam
splatters,
which derive information from video source 316, creates background virtual
image
310.
Looking now at Figs. 14 and 15 together, here there is shown
generally at 326 a theater-like system which is constructed in accordance with
yet
another important embodiment of our invention. Fig. 14 represents an overhead
plan schematic view of this system, and Fig. 15 shows, schematically, a cross
section/side elevation of the system. Focusing for just a moment on Fig. 15,
indicated generally at 328 is what is referred to herein as an audience
envelope
-- a space where members of an audience can be seated or otherwise placed for
viewing (toward the left in Figs. 14 and 15) composite imagery created by the
structure in system 326. Still with momentary reference to Fig. 15 alone,
shown
at 330, in front of the audience envelope, is a stage which can support, if
desired,
three-dimensional objects, including live action.
Progressing from left-to-right generally through Figs. 14 and 15, and
focusing attention on the constituents of system 326, these include a dual-
sector
real image projector 332, a pair of screen/scrim structures 3 34, 336, a piano
beam
splatter 338, another screen/scrim structure 340, another piano beam splatter
342,
and somewhat above and slightly behind, or at least toward the rear of, the
audience envelope, three projectors 34.x. 34b, 34b (see particularly Fi~~.
14). These
pT()Ic:CI()rs are ll)T prcyCCt111!_ i111i1!'_c'>, as IVr Z~:illl~lc ULrI\'c:~l
jiuiii ~imi:'.>, ~1i113. c:W
.~1111) iIiCiiilJ~:lj iii ilie Vi~~:.tili~:,:viOJ) Oi vls:C:i::,s) :I:t
::.:Cs'Jl:::s? ~u:::WS ~~
' CA 02306713 2000-OS-02
. ~ WO 95/1958-~ PGT/US9.5100512
-1 F-
354 (see particularly Fig. 15) with video source 350 pointing downwardly just
rearwardly (relative to the audience envelope) of screen/scrim structure 340,
with
source 352 pointing upwardly immediately beneath beam splitter 342, and with .
source 354 pointing upwardly beneath projector 332. The screen/scrim
structures
in system 326, as do the piano beam splitters, permit visual transmission
through
them. In addition, they act as image-forming surface structures which respect
to
projections, as will be described, from projectors 344, 346, 348. .
~peradon of system 326 permits . very complex compositing of
multiple images, including a real image, in up to six layers, so-to-speak, of
visual
information. More specifically, projection from projector 344 forms an
audience-
viewable image on the viewing side of screen/scrim structure 334. Similarly,
projection from projector 34b forms a viewable image on screen/scrim structure
340. Projection from projector 348 forms a surface-viewable image on the
viewing
side of srreen/scrim structure 336.
Imagery derived from video source 354 is projected by projector 332
to form a foreground projected real image 356. Imagery derived from video
source 352, through the optical action of beam splitter 342, creates a virtual
image
358. Beam splitter 338 creates, as derived from video source 350, a virtual
image
360.
Thus, the system shown and described in and with respect to Figs.
14 and 15 offers the possibility of compositing a quite deep and complex
composite of multiple images, all of which can be combined (composited) with
the
appearance of solid objects, including live action, on stage 330. In the
region of
system 326 which lies between projector 332 and projectors 344, 346, 348, the
structural components of the system can be viewed as a cascaded, interleaved
organization, including at least one beam sputter interposed a pair of image-
forming surface structures (screen/scrim structures), and 'at least one image-
forming surface structure interposed a pair of beam splitters.
Figs. 16 and l7 illustrate at 362 another theater-like organization
constructed in accordance with the features of the present invention. Fig. lh
provides a ~Ch~tl7allC tt)i~ ut:~n view of the system. and Fib.:. i- a crc~~,-
sectionaiwide-eiev;~tiun~~ v ~; ~: of the ,sme. Pimured in 1=i~~. i ; ;::; ~,.
;::~de:~::
CA 02306713 2000-OS-02
.~
WO 9511958a PCT/US9:V(ltlSll
-] 0_
envelope 364 which is like previously mentioned audience envelope 328, and a
stage 366 which is like previously mentioned stage 330.
- Progressing generally from left-to-right in Figs. 16 and 17, through
the various components which form system 362, included are a spherical mirror
' S 3b8, a piano beam splitter 370, a pair of screen/scrim structures 372,
374, another
piano beam sputter 376, and yet one more screen/scrim structure 378. Disposed
slightly above and toward the rear of the audience envelope are three
projectors
380, 382, 384 (see particularly Fig. 16) which are like previously mentioned
projectors 344, 346, 348, respectively. Also included in system 362 are three
video
sources 386, 388, 390 (see particularly Fig.17). Source 386 points upwaidly at
the
underside of beam splitter 370, and sourx 388 points downwardly at the upper
surface of this very same beam splitter. Video source 390 points downwardly at
the upper surface of beam spGtter 376.
System 362, like previously described system 326, permits the deep-
volume compositing of a mix of up to six images, including a projected real
image.
Projections from projectors 380, 382, 384 result in audience-viewable surfaoe-
formed images on the viewing sides .of screen/scrim structures 372, 378, 374,
respectively. Coaction of spherical mirror 368 and adjacent beam splitter 370
derives imagery from video source 388 to create a foreground projected real
image 392. The undersurface of beam splitter 370 coasts with source 38b to
create a background virtual image 394. The upper surface of beam splitter 376
cooperates with video source 390 to create an intermediate virtual image 396.
As is true in the case of previously described system 326, imagery
produced in system 362 can be composited with three-dimensional real objects
and live action on stage 366.
Indicated at 398 in Fig. 18 is yet another embodiment of the present
- invention. This embodiment includes four video sources 400, 402, 404, 406,
two
dual-sector real image projectors 408, 410, and two piano beam splitters 412,
414
which directly overly the image forming surfaces of sources 402, 40~,
respectively.
~~'ith operation of the apparatus of Fig. 18. and from the point of
view of an ~h~en~er »~hic)~ i~ ch~w~n at 41n. the nv~ real image nrniect~r~
and t~~e
two beam splitter~ coast wnn ima4~en~ derived trom source 4tn~ tn create a
near
>~ .~ ~, ,"."".. ." , "m~ w.~.w~ ~ , ,". ., ,. , ., , ~ ~ .~,~.. ~ _ ,. ~ ."
- CA 02306713 2000-OS-02
WO 9i/1958a PCT/US95It10512
_'7()_
foreground projected real image 418. The two beam splitters and real image
projector 410 coact to create an intermediate foreground projected real image
420. Immediately beneath image 420, beam splitter 414 allows direct viewing of
the surface-screen-formed image appearing from video source 404. Cooperation
between beam splitter 414 and video source 406 results in a background virtual
image 422.
Fig. 19 illustrates what might be thought of as a distributed array
form of the present invention, and is shown here, generally at 424, include an
array of six dual-sector real image projectors 426, 428, 430, 432, 434, 436,
six
inanimate visual sources, such as solid objects, 438, 440, 442, 444, 446, 448,
and
five piano beam spiitters 452, 454, 456, 458, 460 which overlie, respectively,
objects 440, 442, 444, 446, 448. Also included, toward the right side of the
organization shown in Fig. 19, are a video source 462 and a piano beats
sputter
464 directly~overlying the screen in this source.
The chosen point of view for an observer in the system of Fig. 19,
is downwardly adjacent the right end of the array in the figure. Here, what is
seen is a vertical composite of seven images which appear in a stack.
Progressing
downwardly through this stack, at 466, 468, 470, 472, 474 and 476 are real
projected images derived from sources 438, 440, 442, 444, 446, 448,
respectively.
Composited beneath this "stack" is the directly viewable, screen-formed image
appearing on the surface (screen) of video source 462.
Fig. 20 illustrates at 478 apparatus constructed in accordance with
the invention which includes a screen/scrim structure 480, on the rear side of
which (from the point of view of an observer shown at 482) is a dual-sector
real
image projector 484. On the viewing side of structure 480 is a projector 486
which acts as a source for the projection of a static, or a moving, image onto
this
viewing side. Real image projector 484 coacts with a video source, for example
that shown at 4ss, to create a foreground projected real image 490 which is
thus
composited ~~th the background, surface-formed image appearing on the viewin<a
surface of structure 480 (as derived from projection by projector 48G).
1:: 1'~1~. ~~, tll~.': :~ ~~7C)t~,M ,~,~,'~'1,~ ::I 'n~ v~:; ::T7()Ih:.'
:::7~t)~:.".'::~:
o~ Ih~ p.'.~:T7I i:wention. ~hf;~s emh~c_-~:n! includes ~~ duul-sec::<):~.
~f~h~::C:.al-
i i
- CA 02306713 2000-OS-02
WO 9i11958~ PC?'lUS9~51I1(1i12
3
' ?1_
component, real image projector 494 which includes optically confronting
reflective components 494, 494. The point of view of an observer is to the
left
of the apparatus pictured in Fig. 21. Relative to this point of view, disposed
behind component 494, which component is partially transmissive to light,
there
' S is a video source 496. At 498 in apparatus 492 is a visual source which
takes the
form of a real object.
With operation of the system/apparatus of Fig. 21, real image
projector 494 projects a foreground real image 500. This real image is
composited against a background, screen-borne image which appears at the
surface (screen) 496 of source 496, as transmitted through projector component
494.
Fig. 22 illustrates another important form of the invention, here
shown generally ai 502, with apparatus S02 including and articulated
(adjustable),
dual-sector real image projector 504, a scrim/screen structure 506, and a
projector
1S S08 usable to project static or moving images onto the image-forming
surface of
structure 506. This image-forming surface faces to the right in Fig. 22. With
operation of this system, projector S04 creates, from a suitable visual image
source, a foreground projected real image S10 which is composited against a
background, surface-formed image resulting from projection from projector 508.
In Fig. 23, at S12 there is shown still another organization which
embodies the key features of the present invention. Within a housing 514 there
are disposed a spherical mirror S 16, a piano beam splitter S 18, and two
visual
imagery sources, including a three-dimensional object 520, and an array S22 of
two-dimensional images.
With operation of the system of Fig. 23, mirror S16 coasts with
I piano beam splitter S 18 to create at 524. and through a viewport S 14a in
housing
j . ~ 14, a foreground projected real image. The piano beam splitter forms at
526 a
background, composited virtual image derived from array 52''
Focusing attention now on Figs. 24 and 2~ together, and beginning
W th Fig. 24, here there i~ shown an amusement-ride system application and
:nT:u)(?~iuiC.,;~t ~}~;: J -~~.~.... ..., ...:','.".. ~ ~'.::~~. ~~~C)\~,'!';
j,n, i-'j'_ '?.'. jC ; rl(~:C::-. O~'i~:
vehicl:. ''_'', whic': t',wc'~ ~_: n:.-~'..'.v ir. :!~c direc:ion of zrrc~w ~
=() alon~_ a ricic
,...__. ~_.~..~ -_~.. .,. , ,.. ~ . ~.
_ CA 02306713 2000-OS-02
WO 9i/t958a pGTIUS9.~/(10512
__
path 532, to transport riding viewers past the three visual staging stations
presented, according to the present invention, by each of three visual display
units
534, 536, 538. These display units may be constructed in accordance with any
one
of the specific system embodiments which have been described hereinbefore.
Fig. 25 illustrates one of these display units, such as display unit 534,
as including a dual-sector real image projector 540, a rear projection screen
542
and a rear projector 544 as a source of visual imagery, a screen/scrim
structure
546, and a viewing-side-of structure-546 projector 548.
With operation of the system depicted in Fig. 25, riders transported
by ride vehicle 528 past the image viewing station presented by this system
see a
mufti-image composite which includes a foreground projected real image 550,
derived from rear-projection screen 542, displayed against a background,
screen-
borne image resulting from projection by projector 548 onto the viewing side
of
structure 546. If desired, the system could be operated in such a fashion that
projector 548 is not at all times turned on, whereupon viewers transported
past
the system now being described would see a composite image which includes
t projected real image 550 against the background image of the screen/scrim
i structure per se.
Turning attention now to Fig. 26, here there is shown generally at
552 another distributed-array form of the present invention including three
dual-
sector real image projectors 554, 556, 558, three video sources 560, 562, 564
and
three piano beam sputters 566, 568, 570. Beam splitters 566, 568 directly
overlie
the screens of video sources 562, 564, respectively, and beam splitter 570 is
disposed in approximately the same relationship to projector 558 in Fig. 26 as
is
previously mentioned beam splitter 464 located relative to projector 436 in
the
structure of Fig. 19.
1'fith operation of system 552, each of the three video sources is
supplied with exactly the same video information. These three sources, and the
projecting optics associated thereW th, are so positioned that a resulting
projected
composite real image lies immediately above beam splitter 570 approximately in
a single plane. hut with the three comno~itin~~ constituent ima~e~ sii~htiv
ata~~~~erru in ti~ut li;~ne reismc tm onr ~mui~:: in suci~ s manner that the
p~x~i~.
- CA 02306713 2000-OS-02
WO 931198.1 PCTJUS9;5I(M512
raster lines, or the like in these images "fill in" spaces to achieve
significantly
higher image resolution than that which characterizes any single one of the
images that appears on the faces of the three video sources. This composite
real
image includes three image components 572, 574, 576 which derive,
respectively,
' S from video sources 560, 562, 564, respectively.
In order to make the "story" of the operation of system 552 clear,
the resultant projected composite real image is shown with each of the three
image components just mentioned displaced vertically relative to one another
(i.e.
significantly out-of-plane), and laterally staggered in an exaggerated manner.
The
staggering which is utilized occurs, from the point of view of a viewer of
Fig. 26,
in a plane which extends generally from the left to the right in the figure,
and
normal to the plane of Fig. 26.
Such a system as system 552 can, of course, be utilized to enhance
resolution using any appropriate number of projected images, two or more.
Shifting focus now to Fig. 27 in the drawings, here there is depicted
schematically at 580 a very exciting system modification of the invention
which
can be employed, with or without multi-image compositing, and which is based
on the concept of supplying image data for the projection of an serially
suspended
real image, where that data includes one or more psychologically motivating
three-dimensional image cues. In other words, the source data, which might
take
the form of a film, a videotape, a video laser disc, a magnetic image-
containing
disc, an optical data stream, an electronic data stream, or other, has built
into it
one or more of these cues which results in the creation ~f imagery that
strongly
suggests to a viewer that he or she is actually looking at a real three-
dimensional,
i.e., real volume-occupying, image. According to this system, these data cues
are
selected from a group of well-known cues, such as that group consisting of
shading. occlusion, perspective, motion parallax, size vs. depth. light (or
chroma
value) vs. depth, and definition vs. depth. Such source data is illustrated in
block
form at ~fi2 in FisTure 27.
Software which is available, for example, to create such image cue,
In is U1;'ilal-l1'1)C: ljal;il7W i;i~iilU(:~ ~I l)llUei~ 1~.'hli'il ;:r a ~UiU
ii:~:1- the li;iillC'.~
- CA 02306713 2000-OS-02
-24-
Flame, Flint, Soft Image, Electric Image, Swivel 3-D, Spectra Vision, Elastic
Reality, and Cluster After Effects (Trademarks).
Image-generating information from source data 582 is furnished, as
indicated by arrow 584, in any suitable fashion to a two-dimensional (2-D)
screen
device (visual image source), such as a video monitor 586, which produces,
from
the supplied image-promoting data stream, a two-dimensional image
characterized
by the presence of psychologically-perceived motivating cues that strongly
suggest
to a viewer that he or she is looking at a real, volume-occupying, three-
dimensional image.
Progressing further through the system illustrated at 580, monitor
586 acts as a visual source, as indicated by arrow 588, for a real-image
projection
system 590 (or real-image projecting optics) which can take the form of any
known type of real-image projection system, including any one of the imaging
systems described hereinabove. As illustrated schematically by arrow 592,
system
590 projects into a visual staging station 594 a projected real image derived,
via
rays emanating from screen device 586, from source data 582. In block form at
596 there is shown a viewer's eye which, in station 594, perceives a
startling,
realistic, three-dimensional-appearing, unencumbered, projected real image
which,
because of the presence of one or more of the source-data three-dimensional
image
cues, is perceived absolutely to be a real, volume-occupying, three-
dimensional
image.
It is the important combined presence of source-data three-
dimensional cues, and the ultimate aerial suspension of an unencumbered image,
characterized by the selected cues, that presents a stunning, unencumbered,
believable three-dimensional image, which actually is an image that lies more
nearly in a somewhat dimensionless (from a thickness point of view) plane in
space.
Further describing what is illustrated in Figure 27, an example here
is pictured where the viewer's eye (s) perceives in station 594 a pair of
turning and
moving boots which change orientations and which appear to walk toward and to
approach the viewer. Four stages in the progress of forward (toward the
viewer)
- CA 02306713 2000-OS-02
-25-
motion of these boots is illustrated at 598a, 598b, 598c and 598d. Arrow 599
schematically illustrates a progression in time as the boots appear to
approach the
viewer. The apparent three-dimensional imagery of these boots is infused with
the
kind of perceptually motivating three-dimensional cues mentioned earlier
embedded in the generating source-data stream, and causing the viewer, in the
specific illustration given, to see moving imagery characterized by shading,
occlusion, perspective, motion parallax, size vs. depth, chroma value (light)
vs.
depth and definition vs. depth cues. From the vantage point of the viewer,
system
580 presents an unencumbered, projected real image which unquestionably
appears
to occupy three-dimensional space, even though that imagery is actually
derived
from data based upon two dimensions.
Suspended Image Interaction
An important extension of the real-image producing systems of the
present invention relates to the capability of allowing a viewer to interact
with a
suspended or apparently floating real image. A large body of published
information enables one skilled in the art to produce a system in which a user
can
manipulate (for example, through a data glove which includes a sensor) or
experience travel within an image displayed on a two-dimensional computer
display screen. For example, see the following U.S. 'Patents: No. 4,988,981,
No.
4,937,444, No. 5,097,252 and No. 4,542,291 (collectively referred to as the
"Zimmerman patents"). The Zimmerman patents as well as many other
publications and products currently on the market generally relate to a
t~hnology
known as "virtual reality" . Figure 28 shows a basic virtual reality system
600
which is disclosed in Zimmerman's '981 patent. The system 600 utilizes a
computer 602 to generate an image on a two-dimensional or semi-flat display
screen 606. A cable 608 connects a data glove 610 to interface electronics 611
which is connected to computer 602. A signal generator, for example, an
ultrasonic transducer 612 is attached to glove 610. Ultrasonic receivers 614a,
614b and 614c are positioned around display screen 606 and are connected to
interface electronics 611. Signal data is collected relating to the position
of
ultrasonic transducer 17 and the degree of bending andlor direction of
pointing, of
one or more of the user" fingers in glove 610. Computer
- CA 02306713 2000-OS-02
WO 9511958a pCT/US9:51Q(1512
602 then affects changes in displayed image 604 corresponding to the movement
of data glove 610, i.e., the user's hand.
The present invention enables a very important and powerful
extension of virtual reality technology by providing techniques for suspending
a
real image with which a viewer may interact. Figure 29 schematically
illustrates
such a system. Interactive suspended image system 620 includes a computer b22
1 which is capadle of generating an image on two-dimensional display screen
624.
Computer 622 and display screen 624 are collectively referred to as an image
source. Real image producing optics (real image derivation/presentation
structure) 626, for example, such as the optics shown in U.S. Patent No.
4,802,750,
is positioned to receive an image from display screen 624, and to form and
project
a corresponding real image b28 in a staging area b30 in front a viewer's eye
631.
A cord 632 connects computer b22 to data glove 633 which is worn on a user's
hand at the end of arm 634. Data glove 633 may also have a signal generator
such as ultrasonic transducer 63b which sends signals to an ultrasonic reviver
b38.
In the system illustrated in Figure 29, interaction data is produced
through sensors and signal generators such as the ones disclosed in the
Zimmerman patents. There are, however, other ways to facilitate interaction
between a user and a suspended image without a data glove. For example, in
Figure 30, a real image of a pear 650 is projected in staging area b52. The
user
' achieves interaction with the pear by moving a portion of hand 652 in the
staging
r
area. A light emission and detection device 654, such as one of the ones
disclosed in U.S. Patent No. 5,248,856 (scanning laser system) generates
signals
indicative of finger location. The signals are transmitted to a signal
processor
which then affects the desired movement or alteration of pear 650.
As shown in Figure 31, the present invention may also take the form
of a ~ame played on a suspended screen. i.e., a real imabe of a screen.
I~'Iaze 660
is suspended :n staging area 662. A plover cursor 664 is movable through maze
66f1. The user attempts to advance cursor fi6.~ from start 666 to end 668. The
user i~ able to direct advancement of cursor fif,4 by touching, or penetratin«
msn~nuecl real ima~'e arn)w: t~7tl. 'f n: t)u<l:ic)n <)f ti)r users fin~_er
rnav ht
CIetCCIeCI. 1()i eXalllj)lt'.. i~l W :Illllll)~' I::ver~. C:~ e::i:)1()\'c:u
lli tile 1\'1iC'I)i ~C11W t)lCli lli
nHw ., ...~,.nm. ~r :..e~rv~, . ~wn,r=m rm,.a a , _ ~. , , , ~ ~ . , ,.. ...
....
CA 02306713 2000-OS-02
WO 9Si1958a PC"f1t7S95I11Q:~12
-27-
U.S. Patent No. 5,24$,856. In some cases it may also be useful for the user to
attach rings, reflectors, light or sound emitters, etc. to the fingers in
order to
. facilitate the interactive process. Additionally, it is also possible to
employ a
sou~d.detecting mechanism to allow the user to interact with a suspended image
by~local~ commands. A system such as the one used to produce the game
illuuu~ed in Figure 31 could also project a real image of a screen and a
keyboard
analogous to a conventional computer screen and keyboard.
From the foregoing, it should be quite apparent and evident how
the system and methodology of the present invention open the °important
doors"
referred to above for the creation of exciting, visually striking and
commanding,
volume-occupying composited and other images, including at least one projected
real image. The potential applications and fields of use are nearly as wide as
the
creative imagination. The numerous embodiments disclosed and discussed herein
show and suggest the various many ways in which optical elements and visual
r 15 sources can be combined, according to the invention, to achieve the kind
of
compositing on which this invention centers. We know, therefore, that other
specific arrangements of such components, well within the scope of this
invention,
will come to the minds of those skilled in the relevant art.
g _
