Note: Descriptions are shown in the official language in which they were submitted.
CA 02361729 2001-10-25
-1-
SPECIFICATIONS
3D MULTIMEDIA VISUALIZATION SYSTEM
BACKGROUND OF THE INVENTION
This invention relates to the fields of stereo photography, stereoscopy,
virtual reality
and three dimensional visualization. These are already well known old subjects
and have many
applications, they are becoming more important to designers, engineers and
scientists due to the
need for better realization of three dimensional images in industrial designs,
architectural
designs, fashion design, web and tv commercials, robotics, medical imaging and
surgery, space
science and pilots training, air surveying, simulation, 3d video games, 3d
movies and many more
applications. The basic idea behind the subject is that each of our eyes sees
a slightly different
perspective view of the same three dimensional objects which enables us to
realize the third
dimension (depth). Different methods are being used to create the same three
dimensional
visualization using two dimensional images.
Stereo photography or stereography is the production of two images of the same
three
dimensional view or computer generated model from two different points
representing the left
eye and the right eye. At the time of viewing the two images are separated in
a way that each eye
sees only it's image at the correct position relative to the other image to
enable the three
dimensional visualization (Stereoscopy). The new existing methods have many
limitations, they
don't give clear full color images, cause head ache and eye fatigue due to
flickering images. The
major limitation that prevents the applications from spreading widely is the
high cost due to the
need for special expensive equipments; two cameras, two projectors, special
display screens and
special sophisticated electrical and electronic devices for alternation and
synchronization.
The old methods dealing with this subject were using simpler approach but
stopped from
developing since a long time. This new system can be considered as development
and
improvement of old methods to work with the existing technologies, it uses any
type of ordinary
available equipments and eliminates the need for two or special equipments at
any stage, the
new apparatuses are of very low manufacturing cost and don't require any high
tech electrical
or electronic parts.
CA 02361729 2001-10-25
-2-
BRIEF DESCRIPTION OF THE DRAWINGS
The following drawings form an essential part of this disclosure and are
important for
explaining the description and claims.
FIG. 1 : Vertical cross-sectional view of the stereo photography attachment.
35 FIG. 2 : Isometric view of the stereo photography attachment.
FIG. 3 : Horizontal cross-sectional view of the stereo photography attachment.
FIG. 4 : Vertical cross-sectional view of the stereo projection attachment.
FIG. 5 : Isometric view of the stereo projection attachment.
FIG. 6 : Back plan view of the dual stereo viewing apparatus for top and
bottom arrangement.
40 FIG. 7 : Back plan view of the dual stereo viewing apparatus for side by
side arrangement.
FIG.8 : Isometric view of the two parts (separated) of the dual stereo viewing
apparatus.
FIG. 9 : Schematic view showing the arrangement of the reflective surfaces for
the top and
bottom arrangement.
FIG.10 : Schematic view showing the arrangement of the reflective surfaces for
the side by side
45 arrangement.
FIG. l i : Schematic view describing the new method of changing the optical
path of the
stereoscopic images in the single eye stereo viewing apparatus.
FIG. I2 : Vertical cross-sectional view of the single eye stereo viewing
apparatus.
FIG. I3 : Front plan view of the single eye stereo viewing apparatus.
50 FIG.14 : Isometric view of the single eye stereo viewing apparatus.
DETAILED DESCRIPTION OF THE DISCLOSURE
3D MULTIMEDIA VISUALIZATION SYSTEM
In the following description and claims some repeated words have the following
meanings.
55 Image (images): Any still or moving visual information that can be seen by
human eyes;
presented, recorded or saved in any form.
Camera: Any type of camera or camera paint or view point in a computer
software that can be
used to produce the said image (images).
Display: Any device, screen or surface for presenting the said image (images)
to be seen by
60 human eyes.
CA 02361729 2001-10-25
-3-
(Paper printed visual information: book, magazine, newspaper or single
photograph.
Cathode ray tube (CRT), liquid crystal display (LCD), front or back projection
screen, flat
screen, said image (images) proj ected on any surface, computer monitor,
television, home
theater or movie theater).
65 Projector: Any type of front or back projector that can be used to present
the said image on any
type of screen or surface to be seen by human eyes.
(Movie theater (Cinema) projector, home theater projector, overhead projector,
slides
projector, projectors connected to computer or any video signal to project the
visual
information on any type of said display)
70 Reflective surface: Any type of optical reflective surface that can be used
to change the position
(optical path) of the said image (images).
(Mirrors, reflective sheets, plated reflective sheets or internal reflection
in prisms)
PRODUCTION
?5 There are various methods already known and used for producing stereoscopic
images.
The known apparatuses similar to the new apparatus in this system are known as
stereo
attachment, beam sputter, stereo adapter or 3d video adapter.
The new apparatus (Stereo Photography Attachment) comprises plurality of
reflective surfaces
1- 6 in a suitable casing preferably made of plastic or a light weight metal,
the apparatus is
80 attached or mounted in front of any type of camera as close as possible to
the lens.
The space in front of the lens 7 is divided at the center of the lens into two
equal halves
by a virtual plane 8 which contains the lens central axis or the camera
shooting line (axis ). One
half of the space is used to change the optical path of one stereoscopic image
by four reflective
85 surfaces 1- 4 as shown in FIG. l, the other half is used to change the
optical path of the other
stereoscopic image by two reflective surfaces 5 & 6 as shown in FIG. 3. With
this arrangement
of reflective surfaces the optical paths are changed along two different
perpendicular planes
(paths), which gives full control of the vertical and horizontal positions of
the two stereoscopic
images in front of the camera. The shift distance (displacement) is made the
same in the two
90 optical paths to maintain the same scale for the two stereoscopic images,
this is done by
CA 02361729 2001-10-25
accurately determining and using the correct distances between the reflective
surfaces in the
two optical paths at the design stage. FIG. 2 shows an isometric view of the
said apparatus.
The design and size of the apparatus depends on the size of the lens and the
camera vertical and
horizontal shooting angels B land e2. The apparatus is preferably designed for
the wider angel
95 in both directions in order to shoot images in both landscape and pornait
orientations, this is
done by rotating the camera 90 degrees around the line of sight.
The two stereoscopic images corresponding to the left and right eyes, whether
still or moving are
instantly transferred to the camera., one on top ofthe other in the correct
upright position and are
combined in one image which is instantly ready for stereo viewing by one of
the following
100 viewing apparatuses.
There are many factors that need to be taken into consideration for the
successful production,
displaying and viewing of stereoscopic images, such as the scale, the distance
between the two
lines of sight, known as the stereo base, the target point or the angle
between the two lines of
sight, the size and the relative position of the displayed images. To control
the factors (variables)
105 at the time of photography, at least one reflective surface in the first
optical path is made
adjustable to rotate around an axis such as 9 FIG. I which is parallel to the
lens 7 and
perpendicular to the virtual plane 8 , this adjustment controls the relative
horizontal position, the
target point and the angle between the two lines of sight. In the other
optical path at least one
reflective surface is made adjustable to rotate around an axis such as 10 FIG.
3 which is parallel
110 to the lens 7 and the virtual plane 8 and perpendicular to the said axis
9, this adjustment controls
the relative vertical position and the vertical shooting angle for different
zooming.
The advantages of this new apparatus are:
-It is used with only one camera of any type, for both still or moving images.
115 -The stereoscopic images are instantly captured in the correct upright
position as one
image which is ready for viewing in real time
-The captured stereoscopic images are one on top of the other (Top and Bottom
Arrangement) which gives wider images that are preferable and more comfortable
to
the human eyes.
120 -The apparatus captures images in both landscape and portrait orientations
CA 02361729 2001-10-25
-5-
-The proper color filters can be added in each optical path if the images are
intended to
be viewed by anaglyph (red & blue} eye glasses
-The apparatus is of very low manufacturing cost, basically thin mirrors and
plastic
125 This apparatus can be manufactured as a separate attachment or as part of
the camera. Different
designs or materials might be used according to the working conditions and the
type of
application. The adjustment mechanism and the adjusting pins (not shown in the
drawings) may
vary and can be made automatic with the camera zooming and focusing .
130 COMPUTER GENERATED IMAGES
The stereoscopic images can also be generated by computer, there are many
existing
computer programs (software) capable of producing perspective views and
stereoscopic images.
Once the three dimensional digital model is set up, the existing programs have
the tools to
control all the variables, the camera point (view point), the target point,
the camera specifications
135 and the output format and specifications, there are also some programs
that can automatically
produce the pair of said stereoscopic images.
The existing methods work with the two images separately in order to be
alternated and
polarized differently using the full area of the screen for each image at a
time, or using the odd
scan lines for one and the even scan lines for the other. This is why
additional hardware is
140 needed, liquid crystal shutters for the eyes or in front of the display
screen, and special video
cards and memory for alternation and synchronization to control the timing and
frequency
between the images and the shutters. With the additional hardware the final
three dimensional
images are not perfect due to the time limitations for displaying and
refreshing different images
on the same screen and for liquid crystals response time.
145 The new method in this 3d Multimedia Visualization System is the way in
which the two
stereoscopic images are displayed in real time or later, and the way in which
the images are
stored (saved). In said new method the two stereoscopic images in any stage of
drafting or their
final rendering outputs are displayed at the same time at different areas of
the same display
screen (real time), or recorded (saved) to be presented later as one unit in a
single image, slide
150 or frame as part of an animation or as one digital video file in any
format.
CA 02361729 2004-O1-26
-6-
PROJECTION / DISPLAYING
Since the two stereoscopic images corresponding to the left and right eyes,
which are
produced using the above stereo photography attachment, or generated by
computer (as
described in the above method) are combined in one image, they can be printed
or displayed
155 by all ordinary methods, however one factor might need adjustment at the
time of projection on
large screens. The horizontal distance on the screen between the projection of
the same points
behind the screen in the two stereoscopic images must not exceed the
horizontal distance between
the human eyes, which is between 60 to 70 mm and can be considered 65 mm. The
new
apparatus (Stereo Projection Attachment) controls this factor and has more
uses. The said
160 apparatus works as the reverse of the stereo photography attachment. It
comprises plurality of
reflective surfaces in a suitable casing. It is attached or mounted in front
of the projector's lens
IS at the closest possible distance to the lens, or manufactured as part of
the projector. FIG. 5
shows an isometric view of the said apparatus.
165 The space in front of the projector lens is divided at the center into two
equal halves by
a virtual plane perpendicular to the lens. One half of the space is used as
the optical path to
project one half of the image, which is the stereoscopic image corresponding
to one eye, by two
reflective surfaces 11 and 12, the other half of the space is used to project
the other half of the
image corresponding to the other eye, by two re$edive surfaces 13 and 14, as
shown in FIG. 4.
170 The shift distance (displacement) is made the same in the two optical
paths to maintain the same
scale for the two stereoscopic images. This is done by accurately determining
and using the
correct distances between the reflective surfaces in the two optical paths at
the design stage.
With this arrangement of reflective surfaces, the optical paths are changed
along two di$'erent
perpendicular planes (paths), which gives full control of the vertical and
horizontal positions of
175 the two stereoscopic images on the screen. One reflective surface in the
first optical path is made
adjustable to rotate around an axis such as 16 FIG. 4, which is parallel to
the lens and
perpendicular to the said virtual plane. One reflective surface in the other
optical path is made
adjustable to rotate around an axis such as 17 FIG. 5. The first adjustment
controls the relative
horizontal position of the two stereoscopic images and the horizontal distance
between the same
1&0 points in the two images on the screen. The second adjustmait controls the
relative vertical
CA 02361729 2001-10-25
-7-
position of the two stereoscopic images on the screen. The two adjustments are
also used to
correct any mistakes that are made at the time of photography. The projected
images whether
still or moving can be re-photographed after the correction to be projected
later without the
apparatus or to be displayed by other means.
185 Another important use of this apparatus (Stereo Projection Attachment) is
that it works with and
simplifies the existing methods. The two adjustments allow the projection of
the two
stereoscopic images to coincide over each other on the screen at the correct
position using only
one projector. By adding the proper color filters in each optical path at the
time of photography
or at the time of projection, the stereoscopic images can be viewed using the
anagiyph (red &
190 blue) eye glasses. The more preferable method is to add two polarizing
filters, one in each
optical path. The polarization is made in two different directions one
perpendicular to the other.
When the two stereoscopic images are projected to coincide over each other on
a silver or
aluminum screen which preserves the polarization or back projected on a screen
that preserve
the polarization, the images can then be viewed using the known 3d polarized
eye glasses. The
195 apparatus can also be used for the side by side arrangement of the
stereoscopic images by
rotating it 90 degrees around the lens axis.
The design and the size of the apparatus depends on the size of the
projector's lens, the distance
from the lens and the projection angle 83, in both the horizontal and vertical
directions.
200 The advantages of this new apparatus are:
-It is used with only one projector of any type, for both still or moving
images
-It gives full control of the relative position in both horizontal and
vertical directions
which enables the projection of stereoscopic images on different sizes of
screens and
205 the correction of photography mistakes
-It is used for projecting images for viewing by anaglyph or polarized eye
glasses or by
the following single eye viewing glasses
-It can be used for both (top and bottom) and (side by side) arrangements of
the
stereoscopic images
210 -The apparatus is of very low manufacturing cost
CA 02361729 2004-O1-26
_g_
VIEWING
This 3D Multimedia Visualization Syst~n also comprises new m~hods and
apparatuses
for viewing still or moving stereoscopic images. In addition to anaglyph and
polarized eye
glasses there are many apparatuses for viewing stereoscopic images known as
stereo viewers.
215 Some of the apparatuses are simply two lenses or two prisms mounted at a
fixed distance from
the stereoscopic images. Another apparatus is the liquid crystal shutter
glasses and the head
mounted virtual reality glasses that comprises two small (LCD) screens. The
new apparatuses
in this system are similar to what is known as mirrors stereoscope.
220 The first new viewing apparatus (Dual Stereo Viewing Apparatus) or simply
Dual Stereoscope,
consists of two equal parts sliding relative to each other along an inclined
combining plane
surface 18. Each part comprises two reflective surfaces 19, 20 parallel to
each other. Each part
is working as a single periscope for one eye. By sliding the two parts
relative to each other to one
end of the controlled movement, the apparatus is used for both arranganents
(top & bottom) FIG.
225 6 and (side by side) FIG. 7. An isometric view of the two parts
(separated) is shown in FIG. 8
The two stereoscopic images (single image produced as described before in the
production
section) are presented on the same display at the same time, each taking a
different area of the
display. The optical path is shifted differently for each eye to make the two
stereoscopic images
230 coincide over each other in front of the two eyes at the correct position
to enable the three
dimensional visualization.
FIG. 9 shows the arrangement of the reflective surfaces for the top and bottom
arrangement. The
shift distance (d) is made equal to one half of one image height which is
equal to one fourth of
the intended display height, the two stereoscopic images are shifted
vertically in opposite
23 S directions to coincide over each other at the required location in front
of the viewer's eyes.
FIG. 10 shows the arrangement the reflective surfaces for the side by side
arrangement. The
shift distance (d) is made equal to one half of one image width which is equal
to one fourth of
the intended display width, the two stereoscopic images are shifted
horizontally in opposite
directions to coincide over each other at the required location in front of
the viewer's eyes. This
240 arrangement of reflective surfaces is already used in the known mirrors
stereoscope.
CA 02361729 2001-10-25
-9-
With this apparatus (Dual Stereoscope), the plane of the shifted stereoscopic
images remains
parallel to the display. The position and the viewing of the shifted images is
not affected by
changing the distance between the apparatus and the display.
The size of the said apparatus depends on the size of the stereoscopic images,
the size can be
245 standardized or different sizes of the apparatus can be made for different
sizes of the display.
Another method for viewing different sizes is to make reflective surfaces 19
adjustable to
change the shift distance (d) according to the display size or to make either
reflective surfaces
19 or 20 adjustable to rotate by a small angle around an axis parallel to the
display screen as will
be described in the second viewing apparatus. The Dual stereoscope is suitable
for viewing from
250 small distances i.e. paper printed stereoscopic images, computer monitors
or any relatively small
display from relatively small distance. The said apparatus can be handheld,
head mounted, put
on as eye glasses, legs supported or fixed in front of the display depending
on the type of
application.
255 The advantages of this new apparatus are:
-It is used for both top and bottom and side by side arrangements
-It is used for many applications such as printed materials, TV, or computer
monitor
-The images are viewed in the best quality that the display can offer
-The images can be viewed from variable distances
260 -The apparatus is of very low manufacturing cost
The second new viewing apparatus uses a new method for changing the optical
path of
the stereoscopic images as shown in FIG. 11. The optical path is changed by
displacement {shift)
and rotation. One of the two reflective surfaces 21, 22 is allowed to rotate
(adjustable) around
265 an axis 27 FIG. 13 which is parallel to the plane of the stereoscopic
images. By rotating one of
the said reflective surfaces by an angle 84 from the parallel position, the
original image 23 is
changed to a new position 24. The apparatus that uses this method of
displacement (change of
optical path) is suitable for viewing relatively large stereoscopic images
from far distances. The
shift distance (D) is kept to minimum (20-40 mm) to reduce the size of the
said apparatuses.
270 Since small angles of rotation make big displacements at far distances,
this apparatus can be
CA 02361729 2001-10-25
-lU-
made in different designs and be used for various applications, it can be made
for one or two eyes
and can be used for both arrangements of the stereoscopic images. FIG.12 shows
a cross
sectional view of such apparatuses.
The new viewing apparatus (Single Eye Stereo Viewing Apparatus) or simply "3D
Single Eye
275 Glasses" comprises two reflective surfaces 21, 22, in a suitable casing
and protective glass 26.
In this apparatus the position of the image is changed for only one eye, the
other eye sees the
image normally as shown in FIG. 13. By adjusting the angle of rotation ~4, the
shifted / rotated
image coincides over the image that is seen normally by the other eye. The two
images don't
coincide exactly over each other, the changed image is rotated by the angle 84
and at a distance
280 (D) behind the other image as shown in FIG. 11. Since the shift distance
(D) and the angle 84
are relatively small, the human eyes and mind tend to combine the stereoscopic
images and
ignore such small variations. This ap~ratus can be used for both arrangements
by rotating the
part containing the two reflective surfaces 90 degrees around the line of
sight.
Since the displacement of the stereoscopic images for a certain angle depends
on the distance,
285 the axis of rotation of 84 must be parallel to the display to keep the
edges of the two images
parallel, this is required for viewers not directly facing the center of the
display, this is done by
allowing the two said reflective surfaces 21 & 22 to rotate (adjustable) as
one unit around an axis
23 FIG. 12 which is perpendicular to the said axis 27. The adjusting pins 24 &
25 for both
rotations (adjustments) are shown in FIG.12 and FIG. 13. This single eye
stereo viewing
290 apparatus can be called (3D Single Eye Glasses). This apparatus can be
head mounted or put on
as eye glasses, it is suitable for viewing stereoscopic images on TV screens,
home theaters,
presentation rooms and movie theaters. FIG. 14 shows an isometric view of this
new apparatus.
For movie theaters and presentation rooms with fixed seating the said
apparatus is preadjusted
and assigned to each seat.
295
The advantages of this apparatus are:
-It is used with many types of display screens without the need for
alternating images
-It is used for large groups of viewers from different positions
-It gives full clear color images
CA 02361729 2001-10-25
-11-
300 -It is small, lightweight and has no health concerns
-It can be used for both arrangements of the stereoscopic images
-The apparatus is of low manufacturing cost
After the proper displacement of the stereoscopic images, there are three
images in ftont
305 of the viewer, the middle one is the required three dimensional image.
When the size (area) of
the image is relatively small to the viewing distance or to the viewing
apparatus the viewer will
see the three images, which might cause confusion and make it hard for some
viewers to
concentrate on the middle image. Two methods can be used to filter (block) the
unneeded
images.
310
1- Polarization
The two stereoscopic images are polarized at the same time on the same display
screen
differently in two perpendicular directions by fixing polarizing sheets or
polarizing glass
at the surface of the display screen at the area of each image, similar
polarizing filters
315 in the same direction are added to the viewing apparatus in any position
in the optical
path and to the free eye glass 28, the polarizing filters work as normal 3d
polarized
glasses but only for blocking the unneeded images.
2- Optical Blocking
320 An adjustable diaphragm (adjustable in the direction of the displacement)
is added in the
optical path to limit the viewing opening to the size (area} of the middle
three
dimensional image.
For all apparatuses in this new system the casing can be made of plastic (PVC)
or any suitable
325 material depending on the type of application and the working conditions.
The adjustment
mechanism can vary according to the final design for each type of application.
Some
applications have special requirements due to certain limitations, the design
of photography,
display and viewing apparatuses can be adjusted to satisfy such special
requirements using the
techniques and methods described in this disclosure.
