Note: Descriptions are shown in the official language in which they were submitted.
2a88~2
MET~IOD FOR COMPRESSING AND EXTENDING AN IMAGE BY
TRANSFORMING ORTHOGONA~LY AND ENCODING THE IMAGE
FIELD OF THE INVENTION
The invention rela-tes to a method for
compressing and extending an image by transforminy
orthogonally and encoding the image, and more
particularly to, and an evaluation method of an image
for ob-taining an objective standard in regard to block
distortion occurring at a block boundary of an image
which i~ transformed orthogonally and encoded.
BA~KGROUND OF THE INVENTION
In a conventional facsimile or television-
telephone set, transmission data is compressed and
",~
- encoded so that the data transmission amount is
decreased. As a method for compressing image data,
` an estimate encoding method and a transformation
encoding method are utili~ed conventionally. In the
estimate encoding method, a signal to be next supplied
is estimated in accordance with a signal which has been
- known by decoding an encoded signal, so that only a
signal component which is different in the estimation
from a correct signal is transmitted to decrease the
amount of information to be encoded.
In the transformat.ion encoding method, only
coefficients of components, signal electric power of
2~88~
which converges on a low frequency region, are encoded
to decrease the amount of information, because the
signal electric power of image signals having high
correlation is distribu-ted mainly on the low frequency
region. That is, the correlation of khe image
signals is positively utilized, so that higher
compression effect is obtained in the transformation
encoding method than in the estimate encoding method.
However, the amount of arithme-tic logic processes is
larger in the transformation encoding method than in
the estimate encoding method, so that the practical use
of the -transformation encoding method has been delayed
as compared to the estimate encoding method.
In accordance with the development of computer
technology, however, the calculation of orthogonal
` transformation required for the transformation encoding
method has been easy in these days, so that the
transformation encoding method has been widely used in
the encoding of images. As an orthogonal
transformation to a frequency region, DCT (discrete
cosine transformation) is considered to be most
effective fGr practical uses, because DCT is superior
in regard to electric pow~r converging on a low
frequency region and the process speed of calculation
algorithm. Among other orthogonal transformations
than DCT, slant -transformation, hurl transformation,
etc. can be used in encoding images.
~ 3 2~886~
According to the conventional image compression
method using DCT, however, there is a disadvantage in
that an optimum compression factor is difficult to be
set therein. That is, when coefficients are
coarsely quantized, a data compression factor becomes
large to deteriorate the quality oE image. In other
words, the process of the image compression is carried
out with hi~h speed, while block distortion which is
discontinuity at boundaries of blocks is generated in
reproducing images. On the other hand, when the
coefficients are finely quantized, the data compression
factor becomes small to decrease the block distortion,
while a high speed process is hindered, and the process
of pictures having fast motion is difficult to be
carried out.
Considering this disadvantage, a higher order
portion corresponding to a high frequency region is
coarsely quantized, and a lower order portion
corresponding to a low frequency region is finely
quantized, because an actual image does not include a
substantial amount of the high fre~uency component.
Consequently, the highly effective encoding of images
is carried out without lowering quality of the images.
It has been reported that block distortion which
is one of factors for deteriorating the quality of
reproduced images is sensed to be larger than random
interference by ten times.
L} ~88g~2
In spite of the above coarse and fine
quentization dependent on frequencies, a considerable
block distortion occurs visually, in case where an
original image includes a large amount of the high
frequency component. This iB applied to image
compression methods using transformation other than
DCT.
SUMMARY OF THE INVENTION
Accordingly, it is an object of the invention to
provide a method for compressing and extending an
image by transforming orthogonally and encoding the
image in which the quality of the image is adequately
evaluated in regard to block distortion with a low
calculation cost, and the visual sensation
characteristic of human beings is adequately reflected.
According to the invention, in a method for
compressing and extending an image by transforming
. orthogonally and encoding the image comprising the step
of compressing the image by a compression factor
determined as a result of an image evaluation of a
block having a predetermined number of pixels which is
obtained from the division of the image,
the method, comprising the steps of:
providing a block distortion standard at a
boundary between image blocks; and
correcting the compression factor in accordance
," ...... . .
2~8~6~
with -the bl.ock distortion standard.
BRIEF DESCRIPTION OF THE_DRAWINGS
The invention will be described in more detail
in conjunction with appended drawings, wherein:
Fig. 1 is a block diagram showing an image
compression appara-tus using DCT.
DESCRIP'rION OF THE PREFERRED_EMBODIMENT
The background of the invention will be
explained with reference to Fig. 1.
An image data compression apparatus using a
standard DCT comprises a transmitter (compression
circuit)l, a receiver (extension circuit) 2, and a
; 15 transmission line 3, wherein image data 10 which is
- divided into blocks each having 8 x 8 pixels (dots) is
supplied to the transmitter 1, and reproduced image
data 20 is supplied from the receiver 20
In the transmitter 1, the two dimensions DCT
2~ transformation is carried out for each block in
accordance wi-th the following transforma-tion equation
(1) .
Suv- ~ C~cv ~ ~ (r~y -Ls) c~s ~Z X-~ cos (2y~
x~ y~ - I ~ 1 6
2~888~
In the above equation (1~, x and y are positions
of a pixel, and u and v are positions of a DCT
coefficien-t, wherein CU and Cv are ~r~ , when u and v
are zero, Cu and Cv are 1, when u and v are other
values, Ls is 128, when a bi-t precision for a pixel
~ value Rxy i5 of 8 bits, and Ls is 2048, when the bit
; precision is of 12 bi-ts.
: As a result of -this transformation, 64
coefficients Suv are obtained in each block, among
which a coefficient Soo is called DC coefficient
indicating a mean value (direct current component) of
64 pixels in a block, while the remaining coefficients
are called AC coefficients. In accordance with this
transformation, 8 x 8 pixels of a block are defined by
a linear coupling of 64 ~CT fundamental vectors.
In this DCT transformation, electric power of
ordinary images is distributed mainly on a low
frequency region. By using this property, image
compression is realized to carry ou-t quantization in
: ~0 which a small number of bits are allocated to
coefficients of a low frequency component, and a large
: number of bits are allocated to coefficients of a high
frequency component.
The coefficient Suv is quantized at each
- 25 coefficient position in a step size different from
others by using a quantization table 4. When the
quantization is coarsely carried out by decreasing the
7 2 ~ 2
number of quantization levels, the amount of data can
be decreased. In this case, a data compression
factor becomes large, while the deterioration can not
be avoided in q-lality of images, if the coarse
quantization is made without any consideration. As
a result, discontinuity occurs at boundaries of blocks,
and error occurs due to the drop of data. Thus,
block distortion is increased in the quantization.
On the other hand, when the quantization is
finely carried out to result in the decrease of the
compression factor, the block distortion is decreased,
while the process of motion pictures having a large
amount of data is difficult to be carried out. In
fact, however, a high frequency component is not
included in actual images by a substantial amount.
In accordance with this tendency, the coarse
quantization is made in the DCT method for higher order
coefficients, and the fine quantization is made therein
for lower order coefficients. Consequent]y, the
encoding of data can be carried out with a high
efficiency, while the quality of images i~ not lowered.
Practically, the decision of a compression
factor is made in accordance with the selection of an
appropriate compression factor from plural compression
~5 factors by an operator. For this purpose,
quantization tables corresponding to plural compression
factors are accessed in a compression circuit -to
~ 2~8~
quantize coefficients of the transformation equation
tl)o At this time, almost all of the high frequency
component is dele-ted.
The quan-tized coefficients are encoded in
accordance with en-tropy encoding by using an encoding
table 5. For this purpose, Hoffman encoding method
is often used. Then, encoded data is transmitted
from the transmitter 1 via the transmission line 3 to
the receiver 2 together with a parameter including
information as to which table is used.
In the receiver 2, the encoded data is decoded
to provide the quantized data by referring to the
transmitted encoding table 5. The quantized data is
inversely quantized to provide the DCT coefficients by
lS referring to the transmit~ed quantization table 4.
In accordance with the property of the quantization,
completel~ original DCT coefficients are not restored.
In this sense, the DCT method is defined as a non-
invertible encoding method. Then, the DCT
coefficients are inversely transformed to the
reproduced image data 20 of blocks each having 8 x 8
pix~ls.
As described above, the original image data 10
is processed in the transmitter 1 to be the compression
data 30 in accordance with the orthogonal
transformation, the quanti~ation and the variable
length encoding, and the compression data 30 is
- ~ 2 ~
extended i.n the receiver 2 to provide the reproduced
. ima~e data 20 in accordance with the decoding, the
; inverse quant.ization and the i.nverse or-thogonal
transformation.
Next, a method for compressing and ex-tending an
: image by transforming orthogonally and encoding the
image of a preferred embodiment according to the
invention, in which the evaluation of the image is
carried out in -the apparatus shown in Fig. 1 in
` 10 accordance with the following steps.
1) Considering the non-linearity of visual
sensation on a stimulus.
The characteris-ti.c o~ the visual sensation on
: the stimulus of brightness is not linear. In ord.er
to measure an error in accordance with the sense of
human beings (not dependent on the level of
brightness)~ it is necessary to convert the level of
brightness to a level proportional to the visual
sensation characteristic of human beings. In
2~ gener~l, the visual sensation characteristic is
.~
~: appro~imately represented by the rules of Weber,
Fechner and Stevens. According to the rule of
Stevens, a brightness E for human beings to sense a
~ s-timulus I of brightness is represented by the
: 25 following equation (2).
E~ C~
1" 2~J~88~
where a and~ are constants, and ~ ranyes 0.3
to 0.5.
(2) Corlsidering the non-linearity of an image
display apparatus.
In general, images are displayed on a display
apparatus such as C~T, etc. Therefore, the
characteristic of the display apparatus is necessary to
be considered. An image on the display apparatus
becomes brigh-t dependen-t on a vol-tage applied to
electrodes thereof. A relation of the voltage V of
the elec-trodes and an illumination brightness is
represented by the following equation ~3).
where c and y are constants.
In accordance with the equation (3), the
equation (4) is obtained.
Yk ( I1C ) 7 (~
where Vk and Ik are values for V and I,
respectively. This is referred to as ~ correction.
A value of ~ is 2.2 to 2.8 for general CRT
display apparatus. In order to reproduce relative
, ~ .
'
2 ~
brigh-tness of original images on a CRT display
apparatus, the ~ correc-tion is necessary to be applied
to brigh-tness signals propor-tional to brightness of -the
original images. In this preEerred embodiment,
image sigrlals which are processed in advance by the
correction are used.
(3) Measuring an error of lightness
"Ligh-tness" is defined by a sense amount on a
brightness stimulus of human beings. An error e(m,
n) of a pixel(m, n) of a reproduced image relative to a
pixel (m, n) of an original image is defined by the
following equation (5).
e (nt, Il) = E~ ( Y (m" 7l.) ) ~ (171, tl) ) (5)
;
where m is a horizon-tal address of a pixel and
the first pixel on the 10ft side is represented by
(m=O), and n is a vertical address of the pixel and the
first pixel on the upper side is represented by (n=O).
A pixel on the right side of the pixel (m, n) is
represented by (m~1, n) and a pixel on the lower side
is represented by (m, n~1). X(m, n) is a briyhtness
signal level of a pixel (m, n) of an original image,
25 and Y(m, n) is a brightness signal level of a pixel (m,
n) of a reproduced image.
In the equation(5), E(v) is a conversion
12 2~8~62
function for converting a brightness signal level V of
an image to a blightrless. Image signals to be
processed are applied in advance with the r correction
relative to an illumina-tion brightness by the
equation(3), so -that an actual brightness is necessary
to be soucJIIt by applying the conversion (inverse r
correction) of the equation(3) to the image signal
level V. Further, the conversion of the equa-tion(2)
is necessary to be carried out -to obtain a relative
lightness which is sensed to this illumination
brightness by human beings.
Accordingly, E(v) is obtained from the
equations(2) and (3) as represented by the following
equation(6).
E ( T~ C ~ ~ (6)
As described before, if ~ is 0.3 to 0.5 and r
is 2.2 to 2.8, r ~ is 0.66 to 1.4. By assuming
this value to be "1", the equation(5) is replaced by
; the following equation(7), because E(v) is proportional
to V.
e (IJZ, J7,) = Y (m" rl) - X. (Itl, n) (7)
33 ~8~6~
(~3 Defining an error in consideration of the
discrimination -threshold characteristic rela-tive to a
liglltness of -the visual sensation.
The visual sensation of human beings keeps the
discrimination threshold characteristic relative to a
lightness, and an error less than a threshold value is
not sensed. Tllis is necessary to be considered to
measure an objec-tive error amount. ~n error e'(m, n)
in considera-tion of a discr;mination threshold relative
to a lightness of the visual sensation is defined by
the following equation (8).
~ e ~ ( m, ~a) ~ t ~ (7~,71) (~)
where the coefficient t i5 "1" (t=l), when an
error e(m, n) of a liyhtness of a pixel of a reproduced
image relative to a lightness of a pixel of an original
image is greater than K~}.[e~m, n)>Kt~], and the
coefficien-t t is O(t=O), when the error e(m, n) is
equal to or less than K-t~[e(m, n)<K-tll]. Here, K-tl~ is
a discrimination threshold value of human beings
relative to a lightness.
(5) Defining a standard o~ block distor-tion.
When the variation of errors between the
original image and -the reproduced image is continuous
2~8~2
1~ -
before and ater a boundary of blocks, no block
distortion occurs, even if an absolute value of the
errors is large. In o-ther wards, block distortion
occurs, when the errors are discontinuous at the
boundary.
The error varia-tion amount dh(m, n) between
horizontal adjacent pixels (m, n) and (m-l, n) in an
image, and the error variation amount dv(m, n) between
vertical adjacent pixels (m, n) and (m, n-l) in the
image are defined by the fol].owing equations (qa) and
(qb)-
;
15~7h (m, 7l) = e~ (m, 11) _ e~ (m - 1, n) ( 9 a )
( Itl ~ 1, n ;~ O )
d V ( 77~ , n) = e ~ ( m, n) - e ~ ( m , n - 1 )
(9 t~
( ~7~ ~ O, t7 ;~ 1 )
2~
A standard of block distor-tion at block
boundaries i5 obtained in self-multiplication of the
. ~ error variation amount a-t each block boundary and in an
average of the self-multiplication values by a side
length of the blocks. That is, a block dis-tor-tion
s-tandard ~h(k, 1) at a boundary of blocks(k, 1) and (k-
~8~
1, l) and a blocks dis-tortion standard qv~k, l) at a
boundary of blocks (k, l) and (k, l-l) are defined by
-the following equations(lOa) and (lOb).
~-1
~[tlll(M~,N~ 2 (1 0 ~)
q 1~ ( 1c, l ) = ~
N
( 1c ~ o
1 o
M--l
qu (k ~ -i (1 O b)
: llq
( ~ ~ o,
where k is a horizontal address of a block, and
the first block on the left side is represented by
?O (k=O), while l is a vertical address of the block, and
;~ the first block on the upper side is represen-ted by
(1=0). A block next on the right side to the
block(k, l) is (k, 1-~1), and a block next on the lower
~:'
side to the block(k, l) is (k, l+l). M is the number
of horizontal pixels in a block, and N is the number of
vertical pixels in the block.
(6) Ob-taining a block distortion standard in
:
2~g~
16
considera-tion of the variation~ruggedness) of
brightness.
A small error is neglected a-t a portion having a
large variation f brightness by human being eyes.
When the variation of brightness is large, a
block distortion amount i5 sensed to be smaller than an
actual value. Considering this -tendency, it is found
that the following equations(lla) to (llc) and (12a) to
(12c) are appropriate to provide block distortion
standards more proximate to the visual sensation
characteristic of human beings.
,~ qh (k, l~
q I ( lc I ) = ~ ( 1 1 a )
(1 ~ ~ 2 (1C, ~ 2 (1C- 1, I) )
l~ (1c,l) (1 1 b)
q~, (1c. 1)= ---
~2 (k~
?,~ 2(1c~ 2 ( k ~ I) )
,~
q ¦~ ( 1G, I) = q 1~ ( 1c, I) ~1 l c)
( (,r2(hC 1) <1 0 r a2(k- 1, I) <
where k i5 equal to or more than l(k>l) and l is
equal to or more than 0(1>0) in the equations (lla) to
(llc).
2~836~,
A qV ~1c, I)
Y u ( Ic 1) = -- ~ ( 1 2 ~ )
(1 ~; (J2 (1C, l) ~ (J2 (k 1~
q^ 1 1 ~ v ( Jc, 1) ( 1 2 b )
(J 2 (1C, I 1)
( 1 ~ cr2(1C 1~ CJ2 (1c, 1)
qt~(1c, 1)= ~v (k. 1) (1 2 c)
(~2(1C, I) ~1 0 r ~J2(k 1~
where k is equal to or more -than O(k>O) and l is
equal to or more than 1(1>1) in the equations (12a). to
(12c).
In the equatlons (lla) to (llc) and (12a) to
(12c), dispersion of brightness is used as parameters
representing the configuration of the brightness
variation. The dispersion ~ Z(k, l) of the visual
sensation brightness in a block(k, l) of the reproduced
image is defined by the following equation(l3).
~-l N-l
2 (1C, I) = ~, ~,, C-Y(A~f~ i, N~ (1c, I) ]
(1 3)
~ ' .
2 ~
1~ .
In the equati.on(l3), p(k, l) is a mean value of
-the visual sensation brightnesses in the block(k, 1) in
the reproduced image, and .is defined by the followlng
equation (1~1).
M--l N-l
~' ~, Y ( M~ -1 i, Nl .,. j )
P(k, I) ~
''
Using -the dispersion of brightness defined in
the equations(13) and (14) as parameters for the
variation of the brightness makes a calculation cost
low. The pxecision of a calculation result is
sufficiently met for a required level. The block
~- distortion standards obtained by the equations (lla) -to
(llc) and (12a) to (12c) used in the invention fully
considers the visual sensation characteristic of human
~ beings to adequately evaluate the image quality
; relating to the block distortion. Further, the
calculation process becomes easy, because the
dispersion of a low cost calculation is used.
In the apparatus as shown in Fig.l, a
quantizatation table 4 is adequately selected by using
the block distortion standards represented by the
19
equations (lla) to (llc) and (12a) to (12c~, and
compression and extension of an image are carried out
by the selected quan-tization table. Consequently,
the image compression having high efficiency can be
realized.
In the block distortion evaluation method as
explained above, the visual sensation of human beings
on a brightness stimulus, a voltage characteristic of
illumination brightness, the discrimination threshold
characteristic on lightness of the visual sensation,
etc. are considered, so that a standard for correct
image evaluation is obtained to select a compression
factor as a compression parameter, dependent on which a
quantization table is selected. Consequently, the
lS block distortion is decreasedj and the compression and
extension of images having a high compression factor is
carried out.
In the conventional method, however, the
increase of calculation cost occurs to make the process
impossible substantially, where a brightness variation
parameter is included therein. On the other hand,
the dispersion of brightness is used in the invention
in place of a theoretically faithful parameterl so that
the cost of calculation is decreased, and a calculated
value has a small error. Consequently, a correct
evaluation standard is obtained in the invention.
Although the invention has been described with
respect to specific embodiment for complete and clear
disclosure, the appended claims are not to be thus
: limited but are to be construed as embodying all
modification and alternative constructions that may
occur to one skilled in the art which fairly fall
within the basic teaching herein set forth.
. 15
~::
