Language selection

Search

Patent 2453122 Summary

Third-party information liability

Some of the information on this Web page has been provided by external sources. The Government of Canada is not responsible for the accuracy, reliability or currency of the information supplied by external sources. Users wishing to rely upon this information should consult directly with the source of the information. Content provided by external sources is not subject to official languages, privacy and accessibility requirements.

Claims and Abstract availability

Any discrepancies in the text and image of the Claims and Abstract are due to differing posting times. Text of the Claims and Abstract are posted:

  • At the time the application is open to public inspection;
  • At the time of issue of the patent (grant).
(12) Patent: (11) CA 2453122
(54) English Title: A METHOD FOR SPEECH CODING, METHOD FOR SPEECH DECODING AND THEIR APPARATUSES
(54) French Title: METHODE DE CODAGE ET LE DECODAGE DE LA PAROLE ET APPAREILS CONNEXES
Status: Expired
Bibliographic Data
(51) International Patent Classification (IPC):
  • G10L 19/12 (2013.01)
(72) Inventors :
  • YAMAURA, TADASHI (Japan)
(73) Owners :
  • RESEARCH IN MOTION LIMITED (Canada)
(71) Applicants :
  • MITSUBISHI DENKI KABUSHIKI KAISHA (Japan)
(74) Agent: RIDOUT & MAYBEE LLP
(74) Associate agent:
(45) Issued: 2010-03-09
(22) Filed Date: 1998-12-07
(41) Open to Public Inspection: 1999-07-08
Examination requested: 2004-01-23
Availability of licence: N/A
(25) Language of filing: English

Patent Cooperation Treaty (PCT): No

(30) Application Priority Data:
Application No. Country/Territory Date
9/354754 Japan 1997-12-24

Abstracts

English Abstract

Speech coding is produced according to a code-excited linear prediction (CELP) speech coding method. A plurality of excitation codebooks storing time series vectors with various noise levels is provided. A noise level of a speech in a concerning coding period is evaluated by using a code or coding result of at least one of spectrum information, power information, and pitch information. One of a plurality of excitation codebooks is selected based on an evaluation result. A noise level of time series vectors output from the excitation codebooks is changed based on the evaluation result of the noise level of the speech. A first excitation codebook storing a noise time series vector and a second excitation codebook storing a non-noise time series vector is provided. A time series vector is generated by adding the time series vector in the first excitation codebook and the time series vector in the second excitation codebook by weighting based on the evaluation result of the noise level of the speech.


French Abstract

On produit un codage de la parole selon une méthode de prévision linéaire à excitation par code (CELP). € cet effet, on prévoit une pluralité de tables à codes d'excitation sauvegardant des vecteurs de séries chronologiques de diverses intensités sonores. L'intensité sonore de la parole dans une section de codage est évaluée en utilisant un code ou un résultat de codage d'au moins un code d'information spectral, un code d'information d'énergie ou un code d'information du pas. Une table à codes d'excitation parmi une pluralité est sélectionnée selon un résultat d'évaluation. L'intensité sonore des vecteurs de séries chronologiques découlant des tables à codes d'excitation est modifiée selon le résultat d'évaluation de l'intensité sonore de la parole. Une première table à codes d'excitation sauvegardant un secteur de séries chronologiques sonores et une deuxième table à codes d'excitation sauvegardant un secteur de séries chronologiques non sonores. Un secteur de séries chronologiques est généré en ajoutant le vecteur de séries chronologiques dans la première table à codes d'excitation et le vecteur de séries chronologiques dans la deuxième table à codes d'excitation en pondérant selon le résultat d'évaluation de l'intensité sonore de la parole.

Claims

Note: Claims are shown in the official language in which they were submitted.



24
Claims

1. A speech decoding method according to code-excited linear prediction (CELP)

wherein the speech decoding method receives a coded speech including a linear
prediction parameter code and an adaptive code, and a gain code, and
synthesizes a
speech using at least an excitation codebook, the speech decoding method
comprising:

obtaining an adaptive code vector from an adaptive codebook based on the
received adaptive code;

obtaining a time series vector with a noise level from the excitation codebook

based on the excitation code; decoding a gain of the adaptive code vector and
a gain of
the time series vector from the gain code;

determining whether modification of the time series vector is necessary;

if modification of the time series vector is determined to be necessary,
modifying the time series vector such that the density of zero-amplitude
samples is
changed as a function of whether the coded speech is voiced or unvoiced;

weighting the adaptive code vector and the time series vector using the
decoded
gains as weights;

adding together the weighted adaptive code vector and the weighted time series

vector;

decoding a linear prediction parameter from the received linear prediction
parameter code; and

synthesizing a speech using the linear prediction parameter and the addition
result.

Description

Note: Descriptions are shown in the official language in which they were submitted.



CA 02453122 2004-01-23

1
A Method for Speech Coding, Method for Speech Decoding and their Apparatuses

This is a division of co-pending Canadian Application No. 2,315,699
filed on December 7, 1998.
Technical Field
This invention relates to methods for speech coding and decoding and
apparatuses for speech coding and decoding for pe:rforming compression coding
and decoding of a speech signal to a digital signal. Particularly, this
invention

relates to a method for speech'coding, method for speech decoding, apparatus
for speech coding and apparatus for speech decoding for reproducing a high
quality speech at low bit rates.

Background Art

In the related art, code-excitecl linear prediction (Code-Excited Linear
Prediction: CELP) coding is well-known as an ef&cient speech coding method,
and its technique is described in "Code-excited linear prediction (CELP): High-

quality speech at very low bit rates," ICASSP '85, pp. 937 - 940, by M. R.
Shroeder and B. S. Atal in 1985.

Fig. 6 ill.ustrates an example of a whole configuration of a CELP speech
coding and decoding method. In Fig. 6, an encoder 101, decoder 102,
multiplexing means.103, and dividing.means 104 are illustrated.

The encoder 101 includes a linear prediction parameter analyzing
means 105, linear prediction parameter coding means 106, synthesis fil.ter
107,
adaptive codebook 108, excitation codebook 109, gain coding means 110,

distance calculating means 111, and weighting-adding means 138. The


CA 02453122 2004-01-23

2
decoder 102 includes a linear prediction parameter decoding means 112,
synthesis filter 113, adaptive codebook 114, excitation codebook 115, gain
decoding means 116, and weighting-adding means 139.

In CELP speech coding, a speech in a frame of about 5 - 50 ms is
divided into spectrum information and excitation information, and coded.
Explanations are made on operations in the CELP speech coding

method. In the encoder 101, the linear prediction parameter analyzing means
105 analyzes an input speech S101, and extracts a linear prediction parameter,
which is spectrum information of the speech. The linear prediction parameter

coding means 106 codes the linear prediction paraaneter, and sets a coded
linear prediction parameter as a coefficient for the synthesis filter 107.
Explanations are made on coding of excitation information.

An old excitation signal is stored in the adaptive codebook 108. The
adaptive codebook 108 outputs a time series vector, corresponding to an
adaptive code inputted by the distance calculator 111, which is generated by
repeating the old excitation signal periodically.

A plurality of time series vectors trained by reducing a distortion
between a speech for training and its coded speech for example is stored in
the
excitation codebook 109. The excitation codebook 109 outputs a time series

vector corresponding to an excitation code inputted by the distance calculator
111.

Each of the time series vectors outputted from the adaptive codebook
108 and excitation codebook 109 is weighted by using a respective gain.
provided by the gain coding means 110 and added by the weighting-adding

means 138. Then, an addition result is provided to the synthesis filter 107 as


CA 02453122 2004-01-23

3
excitation signals, and a coded speech is produced. The distance calculating
means 111 calculates a distance between the coded speech and the input
speech S10I, and searches an adaptive code, excitation code, and gains for
minimizing the distance. When the above-stated coding is over, a linear

prediction parameter code and the adaptive code, excitation code, and gain
codes for minimizi.ng a distortion between the input speech and the coded
speech are outputted as a coding result.

Explanations are made on operations in the CELP speech decoding
method.

In the decoder 102, the linear predictior.d parameter decoding means
112 decodes the linear prediction parameter code to the li.near prediction
parameter, and sets the linear prediction paranieter as a coefficient for the
synthesis filter 113. The adaptive codebook 114 outputs a time series vector
corresponding to an adaptive code, which is generated by repeating an old

excitation signal periodically. The excitation codebook 115 outputs a time
series vector corresponding to an excitation code. The time series vectors are
weighted by using respective gains, which are decoded from the gain codes by
the gain decoding means 116, and added by the `veighting-adding means 139.
An addition result is provided to the synthesis filter 113 as an excitation
signal,
and an output speech S103 is produced.

Among the CELP speech coding and decoding method, an improved
speech coding and decoding method for reproducing a high quality speech
according to the related art is described in "Phonetically - based vector
excitation coding of speech at 3.6 kbps," ICASSP '89, pp. 49 - 52, by S. Wang
and A. Gersho in 1989.


CA 02453122 2004-01-23

4
Fig. 7 shows an example of a whole configuration of the speech coding
and decoding method according to the related art, and same signs are used for
means corresponding to the means in Fig. 6.

In Fig. 7, the encoder 101 includes a speech state deciding means 117,
excitation codebook switching means 118, first excitation codebook 119, and
second excitation codebook 120. The decoder 102 includes an excitation
codebook switching means 121, first excitation codebook 122, and second
excitation codebook 123.

Explanations are made on operations in the coding and decoding
method in this configuration. In the encoder 101, the speech state deciding
means 117 analyzes the input speech S101, and decides a state of the speech is
which one of two states, e.g., voiced or unvoiced_ The excitation codebook
switching means 118 switches the excitation codebooks to be used in coding
based on a speech state deciding result. For exaniple, if the speech is
voiced,

the first excitation codebook 119 is used, and if the speech is unvoiced, the
second excitation codebook 120 is used. Then, the excitation codebook
switching means 118 codes which excitation codebook is used in coding.

In the decoder 102, the excitation codebook switching means 121
switches the first excitation codebook 122 and the second excitation codebook
123 based on a code showing which excitation. codebook was used in the

encoder 101, so that the excitation codebook,. wh.ich was used in the encoder
101, is used in the decoder 102. According to this configuration, excitation
codebooks suitable for coding in various speech states are provided, and the
excitation codebooks are switched based on a state of an input speech. Hence,
a high quality speech can be reproduced.


CA 02453122 2004-01-23

A speech coding and decoding method of switching a plurahty of
excitation codebooks without increasing a transmLission bit number according
to the related art is disclosed in Japanese Unexamined Published Patent
Application ,8 - 185198. The plurality of excitation codebooks is switched

5 based on a pitch frequency selected in aii adaptive codebook, and an
excitation
codebook suitable for characteristics of an input speech can be used without
increasing transmission data.

As stated, in the speech coding and decoding method illustrated in Fig.
6 according to the related. art, a single excitation codebook is used to
produce a
synthetic speech. Non-noise time series vectors with many pulses should be

stored in the excitation codebook to produce a high quality coded speech even
at low bit rates. Therefore, when a noise speech, e.g., background noise,
fricative consonant, etc., is coded and synthesized, there is a problem that a
coded speech produces an unnatural sound, e.g., "Jiri-Jiri" and "Chiri-Chiri."

This problem can be solved, if the excitation codebook includes only noise
time
series vectors. However, in that case, a quality of the coded speech degrades
as a whole.

In the improved speech coding and decoding method illustrated in Fig.
7 according to the related art, the plurality of excitation codebooks is
switched
based on the state of the input speech for producing a coded speech.

Therefore, it is possible to use. an excitation codebook including noise time
series vectors in an unvoiced noise period of the input speech 'and an
excitation
codebook including non-noise time series vectors in a voiced period other than
the unvoiced noise period, for example. Hence, even if a noise speech is coded

and synthesized, an unnatural sound, e.g., "Jiri-Jiri," is not produced.


CA 02453122 2008-08-11

6
However, since the excitation codebook used in coding is also used in
decoding, it
becomes necessary to code and transmit data which excitation codebook was
used. It
becomes an obstacle for lowing bit rates.

According to the speech coding and decoding method of switching the plurality
of excitation codebooks without increasing a transmission bit number according
to the
related art, the excitation codebooks are switched based on a pitch period
selected in
the adaptive codebook. However, the pitch period selected in the adaptive
codebook
differs from an actual pitch period of a speech, and it is impossible to
decide if a state
of an input speech is noise or non-noise only from a value of the pitch
period.

Therefore, the problem that the coded speech in the noise period of the speech
is
unnatural cannot be solved.

This invention was intended to solve the above-stated problems. Particularly,
this invention aims at providing speech coding and decoding methods and
apparatuses
for reproducing a high quality speech even at low bit rates.



CA 02453122 2008-08-11
7
Disclosure of the Invention

In order to solve the above-stated problems, in a speech coding method
according to this invention, a noise level of a speech in a concerning coding
period is
evaluated by using a code or coding result of at least one of spectrum
information,

power information, and pitch information, and one of a plurality of excitation
codebooks is selected based on an evaluation result.


CA 02453122 2008-08-11

8
In accordance with one aspect of the present invention there is provided a
speech decoding method according to code-excited linear prediction (CELP)
wherein
the speech decoding method receives a coded speech including a linear
prediction
parameter code and an adaptive code, and a gain code, and synthesizes a speech
using

at least an excitation codebook, the speech decoding method comprising:
obtaining an
adaptive code vector from an adaptive codebook based on the received adaptive
code;
obtaining a time series vector with a noise level from the excitation codebook
based on
the excitation code; decoding a gain of the adaptive code vector and a gain of
the time
series vector from the gain code; determining whether modification of the time
series

vector is necessary; if modification of the time series vector is determined
to be
necessary, modifying the time series vector such that the density of zero-
amplitude
samples is changed as a function of whether the coded speech is voiced or
unvoiced;
weighting the adaptive codebook vector and the time series vector using the
decoded
gains as weights; adding together the weighted adaptive codebook vector and
the

weighted time series vector; decoding a linear prediction parameter from the
received
linear prediction parameter code; and synthesizing a speech using the linear
prediction
parameter and the addition result.


CA 02453122 2008-08-11

9
In accordance with another aspect of the present invention there is provided a
speech decoding apparatus according to code-excited linear prediction (CELP)
wherein
the speech decoding apparatus receives a coded speech including a linear
prediction
parameter code, an excitation code, an adaptive code, and a gain code, and
synthesizes

a speech using at least an excitation codebook, the speech decoding apparatus
comprising: a time series vector modulator for: obtaining an adaptive code
vector
from an adaptive codebook based on the received adaptive code; obtaining a
time
series vector with a noise level from the excitation codebook based on the
excitation
code; decoding a gain of the adaptive code vector and a gain of the time
series vector

from the gain code; and determining whether modification of the time series
vector is
necessary and for modifying the time series vector such that the density of
zero-
amplitude samples is changed as a function of whether the coded speech is
voiced or
unvoiced if modification of the time series vector is determined to be
necessary; and a
speech synthesizer for: weighting the adaptive codebook vector and the time
series

vector using the decoded gains as weights; adding together the weighted
adaptive
codebook vector and the weighted time series vector; decoding a linear
prediction
parameter from the received linear prediction parameter code; and synthesizing
a
speech using the addition result.


CA 02453122 2008-08-11

Brief Description of the Drawings

Fig. 1 shows a block diagram of a whole configuration of a speech coding and
speech decoding apparatus in embodiment 1 of this invention.

Fig. 2 shows a table for explaining an evaluation of a noise level in
5 embodiment 1 of this invention illustrated in Fig. 1.

Fig. 3 shows a block diagram of a whole configuration of a speech coding and
decoding apparatus in embodiment 3 of this invention.

Fig. 4 shows a block diagram of a whole configuration of a speech coding and
speech decoding apparatus in embodiment 5 of this invention.

10 Fig. 5 shows a schematic line chart for explaining a decision process of
weighting in embodiment 5 illustrated in Fig. 4.

Fig. 6 shows a block diagram of a whole configuration of a CELP speech


CA 02453122 2004-01-23

11
coding and decoding apparatus according to the related art.

Fig. 7 shows a block diagram of a whole configuration of an improved
CELP speech coding and decoding apparatus according to the related art

Best Mode for Carrying C)ut the Invention

Explanations are made on embodiments of this invention with reference to
drawings.

Effibodiment 1.

Fig. 1 illustrates a whole configuration of a speech coding.method and
speech decoding method in embodiment 1 according to this invention. In Fig.
1, an encoder 1, a decoder 2, a multiplexer 3, and. a divider 4 are
illustrated.

The encoder 1 includes a linear prediction parameter analyzer 5, linear
prediction parameter encoder 6, synthesis filter 7, adaptive codebook 8, gain
encoder 10, distance calculator 11, first excitation codebook 19, second
excitation codebook 20, noise level evaluator 24, excitation codebook
switch.25,

15, and weighting-adder 38. The decoder 2 includes a linear prediction
parameter decoder 12,. synthesis filter 13, adaptive codebook 14, first
excitation
codebook 22, second excitation codebook 23, noise level evaluator 26,
excitation
codebook switch 27, gain decoder 16, and weighting-adder. 39. In Fig. 1, the
linear prediction parameter analyzer 5 is a spectrum information analyzer for

analyzing an input speech S1 and extracting a linear prediction parameter. .
which is spectrum information of-the speech.. The linear prediction parameter
encoder 6 is a spectrum information encoder for coding the linear prediction
parameter, which is the spectrum information and setting a coded linear
prediction parameter as a coefficient for the synthesis filter 7. The first

excitation, codebooks 19 and 22 store pluralities of non-noise time series
vectors,


CA 02453122 2004-01-23

12
and the second excitation codebooks 20 and 23 store pluralities of noise time
series vectors. The noise level evaluators 24 and 26 evaluate a noise level,
and the excitation codebook switches 25 and 27 switch the excitation codebooks
based on the noise level.

Operations are explained.

In the encoder 1, the linear prediction parameter analyzer 5 analyzes
the input speech S1, and extracts a linear prediction parameter, which is
spectrum information of the speech. The linear prediction parameter encoder
6 codes the linear prediction parameter. 'Phen, the linear prediction

parameter encoder 6 sets a coded linear prediction parameter as a coefficient
for the synthesis filter 7, and also outputs the coded linear prediction
parameter to the noise level evaluator 24.

Explanations are made on coding of excitation information.

An old excitation signal is stored in the adaptive codebook 8, and a time
series vector corresponding to an adaptive cocle inputted by the distance
calculator 11, which is generated by repeating an old excitation signal
periodically, is outputted. The noise level evaluaLtor 24 evaluates a noise
level
in a concerning coding period-based on the coded linear prediction parameter
inputted by the linear, prediction parameter encoder 6 and the adaptive code,

e.g., a spectrum gradient, short-term prediction gain, and pitch fluctuation
as
shown in Fig. 2, and outputs an evaluation result to the excitation codebook
switch 25. The excitation codebook switch 25 switches excitation codebooks
for coding based on the evaluation result of the noise level. For example, if
the noise level is low, the first excitation codebook 19 is used, and if the
noise
level is high, the second excitation codebook 20 is 'used.


CA 02453122 2004-01-23

13
The first excitation codebook 19 stores a. plurality of non-noise time
series vectors, e.g., a plurality of time series vectors trained by reducing a
distortion between a speech for training and its coded . speech. The second
excitation codebook 20 stores a pluraiity of noise time. series vectors, e.g.,
a

plurality of time series vectors generated from random noises. Each of the
first excitation codebook 19 and the second excitation codebook 20 outputs a
time series vector respectively corresponding to an excitation code inputted
by
the distance calculator 11. Each of the time series vectors from the adaptive
codebook 8 and one of first excitationcodeba k .19 or second excitation

codebook 20 are weighted by using a respective gain provided by. the gain
encoder 10, and added by the weighting-adder 38. An addition result is.
provided to the synthesis filter 7 as excitation signals, and a coded speech
is
produced. The distance calculator 11 calculates a distance between the coded
speech and the input speech il, and searches an adaptive code, excitation
code,

and gain for minimizing the distance. When this coding is over, the linear
prediction parameter code and an adaptive code, e:xcitation code, and gain
code
for minimizing the distortion between the input speech and the coded speech
are outputted as a coding result S2. These are characteristic. operations in
the
speech coding method in embodiment 1.

Explanations are made on the decoder 2. In the decoder 2, the linear
prediction parameter decoder. 12 decodes the.linear prediction parameter code
to the linear prediction parameter, and sets the decoded linear prediction
parameter as a coefficient for the synthesis filter :13, and outputs the
decoded
linear prediction parameter to the noise level evaluator 26.

Explanations are made on decoding of excitation information. The


CA 02453122 2004-01-23

14
adaptive codebook 14 outputs a time series vector corresponding to an adaptive
code, which is generated by repeating an old excitation signal periodically.
The noise level evaluator 26 evaluates a noise level. by using the decoded
liriear
prediction parameter inputted by the linear prediction parameter decoder 12

and the adaptive code in a..same method with the noise level evaluator 24 in
the encoder 1, and outputs an evaluation result to the excitation codebook
switch 27. The excitation codebook switch 27 switches the first excitation
codebook 22 and the second excitation codebook 23 based on the evaluation
result of the noise level in a same method with the excitation codebook switch
25 in the encoder I.

A plurality of non-noise time series vecto:rs, e.g., a plurality of time
series vectors generated by training for reducing a distortion between a
speech
for training and its coded speech, is stored in the first excitation codebook
22.
A plurality of noise time series vectors, e.g., a plurality of vectors
generated

from random noises, is stored in the second excitation codebook 23. Each of
the first and second excitation codebooks outputs a time series vector
respectively corresponding to an excitation code. The time series vectors from
the adaptive codebook 14 and one of first excitation codebook 22 or second
excitation codebook 23 are weighted by using respective gains, decoded from

gain codes by the gain decoder 16, and added by the weighting-adder 39. An
addition result.is provided.to the synthesis filter 13 as an excitation
signal, and
an output speech S3 is produced. These are operations are characteristic
operations in the speech decoding method in embodiment 1.

In embodiment 1, the noise level of the input speech is evaluated by
using the code and coding result, and various excitation codebooks are used


CA 02453122 2004-01-23

based on the evaluation result. Therefore, a high quality speech_ can be
reproduced with a small data amount.

In embodiment 1, the plurality of time series vectors is stored in each of
the excitation codebooks 19, 20, 22, and 23. However, this ern.bodiment can be
5 realized as far as-at- least a time series vector is stored in each of the
excitation
codebooks.

Embodiment 2.

In embodiment 1, two excitation codebooks are switched. However, it
is also possible that three or more excitation codebooks are provided and
10 switched based on a'noise level.

In embodiment 2, a suitable excitation codebook can be used even for a
medium speech, e_g., slightly noisy, in* addition to two k.inds of speech,
i.e.,
noise and non-noise. Therefore, a high quality speech can be reproduced.
Embodiment 3.

15 Fig. 3 shows a whole configuration of a speech coding method and
speech decoding method in embodiment 3 of this invention. In Fig.. 3, same
signs are used for units corresponding to the units in Fig. 1. In Fig. 3,
excitation codebooks 28 and 30 store noise time series vectors, and samplers
29
and 31 set an, amplitude value of a sample with a low amplitude in the time
series vectors to zero.

Operations _are explained: ._ In the encoder. _ 1, the linear prediction
parameter analyzer 5 analyzes the input speech Si, and extracts a linear
prediction parameter, which is spectrum information of the speech. The
linear prediction parameter encoder 6 codes the liriear prediction parameter.

Then; the linear prediction parameter encoder 6 sets a coded linear prediction


CA 02453122 2004-01-23

16
parameter as a coefficient for the synthesis filter 7, and also outputs the
coded
linear prediction parameter to the noise level evaluator 24.

Explanations are made on coding of excitation information: An old
excitation signal.is stored in the adaptive codebook 8, a.nd a time series
vector
corresponding -to- an adaptive code inputted by the distance calculator 11,

which is generated by repeating an old excitation signal periodically, is
outputted. The noise level evaluator 24 evaluates a noise level in a
concerning coding period by using the coded linear prediction parameter, which
is inputted from the. linear prediction parameter encoder 6, and an adaptive

code, e.g., a spectrum gradient, short-term prediction gain, and pitch
fluctuation, and outputs an evaluation result to the sampler 29.

The excitation codebook 28 stores a plurality of time.series vectors
generated from random noises, for example, and outputs a time series vector
corresponding to an excitation code inputted. by the distance calculator 11.
If

the noise level is low in the evaluation result af the noise, the sampler 29
outputs a time series vector, in which an amplitude of a sample with an
amplitude below a determined value in the time series vectors, inputted from
the excitation codebook 28, is.set to zero, for example. If the noise level is
high, the sampler 29 outputs the time series vector inputted froni the

.20 excitation codebook 28 without modification. Each of the times series
vectors
from the adaptive codebook .8 and the sampler. 29 is weighted by using a
respective gain provided by the gain encoder 10 and added by the weighting-
adder 38. An addition result is provided to the synthesis filter 7 as
excitation
signals, and a coded speech is. produced. The distance calculator 11
calculates

26. a distance between the coded speech and the input speech S1, and searches
an


CA 02453122 2004-01-23

17
adaptive code, excitation code, and gain for min]"iffiizing the distance. When
coding is over, the linear prediction parameter code and the adaptive code,
excitation code, and gain code for minimizing a distortion between the input
speech and the coded spesch are outputted as a coding result S2. These are
characteristic operations in the speech coding method in embodiment 3.

Explanations are made on the decoder 2. In the decoder 2, the linear
prediction parameter decoder 12 decodes the linear prediction parameter code
to the linear prediction parameter. The linear prediction parameter decoder
12 sets the linear, prediction parameter as a coefficient for the synthesis
filter

13, and also outputs the linear prediction parameter to the noise level.
evaluator 26.

Explanations are made on decoding of excitation information. The
adaptive codebook 14 outputs a time series vector corresponding to an adaptive
code, generated by repeating an old excitation signal periodically. The noise

level evaluator 26 evaluates a noise - level by using the - decoded linear
prediction parameter inputted from the linear prediction parameter decoder 12
and the adaptive code in a same method with the noise level evaluator 24 in
the encoder 1, and outputs an evaluation result to the sampler 31.

The excitation codebook 30 outputs a time series vector corresponding
to an excitation code. The sampler 31 outputs a. time series vector based on
the evaJuation result of the noise level. in same processing with the sampler
29
in the encoder 1. Each of the time series vectors outputted from the adaptive
codebook 14- and sampler 31 are weighted by using a respective gain provided
by the gain decoder 16, and added by the weighting-adder 39. Aiz addition

result is provided to the synthesig filter 13 as an excitation signal, and an


CA 02453122 2004-01-23

18
output speech S3 is produced.

In embodiment 3, the excitation codebook storing noise time series
vectors is provided, and an excitation with a low noise level can be generated
by sampling excitation signal samples based on an evaluation result of the

noise level the speech. Hence, a high quality speech can be reproduced with a
small data amount. Further, since it is not necessary to provide a plurali.ty
of
excitation codebooks, a memory amount for storing the excitation codebook can
be reduced.

Embodiment 4.

In embodiment 3s the samples in the tinne series voctors are either
sampled or not. However, it is also possible to change a threshold value of an
amplitude for sampling the samples based on the noise level. In embodiment
4, a suitable time series vector can be generated and used also for a medium
speech, e.g., slightly noisy, in addition to the two types of speech, i.e.,
noise and
non-noise. Therefore, a high quality speech can be reproduced.

Embodiment 5.

Fig. 4 shows a whole configuration of a speech coding method and a
speech decoding method iri embodiment 5 of this invention, and same signs are
used for units corresponding to the units in Fig. 1.

. In Fig. 4, first excitation codebooks 32 arLd 35 store noise time series
vectors, and second excitation codebooks 33.and 36 store non-noise time series
vectors. The weight determiners 34 and 37 are also illustrated.

Operations are explained. . In the encoder 1, the linear prediction
parameter analyzer 5 analvzes the input speech S1; and extracts a linear
prediction parameter, which is spectrum information of the speech. The


CA 02453122 2004-01-23

19
linear prediction parameter encoder 6 codes the linear prediction parameter.
Then, the linear prediction parameter encoder 6 sets a coded linear prediction
parameter as a coefficient for the synthesis filter 7, and also outputs the
coded
prediction parameter to the noise level evaluator 24.

Explanations are made on coding of e:xcitation information. The
adaptive codebook 8 stores an old excitation signal, and outputs a time series
vector corresponding to an adaptive code inputted by the distance calculator
11,
which is generated by repeating an old excitation signal periodically. The
noise level evaluator 24 evaluates a noise level in a concerning coding period
by

using the coded linear prediction parameter, which is inputted from the linear
prediction parameter encoder 6 and the adaptive code, e.g., a spectrum
gradient, short-term prediction gain, and pitch fluctuation, and outputs an
evaluation result to the weight determiner 34.

The first excitation codebook 32 stores a plurality of noise time series
vectors generated from random noises, for example, and outputs a time series
vector corresponding to an excitation code. The second excitation codebook 33
stores a plurality of time series vectors generated by training for reducing a
distortion between a speech for training and its coded speech, and outputs a
time series vector corresponding to an excitation code inputted by the
distance

calculator 11. The weight determiner 34 determines a weight provided to the
time series vector from tl~ie first excitation codebook 32 and.the time series
vector from the second excitation codebook 33 based on the evaluation result
of
the noise level inputted from the noise level evaluator 24, as illustrated in
Fig.
5, for example. Each of the time series vectors from the first excitation

codebook 32 and the second excitation codebook 33 is weighted by using the


CA 02453122 2004-01-23

weight provided by the weight determiner 34, and added. The time series
vector outputted from the adaptive codebook 8 and the time series vector,
which is generated by being weighted and added, are weighted by using
respective gains provided by the gain encoder 10, and added by the weighting-

5 adder 38. Then, -an addition result is provided to the synthesis filter 7 as
excitation signals, and a coded speech is produced. The distance calculator 11
calculates a distance between the coded speech and the input speech S2, and
searches an adaptive code, excitation code, and gain for minimizing the.
distance. When coding is over, the linear prediction parameter code, adaptive

10 code, excitation code, and gain code for minimizing a distortion between
the
input speech and the coded speech, are outputted as a coding result.
Explanations are made on the decoder 2. ln the decoder 2, the linear

prediction parameter decoder 12 decodes the linear prediction parameter code
to the linear prediction parameter. Then, the 'iLi.near prediction parameter
15 decoder 12 sets the linear prediction parameter as a coefficient for the

synthesis filter 13, and also outputs the linear prediction parameter to the
noise evaluator 26.

Explanations are made on decoding of excitation information. The
adaptive codebook 14 outputs a time series vector corresponding to an adaptive
20 code by repeating an old excitation signal periodically. The noise. level

evaluator 26. evaluates. a.noise level. by.using the decoded linear prediction
parameter, which is inputted from the linear prediction pararneter decoder.12,
and the adaptive code in a same method with the noise level evaluator 24 in
the encoder 1, and outputs an. evaluation result to the weight determiner 37.

The first excitation codebook 35 and the second excitation codebook 36


CA 02453122 2004-01-23

21
output time series vectors corresponding to excitation codes. The weight
determiner 37 weights based on the noise level evaluation result inputted from
the noise level evaluator 26 in a same method with the weight determiner. 34
in
the encoder 1. Each of the time series vectors from the first excitation

codebook 35 and the second excitation codebool: 36 is weighted by using a
respective weight provided by the weight determirier 37, and added. The time
series vector outputted from the adaptive codebook 14 and the time series
vector, which is generated by being weighted and added, are weighted by using
respective gains decoded from the gain codes by the gain decoder 16, and added

by the weighting-adder 39. Then, an addition result is provided to the
synthesis filter 13 as an excitation signal, and an output.speech S3 is
produced.
i
In embodiment 5, the noise level of the speech is evaluated by using a
code and coding result, and the noise time series vector or non-noise time
series vector are weighted based on the evaluation result, and added.

].5 Therefore, a high quality speech can be reproduced with a small data
amount.
Embodiment 6.

In embodiments 1 5, it is also possible to change gain codebooks
based on the evaluation result of the iaoise levelõ In embodiment 6, a most
suitable gain codebook can be used based on the excitation codebook.
Therefore, a high quality speech can be reproduced.

Embodiment.7.
In embodiments 3. - 6, the noise level of the speech is evaluated, and
the excitation codebooks are switched based on the evaluation result.
However, it is also possible to decide and evaluate each of a voiced onset,

plosive consonant, etc., and switch the excitation codebooks based on an


CA 02453122 2004-01-23

22
evaluation result. In embodiment 7, in additioxi to the noise state of the
speech, the speech is classified in more details, e.g., voiced onset, plosive
consonant, etc., and a suitable excitation codebook can be used for each
state.
Therefore, a high quality speech can be reproduced.

Embodiment -$.

In embodiments 1- 6, the noise level in the coding period is evaluated
by using a spectrum gradient, short-term prediction gain, pitch fluctuation.
However, it is also possible to evaluate the noise level by using a ratio of a
gain
value against an output from the adaptive codebook.

Industrial Applicability

In the speech coding method, speech decoding method, speech coding
apparatus, and speech decoding apparatus according to this invention, a noise
level of a speech in. a concerning coding period is evaluated by using a code
or
coding result of at least one of the spectrum information, power information,

and pitch information, and various excitation codebooks are used based on the
evaluation result. Therefore, a high quality speech can be reproduced with a
small data amount.

In the speech coding method and speech decoding method according to
this invention, a plurality of excitation codebooks storing excitations with
various noise levels is provided, and the plurality of excitation codebooks is

switched based on the evaluation. result. of the noise .level of the speech.
Therefore, a high quality speech can be reproduced with a small data amount.
In the speech coding method and speech decoding method according to

this invention, the noise levels of the time series vectors stored in the
excitation codebooks are changed based on the evaluation result of the noise


CA 02453122 2004-01-23

23
level of the speech. Therefore, a high quality speech can be reproduced with a
small data amount.

In the speech coding method and speech decoding method according to
this invention, an excitation codebook storing noise time series vectors is
provided, -and- a time series vector with a low noise level is generated by

sampling signal samples in the time series vectors based on the evaluation
result of the noise level of the speech. Therefore, a high quality speech can
be
reproduced with a small data amount.

In the speech coding method and speech decoding method according to
this invention, the first excitation codebook storing noise time series
vectors
and the second excitation codebook storing non-noise time series vectors ar-e
provided, and the time series vector in the first excitation codebook or the
time
series vector in the second excitation codebook is weighted based on the
evaluation result of the noise level of the speech, and added to generate a
time

series vector. Therefore, a high quality speech can be reproduced with a small
data amount.

Representative Drawing
A single figure which represents the drawing illustrating the invention.
Administrative Status

For a clearer understanding of the status of the application/patent presented on this page, the site Disclaimer , as well as the definitions for Patent , Administrative Status , Maintenance Fee  and Payment History  should be consulted.

Administrative Status

Title Date
Forecasted Issue Date 2010-03-09
(22) Filed 1998-12-07
(41) Open to Public Inspection 1999-07-08
Examination Requested 2004-01-23
(45) Issued 2010-03-09
Expired 2018-12-07

Abandonment History

Abandonment Date Reason Reinstatement Date
2009-08-25 FAILURE TO PAY FINAL FEE 2009-08-27

Payment History

Fee Type Anniversary Year Due Date Amount Paid Paid Date
Request for Examination $800.00 2004-01-23
Registration of a document - section 124 $100.00 2004-01-23
Application Fee $400.00 2004-01-23
Maintenance Fee - Application - New Act 2 2000-12-07 $100.00 2004-01-23
Maintenance Fee - Application - New Act 3 2001-12-07 $100.00 2004-01-23
Maintenance Fee - Application - New Act 4 2002-12-09 $100.00 2004-01-23
Maintenance Fee - Application - New Act 5 2003-12-08 $200.00 2004-01-23
Maintenance Fee - Application - New Act 6 2004-12-07 $200.00 2004-11-24
Maintenance Fee - Application - New Act 7 2005-12-07 $200.00 2005-12-01
Maintenance Fee - Application - New Act 8 2006-12-07 $200.00 2006-11-23
Maintenance Fee - Application - New Act 9 2007-12-07 $200.00 2007-11-23
Maintenance Fee - Application - New Act 10 2008-12-08 $250.00 2008-11-21
Reinstatement - Failure to pay final fee $200.00 2009-08-27
Final Fee $300.00 2009-08-27
Maintenance Fee - Application - New Act 11 2009-12-07 $250.00 2009-12-07
Maintenance Fee - Patent - New Act 12 2010-12-07 $250.00 2010-09-17
Maintenance Fee - Patent - New Act 13 2011-12-07 $250.00 2011-11-22
Registration of a document - section 124 $100.00 2012-04-04
Maintenance Fee - Patent - New Act 14 2012-12-07 $250.00 2012-11-14
Maintenance Fee - Patent - New Act 15 2013-12-09 $450.00 2013-11-13
Maintenance Fee - Patent - New Act 16 2014-12-08 $450.00 2014-12-01
Maintenance Fee - Patent - New Act 17 2015-12-07 $450.00 2015-11-30
Maintenance Fee - Patent - New Act 18 2016-12-07 $450.00 2016-12-05
Maintenance Fee - Patent - New Act 19 2017-12-07 $450.00 2017-12-04
Owners on Record

Note: Records showing the ownership history in alphabetical order.

Current Owners on Record
RESEARCH IN MOTION LIMITED
Past Owners on Record
MITSUBISHI DENKI KABUSHIKI KAISHA
YAMAURA, TADASHI
Past Owners that do not appear in the "Owners on Record" listing will appear in other documentation within the application.
Documents

To view selected files, please enter reCAPTCHA code :



To view images, click a link in the Document Description column. To download the documents, select one or more checkboxes in the first column and then click the "Download Selected in PDF format (Zip Archive)" or the "Download Selected as Single PDF" button.

List of published and non-published patent-specific documents on the CPD .

If you have any difficulty accessing content, you can call the Client Service Centre at 1-866-997-1936 or send them an e-mail at CIPO Client Service Centre.


Document
Description 
Date
(yyyy-mm-dd) 
Number of pages   Size of Image (KB) 
Abstract 2004-01-23 1 31
Description 2004-01-23 28 1,582
Claims 2004-01-23 10 412
Drawings 2004-01-23 7 278
Cover Page 2004-03-17 1 36
Claims 2009-08-27 1 32
Description 2008-08-11 23 1,207
Claims 2008-08-11 2 68
Representative Drawing 2009-03-04 1 14
Abstract 2009-10-09 1 31
Cover Page 2010-02-08 2 55
Correspondence 2004-02-03 1 13
Correspondence 2004-02-03 1 41
Assignment 2004-01-23 4 120
Correspondence 2004-03-19 1 16
Correspondence 2004-02-20 5 119
Correspondence 2004-03-22 1 17
Prosecution-Amendment 2008-08-11 9 276
Prosecution-Amendment 2008-02-13 6 256
Prosecution-Amendment 2009-08-27 3 98
Correspondence 2009-10-09 1 18
Correspondence 2012-04-04 3 97
Assignment 2012-04-04 7 411
Correspondence 2012-05-09 1 14
Correspondence 2012-05-09 1 20