Note: Descriptions are shown in the official language in which they were submitted.
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
Noalinaar System, Method of Dasiga thereof and
Computer Program Product
The present invention relates to non-linear systems,
methods of design thereof in the frequency domain and
computer program products. More particularly, the present
invention relates to a non-linear system having pre-
determinable frequency response characteristics. The
invention can be utilised to design and realise, for
l0 example, nonlinear filters having a required frequency
response or transfer functions having specified transfer
characteristics or within a control system context.
The possible frequency components in an output signal
of a linear system are exactly the same as the frequency
components of a corresponding input signal. Conventional
linear filter design is based on the principle that energy
in unwanted frequency bands is attenuated.
The Dolby filter, which varies the amplitude of the
output signal as a function of the level and frequency of
the input, is an example of a nonlinear filter system.
However, when compared with the input, the output does not
contain any additional frequency components. Modulation is
another concept related to nonlinear filtering, which is
associated with signal transmission where the signal to be
transmitted is modulated by a carrier signal and then
transmitted through a medium. Although a modulation device
allows energy to be moved from one frequency band to
~ another, the output frequency components of such a device
depend not only on the input components but mainly on the
carrier signal. Therefore, the energy transfer implemented
by modulation is realised by a two input and one output
1
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
system where one input is the carrier signal and the other
input is the signal to be processed.
The prior art lacks a non-linear system and method
of/apparatus for the design of such a non-linear system for
predictably transferring energy from one frequency or band
of frequencies of an input signal to another frequency or
band of frequencies independently of any other input signal.
Further, the prior art lacks a non-linear control system
l0 which can predictably transfer energy from one frequency
band to another frequency band.
It is an object of the present invention to at least
mitigate some of the problems of the prior art.
Accordingly, a first aspect of the present invention
provides a method for designing a non-linear system for
transferring energy from a time or spatial domain input
signal having a first spectrum at a first pre-determinable
frequency or range of frequencies to a time or spatial
domain output signal having a second spectrum at a second
pre-determinable frequency or range of frequencies.
Preferably, the method comprises the steps of
identifying the first spectrum of the time or spatial domain
input signal from which energy is to be transferred,
specifying the second spectrum of the time or spatial domain
output signal to which said energy is to be transferred, and
calculating, using a frequency domain description of said
output signal, for example, the output spectrum, expressed
in terms of a frequency domain description of said input
signal and coefficients of ~ a time or spatial domain
description of a generalised non-linear system, the
2
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
coefficients of a said time or spatial domain description of
said generalised non-linear system in order to give effect
to the energy transfer.
Advantageously, the present invention
allows energy at a particular frequency within a given
system to be transferred to another frequency or band of
frequencies at which the response of the system is greatly
reduced or negligible, or
allows energy of a signal which is transmitted at a
particular frequency or band ' of frequencies to be
transferred, without using an additional modulating signal,
to another frequency or band of frequencies at which the
associated transmission media allows signals to pass, or
allows energy at a particular band of frequencies to be
transferred and spread over a new wider range of frequencies
so as to attenuate the energy by employing the desired
interkernel and intrakernel effects of nonlinear systems.
The present invention is based upon the relationship
between the input and output spectra or frequency components
of nonlinear systems, and the relationship between the input
and output frequencies and/or frequency ranges in the
nonlinear case. In addition, the invention utilises a
mapping between the time or spatial domains and frequency
domain which allows the output spectra or frequency content
of nonlinear systems to be described completely by- the
coefficients of time or spatial domain models which
represent the filter or non-linear system to be constructed.
A second aspect of the present invention provides a
method for manufacturing a non-linear system for
transferring energy from a time or spatial domain input
3
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
signal having a first spectrum at a first pre-determinable
frequency or range of frequencies to a time or spatial
domain output signal having a second spectrum at a second
pre-determinable frequency or range of frequencies, said
method of manufacture comprising the steps of
(a) designing said non-linear system comprising the steps of
identifying the first spectrum of the time or spatial domain
input signal from which energy is to be transferred,
specifying the second spectrum of the time or spatial domain
output signal to which said energy is to be transferred, and
calculating, using a frequency domain description of said
output signal, for example, the output spectrum, expressed
in terms of a frequency domain description of said input
signal and coefficients of a time or spatial domain
description of a generalised non-linear system, the
coefficients of a time or spatial domain description of said
generalised non-linear system in order to give effect to the
energy transfer, and
(b) materially producing the non-linear system so designed.
A third aspect of the present invention provides a data
processing system which can transfer energy from a time or
spatial domain input signal having a first spectrum at a
first pre-determinable frequency or range of frequencies to
a time or spatial domain output signal having a second
spectrum at a second pre-determinable frequency or range of
frequencies, said system comprising
means for identifying the first spectrum of the time or
spatial domain input signal from which energy is to be
transferred,
4
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
means for specifying the second spectrum of the time or
spatial domain output signal to which said energy is to be
transferred, and
means for calculating, using a frequency domain description
of said output signal, for example, the output spectrum,
expressed in terms of a frequency domain description of said
input signal and coefficients of a time or spatial domain
description of a generalised non-linear system, the
coefficients of a time or spatial domain description of said
generalised non-linear system in order to give effect to the
energy transfer.
A fourth aspect of the present invention provides a
computer program product for designing a non-linear system
for transferring energy from a time or spatial domain input
signal having a first spectrum at a first pre-determinable
frequency or range of frequencies to a time or spatial
domain output signal having a second spectrum at a second
pre-determinable frequency or range of frequencies, said
computer program product comprising
computer program code means for identifying the first
spectrum of the time or spatial domain input signal from
which energy is to be transferred,
computer program code means for specifying the second
spectrum of the time or spatial domain output signal to
which said energy is to be transferred, and
computer program code means for calculating, using a
frequency domain description of said output signal, for
example, the output spectrum, expressed in terms of a
frequency domain description of said input signal and
coefficients of a time or spatial domain description of a
generalised non-linear system, the coefficients of a time or
5
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
spatial domain description of said generalised non-linear
system in order to give effect to the energy transfer.
A fifth aspect of the present invention provides a non-
linear system which can transfer energy from a time or
spatial domain input signal having a first spectrum at a
first pre-determinable frequency or range of frequencies to
a time or spatial domain output signal having a second
spectrum at a second pre-determinable frequency or range. of
frequencies, said system comprising
means for identifying the first spectrum of the time or
spatial domain input signal from which energy is to be
transferred,
means for specifying the second spectrum of the time or
spatial domain output signal to which said energy is to be
transferred, and
means for giving effect to the energy transfer using
coefficients of a time or spatial domain description of a
generalised non-linear system, said coefficients having been
calculated using a frequency domain description of said
output signal, for example, the output spectrum, expressed
in terms of a frequency domain description of said input
signal and coefficients of a time or spatial domain
description of a generalised non-linear system.
Advantageously, the fifth embodiment allows processing
for the determination of the coefficients to be performed
off-line and merely incorporated into a non-linear system
which uses the coefficients.
6
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
Embodiments of the present invention will be described
by way of examples only, With reference to the accompanying
in which:
figure 1 shows the effect of traditional signal
processing by, for example, a linear filter;
figure 2 illustrates signal processing according to one
aspect of the present invention;
figure 3 depicts a further example of the signal
processing according to the present invention;
figure 4 shows a non-linear system arranged to give
effect to the energy transformation shown in figure 3;
figure 5 illustrates a further energy transformation in
which energy is distributed over a wider frequency band;
figure 6 illustrates the power spectral densities for
the input and output signals of a designed nonlinear system;
figure 7 illustrates the power spectral densities for
the input and output signals of another designed nonlinear
system;
figure 8 depicts schematically a non-linear system;
figure 9 shows a digital implementation of the non-
linear system shown in figure 8;
figure 10 illustrates the power spectral densities for
the input and output signals of the nonlinear system which
was obtained using a design which improves the filtering
effect shown in figure 6;
figure 11 illustrates the power spectral densities for
the input and output signals of the nonlinear system which
was obtained using a design which improves the filtering
effect shown in figure 7;
7
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
figure 12 shows the time domain input and output of the
nonlinear system with the frequency domain filtering effect
shown in figure 10;
figure 13 shows the time domain input and output of the
nonlinear system with the frequency domain filtering effect
shown in figure 11;
figure 14 depicts the structure of a designed nonlinear
system;
figure 15 illustrates the frequency spectrum of a
signal to be processed using the present invention;
figure 16 illustrates the result of a Fast Fourier
Transform of an input signal having the spectrum shown in
figure 15;
figure 17 illustrates the results of the n-dimensional
(n= 2 and 3) convolution integration for the spectrum shown
in figure 16;
figure 18 illustrates the output magnitude frequency
response of a designed nonlinear system to an input signal
having the frequency spectrum shown in figure 15;
figure 19 shows the frequency spectrum of a further
signal to be processed using the present invention;
figure 20 illustrates the output magnitude frequency
response of the same nonlinear system as shown in figure 18
to the further signal to be processed having the frequency
spectrum shown in figure 19;
figure 2l~illustrates the frequency spectrum of a still
further signal to be processed using the present invention;
figure 22 illustrates the output magnitude frequency
response of the same nonlinear system as in figure 18 to the
still further signal to be processed having the frequency
spectrum shown in figure 21;
8
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
figure 23 illustrates the structure of. another designed
nonlinear system;
figure 24 shows the continuous time realisation of the
discrete time system in figure 23;
figure 25 shows a mechanical implementation of the
continuous time system in figure 24;
figure 26 illustrates the result of a Fast Fourier
Transform of the further signal shown in figure 19;
figure 27 illustrates the output magnitude frequency
response of a further designed nonlinear system to the
further signal shown in figure 19;
figure 28 illustrates the output magnitude frequency
response of a still further designed nonlinear system to the
signal shown in figure 15;
figure 29 illustrates the output magnitude frequency
response of the nonlinear system shown in figure 28 to the
further signal shown in figure 19;
figure 30 illustrates a flow chart for designing a
nonlinear system according to an embodiment;
figure 31 illustrates a flow chart for designing a
nonlinear system according to a further embodiment;
figure 32 shows the structure of a nonlinear filter
designed based on specifications for both the magnitude
and phase of output frequency responses;
figure 33 depicts the input and output magnitude
frequency characteristics of a specific nonlinear filter
designed based on specifications for both the magnitude
and phase;
9
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
figure 34 shows the phase angle of the spectrum
Yz(jw) in figure 32 in the specific design case shown in
figure 33 which reflects the phase response
characteristic determined by the design;
figure 35 shows the phase characteristics of the
linear phase FIR filter in the specific design case shown
in figure 33;
figure 36 depicts the discrete time model of a
nonlinear filter designed to focus energy from two
different frequency bands into a single frequency band;
figure 37 shows the spectrum of an input signal of
the nonlinear filter in figure 36;
figure 38 shows the frequency response of the
nonlinear filter in figure 36 to the input in figure 37,
which indicates an energy focus effect of the nonlinear
filter;
figure 39 illustrates the block diagram of a spatial
domain nonlinear filter;
figure 40 depicts the power spectral densities of an
input and the corresponding output of the spatial domain
nonlinear filter in figure 39;
figure 41 depicts an spatial domain input and
corresponding output of the filter in figure 39;
figure 42 shows a one dimensional image to be
processed by the spatial domain nonlinear filter in
figure 39;
10
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
figure 43 shows the one dimensional image obtained
by processing the image in figure 42 using the spatial
domain nonlinear filter in figure 39; and
figure 44 illustrates a data processing system upon
which embodiments of the present invention can be
implemented.
Referring to figure 1, there is shown the principle of,
for example, traditional low pass, high pass, and band pass
filtering. Figure 1 shows the power spectrum of a signal
100 both before and after processing. The energy of a
signal 100 to be filtered comprises two parts, namely, a
first part 102 for further processing or of interest and a
second part 104 which is of no interest. Typically, the
second part 104 of the signal is attenuated which results in
a second signal 106. The second signal 106 comprises the
original or a copy of the first part 102 and an attenuated
portion or an attenuated version of the second part 108.
Figure 2 illustrates the principle of signal processing
according to one aspect of the present invention. Figure 2
shows the power spectrum of a signal 200 both before and
after processing. The signal comprises a first portion 202
and a second portion 204. The first portion 202 of the
signal 200 is of interest for further processing or output.
Accordingly, as a result of the signal processing using the
present invention, the first portion 202 is retained and the
energy in the second portion 204 is translated to another
frequency band 206.
11
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
I. DETAINED DECRIPTION
The theory and method underlying the present invention
will now be described in general terms in steps (i) to (vi).
(i) Determine the frequency spectrum of a signal to be
processed, including the range of frequencies of the signal.
(ii) Specify the frequency spectrum of the output signal.
(iii) Determine the structure of a Nonlinear Auto-Regressive
model with eXogenous inputs (NARX model) to ensure that the
energy transformation between different frequency bands and
other design requirements, for example, specifications for
magnitude and/or phase of the output spectrum over the
required output frequency band can be met or realised.
The general expression for a NARX model is given by
N
Y(k)=L.rYn(k)
(1)
n~l
where yn(k) is a 'NARX nth-order output' given by
n tC n
p p+q
Yn( k ) _ ~ ~ cpq( lm...,lp+q)~ Y ( k - li) ~ a ( 1t - li)
p=~ l~,lP~9=1 1a1 1
=p+1
with
(2)
p+q=n, li =1,...,Kn, i=1,...,p+q, and
l .lv.y=1 11 ~1 1",q=1
Kn is the maximum lag and y ( .) , a ( .) , and cpq( .) are the
output, input, and model coefficients respectively. A
specific instance of the NARX model such as
y(k) - 0.3u (k-1)+0.7y(k-1)-0. 02u (k-1) a (k-I)-0. 04u (k-2) a (k-1)
- 0 . 0 6y (k-1 ) a (k- 3 ) - 0 . 0 8 y (k-2 ) y (k-3 )
may be obtained from the general form (1) and (2) with
12
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
cpl (1)=0.3, cl0 (1)=0.7, c02 (I, 1)=_0.02, c02 (2, I)=-0.04,
clI ( I, 3) =-0 . 06, c20 (2, 3) =-0. 08, else cpq( . ) =0
Simplified designs will be considered below where the
NARX model with only input nonlinearities is employed.
However, it will be appreciated by one skilled in the art
that the present invention is not limited to use in relation
to only input nonlinearities. The present invention can
i0 equally well be used in circumstances of both non-linear
outputs and non-linear inputs and outputs. Equally, the
invention is not restricted to realisation as a NARX model.
The invention may be realised using many alternative model
forms either in discrete time or continuous time. Models
such as the Hammerstein and Wiener model, or continuous time
models, for example, a nonlinear differential equation model
could be used or any other model, including discrete or
continuous spatial models, that can be mapped into the
frequency domain. However, for each of the models the main
design principle is the same.
The NARX model with only input nonlinearities is given
by equation (I) where
K" n
~C~(h,~~~,ln)~u(k-li) for nz2
yn ( k) _ ~.~,=Ki i=1 ( 3 )
~clo(~)Y(k-11)+~col(11)u(k-li) for n=I
iz=i ~m
30
The structure of the NARX model (1) and (3) is defined
by the values of N, Kn,n=1,...,N, and, for each n (an
integer between 1 and N inclusive), involves terms of the
form
n
Con(ll,~..~ln)~u(k_li) li=I,...,Kn, 1=I,...,n,
i=1
13
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
when n z 2 and
clo(11) Y (k-11) ~ coi(li) a (k-h) ~ 11 =1,...,K~
when n=1 in the model.
The parameter N in the non-linear model (1) and (3) is
associated with the realisability of the model required to
give effect to the energy transformation. The ability to be
l0 able to realise the energy transformation is determined from
the relationship between the input and output frequencies or
frequency ranges of non-linear systems.
The structure parameters Kn, n =1,...,N , are associated
with the extent to which specific design requirements such
as the magnitude and/or phase of the output spectrum over
the required output frequency band can be satisfied. These
parameters are iteratively determined as part of the design.
The model could initially be assumed to be of a simple form
in terms of these parameters. However, if the initial
choice of parameters does not produce a satisfactory design
the parameters are progressively or gradually revised
according to the energy transfer effect of the resulting
non-linear system.
For systems described by the NARX model (1) and (3),
the relationship between the input and output frequencies or
frequency ranges is given by
fY=f~r~UfxN_1 (
where fY denotes the range of frequencies of the output, and
f~ and f~-1 denote the ranges of frequencies produced by the
Nth-order and (N-1)th-order nonlinearities, and
14
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
l'-1
~ na
U Ik when c 1
(a+b) (a+b)
~ na
U Ik _ Z 1
. when
(a+b) (a+b)
n=N and
N-1
where [.] relates to or means take the integer part,
na
i = +1
(a+b)
Ik =[na-k (a+b) ,nb-k (a+b)~ for k= 0,...,i' -1,
Ii =[O,nb-i'(a+b) ],
and the frequencies of the signal to be processed are in the
range defined by the interval [a,b].
Given [a,b] and the required output frequency range fy,
the smallest N for the NARX model (1) and (3) which can
bring about the specified frequency domain energy
transformation can be determined from equation 4.
(iv) Map the NARX model with the structure given in (iii)
into the frequency domain to yield the frequency domain
description. The frequency domain description is given in
terms of the Generalised Frequency Response Functions
(GFRFs) , Hn(jwl,"',7wn) , n=1,...,N, which, after this mapping,
are specified in terms of time or spatial domain model
parameters.
The mapping of the NARX model(1)and(3) between the
time or spatial domain and the frequency domain is given by
~(jwl~.,ijwn)= 1 ~( ,. ~)p~-j(wllt~'..,y'E'~'Tn~~
1 ~C'10(~) ~ ~ (wl+r" i+Wn) liJ ~~'n 1
n=1,...,N (5)
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
Therefore the frequency domain properties of the system can
be completely defined in terms of the parameters cpq (.) of
the time or spatial domain description of the system.
(v) The output frequency response of the non-linear system
(1) and (3) is given by
Y(~t"l)-~,Yn(7W) (6)
a=i
where
Yn(JW) (2~)a i wl+...JH=~~Wli'..,~Wn)~U(7wi~aw
Wlth
~( .) dQw
wl+,...,+wr=w
denoting an integration over the nth-dimensional hyper-plane
wl+,...,+wn = w
Based on this relationship, the parameters in
FIn (jwl, . . . , jwn) ,n=1, . . . ,N, which, due to the mapping
performed in (iv), are the same parameters as those in the
time or spatial domain model are determined. This step
enables the shape of the output frequency spectrum Y(jw) to
be defined which in turn ensures that the spectrum
approaches the specified output frequency spectrum as
closely as possible.
Different design specifications can lead to different
implementations of corresponding designs.
(v. l) Firstly, given knowledge of the input spectrum
U(jw) and the required output spectrum Y* (j w) . Substituting
(5) and (7) into (6) yields
16
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
_ 1 N l~,~n x
Y(~w)- x ~ la-1) ~ Cpn(11i~..~ln)X
1 ~clp(li) exp ( )wll) n~l (2~) 1~.~=~
11=1 ( 8 )
n
eXp~ ~ (wlll+~...,+Wnln)~~U (7wi) dQw
wl +~ ..~iwy mw 1=1
Equation (8) enables the parameters associated with the
time or spatial domain NARX model,
cpn(Il,...,ln), 11=1,...,Kn,...,ln=I,...,Kn, n=1,...,N,
and
cl p (11 ) . 11=1, . . . . Kl .
to be determined as follows to implement the required
design: .
1) Based upon the equation .
N h'V11 ~xn
Y*(~w)-~ (ZTI)tn-11 lLr1 Cpn(1W..~ln)X
n (9)
eXPy J (well+,...,+wnln)~~U (Jwi) dcrw
wl+; ..,two=w i=1
determine parameters
cpn(11,...,In),11=1,...,Kn,...,ln=1,...,Kn, n=1,...,N,
using a least squares routine to make the right hand side of
equation (9) approach the specified output spectrum as
2o closely as possible.
The first term on the right hand side of equation (8)
1
x,
1- ~cio(l~) eXP (-Jwli)
is omitted from (9). The omitted term represents linear
output terms in the time or spatial domain realisation of
17
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
the nonlinear system and these may not be needed to achieve
the design at this step, hence they are omitted from (9).
2) In order to augment the performance of a filter designed
as above, it may be desirable to also design a suitable
linear filter H( jw) to improve the approximation to Y* ( jw)
obtained in 1) above such that
l~~ Ka
w) tn-11 ~ Con(ll..~ln) x
n~l ( 2~) h,la.l
exPy) (well+,~..~+Wnln)~~U (jwi) dQW
wl+; ..,+vaw i~l
can achieve a better approximation to Y*(j w). As part of
l0 this linear design the parameters cl0(11)., 11. =1,...,K1~
which were omitted from (8) to get (9), can be obtained from
the parameters of the linear filter.
Design 1 hereafter illustrates the design of a non-
i5 linear system using this first case.
(v.2) Secondly, given the input spectrum U(jw), and a
specified bound for the magnitude of the required output
spectrum, YB*(w).
20 A bound YB ( w) for the magnitude of the output spectrum
Y(jw) of the NARX model (1) and (3) can be expressed as
N I
YH(w) ~ (2~)m-a IHn(jwl,...~jwn)I~IU~*...*IU (jw) (10)
n
25 according to the result in Billings, S.A. and Zang, Zi-
Qiang, 1996, A bound for the magnitude characteristics of
nonlinear output frequency response functions, Part 1:
18
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
Analysis and computation. Int. J. Control-, Vo1.65, pp309-
328, where
~pl*...*Ip (jw)I
n
denotes the n-dimensional convolution integration for the
magnitude characteristic of the input spectrum and
IHn(jwl,~~~,jwn)h
represents a bound for the GFRFs magnitude
~gn(jwl~...~jWn~
with wl, . . . , wn satisfying the constraint wl+, . . . , +wn = w.
For the NARX model (1) and (3),
lijn(J1n11~...~jwn)w
can be evaluated as follows
IHn(7w1,...~~wn)w ' K1 1 ~ ~Con(11.'..~ln)~ (11)
1- LIC10(11) eXp (-]Wll il.l"=1
11=1
Combining (10) and (11) yields
1 N 1
YB(w)- ~ cn-11 Cn~U~*...*IU(jw)' (12)
K nal ( 271)
1 ~C10(11) exp ( Jwll)
11x1
where
Cn - ~~COn(lln..~ln)I
11.x,=1
Equation (11) enables
K"
Cn - ~~COn(lli'..~ln))
11,1"=1
and cl0 (11), 11=1,...,K1 to be determined for shaping the
bound YB (w) for Y ( jw) in order to make this bound approach
YB*(w). The procedure which can be used to achieve this is
as below.
19
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
1) Based upon the equation
N (n-1) n *...*
Yai ( w ) _ ~ 1 C (U~ IU ( j w )~ ( 13 )
n=1 ( 2~c)
n
use a least squares routine to make the right hand side of
the above equation approach YB*(w) especially over the
frequencies or frequency range to which the required energy
transformation needs to be implemented. The coefficients Cn
n=1,---,N, in equation (13) must be constrained to be
positive since Cn is the result of the summation of the
modulus of the coefficients ~On~ll,w ~~ln~~
11=1,...,Kn,...,ln=1,...,Kn.
The first term on the right hand side of equation (12)
1
K
1-L.rcio(11) exp (-jwh)
a=~
is omitted from (13). The omitted term represents linear
output terms in the time or spatial domain realisation.
These omitted terms may not be needed to achieve the design
at this step, hence they are omitted from (13).
2) If necessary, the approximation to Y$*(w) in 1) above
can be supplemented using a linear filter with a magnitude
characteristic IH (jw)I such that
N
IH(Jw)I~ ln-1! CnIU~*...*lU(jw)~
n=1 ( 2~c)
n
provides a better approximation to the specified bound and
as a result clp(11), 11-1,...,Kl, which were omitted from
(12) to get (13), can be obtained from the linear filter
parameters.
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
Design 2 hereafter illustrates the detailed procedure
of the above and several examples of the design.
(V.3) Thirdly, there are many practical situations which
should be dealt with on an individual basis. There follows
examples of two such situations.
(a) Referring to figure 3 there is shown an input
signal having a spectrum U(jw) 300 which comprises a portion
302 of interest, between frequencies a and e, and an portion
304, between frequencies a and b, to be translated to
another frequency range 306 defined by frequencies f and 2b
while retaining the portion of interest 302 within the
output signal 308.
IS
In order to realise the energy transformation shown in
figure 3, a non-linear system 400 can be constructed as
illustrated in figure 4 which comprises means 402, 404 and
406 for implementing the following components
Hl (jW) . H2 (jwl~ jW2) ~ and H( jw) .
Hl(jw) 402 and H(jw) 406 can be implemented readily using
classical linear band pass filters, while H2(j wl,j w2) 404
can be constructed in the time or spatial domain as shown in
the equation below
Yz(k)= ~, coz(lmlz)~u(k-li)
11.1=1 i=1
with the parameters, coz(ll,lz), 11 =1,~~~,Kz,lz =1,~~~,Kz being
determined to produce the signal yz(k) with a required
frequency characteristic. Each of the components 402, 404
21
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
and 406 have corresponding frequency responses 408, 410 and
412. Consequently, the whole non-linear system can be
realised as a non-linear time or spatial domain filter as
y(k)=H1(q 1)u(k)+H(q-1) ~ coz(li~lz)~u(k-li)
11,1==1 1=1
1 1 K 2
_H1N(q 1)u(k)+HN(q 1) ~ coz(ll~lz)~u(k-li)
H1D ( q ) Hp ( q ~ ll,lz.l rill
where
1 H1N(q 1) 1 Hp(q 1)
Hl(q ) = H1D(q 1)' H (q ~- HD(q 1)
are the backward shift operator descriptions of the linear
filters which have the frequency response functions H1(j w)
and H(jw), respectively.
The equation for y(k) can be further written as
Hln(q 1) HD(q 1) Y (k)= Hu,,(q 1) Hu(q 1) a (k)+HH(q 1) Hla(q 1) ~
coz(ll~lz)~u (k-li)
11,1==1 i=1
which is clearly a NARX model that can be described by
equations (1) and (3).
Although the above shows energy transformation from a
frequency band to a higher frequency band, energy can
equally well be transferred from one frequency band to a
lower frequency band.
(b) If the objective of the energy transformation and
hence the desired non-linear system is only to distribute
energy of the signal to be processed over a wider frequency
band without energy amplification then a simpler model may
be sufficient. Referring to figure 5, there is shown
schematically an input signal 500 in the frequency domain
comprising energy between frequencies a and b. The desired
output frequency spectrum 502 comprises two portions, a
lower frequency portion 504 and a higher frequency portion
22
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
506. It will be appreciated that the energy of the input
signal 500 is to be spread over the two frequency ranges 504
and 506.
A quadratic filter, for example,
y (k) =a u2 (k)
can be designed to redistribute energy of the original
signal u(k), with frequency components over the frequency
band [a, b], to the new ranges [O,b-a] and [2a,2b] without
energy amplification provided~an appropriate a is selected
in the design process described above.
(vi) The final step in the design process is to
materially realise, that is, to physically realise the
designed filter using appropriate software or hardware or
combination of software and hardware.
Although the present invention has been described above
with reference to a NARX model, it will be appreciated that
the present invention is not limited thereto. The method
and realisation of non-linear systems having pre-
determinable frequency or energy transfer characteristics
can equally well be utilised using other forms of
descriptions of non-linear systems or models where there
exists a requirement to transform or transfer energy at one
frequency or band of frequencies to energy at another
frequency or band of frequencies.
The present invention can be used to realise energy
transformations over frequencies using a nonlinear system or
23
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
to modify energy transformation of an existing linear or
non-linear system.
Furthermore, the present invention can be applied or
utilised in the field of design and realisation of
electronic circuits or filters. The energy in the input
signal at a particular frequency or band of frequencies is
transferred to desired frequency bands. Similarly, in
mechanical systems, the addition of non-linear mechanisms
could transfer the energy of a vibration at an undesirable
frequency to some other frequency. The present invention
may also find application in the field of fluid mechanics,
for example, in the effects of flow around objects (e.g. oil
platform legs), noise in ducting and pipe flow systems.
Alternatively, the modifications which are required to
be effected to a known linear or non-linear system, for
example, a mechanical system, in order to bring about a
particular frequency distribution of energy can be
determined using the present invention and then the linear
or non-linear system can be so modified.
II. EXAI~IrES ..
II.1 DESIGN 1
Design No.l shows an example of how the energy of an
input signal having predetermined frequency components can
be transferred to other frequencies.
Consider digitally filtering an input signal
u(t)=cost+cos2t, (14)
24
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
wherein the sampling period is T =1/100 s .
The first step is to determine the frequency spectrum
of the signal to be processed. The frequency spectrum of
the signal to be processed comprises input frequencies
wal =1 and wa2 = 2
The second step is to specify the output frequency
characteristics of the filter. Two different filtering
l0 problems will be considered for this example.
The specification for the first problem is to transfer
the energy in u(t) to the output frequency wao=0 and the
specification for the second problem is to transfer the
energy in a (t) to the output frequency wao =4
Since the sampling period is T =1/100 s, the digital
input to the filter is
u(k)=cos100k+cos100k for k=0, 1,... , (15)
the normalised input frequencies are therefore
wdl =1/100 and w~ = 2/100,
and the required normalised output frequencies are
w~ =0 for the first filtering problem and wdo =4/100 for the
second filtering problem.
For this example, the output frequencies produced by
the nth-order nonlinearity of a non-linear filter are
distributed uniformly in
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45b44 PGT/GB99/00550
' ~ nb _ na
U Ij when [ ~
1
i.o (a+b) (a+b)
fY" nb na (16)
_ ) Z1
UI when
[
j
(a+b) (a+b)
j.o
2
where 1 means to
a =100' take
b the
' [ x inte
100 er
g
part
of x,
and
_ na
+1
(a+b) ,
Ii for j=0
=~na-j i'
(a+b) -1
, nb-j
(a+b)~
,
...,
,
Ii =~O.nb-i'(a+b)~,
with any two neighbouring
the frequencies
difference
between
2 1
1
_
being
O =
-
100 100
100
For n=1, it can be evaluated from the above equations
that
1 2
[100'100] (1~)
and the corresponding output frequencies are
1 2
100'100}
For n=2, it can be similarly obtained that
_ -~ 2 4 ~ 4 3 _ 2 4 1
fY2 I°vh 100'100 V[0'100 100 100'100 V 0'100
~C
C
and the corresponding output frequencies are
1 2 3 4
~~'100'100'100'100
Therefore, a NARX model of up to second order
nonlinearity will be sufficient to realise the energy
transformations required by the filtering example thereby
addressing the third step in the design process.
According to the above analysis, select a NARX model of
the form
Y(k)=~clo(ki)Y(k-kl)+~,~,coz(ki~k2)u(k-ki)u(k-k2) (18)
kWl kl~k==0
26
SUBSTITUTE SHEET {RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
as the basic structure for the non-linear filter and take
KZ =1 for simplicity. The parameters Kl, clo(1) ,...,clo(K1) and
cot( kl,k2) , kl = 0, 1 and k2 = 0, 1, then need to be determined to
completely specify the design.
In order to derive the procedures for determining these
parameters, consider the frequency domain characteristics of
the filter model (18). According to J.C.Peyton Jones and
S.A.Billings, Recursive Algorithm for Computing the
l0 Frequency Response of a Class of Non-linear Difference
Equation Models, Int. J. Control, 1989, Vo1.50, No. S, 1925-
1940, the generalised frequency response functions of this
filter model are
H1(jw)=0
cot( kl, k2) expl- j~wlkl + w2k2~,
kt=ok~~ ( 19 )
Hy(jWlijW2)=
1- ~ coo( k~) exP~" J~W ~ + w2~k~~
x,=1
Hn(~~"~1~"'~J~"~n)=0 for ri>_3
The output frequency response of the filter (18)
under the input
x
u(k)=cos100k+cosl00k ~ A(2 ~~~t ' (20)
i=-x,i:o
with K=2, A (wi) = l, Wi = ~00' w-i =-wi' 1=~1,t2, can be
25
written as
_1
_ rr _ _ ~A(wi,)A(wi,)Hz(jwil,j.wi=) for w~>0
2 vit+vizsv
Y(jw)=~Y"(jW)=Yz(jW)= 1
- ~A(Wi )A(Wi )HZ(jWi'jWi ) for W=0
i z i z
4 vil+v:z=v
(21)
27
SUBSTITUTE SKEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
where il,i2 E~-2,-1,+1,+2~, Y(jw) is related to the output
spectrum Y(jw) by
2Y(jw) for w>0
Y(]W) Y(jw) for w=0
and, similarly, Yn(jw) is related to the nth-order output
spectrum Yn(jw) by
2Yn(jw) for W > 0
Yn(jW)=
Yn(jw) for w=0
This is a. specific form of the general expression for output
frequency responses of non-linear systems which are given by
H
Y(]~'')=~~(]W) (22)
n=1
Where
n
Yn(]W)= 1~~ jijn(jWli...,jWn)~U(]Wi~~W
( ~~) Wl+r..niWn-W iai .
W7.th
j( .) d~W
Wt+,._,iW~sV
denoting an integration over the nth-dimensional hyper-plane
wl+,~~~,+wn=w and N being the maximum order of the dominant
system nonlinearities.
28
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
Substituting (19) into (21) yields
1 1
_ 1 ~ Lrcoz(kl~kz) exp[-j (wilkl +wizkz)J
Y(Jw) ~A(wil)A(wi=)kl=Okx K
2 wll+w,Z=w -
1 clo(kl) expC-j (wi~ +wiz ) k1J
k,=1
- K 1 ~~coz(kl~kz)1 ~A~i,)A(wi,)e -j (wiikl+w )
_ _
1 ~C10(kl) eX~ Jw kl~kl'~kp"o 2wy1+v~2~
kh Jl
1 1
=H(jw)~~coz(kl~kz)f(w~kl~kz) for w>0 (24)
k,=O kZ ~
and
_ 1 1
Y(~w)=H(~w)~~coz(kl~kz)f (w~2l~kz) for w=0 (25)
ki~k2~
where
H(ew)= K
1 (26)
1- L..clo(kl) exP[-jw kl,
k,=1
f(w,k ,k )-1 ~A(w. )A(w. )ex [ (27)
1 z - ~, ~Z P -j (wilkl +wi=kz)
2 Vi1+N,ZsV
Moreover denoting
1 1
~coz(kl,k2) f (w,kl,kz) for w > 0
Y (jw)= i1=°iZ=° (28)
f (w.kl.kz)
~~coz(kl,kz) for w=0
kl~ki=0 2
gives
Y(jw)=H(jw)Y(jw). wZ0 (29)
In view of the fact that H(jw) is the frequency
response function of a classical linear filter and Y(jw) is
a linear function of the filter parameters coz( kl,kz) ,
kl = 0, 1 and kz = 0, 1, the procedures for determining the
parameters of the non-linear filter with the given design
requirements and the structure (18) are given as .
29
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
(a) From the design requirements, determine the desired
output frequency characteristic Y~(jw) and choose the
parameters coz(kl,kz) , kl = 0,1 and kz = 0,1, appropriately to
make Y (jw) approximate Y~(jw) as well as possible.
(b) Examine the filtering effect of
Y (k)= ~ ~coz(ki~kz) a (k-kz) a (k-kz) . (30)
kl~OkZ.O
where cot( kl,kz) , kl = 0, 1 , kz = 0, 1, are the results obtained
in the procedure (a). If the effect is acceptable, then
choose H(jw)=1 so that the filter parameters
cio(1)=cio(2)=....,=cio(Ki)=0 %
otherwise design the classical linear filter H(jw) to make
H(jw)Y(jw) satisfy the requirements for the output frequency
characteristics and obtain the filter parameters
K1, clo(1) ,clo(2) ,...,clo(K1) at the same time.
Therefore, in order to address the first problem to
transfer energy from a (t) , w81 =1 and waz = 2 , to the output
frequency waa = 0 , take
Y~(j0)=1, Y~(jwi)=0, w~-100 1 1'2'3'4.
and-for the second problem to transfer energy from u(t),
wal =1 and waz = 2 , to the output frequency wao = 4 , take
Y~(7100) 1~ Y~(7wi) 0' wi 100 i 1, 2' 3, 0.
The filter parameters coz( kl,kz) , kl = 0, 1 ; kz = 0, 1, can then
be determined through the group equations
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
te[Y' ( J 0 )l = ~, ~ coz ( ki ~ kz ) f R ( 0 ~ kl' kz)
kl~xs~ 2
Re Y'(J100)~ ~~ooz(kmkz) fR(100'kl~kz)
kl~kz~0
_ i i fz(O~kl~kz) (31)
I~y'(JO)~=~~coz(ki~kz)
kl~kZ=0
_ 1 1
I~Y'(7100), ~~COZ(kmkz) fi(100~k1~k2)
ki.Okz 0
by the least squares method. In (31) fA( .) and fI( .)
represent the real and imaginary parts of f(.).
Rewrite (31) as
Y=XB (32)
31
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
where
T
Y= Re~Y~(j0)~.~..~Re~Y~(J100)'I~Y~(~0)~r~..rIm Y~(j 4 ) (33)
100
C
B-[C02(~r ~) rC02(lr 1) rC02(O.1)+C02(l, ~),T (34)
fir n n n ~ aRr n , , ~ rn, ~ ., , , 1
G G
_ fR( 4 . 0, 0) , fR( 4 4
_ 100 100'1,1)' fR(100'0'1)
f'(0,0,0) fI(0,1,1) fI(0,0,1)
2. . 2 ' 2
I s 4 I 4
4 '1,1), f (
r '0~1),~
f
(100'0~0)~
f
(
L 100
100
i
x cos 100
2 2 ~x 2
2 2cos +cos
cos
100 100
100
1 cos 100 cos 100
2 2cos + cos
cos
100 100
100
- 1 cos 100 cos 100
i
_0 _0 ~x. sin 100
2 2 G_'x Z
0 - 2sin sin
sin
100 100
100
0 -sin 100 -sin 100
o -2sin 100 . (35)
sin 100 -sin
1Q0
0 -sin100 -sin100
Notice be written in (34) due to the
that the form of
B can
fact
that
f.(w,0,1)=f(w,1,0). (36)
Therefore, the filter parameters 8 for the first
filtering problem to transfer energy from u(t),
wal =1 and wa2 = 2 , to the output frequency wao = 0 can be
obtained as
Bi =(XTX)_iXTY~ (37)
where
9 5 T
yl = 1,0,...~ O~O~...r p ~ (38)
32
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
and the parameters B for the second filtering problem to
transfer energy from a (t) , w~l =1 and waz = 2 , to the output
frequency wao=4 can be obtained as
Bz =(XTX)_1XT'Iz (39)
where
1 5 T
yz = 0,...~ 0 1 0,...,. (40)
0
The ing (37)
results and (39)
of are
comput
Cioz(0, 0) 1187
Cloz(1, 1) 1187 (41)
Cloz(0, 1)+Cloz(1, -2373.
0) 8
and
Czoz(0, 0) -1206.2
62 Czoz(1.1) -1206.2 (42)
=
Czoz(0, 1)+Czoz(1, 2413.2
0)
respectively.
Under the input of (20), the power spectral densities
of the input and output of the non-linear filter
yl(k)=~~cloz(kl.kz)u(k-kl)u(k-kz)
ky=Oki~O
= cloz(0,0)uz{k) + cloz(1,1)uz(k -1) + {cloz(1,0) + cloz(0,1)~u(k -1)u(k)
(43)
which is initially designed to address the first filtering
problem above, are shown in figure 6, and the power spectral
densities of the input and output of the non-linear filter
33
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
i i
Y2( k) - ~ ~c202( ki.k2) a ( k-kl) a ( k-k2)
klsOkZ~
=0202(~~~)u2(k)+C202(1,1)L12(k-1)+[C202(li~)+C202(0i1)]u(k-1)a(k)
(44)
which is initially designed to address the second filtering
problem above, are shown in figure 7.
Further improvement to the performances of the filters
(43) and (44) may be possible. Therefore, a linear filter,
H(jw), is designed in order to further improve the filter
performances.
To improve the performance of the filter (43) for the
first filtering problem, H(jw) is designed to be a fifth
order low-pass type 1 Chebyshev filter with cut off
frequency 0.5 rad/sec and 0.5 dB of ripple in the pass-band
to ensure a satisfactory frequency response over the pass
band. The result is
bl(1)+bi(2) z-1+~..+bl(6) z-s
Hl(jw)= 1-al(2) z-1-..._al(g) z-s
=10-120 - 0174+0. 08532 1 +0.18122-2 +0.16522-3 +0. 09332-' +0 . 01592 5
1+4. 99412-1 -9. 97652-2 +9. 96482-3 -4. 97662-' +0. 99422 5 ~j"
(45)
To improve the performance of the filter (44) for the
second problem, H (jw) is designed to be a fifth order high-
pass type 1 Chebyshev filter with cut off frequency 3.9
rad/sec and 0.5 dB of ripple in the pass band for the same
purpose as in the first problem case. The result is
b2(1)+b2(2) z-1+...+b2(g) z-s
H2(~w) 1_a2(2) z-1_..~g2(6) z-s
z.ej"
- 0. 9218-4. 60882-1 +9.21752-2 -9. 21752-3 +4. 60882-' -0. 92182-sI
1+4 . 83812-1 -9. 36352-2 +9. 06132-' -4 . 38462-' +0. 84862-s ...
(46)
The purpose of the additional linear filter is to
attenuate unwanted frequency components in the outputs of
34
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
the filters (43) and (44) for the above two filtering
problems respectively to make the output of the additional
filter satisfy the corresponding design requirement.
It will be appreciated that the filter parameters
Kl~ clo{1) ~"'.clo(K1) ~ associated with the expression
x
1- ~clo(kl) exp~-jwkl~ in H (jw) can be obtained as a result
keel
of dividing the denominator of H(jw) by the numerator of
H (jw) . The specific H (jw) is given by H1(jw) and Hz(jw) in
equations (45) and (46) for the two filtering problems
respectively.
The general description for the nonlinear filters
i5 designed as above is
Kt K
Y{k)-~cio(kl)Y(k-kl)= 1-~clo(kl)q-kl (k)=H{q-1)y(k)
kl~l kcal
~ ~ ~x
°k~k~COZ(kl~kz)u(k-kl~{k-kz)=~~,coz(kl~kz)qik'qzkxu(k) (47)
i x klspkx.p
where
K.
H(q-1) = 1-~clo{kl)q'kl ~ (48)
klsl
and q-1, q~l and qzl denote the backward shift operators.
Another expression in the time domain for (47) is
Kx Kx
Y(k)=H-1(q~l)~ ~~COZ{kl~kz)qlk'qzkx ~u(k) {49)
kl~kx~0
Therefore, embodiments of the non-linear filters which have
been designed can be realised in a manner as shown in figure
8 or more specifically as shown figure 9.
It will be appreciated that in figure 8 the two
components 800 and 802 are represented by
1 1
G1{qlliq2l)- ~~Cux(kl~k2~lk'~I2kx
kl=OkxaO
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
and
Gz(q 1)=H-1(q-1)-b (1)+b (2)q-1+...+b (6)q_5-
1_a (2) q-1_..~a (6) q-5
For the first filtering problem in this example
G1(qil.qzl)- ~,~co~(kl~kz~lklqz~
kl=Oki=0
with coz ( kl, kz) 's given by ( 41 ) and
bl(1)+bl(2) q-1+...+bl(6) q-s
Gz(q l)
1 _ al ( 2 ) q-1 _. . ._al ( g ) q-s
with bl( i ) 's and al( i ) 's given by ( 45 ) .
For the second filtering problem in this example
G1(q~l,dz1)y~coZ(kl~kzyk'~IZk~
kl=Ok==0
with coz(kl,kz) 's given by (42) and
bz(1)+bz(2) q-1+...+bz(6) q-s
Gz(q 1) 1-az(2) q-1-..._az(6) q-5
with bz( i ) 's and az ( i ) 's given by ( 4 6 ) .
Referring to figures 10 and 11, there is shown the
filtering effects of the filters designed to address the two
filtering problems. Figure 10 shows the power spectrum
densities of the output and input of the nonlinear filter
which is finally obtained for the first filtering problem.
Figure 11 shows the power spectrum densities of the output
and input of the nonlinear filter which is finally obtained
for the second filtering problem. The effects of the
filtering in the time domain of the two filters are shown in
figures 12 and 13. All the responses indicate that the
filters substantially satisfy the design requirements.
36
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
II.2 DESIGN 2
Design No.2 illustrates the detailed procedure and
several examples for designing a non-linear system for
transferring the energy of a signal from a first
predeterminable frequency or range of frequencies to a
second predeterminable frequency or range of frequencies
such that the output frequency response of the nonlinear
system so designed is within specified bounds.
II.2.1 Detailed Procedure
(1) Given u(t), the signal to be processed in the time or
spatial domain, the frequency band [c,d] to which the
energy of u(t) is to be transferred, and the user
specified bound Y$'(w) for the output spectrum Y(jw) over
[c, d] for the design.
(2) Sample the time or, spatial domain signal u(t) with
sampling interval T to yield a discrete series to (k)} and
perform a Fast Fourier Transform (FFT) on the series to
compute the spectrum U ( j w) of a ( t ) as
L1~ M M
~j~l~ =~d~J M 1~~ 1--~2 _1~,..., ~,...,_
2
where Udlj (~)~ is the result of the FFT operating on f a ( k)}
and M is the length of the data used to perform the FFT.
M is taken as an even number for convenience.
(3) Evaluate the range [a,b] of frequencies in u(t) as
b- 2~1b~ a_ 2~c1
MT MT
37
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
where lb is an integer such that
M
UCj~lb~ X0.05, UCj~l~ <0.05 for lE (lb+1),~~~,
2
and 1a is an integer such that
UCj~la) >_0.05, UCjMTl ) <0.05 for 1 E{0,...,(la-1)~
(4) The relationship between the bound of the output
spectrum YB(w), the coefficients of the NARX model
N
y(k)=~,yn(k)
nil
n
~... ~ Con~ll~...~ln)~u ( k-1;) for n ~ 2
yn ( k ) = R 11=1 1"=1 i=1
R
~c~o(1~)Y(k-11)+~coi(11)u(k"11) for n=1
lt-1 11=1
and the spectrum U(jw) is given by
N K K
Ye(W)= 1 1
K ~ (n-11 ~ ~~ ~ ICOn( 11~~ ~ rln~~~lUl*...*IU ~ j W )~
n=N ( 21r~ 1 =1 1"=1 ~w-~~
1 ~ C10~ 11~ eXp ~-J W11~~ c n
1=1y
N
U *~'~* U W
K~ 1 ~ ' In 11 nl
n=NO1 2~~ '--~r--~
h- c:o(11~ eXP (-jWll)
1=1,
where
Cn = ~ . . . ~' ~COn ~ll . . ~ In ~~ n = No ~ . . . ~ N
11=1 la=1
is are parameters associated with the NARX model parameters
Kn~ COn(llr'..~ln) i 11 =1,...~Kn~...~ln =1~...~Kn~ for n=No,~..~N ~
~U~*~~~*IU (jw)) denotes the n-dimensional convolution
n
integration for the magnitude jU(jw)lof the spectrum
U ( jw) , which is defined by
38
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
IpI*...*IU(~W)I- ~.r'~IU(~wi)L..Ip[7 (w_wl_,...~_y,~n_1) ]IdWl...dW~-~
~n
and No=1 when the NARX model involves nonlinear terms
from order 1 to N.
Based upon this expression, the structure
parameters N and No and the NARX model parameters are
determined as below.
(i) Evaluate
- U Ii when ~ na ~ < 1
(a+b) (a+b)
U Ii when nb na
(a+b) C (a+b) ,
where [ x ] denotes the integer part of x,
_ na
[ (a+b) ~+1
I; =[na-i (a+b) ,nb-i (a+b)~, for i=0,~~~,i' -1
Ii =~O,nb-i"(a+b)~
for n=1,2,... until a value of n is reached such that
part of the specified output frequency range Ic,d
falls into f~. This value of n is used as the value
of No.
(ii) Evaluate
for n=2,3,... until a value of n is reached such
that the frequency range ~c,d~ falls completely
within the corresponding fY. This value of n is
taken as the value of N.
(iii) Calculate
~pl*...*IU ( ~ w )I
n
39
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
to yield
~U~*"-*IU (j2~c i~MT)I, for i = 0,-~',M~2
n
using the algorithm
m-W
iQl*...*Ip(j2m i~MT)I=TUCi+~2 -1)n~2M ) i=p,...~-
-.-,
n
~U(0),---,U [n (M-1)}=Conv U(0),~~~,0(M-1) ~~ , U(0)
,..,U(M-1)
------~---_--
A
U (i)=IUdCj M Ci- 2 +1)~~, i=0, 1,...,M-1
for n = No,'-',N , where Conv ( . ) denotes the
convolution operation and U(.) and U(.) represent
the intermediate results of this algorithm.
( iv) Based on the ( id - i~ + 1 ) equations
YB.~2~cil _ '" 1 Ir~ 2~i _ .
J ~ (2~r)~n~~*... U~~ MT ~ J i y,y +1,. .aid
s
n
where i = roundCcMTI CdMT
, id = round 2~ ~ , and round ( x )
means to take the integer nearest to x, use a least
squares routine to compute
Cn r n=N~,~..~N ~
under the constraint that the results must be
positive, and then select the NARX model parameters
Kn~ COn(ll~..~ln) i 11 =Z,...~Kn~...~ln =1~...~Kn
for n=No,'~~,N
under the constraints on the summation of the
modulus of the coefficients given by
A ~,
Cn c ~...~~COn(ll..~ln~~ n=N~~...~N
11=1 lA=11
(v) If necessary, design a classical linear filter, for
example, a band pass filter which ideally allows the
frequency response to be unity over the frequency
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
band [c, d] and zero beyond to yield the linear
frequency characteristic
1
K
1- ~clo(11) exP (-jwh)
1191
and therefore determine the parameters associated
with K1, clo(11) , 11 =1,~~~,K1 . Otherwise, all of the
parameters of clo( .) can be taken as zero to yield a
model having no regression terms associated with the
output.
(5) Construct a NARX model as shown in figure (14) using the
results obtained in the above (iv) and (v). The
nonlinear system illustrated in figure 14 comprises a
nonlinear part 1400 and a linear part 1402. It will be
appreciated that in figure 14
n n
~(~....,~lWutk-11)=~,...~ ~a,(h~..y~)~u(k-11)
h~sl ~y il=1 la.l W
II.2.2 Three Specific Examples
Example 1
This example illustrates a further implementation or
design of a nonlinear system following the above detailed
procedure.
41
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
(1) The signal to be processed is given by
u(t)=2Mu2~sln a t sin ~ t
with a = 3 . 3, ~i=1, and Mu =1. 6 . The frequency spectrum
U(jw) of the signal is shown in figure 15 indicating
that the real input frequency range is [1,3.3. The
requirement for the design is to transfer energy of the
original signal to the frequency band ~c,d~=[5.6,7.6]
with the bound on the output spectrum magnitude
specified to be YB~(w)=1.6 over this frequency band.
( 2 ) Sample a ( t ) with sampling interval T = 0 . O1 sec to produce
1 sin akT-sin ~ kT 1 sin 3.3x0.Olk-sin 0.01 k
u(k)=2Mu~ ~ =2x1.6x~x
O.Olk
k =-1999,~~~, 0,~~~, 2000
and perform a Fast Fourier Transform (FFT) on this
series (M=4000) to compute
_2~r _ 2~r 1
UdO M 1/ UaC~40001~ 1=-1999,~~~,0,~~~,2000
and then to yield
Nra' 1 ~~ 4000 0 . 011- O . OlUdCj 40001 1=-1999, ~ ~, 0,~ ~ ~, 2000
the result of which, in the nonnegative frequency range,
is shown in figure 16.
Notice the difference between the real spectrum of
u(t) in figure 15 and the computed spectrum in figure
16. The differences are due to the errors caused by the
FFT operation. The design should and will be performed
based upon the computed spectrum to lead to more
practical results.
42
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
(3) Evaluate the frequency range ~a,b~ of u(t) from the
computed spectrum giving
a=0.6283 b=3.7699
(4) Design the system structure and parameters
(i) Determination of No.
Clearly, the output frequency range contributed by
the linear part when the input frequencies are within
~a,b~=0.6283, 3.7699 is
fY~ =~a,b~=~0. 6283, 3.7699
l0 The frequency range fY= produced by the second
order nonlinearity in this case is obtained as
follows.
Since n = 2 ,
nb _ na _ 2x3.7699 _ 2x0.6283
(a+b) [ (a+b) (3.7699+0.6283) 3.7699+0.6283
C )
=1. 7143-( 0 . 2857 ~ =1. 7143-0 > 1
and
i ~ +1= 2x0.6283 +1=( 0.2857 ~+1=0+1=1
[(a+b) 3.7699+0.6283
~C
i i3
f~ _~ _ ~r~a-i (a+b) ,r~b-i (a+b~ ~O,r~lri'(a+b~
~na,r~0,z~-(a+b~~2x0.6283, 2x3.70, 2x3.7699-(0.6283+3.7699
=1.2566, 7.53980, 3.1416=~0, 7.5398
fYZ thereby obtained contains part of the specified
output frequency range ~c,d~ _ ~5 . 6, 7 . 6~ . So, No is
determined to be No = 2 .
(ii) Determination of N .
43
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
Evaluating fY =f~Uf~-1 for n=2 yields
fylna2 =f,~UfYI =~0, 7.5398~~0.6283, 3.7699=~0, 7.5398
To evaluate fYl~3 =fY~Uf,~ , calculate fY first. In
this case
nb _ na _ 3 x 3 . 7 699 _ 3 x 0 . 6283
(a+b) (a+b) (3.7699+0.6283) (3.7699+0.6283)
=2.5714-~ 0.4286 ~=2.5714-0>1
i»- na +1- 3x0.6283
+1=~ 0.4286 ~+1=0+1=1
(a+b) [ 3.7699+0.6283
So
fY3 =UIi =IoUII =~na,nb~0.nb-(a+b)~
3x0.6283, 3x3.7699~~0, 3x3.7699-(0.6283+3.7699)
1.8848, 11.3097~U~0, 6.91I5~=~0, 11.3097]
Therefore
fxln=s =fYaUf~ =~0, 7.5398~~0, 11.3097=~0, 11.3097
fYln=3 thereby obtained includes the whole specified
output frequency range ~5.6, 7.6~. N is therefore
determined to be N = 3 .
( iii ) Calculate ~U~*.-.*IU ( jw)I for n = No = 2 and n = N = 3 ,
n
respectively to yield
~t~* . ~U (j2~c i~l~ ~L~* ~ ~U (j2~c i~4000x0.01~ i=0; -;400q2, n=2 and 3
-w
n n
The results are shown in figure I7.
( iv) Based on the ( id - i~ + 1 ) equations
YB» (n i/2 0 0 0 x 0 . 01 ) =1. 6 = 2~ CZ ~U~* IU~j n' i/2 0 0 0 x 0 . 0 l~l
+ 1 2 C3 ~U~*~U~ * IU~j ~c i/2 000 x 0 . 01)I
( 2~t)
1 lc, lc+1, ~ .. ~ id-1 ~ ld
With
44
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
i~ = round~cMT~2~~ = round~5 . 6 x 4000 x 0 . 012 x ~t~ = 36
id = round~dMT/2~r~ = round~7 . 6 x 4 0 0 0 x 0 . 012 x ~c~ = 4 8
use a least squares routine under the constraint of
nonnegative solutions to compute Cz and C3, that is,
to determine CZ and C3, under the constraints of
CZ Z 0 and C3 >_ 0, to minimises the following
expression
1. 6-~~ p~~(~,~ ;~2oooxo.0l~- 12 c, p~r~ *~o(~n i/2oooxo. ol~
(v~
The results obtained are
CZ = 0 and C3 = 3 . 8 3 67
(v) Design, optionally, a linear Butterworth band pass
filter to attenuate the frequency components beyond
the frequency band ~c, d~=~5.6, 7.6~ to yield the
linear frequency characteristic
10-30. 0986-0.1972q-2 +0. 0986q~''
=a
1-3. 9633q-1 +5. 8988q'Z -3. 9076q-3 +0. 9721q-° q ~
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
(5) Construct a NARX model as shown in figure 14 with
No -2, N=3, K2 =K3 =1, co2(1, 1)=0, co3(1, 1, 1)=3. 8367,
that is,
"~ ~~h... ;In)l lu (k-lid W~ ~roz~ll~~z)~ (k-li)+
~~x~ W
~~~ ~(~~lZ~~)~(k-11>
1 1 2
C02\hil2Jl lu (k-li)+
ll~llxal 1.1
1 1 1 3
C03~1'1~12~13~~u(k li)
11=1 h=11.1 i=1
=c~(1,1)u2(k-1)+c~(1,1,1)u3(k-1)=Oxu2(k-1)+3.8367u3(k-1)=3.8367u3(k-1)
and
1Q'3~0.0986-0.1972q~+0. 0986q~')
K~ _1
[1-1~ ~'~ ~ 1' ~ q - 1-3.9633q 1+5. 8988q 2-3.9076q 3+0.9721 '~
q
which determines the parameters associated with the NARX
model parameters K1 and clo( 11) , 11 =1,---,K1.
The output frequency response under the given input is
shown in figure 18 indicating that the energy has been
transferred to the specified frequency band ~c, d~=~5.6, 7.6~
with the magnitude of the response below the specified bound
1.6.
The frequency response of the above design is examined
for other input signals below.
46
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
In the first case, consider
u(t)=~(b2Ma)tZ~2cos(a 2 )t-cosbt-cosa t
where a, b, and Mu are defined as above. The frequency
spectrum of the signal is shown in figure 19. The frequency
range is clearly the same as that of the signal having the
spectrum given in figure 15 and the magnitude of the
spectrum also satisfies the condition that
IU(Jw)ISM"=1.6
This implies that the frequency response of the designed
system to this u(t) should in theory also transfer energy
into the frequency band [c, d]=~5.6, 7.6] with the output
magnitude frequency response being less than Y8~(w)=1.6 over
this frequency band. Figure 20 shows this frequency
response and indicates that the actual result is consistent
with the theoretical predictions.
For the second case, u(t) was taken as a random
process with the frequency spectrum given in figure 21. The
frequency spectrum is substantially within the frequency
range ~1, 3,3] with a magnitude of less than 1.6. Therefore,
the same conclusion should apply for the output magnitude
frequency response of the designed system to this random
input. Figure 22 shows this response and indicates that the
energy is transferred to a new frequency band of
substantially ~5.6, 7.6~. Note that the magnitude of the
output spectrum over this frequency band is well below the
specified bound YBr(w)=1.6. This is because of the effect of
the attenuation which is due to intrakernel interference of
the nonlinear mechanism.
The nonlinear filter which has been designed above can
be represented by the block diagram shown in figure 23. This
47
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45b44 PCT/GB99/00550
could be realised electronically by following the approach
used to realise Design 1 in figure 9. However, for some
applications the design may need to be realised in
continuous time. Using the bilinear transformation
1 + ~T~2)s
q=
1- ~T~2)s
where T=0.01 is the sampling interval, q-1 is the delay
operator, and s is the Laplace Transform operator and
substituting in the discrete time design in figure 23
provides the equivalent continuous time system shown in
figure 24. Simulating the system in figure 24 produces
almost identical responses as the discrete time system
response of figure 18.
The system in figure 24 could for example be realised
mechanically as illustrated schematically in figure 25 where
the cubic device is either a material which exhibits a cubic
response or is implemented as an actuator which takes ui(t)
as input and produces an actuation output ua(t) which is
proportional to the cubic power of the input.
One possible application of this design would be in
vibration isolation. For example it may be required to
transfer energy from an input frequency range [1,3.3] to the
frequency range [5.6,7.6]. The new design could be used to
achieve this effect.
Other much more complicated designs for vibration
isolation can be achieved based on the present invention.
The design procedure would be exactly as described above. but
the realisation would involve the synthesis of dampers,
damping materials or actuators with the nonlinear dynamic
characteristics specified by the designs.
Example 2
48
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1.
WO 99/45644 PGT/GB99/00550
Example 2 shows an application of the design above to
the attenuation of signal energy over unwanted frequency
bands using designed nonlinear effects.
When using linear structures for the attenuation of
signal energy in a physical system, the attenuated energy is
usually absorbed by devices such as dampers in mechanical
systems and resistors in electronic circuits and transformed
to other energy forms such as thermal energy. This may lead
to undesirable effects and measures, such as using radiating
l0 devices, sometimes have to be taken to compensate for these
effects. When a nonlinear system is employed, instead of
attenuating the signal energy directly as in the linear
case, the signal energy at a frequency of interest can be
spread over a wider frequency band and attenuated by means
of the counteractions between different terms which compose
the output spectrum. This means that, to a certain extent, a
nonlinear design for signal energy attenuation can reduce
the requirements for using energy absorption devices and is
of great benefit in practical applications.
Another important application would be, for example, in
the design of the foundations or the modification of the
characteristics of buildings and structures which are in
earthquake zones. The objective in such an application would
be to design materials or actuators, tuned as required for
each structure, which transfer the damaging input energy
from an earthquake to another more acceptable frequency band
or spread the energy to be within an acceptable bound over a
desired frequency range. Spreading the energy using the
present design should produce significant reductions in
earthquake damage.
(1) Design a nonlinear system to attenuate the energy of the
signal
49
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
u(t)=~(a2Mb)t2 2cos~a2bt)-cosa t-cosh t .
where a=3.3, b=1, Mu =1.6.
(2) The spectrum of the signal is evaluated. This is
implemented by sampling the signal with sampling
interval T =O.Olsec to produce
a ( k) = 2Mn
~c(a-~ (kT)2 2cosCa 2 ~kTj -cosa kT-cos~B kT
k =-1999,~--, 0,-~-, 2000
and perform a Fast Fourier Transform (FFT) on this
series. The result of the FFT is shown in figure 26.
(3) Evaluate the range ~a,b~ of frequencies in the signal
based on the computed spectrum. The evaluation gives
a=1.0996 b=3.1416
This is because the computed spectrum indicates
IU (jw)I Z 0. 05 for w E~1. 0996, 3 .1416
and
IU (jw)' < 0 . 05 for other w
(4) Assume that, as part of the design, output frequency
range is ~c,d~=~0, 7.3~ and the required bound over this
frequency band is YB~(w) =1 .
(5) Following the same steps for the design of the system
structure and parameters as in example 1 above,
No, N, and C", n = No,~~-,N were determined as follows .
(i) No
No is determined to be No=1. This is because
fyl =~a,bJ=1.0996, 3.14161E~0, 7.3~=(c, d~
where fYl denotes the output frequency band contributed
by the system linear part, and part of the selected
output frequency range falls into the linear output
frequency range fYl .
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
(ii) N
In this case, it can be obtained using a=1.0990 and
b=3.1416 that
f,~ =2.1992, 6.2832~~0, 2.0420
fY~ _ ~0, 9 . 4248
Thus, if the maximum nonlinear order is taken to be 2,
then the output frequency range of the system is
~r~n=z =f~Uf,~ =~0, 6.2832
If the maximum order is taken to be 3, then the output
l0 frequency range
fyln.3 =fg Uf~ =~0, 9.4248
Clearly, fYlns3 contains the whole selected output
frequency range ~c,d~ _ ~0, 7 . 3~ , N is therefore determined
to be N=3.
IS (iii) C~, n=1, 2, 3.
Cn, n =1, 2, 3 . are determined to minimize the
following expression
_~1-~~U(~~/~~-~c~ hI*~~~~/MT~- 12~ hi*hI*~~~~' i/r2r~ 2
1'Le
under the constraints of Ci ~ 0, i =1, 2, 3 .
Notice that for this specific example,
M = 4000
CcMTI CO x 4000 x 0 . O11
i~ = round 2~ ,I = round 2~
~dMT~ C7 . 6 x 4000 x 0. O1J
id = round 2~ = round 2~ = 48
The solution to this minimisation problem is
C1 = 0, CZ = 2 .1932, C3 = 6. 0550
51
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
(6) Select the NARX model parameters
Knr Con(lln..~ln) r 11 =1,...~Knr...~ln =lr...rKnr for
n=No,...~N
based on the results obtained in (5) as
Ki = Kz = K3 = 2
coi( .) =0.
c~(1,1)=1.1932, c,~(1,2)=c~(2,1)=0, c~(2,2)=-1,
cp3 ( 1,1,1 ) = 3 . 0550, c.~3 ( 2, 2, 2 ) = 3, and other c93 ( . ) 's are
zero
and consequently construct a NARX model as
n K
Y(k)=~ y..~ ~(hr...~~)~u(k-li)=~co~(h)u(k-li)+
n"t~ 1==1 la'1 i~ 1i=1
x2 2 K K~ K~ 3
~~ ~2Chr~)~u(k li)+ ~~~ ~'03~hr~rl3~~u~k li)
l=u2~1 i=1 11~~=11~=1 i_1
=~~~~~)u(k-~)+~~,coz(~xrlz~~(k-li)+z z z
=c~(1,1) uz(k-1)+c~(2, 2) uz(k-2)+co3(1,1,1) u'(k-1)+co3(2, 2, 2) u'(k-2)
= 1.1932uz(k-1)-uz(k-2)+3. 0550u3(k-1)-3u3(k-2)
Notice that the selected NARX model parameters
satisfy the relationship
Icoyly = 0 = Ci
y=~
KZ
~cvz~h~lz~=Icoz(1~1~+Icoz(2r2~ =~1.1932~+I-1~ =2.1932
i~_i jai -Cz
~(~r~rls~~c~(1.1.1~-+~c~(2.2.2~ ~3.055ø~-~ =6.0550
and the different signs selected for
coz(1,1) and coz(2,2)
and for
co3(1, 1, 1) and co3(2, 2, 2)
are such as to give effect to the intra-kernel and
inter-kernel interferences, which is to attenuate the
energy of the input signal.
52
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
The frequency domain response of the constructed model
to the sampled series of the input signal is shown in figure
27. It can be seen that excellent energy attenuation has
been achieved by the designed system. It will be
appreciated that the input energy in figure 26 has been
spread over the designed frequency band by the nonlinear
filter.
Example 3
This example shows another application of the present
invention to the attenuation of signal energy over unwanted
frequency bands using designed nonlinear effects. The
example also illustrates the effect of the same design on a
different input signal to demonstrate the effectiveness in
energy attenuation of the designed system in different
circumstances.
(1) Design a nonlinear system to attenuate the energy of the
signal
u(t)=2M 1 sin a t -sin ~3 t
a 27C t
with a=3.3, ~=1, and Mu =1.6 .
(2) The spectrum of the signal is evaluated by sampling the
signal With sampling interval T =0.01 sec to produce
u(k)=2N1~ 1 s~ ~ S~ ~ ~=2x1.6x 1 x S~ 3.3x0.01k-sin 0.01 k
O.Olk
k=-1999,~~~, 0,~~~, 2000
and then performing a Fast Fourier Transform (FFT) on
the obtained time series. The result of the FFT is the
same as that shown in figure 16.
53
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
(3) Evaluating the range ~a,b~ of frequencies in the signal
based on the computed spectrum gives
a=0.6283 b=3.7699
as the computed spectrum indicates
IU(jw)I>_0.05 for w~E~0.6283, 3.7699
and
~U (jw)I < 0. 05 for other w .
(4) Assume that, as part of the design, it is desired that
the output frequency range is ~c,d~=~0, 10.3j and the
required bound over this frequency range is YB'(w)=1.
(5) Following the same steps for the design of the system
structure and parameters as in example 1 above, the
parameters No, N, and Cn, n=No,~~~,N are determined as
follows.
(i) No
No is determined to be No =1 due to
f,~ _ ~a , b~ _ ~0 . 6 2 8 3 , 3 . 7 6 9 9~ E ~0 , 10 . 3~ _ ~c , d~ ,
which indicates that part of the selected output
frequency range falls into the linear output
frequency range fYl.
(ii) N
In this example, N is obtained using a=0.6283 and
b=3.7699. Therefore,
f,~ =~0, 7 .5398
f~ =~0, 11.3097.
Hence, if the maximum nonlinear order is taken to be
2, the output frequency range of the system is
fyln=2 = fY=UfYI =~0, 7 . 5398 .
If the maximum order is taken to be 3, the output
frequency range
~In=3 -~c,~~ =t0~ 11.3097 .
54
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
As fYln=3 contains the whole selected output frequency
range ~c,d~=~0,7.6~,. N, for the design, is determined
to be N=3.
(iii) Cn, n=1, 2, 3 ,
Cn, n =1, 2, 3 are determined in such a manner as
to minimise
1"Ci~U(7~MT~-~Cz ~~*~~J~~-(~z~ ~~'"~~*I~7~ ~~
under the constraints of Ci ~ 0, i =1, 2, 3 . In this case
also M=4000 but
CcMTI CO x 4000 x 0 . O11
i~ = round 2~ J = round 2~ J = 0
rdMTl r10. 3 x 4000 x 0 . Ol.l
id = round) 2~ I = round) 2~ J = 66
The solution to this minimisation problem is
C1 =0, CZ =0.2928, C3 =0.9763
(6) The NARX model parameters
Kn~ Con(llr~..~ln) r 11 =1,...~Kn~...~ln =1~...~Kn~ for n=No,~..~Dj ,
are selected based on the results obtained in (5) as
Ki=Kz=K3=2
coi(.)=0
c~(1,1)=0.1928, coz(1,2)=--0.1, c~(2,1)=0, c~2(2,2)=0,
cp3(1,1,1)=0. 6763, cD3(1, 2, 2)=-0.3, and other cD3( .) 's are zero.
and consequently a NARX model is constructed
N ~, K" n
Y(k)= ~ ~'..~' con~].1,...~ln~~u(k-li)
rr~No 1,=1 ~,=1 t=1
=~,~m(~) a (k-~)+~ ~oz(~~lx~~ (k-~)+ 2~ ~~~.rlzr~~~ (k-~)
~=i ~-uz~~ yi ~,~-~ t~
=cro2(1,1)u2(k-1)+coz(1,2)u(k-1)u(k-2)+co3(1,1,1)u'(k-1)
+ca3(1, 2, 2)u(k-1)u2(k-2)
=0.1928uZ(k-1)-0.1u(k-1)u(k-2)+0.6763u3(k-1)-0.3u(k-1)uz(k-2)
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
The selected NARX model parameters satisfy the
relationships
~~Coyly - 0 - C1
11=1
c,~~ls,lz~=Ic~(1,1~+Ic~(1,2~ =~0.192~+~-0.1~ =0.2928=C~
g ~ c~l~,lz,l~~c~(1.1,1~+~c~(1,2.2~ ~0.616~-~-0.~ x.9763-C~
and the different signs selected for
co2(1, 1) and co2(1, 2)
and for
co3(1,1,1) and co3(1,2,2)
are in order to give effect to the intra-kernel and
inter-kernel interferences, which is to attenuate the
energy of the input signal.
The frequency response of the constructed model to the
t5 input signal specified above is shown in figure 28 which
indicates that the required energy attenuation has been
realised.
The frequency response of the design above to the input
signal in example 2 gives the result shown in figure 29.
The nonlinear system design above clearly also works for the
signal in example 2 in energy attenuation although the model
was not specially designed for this signal. This is
reasonable since the magnitude of the spectrum of the signal
in example 2 is less than the magnitude of the spectrum of
the signal in this example over almost all of the input
frequency band and over the other frequency bands the
magnitudes of the spectra of the two signals are all zero.
This illustrates that the above design is effective not only
for the input based on which the design is implemented but
also for other inputs with magnitude frequency
characteristics less than the magnitude of the spectrum of
the considered input.
56
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
III. FLOWCHARTS
Referring to figure 30, there is shown a flow chart
3000 depicting the steps of an embodiment of the present
invention in which the output spectrum is specified over a
given range of output frequencies.
The signal to be processed and the desired frequency
response of the non-linear system to be designed are input
via steps 3002 to 3006.
At step 3002, a digital input signal {u(k)} and its
sampling interval T are to be provided. The range of output
frequencies [c, d] over which the energy of the input signal
is to be transformed is given in step 3004. The output
frequency range is specified using beginning and end
frequencies c and d respectively. The distribution of the
energy over the output frequency range [c,d~] is requested or
specified in step 3006.
The frequency characteristics of the input signal are
determined at steps 3008 and 3010. More particularly, the
frequency components of the digitised input signal,{u(k)},
are calculated using a Fast Fourier Transform at step 3008.
The range of frequency components contained within the input
signal is determined from the FFT at step 3010.
Referring to steps 3012 to 3024, the orders of the
nonlinearities required to realise a desired nonlinear
system and, hence, the energy transformation, are
calculated.
57
SUBSTITUTE SHEET (RULE 2b)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
Variables n and No are set to one and zero respectively
at step 3012. The output frequency components resulting from
the nth-order of system nonlinearities are determined at
steps 3014 and 3016.
A determination is made at step 3018 as to whether or
not No=0, that is to say, whether or not the smallest order
of system nonlinearities which makes a contribution to the
desired energy transformation has been determined. If No is
equal to zero, a determination is made at step 3020 as to
whether or not part of the specified output frequency range
falls within fyn. If the determination is negative,
processing continues at step 3026 at which the value of n is
increased by one. However, if the determination is
positive, the value of No is set to equal n at step 3022 and
processing continues at step 3026.
If No is not equal to zero, then a determination is
made at step 3024 as to whether or not the specified output
frequency range lies completely within fy = fyn v.fyn_l. If
the determination is positive, processing continues with
step 3027. However, if the determination is negative, the
value of n is incremented by one at step 3020 and processing
continues at step 3014.
Steps 3028 to 3034 determine the values of the lags of
the nonlinear model for all values of n = N0, NO+1,...,N and
determine the parameters of the nonlinear system to be
designed.
Step 3036 represents a step for fine tuning of the
output or frequency response of the designed non-linear
system.
58
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99145644 PG"f/GB99/00550
Steps 3038 and 3040 determine whether or not the
resulting frequency response is sufficient to meet the
design requirements. If the frequency response of the
designed filter is acceptable, the discrete version of the
filter is output at step 3042. However, if the designed
non-linear system does not have an acceptable frequency
response, then step 3044 increments the value of Kn by one
for all n= Np, NO+1,...,N and steps 3030 to 3040 are
iteratively repeated.
The determination in step 3040 as to whether or not the
designed filter is acceptable is made, for example, by
calculating the difference between the required output
spectrum and the real output spectrum of the designed system
over the frequency band [c,d]. If the modulus of the
difference is below a predeterminable threshold over all the
output frequency band [c,d], then the designed nonlinear
system may be deemed to be acceptable. However,. if the
modulus of the difference is greater than the threshold at
any frequency over [c,d], then the design is refined.
Referring to figure 31, there is shown a flow chart
3100 for implementing computer code according to a second
embodiment of the present invention.
The signal to be processed and the specification for
the desired bound to be imposed upon the output signal
frequency characteristics is input at steps 3102 to 3106.
At step 3102, a digitised input signal and its sampling
interval T are to be provided. The range of output
frequencies [c, d] over which the energy of the input signal
is to be transformed is specified in step 3104. A bound
59
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
YB*(w) for the distribution of the energy- over the output
frequency band [c, d] is input at step 3106.
The frequency characteristics of the input signal are
determined at step 3108 and 3110. More particularly, the
frequency components of the digitised input signal,{u(k)},
are calculated using a Fast Fourier Transform at step 3108.
The range of frequency components contained within the input
signal is determined from the FFT at step 3110.
15
Referring to steps 3112 to 3124, the orders of the
nonlinearities required to realise a desired. nonlinear
system and, hence, the energy transformation, are
calculated.
Variables n and No are set to one and zero respectively
at step 3112. The frequency components resulting from the
nth-order of system nonlinearities are determined at steps
3114 and 3116.
A determination is made at step 3118 as to whether or
not No - 0, that is to say, whether or not the smallest
order of system nonlinearities which contributes to the
desired energy transformation has been determined. If No is
equal to zero, a determination is made at step 3120 as to
whether or not part of the specified output frequency range
falls within fyn. If the determination is negative,
processing continues at step 3126 in which the value of n is
increased by one. However, if the determination is
positive, the value of No is set to equal n at step 3122 and
processing continues at step 3126.
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
If, at step 3118, it is determined that No is not equal
to zero, then a determination is made at step 3124 as to
whether or not the specified output frequency range lies
completely within fy = fyn a fyn_1. If the determination is
positive, processing continues with step 3127. However, if
the determination is negative, the value of n is incremented
by one at step 3126 and processing continues at step 3114.
Steps 3128 to 3134 determine the values Cn for all
values of n = N0, NO+1,...,N, which represents the summation
of the modulus of the values of the parameters of the
nonlinear system.
At step 3136 the parameters of a NARX model are
selected given the constraints imposed upon the non-linear
system obtained in steps 3128 to 3134. A determination is
made via steps 3138 and 3140 as to whether or not the
frequency response beyond the frequency band [c,d] of the
designed filter is acceptable. If the frequency response is
acceptable, the filter design parameters are output at step
3142. However, if the filter characteristics are not
acceptable at frequencies outside the frequency range (c,d],
then a conventional filter, H(q-1), is designed, at step
3144, in order to reduce or obviate the frequency response
of the designed filter outside the range of frequencies
[c,d]. Finally, the design is completed at step 3146 by
combining the designed non-linear and linear filters, if
any.
The determination in step 3140 as to whether or not the
frequency response of the designed filter is acceptable
outside the range of frequencies [c, d] is made, for example,
by comparing the modulus of the frequency response beyond
the frequency range [c, d] with a predeterminable threshold.
61
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
If the modulus is below the threshold over all the frequency
range outside [c,d], then the designed nonlinear system may
be deemed to be acceptable. However, if the modulus is
greater than the threshold at any frequency beyond [c,d],
the design is refined.
62
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
IV. THREE MORE DESIGNS AND ERAMpLES
IV.l DESIGN OF NONLINEAR FILTERS WITH SPECIFICATIONS FOR
BOTH THE MAGNITUDE AND PHASE OF OUTPUT FREQUENCY RESPONSES
It will be appreciated that the basic principles of the
present invention can be applied to the design of nonlinear
filters based on specifications for both the magnitude and
phase of output frequency responses. The ability to
modulate phase as well as or instead of magnitude is of
particular importance in telecommunication applications.
Consider a filtering problem such that given an input
spectrum U(j w) over a frequency band [a, b] and a desired
output spectrum Y*(jw) over another frequency band [c, d] , a
filter is required to be designed so that the output
frequency response Y(jw) can match the desired spectrum
' Y*(jw) as closely as possible in terms of both magnitude and
phase characteristics. The.basic principles in Section I can
be directly applied to realise the design of such a filter.
The procedure to be followed is described below.
First, a nonlinear filter
y, (t) = N[u(t)]
is designed using the. basic principles described in Steps
(i)-(iv) and (v.l) Part 1 in Section I to produce a
frequency response Y,(jw) such that Y, (j w) can match Y~*(jw)
over the specified output frequency range [c, d] as closely
as possible in terms of both the magnitude and phase.
Secondly, if required, design a linear filter with a
frequency response function H,(j w) such that, ideally,
H~(jw) = Y*{~W~ w a[c, d)
Y~ (J w)
63
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PC"f/GB99/00550
This can be used to improve Y, (j w), the result obtained from
the nonlinear design, so that the frequency response of
the corresponding output
Yz (j w) = Hi (j w)Yi (j w)
provides a better match to the desired spectrum Y,(jw).
Thirdly, if required, design a linear phase FIR (Finite
Impulse Response) band pass filter Hz(j w) with the ideal
magnitude frequency characteristic
1 w a[c,d]
IHz(jw)I 0 otherwise
and a linear phase over the frequency range. Then construct
the designed filter using linear filters H, (j w) and Hz (j w)
and nonlinear filter N[u(t)] as shown in figure 32 to yield
the output frequency response
Y(j w) = Hz (j w)Yz (.7 w)
The second and third steps above follow the design
principle described in Step (v.l) Part 2 in Section I so as
to augment the performance of the nonlinear filter
y, (t)=N[u(t)] designed in the first step.
Ideally, Y(jw)=Hz (jw)Yz(jw) implies that
I y(jw~ _ ~Hz(Jw~~x(jw~ =I Y~Jw~ '~~(Jw)Y(Jw~ -I y~(jw~ w E[~~
0 ode
and
LY(jw)=LHz(jw)+LYz(jw)=k~w+LY'(jw)
due to the linear phase characteristic of Hz (j w) where k~ is
a coefficient Which is a function of the order of Hz (j w) .
This indicates that the output frequency response of the
designed filter is ideally the same as the desired response
over the output frequency range [c, d] except for a linear
phase difference between the real and the desired phase
response. This is in fact an unavoidable phenomenon if band
64
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT /GB99/00550
pass filtering such as the effect of HZ(j w) is applied for
the design. However, this is still an ideal characteristic
since a linear phase implies that the filter group delay is
constant, the filtered signal is simply delayed for some
time determined by k~, and the wave shape of the processed
signal is preserved, that is, there is no phase distortion
in the filter output.
The results of a specific nonlinear filter design
obtained using the above procedure and based on
specifications for both the magnitude and phase are shown in
figures 33-35.
The given input for this design was produced using a
white noise sequence uniformly distributed in [0,4] and band
limited within the frequency range [a,b]=[1,8] under a
sampling interval T$ = 0.02 s . The magnitude of the spectrum of
the given input is shown in figure 33.
The desired output spectrum was chosen to be
" exp(-500w) + j(600w2 ) w a ~c, d~ _ ~13,16~
Y (J w) ° 1000
0 otherwise
Figure 33 also shows the comparison between the
magnitude of the output spectrum Y(j w) of the designed
nonlinear filter and the magnitude of the desired spectrum
Y '"(j w) .
Figure 34 shows the comparison between the phase angle
of Y,(jw), the output spectrum before linear phase filtering,
and the phase angle of the desired spectrum Y"(jw).
Figure 35 shows the phase angle of the applied linear
phase filter HZ (j w) .
It can be observed from the above that a nonlinear
filter designed using the basic principles of the present
invention can produce an output frequency response which
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
Figure 35 shows the phase angle of the applied
linear phase filter HZ (j w) .
It can be observed from the above that a nonlinear
filter designed using the basic principles of the present
invention can produce an output frequency response which
satisfies a design specification in terms of both the
magnitude and phase.
The discrete time model description of the designed
filter is given below where the nonlinear part of the
model is the discrete time model description of the
nonlinear filter
Y~ (t) - N~u~t)~
and the linear part of the model is' the discrete time
model description of the linear filter, the frequency
response function of which is
H(J w) = Hi (.7 w)Hi (J w)
Nonlinear part of the model:
y(k)= +(3.123e+06) u(k-1) +(-2.244e+07) u(k-2) +(6.602e+07)
u(k-3)
.. +(-1.027e+08) u(k-4) +(8.961e+07) u(k-5) +(-4.18e+07)
u(k-6)
+(8.176e+06) u(k-7) +(4.239e+09) u(k-1)u(k-1)
+(-1.772e+10) u(k-1)u(k-2) +(5.897e+09) u(k-1)u(k-3)
+(7.213e+09) u(k-1)u(k-4) +(-3.66e+09) u(k-1)u(k-5)
+(-1.869e+08) u(k-1)u(k-6) +(6.736e+07) u(k-1)u(k-7)
+(-6.777e+08) u(k-2)u(k-2) +(8.003e+10) u(k-2)u(k-3)
+(-7.57e+10) u(k-2)u(k-4) +(6.023e+09) u(k-2)u(k-5)
+(8.648e+09) u(k-2)u(k-6) +(-4.365e+08) u(k-2)u(k-7)
+(-8.365e+10) u(k-3)u(k-3) +(2.268e+10) u(k-3)u(k-4)
+(1.005e+11) u(k-3)u(k-5) +(-3.795e+10) u(k-3)u(k-6)
+(-2.516e+09) u(k-3)u(k-7) +(1.054e+11) u(k-4)u(k-4)
+(-1.97e+11) u(k-4)u(k-5) +(1.109e+10) u(k-4)u(k-6)
66
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
+(1.907e+10) u(k-4)u(k-7) +(2.352e+10) u(k-5)u(k-5)
+(8.173e+10) u(k-5)u(k-6) +(-3.318e+10) u(k-5)u(k-7)
+(-4.218e+10) u(k-6)u(k-6) +(2.042e+10) u(k-6)u(k-7)
+(-1.658e+09) u(k-7)u(k-7)
Linear part of the model:
y(k)=b(1)u(k)+b(2)u(k-1)+, ...,+b(m)u(k-m)-a(1)y(k-1)-, ...,-
a (n) y (k-n)
with n=2 and m=303 where
[a(1),... ...,a(n)] -
-1.86215871605398 0.95715116734794
and
[b(1),... ..., b(m)] _
l.Oe-03
Columns 1 through
4
0.00000003328202 0.00000021432147 0.00000080368128
0.00000227704991
Columns 5 through
8
0.00000537879856 0.000011134991 06 0.00002079938253
0.00003571014847
Columns 9 through 2
1
0.00005704570668 0.00008548478679 0.00012079738459
0.00016141668710
Columns 13 through 16
0.00020406372559 0.00024351205626 0.00027258483896
0.00028246765302
Columns 17 through 20
0.00026339508245 0.00020572744049 0.00010137844659
-0.00005450964923
Columns 21 through 24
-0.00026181250429 -0.00051381800480 -0.00079603373996
-0.00108568381434
Columns 25 through 28
-0.00135214637123 -0.00155851835832 -0.00166438952001
-0.00162976908378
Columns 29 through 32
67
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
-0.00141994747987 -0.00101090816448 -0.00039475153522
0.00041552374840
Columns 33 through 36
0.00138259540242 0.00244344402372 0.00351062196838
0.00447655873267
Columns 37 through 40
0.00522101718800 0.00562147075427 0.00556579258464
0.00496627276545
Columns 41 through 44
0.00377365278712 0.00198963381599 -0.00032378155160
-0.00303968275897
Columns 45 through 48
-0.00596769040539 -0.00886230677976 -0.01143843394688
-0.01339358387193
Columns 49 through 52
-0.01443551408603 -0.01431325012233 -0.01284878916639
-0.00996641286493
Columns 53 through 56
-0.00571602453045 -0.00028726506096 0.00598841256370
0.01264965179911
Columns 57 through 60
0.01913182739200 0.02480771068003 0.02903991461588
0.03124135106508
Columns 61 through 64
0.03093862246516 0.02783233132424 0.02184786863383
0.01317044094614
Columns 65 through 68
0.00225896524855
-0.01016501602446
-0.02315515892661
-0.03560414378179
Columns 69 through 72
-0.04633007891956 -0.05417943987784 -0.05813822823951
-0.05744137376473
Columns 73 through 76
-0.05166958483783 -0.04082303832663 -0.02536256454818
-0.00621129546254
Columns 77 through 80
0.01528703636150 0.03745307958913 0.05839584942467
0.07616729599331
68
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/OOS50
Columns 81 through 84
0.08893537701557 0.09516078483677 0.09376093809767
0.08424478625381
Columns 85 through 88
S 0.06680350720636 0.04234527006789 0.01246669428018
-0.02064087852648
Columns 89 through 92
-0.05434613862312 -0.08578337461088 -0.11209316760456
-0.13067820746590
Columns 93 through 96
-0.13945154456062 -0.13705390892471 -0.12301823047738
-0.09786316009190
Columns 97 through 100
-0.06310299056015 -0.02116847625143 0.024'75895107438
0.07098889554710
Columns 101 through 104
0.11362138287669 0.14887942949652 0.17344622849594
0.18477606135825
Columns 105 through 108
0.18134984027062 0.16284982658307 0.13023456167487
0.08570350882143
Columns 109 through 112
0.03255064587105 -0.02508361142904 -0.08254318260252
-0.13504269472806
Columns 113 through 116
-0.17807650738416 -0.20781448143133 -0.22144885867665
-0.21746018536730
Columns 117 through 120
-0.19577680884658 -0.15781155123986 -0.10636991902139
-0.04543567185132
Columns 121 through 124
0.02014930576277 0.08508414798056 0.14405304899329
0.19217566873157
Columns 125 through 128
0.22542441249983 0.24097171607669 0.23743645368538
0.21500740460840
Columns 129 through 132
0.17543256598964 0.12187499247761 0.05864768640035
69
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
-0.00914923229050
Columns 133 through 136
-0.07605725937466 0.13671663683833 -0.18631209098366
-
-0.22096869885059
Columns 137 through 140
-0.23806415895179 0.23643147511610 -0.21643603250516
-
-0.17992231311682
Columns 141 through 144
-0.13003701658436 -0.07094606546323 -0.00747191949549
0.05531598034943
Columns 145 through 148
0.11252149812387 0.15981666793597 0.19377819943088
0.21213874239435
Columns 149 through 152
0.21393429471004 0.19953878954962 0.17058700949905
0.12979660938955
Columns 153 through 156
0.08070832589097 0.02736960335274
-0.02600882989955
-0.07539394440027
Columns 157 through 160
-0.11724060322409
-0.14874679880287
-0.16803574024719
-0.17425382855726
Columns 161 through 164
-0.16758132308460
-0.14916007746448
-0.12094944070741
-0.08552673296083
Columns 165 through 168
-0.04585223365109 -0.00502017035384 0.03398322634818
0.06849574758055
Columns 169 through 172
0.09635411698109 0.11601725927068 0.12663256434628
0.12804494388799
Columns 173 through 176
0.12075316710299 0.10582180562013 0.08475985344594
0.05937858562038
Columns 177 through 180
0.03164147930605 0.00351816237707 -0.02314740959980
-0.04674674074459
Columns 181 through 184
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
-0.06598945884170 -0.07995651694641 -0.08812411270222
-0.09036059631364
Columns 185 through 188
-0.08690017680683 -0.07829817708583 -0.06537295841595
-0.04913952047510
Columns 189 through 192
-0.03073930999045 -0.01137008308799 0.00778109613199
0.02559935810198
Columns 193 through 196
0.04109626424759 0.05345544314259 0.06206856688305
0.06656076607150
Columns 197 through 200
0.06680468888031 0.06292254225138 0.05527568217195
0.04444169619049
Columns 201 through 204
0.03117946545587 0.01638338990942 0.00102875697948
-0.01388895099522
Columns 205 through 208
-0.02741724189660 -0.03870846951445 -0.04707559699096
-0.05203784736309
Columns 209 through 212
-0.05335260858275 -0.05103084289941 -0.04533443158680
-0.03675527219878
Columns 213 through 216
-0.02597741626758 -0.01382495500742 -0.00119959263130
0.01098723154804
Columns 217 through 220
0.02188229583806 0.03075319656401 0.03704059636285
0.04039599306472
Columns 221 through 224
0.04070212260137 0.03807460516092 0.03284505620907
0.02552746332356
Columns 225 through 228
0.01677103005022 0.00730378144712 -0.00212808430644
-0.01081988478115
Columns 229 through 232
-0.01816221252030 -0.02368447649585 -0.02708498340864
-0.02824561802129
71
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
Columns 233 through 236
-0.02723060984541 -0.02427029083261 -0.01973202360355
-0.01408149907660
Columns 237 through 240
-0.00783828203366 -0.00152977531128 0.00435233046871
0.00938952420923
Columns 241 through 244
0.01326503243370 0.01578162483958 0.01686791315533
0.01657347478885
Columns 245 through 248
0.01505411203293 0.01254934451451 0.00935476560966
0.00579214028759
Columns 249 through 252
0.00218008037598 -0.00119216975076 -0.00408581800286
-0.00632711824010
Columns 253 through 256
-0.00781483560799 -0.00852066157236 -0.00848329376098
-0.00779740923517
Columns 257 through 260
-0.00659902170090 -0.00504908820003 -0.00331691201488
-0.00156482692685
Columns 261 through 264
0.00006463440339 0.00145824730714 0.00253783620427
0.00326220436512
Columns 265 through 268
0.00362556118310 0.00365304002511 0.00339409451670
0.00291465798950
Columns 269 through 272
0.00228895177653 0.00159174429109 0.00089171267597
0.00024636506918
Columns 273 through 276
-0.00030123128510 -0.00072387920912 -0.00100998481168
-0.00116188515783
Columns 277 through 280
-0.00119315515203 -0.00112532046764 -0.00098439594641
-0.00079761965498
Columns 281 through 284
-0.00059067279083 -0.00038557775676 -0.00019936402666
72
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
-0.00004349568836
Columns 285 through 288
0.00007602486265 0.00015801946885 0.00020513691086
0.00022267635728
Columns 289 through 292
0.00021739726997 0.00019645030203 0.00016652267489
0.00013324716819
Columns 293 through 296
0.00010088214188 0.00007223559481 0.00004878213424
0:00003090906954
Columns 297 through 300
0.00001822614592 0.00000988083116 0.00000483478363
0.00000207399807
Columns 301 through 303
0.00000074209218 0.00000020073804 0.00000003164528
TABLE 1
73
SUBSTITUTE SHEET (RULE 2~
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
IV.2 DESIGN OF NONLINEAR FILTERS TO FOCUS ENERGY FROM
DIFFERENT FREQUENCY SANDS INTO A SINGLE FREQUENCY HAND
The above embodiments of the present invention
illustrate how the principles underlying the invention can
be used to transfer energy from one frequency or frequency
range to another frequency or frequency range. However, it
will be appreciated that the present invention can equally
well be utilised to focus energy from a given frequency
band or given frequency bands into a single, and
preferably, narrower frequency band.
The problem to be addressed in this design is that
given an input spectrum which possesses nonzero magnitude
characteristics over two different frequency bands [a,,b,]
and [a~,b2] , where a2 > b, , a filter is required to be designed
to focus energy from the two different input frequency
bands into a single output frequency band [c,d], where
c > b,, d < a2 , with the spectrum of the filter output over the
output frequency range [c, d] satisfying certain
specifications. The specifications to be satisfied can be
specified in terms of magnitude, phase or both.
The only difference of this design compared to the
designs in Section I is that the determination of the
maximum order N of the filter nonlinearities should not
only ensure that the specified output frequency band [c, d]
is covered by the filter's output frequency range, but also
should ensure that the output energy over [c, d] is derived
from the input frequency range [a,,b,] and the input
frequency range [az,bz]. Therefore, the principles for this
design are exactly the same as those described in Section I
except for step (iii) which should follow the new principle
above.
74
SUBSTITUTE SHEET {RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
Consider an example where a nonlinear filter is to be
designed to focus the energy from two different frequency
bands [3, 4] and [10, 11] of an input signal
a t =2M _1 sin2~tb,t-sin2~ca,t+ 1 sin2nbZt-sin2~ra2t~
( ) "~2~c t 2~ )t
where b, = 4, a, = 3, b2 =11, a= =10, M" = 0.03 , into a single frequency
band around frequency f=7 with the single output frequency
band as small as possible and the output magnitude
characteristic at frequency f=7 being 3M" = 0.09 .
It can be shown that when subject to the excitation of
an input with the frequency spectrum over two different
frequency bands [a,,b,] and [a2,b,], the output frequency
ranges of a nonlinear system contributed by the system's
2nd order nonlinearity is
[2az,2bi~, [2a,,2b,~, [a, +az~~ +bz~, [0,b, -ayu[O,bZ -a2] and [aZ -b,~~ -a~~
Substituting b, = 4, a, = 3, b2 =11, a= =10 into a., -b, and b2 -al
yields
[a2 - b>> ba - at~ _ [6~g~
Clearly this output frequency range covers frequency f=7
and the system output energy over this frequency band is
derived from the input frequency range [a,,b,]=[3,4~ and the
input frequency range [aZ,b2~ _ [10,11] . Therefore, the maximum
order of system nonlinearities can be taken to be N=2 for
this specific design.
Moreover, following the same design principles as
described in Section I, a discrete time nonlinear filter
under the sampling period TS=1/SOs can be obtained for this
specific design. Figure 36 illustrates schematically such
a filter.
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99145644 PC'f/GB99/00550
Figures 37 and 38 show the input and output frequency
spectra of this filter respectively and clearly indicate
that the input energy over the two different input
frequency bands (3,4] and [10,11] have been, as required,
successfully focused into a very small band around
frequency f=7.
IV.3 DESIGN OF SPATIAIr DOMAIN NONhINEAR FIhTERS
Although the above embodiments have been described
with reference to the design of non-linear time-domain
systems, it will be appreciated that the present invention
is equally applicable to non-linear spatial-domain systems.
In the one dimensional case, the present invention can
be directly applied and the only difference of the one
dimensional spatial domain case over the above time-domain
embodiments is that the time-domain variables t and k in
the continuous and discrete time filter equations become
the continuous and discrete spatial variables X and Xk in
the spatial domain filter equations.
Consider a one dimensional spatial domain filtering
problem that is the same as the second problem addressed in
Section II.1 except that the time variables t and k become
the spatial variables X and Xx in the present design.
Figure 39 shows the block diagram of the spatial
domain nonlinear filter designed in this case. It can be
seen that the spatial-domain filter is exactly the same as
that shown in figure 9 which is the block diagram of the
corresponding time domain nonlinear filter designed in
Section II.1 except that the time variables t, k, T, and
s(second) in figure 9 have been changed to the spatial
variables X, Xk, OX, and m (meter) in figure 39.
Figures 40 and 41 show the effects of spatial domain
nonlinear filter. Again, except for the time variables
76 _
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PCT/GB99/00550
being changed to spatial variables, the figures are the
same as figures 11 and 13 which are the results of the
corresponding time domain nonlinear filter.
The filtering effect in the time domain of the second
nonlinear filter designed in Section II.1 indicates an
energy transfer from the input frequencies wa, =1 and wa2 = 2
to the output frequency wao= 4. Figure 40 indicates the same
effect but in the spatial domain. In this case, the spatial
domain nonlinear filter transfers energy from the input
spatial frequencies wd, =1 and way = 2 to the output spatial
frequency wao = 4 .
When this one dimensional spatial domain nonlinear
filter is applied for one dimensional image processing,
where figure 41 represents the intensities over the spatial
variable X of the images before and after the processing,
the energy transformation effect of the spatial domain
nonlinear filter can be further illustrated by figures 42
and 43. Figure 42 shows the one dimensional input image
with energy located in spatial frequencies wd, = 1 and w82 = 2
and figure 43 shows the one dimensional output image with
energy located in another spatial frequency wao= 4 due to
the effect of nonlinear filtering.
Although the present invention has been described
above with reference to a one dimensional 'case in the
spatial domain, it will be appreciated that the present
invention is not limited thereto. The present invention can
equally well be applied to the design and implementation of
non-linear systems for realising transfer of energy from
first m-dimensional spatial domain frequencies to specified
second n-dimensional spatial domain frequencies, where m
and n are greater than one.
77
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99!45644 PCT/GB99/00550
It will be appreciated that an application of the
transfer of energy from first m-dimensional spatial domain
frequencies to specified second n-dimensional spatial
domain frequencies would be digital image processing or
filtering. In such a case m=n=2. The present invention
can be designed to produce filters that operate upon
digital images. The filters can be designed to perform
numerous different functions such as, for example, image
compression or filtering to remove noise or vary the colour
space of an image.
The phrase "transfer of energy" includes, without
limitation, the processing of a first signal, specified in
the time domain or spatial domain, to produce second signal
having predeterminable characteristics including a
specified energy distribution.
Furthermore, it will be appreciated that the terms
"frequency range" and "range of frequencies" includes a
group of frequencies or frequency group. A group of
frequencies comprises a plurality of frequencies spatially
distributed within an n-dimensional space or over a
subspace.
It will be appreciated by those skilled in the art
that the phrase "specified spectrum" relates to the
specification of at least one of either the magnitude and
phase of a signal or frequency components of a signal and
is equally applicable to situations in which only the
magnitude is specified and to situations in which both the
magnitude and phase are specified.
It will be appreciated that the input and output
signals of any or all of the various embodiments of the
present invention may be time or spatial domain continuous
or discrete input or output signals.
78
SUBSTITUTE SHEET (RULE 26)
CA 02322440 2000-09-O1
WO 99/45644 PGT/GB99/00550
Referring to figure 44 there is shown a data processing
system 4400 upon which embodiments of the present invention,
that is to say, the non-linear systems and the methods of
design thereof can be implemented or realised. It will also
be appreciated that the non-linear systems so designed may be
implemented in digital form using the data processing system
or other suitable hardware and software. The data processing
system 4400 comprises a central processing unit 4402 for
processing computer instructions fox implementing the design
of nonlinear systems given an input signal and particular
output signal requirements. The data processing system also
comprises a memory 4404 for storing data to be processed or
the results of processing as well as computer program
instructions for processing such data, a system bus 4406, an
IS input device 4408, an output device 4410 and a mass storage
device, for example, a hard disc drive 4412.
79
SUBSTITUTE SHEET (RULE 26)
