Language selection

Search

Patent 2224199 Summary

Third-party information liability

Some of the information on this Web page has been provided by external sources. The Government of Canada is not responsible for the accuracy, reliability or currency of the information supplied by external sources. Users wishing to rely upon this information should consult directly with the source of the information. Content provided by external sources is not subject to official languages, privacy and accessibility requirements.

Claims and Abstract availability

Any discrepancies in the text and image of the Claims and Abstract are due to differing posting times. Text of the Claims and Abstract are posted:

  • At the time the application is open to public inspection;
  • At the time of issue of the patent (grant).
(12) Patent Application: (11) CA 2224199
(54) English Title: APPARATUS FOR AND METHOD OF CONTROLLING SPEECH PROCESSORS AND FOR PROVIDING PRIVATE DATA INPUT VIA THE SAME
(54) French Title: APPAREIL ET PROCEDE PERMETTANT DE COMMANDER DES PROCESSEURS VOCAUX ET DE FOURNIR DES DONNEES D'ENTREE PRIVEES PAR L'INTERMEDIAIRE DESDITS PROCESSEURS
Status: Dead
Bibliographic Data
(51) International Patent Classification (IPC):
  • H04R 25/00 (2006.01)
  • A61F 11/04 (2006.01)
  • A61N 1/36 (2006.01)
(72) Inventors :
  • SINGLE, PETER (Australia)
  • DALY, CHRISTOPHER NEWTON (Australia)
  • MACAULAY, BRUCE (Canada)
(73) Owners :
  • SINGLE, PETER (Not Available)
  • DALY, CHRISTOPHER NEWTON (Not Available)
  • MACAULAY, BRUCE (Canada)
(71) Applicants :
  • COCHLEAR LIMITED (Australia)
(74) Agent: SIM & MCBURNEY
(74) Associate agent:
(45) Issued:
(86) PCT Filing Date: 1996-06-28
(87) Open to Public Inspection: 1997-01-16
Availability of licence: N/A
(25) Language of filing: English

Patent Cooperation Treaty (PCT): Yes
(86) PCT Filing Number: PCT/AU1996/000403
(87) International Publication Number: WO1997/001314
(85) National Entry: 1997-12-09

(30) Application Priority Data:
Application No. Country/Territory Date
PCT AU95/00380 World Intellectual Property Organization (WIPO) (Intl. Bureau of) 1995-06-28

Abstracts

English Abstract




A hearing aid device such as a cochlear implant comprising a microphone (116)
for receiving ambient sounds as well as spoken or voice commands and for
converting said sound into corresponding electrical signals. A processor (142)
separates the signal into command signals and voice signals. The voice signals
are transmitted to the patient in the usual manner, while the command signals
are used to control certain functions of the processor, such as volume control
processing criteria selection, or the provision of information such as battery
status, the time, the user's body temperature and reminders or notes made by
the user. Alarm messages are automatically transmitted to the user when
appropriate whereas others are available at a user set time or on demand. The
system is customisable allowing for the user to record his/her own messages
and to enter commands either by means of a keypad or by speech recognition.


French Abstract

Dispositif de prothèse auditive telle qu'un implant cochléaire, qui comporte un microphone (116) destiné à recevoir les sons ambiants, ainsi que des commandes parlées ou vocales, et à convertir lesdits sons en signaux électriques correspondants. Un processeur (142) sépare le signal en signaux de commande et en signaux vocaux. Les signaux vocaux sont transmis au patient de la manière habituelle, tandis que les signaux de commande sont utilisés pour commander certaines fonctions du processeur, telles que la sélection de critères de traitement du contrôle du volume, ou la fourniture d'informations telles que l'état de la pile, l'heure, la température du corps de l'utilisateur et des mémentos ou des notes faits par l'utilisateur. Les messages d'alarme sont automatiquement transmis à l'utilisateur lorsque cela est approprié, tandis que d'autres sont à sa disposition au moment fixé par lui ou sur demande. Ledit système peut être adapté, ce qui permet à l'utilisateur d'enregistrer ses propres messages et d'entrer des commandes soit par un clavier, soit par reconnaissance vocale.

Claims

Note: Claims are shown in the official language in which they were submitted.


18

CLAIMS
1. A device for aiding a person having a hearing impairment, said device
comprising:
a microphone for converting ambient sounds and commands
including voice commands and other audio signals to electrical signals;
signal processing means for processing said electrical signals in
accordance with control signals;
means for transmitting processed signals to said person; and
command recognition means coupled to said microphone for
recognizing said voice commands and wherein said recognition means
generates said control signals.

2. The device of claim 1 wherein said signal processing means includes
a volume control for controlling the volume of the processed signals for
said person and wherein said control means is capable of being adjusted by
said control signals.

3. The device of claim 1 wherein signal processing means includes
means for converting said electrical signals into aural stimulating signals
selectively in accordance with one of a first and a second set of criteria,
wherein said control signals define the selected criteria.

4. The device of claim 1 further including a battery for providing power
to said device, means for monitoring a status of said battery, means for
generating an oscillating signal and superimposing means for superimposing
said oscillating signal on said electrical signals to indicate said status.

5. The device of claim 4 wherein said command recognition means
recognizes a battery status command, said command recognition means
generating a battery status control signal responsive to said battery status

19

command, said battery status control signal enabling said superimposing
means.

6. A device for aiding a hearing impaired person; said device
comprising:
an external section worn by said person; and
an internal section implanted in said person;
said external section including a microphone receiving audio signals
and converting them into received electrical signals, signal processing
means for processing signals into stimulation signals, transmitting means
for transmitting said stimulation signals to said internal section, a battery
for generating power to said external section, and means for reporting a
status of said battery;
said reporting means including monitoring means for monitoring said
battery, signal generating means coupled to said monitoring for generating
battery status signals indicative of said status and means for combining
said battery status signals and said stimulation signals for indicating to said
person said battery status.

7. The device of claim 6 wherein said external section further comprises
command receiving means for receiving a command from said person, said
command receiving means activating said reporting means.

8. The device of claim 7 wherein said command receiving means is
arranged and constructed to receive spoken commands.

9. The device of claim 7 wherein said processing means process said
electrical signals in accordance with control signals, wherein said control
signals are generated by said command receiving means in response to
commands from said person.




10. The device of claim 9 wherein said commands are spoken
commands.

11. The device of claim 9 wherein said processing means includes a
volume control circuit for adjusting a volume of said stimulating signals in
response to a volume command.

12. The device of claim 9 wherein said processing means process said
signals in accordance with one of a first and a second conversion criteria,
said processing means including selection means for selecting said
conversion criteria in accordance with said commands.

13. A hearing aid system comprising:
means for receiving ambient and command signals and converting
said signals into electrical signals;
means for separating said electric signals into audio signals and
command signals;
means for processing said audio signals to generate audio stimulating
signals;
means for controlling said processing signals in accordance with said
command signals; and
means for transmitting said stimulating signals to the cochlear nerve
of a patient.

14. The system of claim 13 wherein said command signals are voice
commands.

15. The system of claim 14 wherein said means for controlling include
command recognition means for recognizing said oral commands.




21


16. The system of claim 14 wherein said controlling means includes
storing means for storing a plurality of test words and comparing means for
comparing said commands to said test words to identify a particular
command with a function of said system.

17. The system of claim 16 wherein said test words include words
designating one of a battery check function and a volume control function.

18. The system of claim 15 wherein said processing means includes a
first module for processing said audio signals in accordance with a first
criteria and a second module for converting said audio signals in
accordance with a second criteria, said system including module selecting
means for selecting one of said modules, said selecting means being
controlled by one of said commands.

19. A cochlear implant system comprising:
means for sensing ambient sounds and generating in response first
electrical signals;
event means for sensing events other than said ambient sounds and
generating in response second electrical signals;
means for generating processed signals corresponding to said first
and second electrical signals; and
stimulating electrodes for applying said processed signals to an
auditory nerve so that the patient can perceive said ambient sounds and
receive information regarding said events.

20. The system of claim 19 further comprising memory means for
storing a preselected message corresponding to one of said events, said

22

stimulating electrodes applying stimulating signals corresponding to said
message.

21. The system of claim 20 wherein said message comprises processed
message signals suitable for application by said electrodes.

22. The system of claim 19 wherein said event means comprises an
internal sensor for determining an internal condition of said system and for
generating a signal indicative of said internal condition.

23. The system of claim 22 further comprises a power source for
providing power to the system and wherein said internal sensor monitors
said power source.

24. The system of claim 19 wherein said even means comprises a sensor
for sensing an external condition and for generating a signal indicative of
said external condition.

25. The system of claim 24 wherein said sensor is constructed and
arranged to sense exercising by said patient.

26. The system of claim 24 wherein said external sensor senses speech
by said patient.

27. The system of claim 26 wherein said memory means stores a
reminder message corresponding to said speech.

Description

Note: Descriptions are shown in the official language in which they were submitted.


CA 02224199 1997-12-09
. W O 97/01314 PCT/AU~.~CtO3


APPARATUS FOR AND MFTHOD OF CONTROI I ING SPFFCH
PROCFSSORS AND FOR PROVIPING PRIVATE DATA INPUT VIA THE
SAME
TECHNICAL FIEI n
This invention relates to apparatus for and a method of controlling
the operation of devices used to enhance the aural faculties of a person,
such as, for example, a cochlear implant.
The invention further relates to a cochlear prosthesis capable of
conveying information of interest to the wearer by transmitting said data
directly to the wearer in an unobtrusive and private manner. This is
accomplished by incorporating the data into the processed sound
stimulations which stimulate the user's auditory nerve in the normal course
of operation of the cochlear implant.
BACKGROUNP ART
Various devices, such as cochlear implants, are being used to assist
persons having a chronic aural disability or impairment which cannot be
alleviated by external hearing aids. These devices typically include two
sections: an external section carried on the user and an internal section
which is implanted into the user.
The external section typically includes a microphone for converting
ambient sounds into electrical signals, signal processing means for
converting the electrical signals into processed signals, and a signal
transmitter for transmitting the processed signals to the internal section.
The internal section typically includes receiver means for receiving signals
from the transmitter, signal processor means for processing the received
signals, and stimulating means for stimulating the inner ear of the person,
such as the cochlea, in accordance with the received signals.
The external section further includes various manual controls for the
operation of the device, such as a volume control, battery checking, and so
on. A problem with devices of the kind just described is that, although the

CA 02224199 1997-12-09
W O 97/01314 PCT/A~,~,r~CI~


microphone, transmitter and signal processing means are electronic
components which are readily miniaturized, the overall size of the external
section is still too large because of the manual controls which typically
consist of, or are implemented, using mechanical components.
A further disadvantage of the existing systems is that, naturally, ~the
person tends to hide the external section on his person, i.e. in the clothing,
so that the impairment is not obvious. However, once the external section
is hidden, it is difficult to manipulate its manual controls.
Additionally, the external component of some of the devices may
,~ ~
include status indicators, relating to various functions of the device, to the ~-~;
wearer. This technique has several disadvantages. One major
disadvantage is that it is relatively conspicuous and counter to the general
prosthetic device design objective of presenting as low a profile as possible.
Another disadvantage of this technique is that alarms may go
unnoticed by the user. For example, if the alarm is provided as a visual
indicator such as an LED mounted on the external component, then if the
user wears this external component behind the ear, or in a pocket, the
warning indication will not be detected unless a deliberate effort is made
to inspect the indicator. Furthermore, the diligent user will regularly check
such status indicators only to find that all is well and that there has been .
no need to have taken the trouble of checking.
A further disadvantage of the present technique is that it lacks
flexibility since it is arranged and constructed to monitor and indicate only
very specific functions.
It is possible to make use of an audible alarm, for example by means
of a small loudspeaker or tone-generator, rather than a visual one, however,
this approach also presents problems. A disadvantage of audible alarms is
that they may make the wearer overly conspicuous and self-conscious. In
addition, the very purpose of the device is to provide assistance to a person
who has hearing difficulties. Providing the user with more external sounds,

CA 02224199 1997-12-09
W 097/01314 PCT/AU~5.'C1~?


which he may not hear clearly, can have the unwanted effect of generating
confusion and irritation.
Finally, work is being conducted to minimize these devices to a point
where the external component is completely eliminated and all its functions
are incorporated in a single implanted component. Of course, this type of
device is not amendable to the user of either visual or audible alarms.
DISCLOSURE OF THF INVFNTION
According to one aspect of the invention there is provided a device
for aiding a person having a hearing impairment, said device comprising:
a microphone for converting ambient sounds and commands,
including voice commands and other audio signals, to electrical signals;
signal processing means for processing said electrical signals in
accordance with control signals;
means for L,dnsmitting processed signals to said person; and
command recognition means coupled to said microphone for
recognizing said voice commands and wherein said recognition means
generates said control signals.
According to another aspect of the invention there is provided a
device for aiding a hearing impaired person; said device comprising:
an external section worn by said person; and
an internal section implanted in said person;
said external section including a microphone receiving audio signals
and converting them into received electrical signals, signal processing
means for processing signals into stimulation signals, transmitting means
for transmitting said stimulation signals to said internal section, a battery
for generating power to said external section, and means for reporting a
status of said battery;
said reporting means including monitoring means for monitoring said
battery, signal generating means coupled to said monitoring for generating
battery status signals indicative of said status and means for combining

CA 02224199 1997-12-09

WO 97/01314 PCT/AU5~.r~0'0~


said battery status signals and said stimulation signals for indicating to said
person said battery status.
According to a further aspect of the invention there is provided a
hearing aid system comprising:
means for receiving ambient and command signals and converting
said signals into electrical signals;
means for separating said electric signals into audio signals and
command signals;
means for processing said audio signals to generate audio stimulating
signals; ---
means for controlling said processing signals in accordance with said
command signals; and
means for transmitting said stimulating signals to the cochlear nerve
of a patient.
According to a still further aspect of the invention there is provided a
cochlear implant system comprising:
means for sensing ambient sounds and generating in response first
electrical signals;
event means for sensing events other than said ambient sounds and
generating in response second electrical signals; .
means for generating processed signals corresponding to said first
and second electrical signals; and
stimulating electrodes for applying said processed signals to an
auditory nerve so that the patient can perceive said ambient sounds and
receive information regarding said events.
BRIEF DESCRIPTION QF THE DRAWINGS
Fig. 1 is a block diagram of a prior art device;
Fig. 2 is a block diagram of a device according to a first embodiment
of the invention;
Fig. 3 is a block diagram of the command recognition module

CA 02224199 1997-12-09
- W O 97/01314 PCT/A~ 0tV~


of Fig. 2;
Fig. 4 is a block diagram of a second embodiment of the invention;
Fig. 5 shows the programming information contained in the
memory of the device from Fig. 4;
Fig. 6 is a biock diagram of a cochlear implant constructed in
accordance with a third embodiment of the invention;
Fig. 7 is a block diagram of a cochlear implant constructed in
accordance with a fourth embodiment of the invention;
Fig. 8 is a schematic diagram of the elements of a two-part
cochlear implant system constructed in accordance with
the invention; and
Fig. 9 is a schematic diagram o the elements of a completely
implanted cochlear system constructed in accordance with
the invention.
MODES FOR CARRYING OUT THF INVENTIQN
Referring now to the drawings, and more particularly to Fig. 1, a
typical prior art device 10 includes an external section 12 and an internal
section 14. The external section 12 includes a microphone 16 which picks
up ambient sounds and converts them to corresponding electrical signals on
line 18. Line 18 is connected to a manual volume controller 20 shown
diagrammatically as a potentiometer. The volume controller output 22 is
fed in parallel to a first and a second converter 24, 26 respectively. Each
of these converters 24, 26 convert the received signal into cochlea
stimulating signals, using certain preselected criteria.
For example, converter 24 may perform the conversion using a
criteria which is best suited for signals in a crowded room whereas
converter 26 may perform a conversion more suitable for sounds in a more
intimate, one-to-one conversation.

CA 02224199 1997-12-09
W O 97/01314 PCT/AU~.S~-~C103


A manual switch 28 is used by the person to select the converter
most suitable for a particular environment. The converted signals selected
by switch 28 are fed to a transmitter 27 to be sent to internal section 14.
Internal section 14 includes a receiver 30, a signal generator 32 and
a stimulator electrode 34. The signals from receiver 30 are transformed
into suitable cochlea stimulation signals by signal generator 32. These
stimulation signals are then transmitted to electrode 34 for stimulating the
cochlea.
The system may include other components, such as a battery 36
used to provide power to the subassemblies of section 12. In order to
check whether the battery is depleted or not, the person closes a battery
test switch 38. This allows current to flow from battery 36 to a LED 40.
When the baKery 36 is low, the LED 40 will be very dim thus indicating
that the battery is depleted and should be replaced.
As previously mentioned, this arrangement is disadvantageous in
that it has several manual components, such as switches 28 and 38 as
well as LED 40, which make it bulky and difficult to operate, especially if
hidden in clothing. In addition, the device cannot be used by a person who
is so incapacitated that he cannot use his fingers.
An improved device 110 constructed in accordance with one -
embodiment of this invention is shown in Fig. 2. Device 110 includes an
external section 112 and an internal section which has been omitted since
it is preferably identical to the section 14 in Fig. 1. Most of the time, the
external section 112 operates in the same manner as external section 12 of
Fig. 1. More specifically, a microphone 116 picks up ambient sounds and
converts them into corresponding electrical signals on line 118. After
amplification by amplifier 120, the amplified signals are fed in parallel to
two converters 124, 126. An electronic switch 128 is used to select the
output of one of the converters and feed the same to transmitter 127.
Power to the whole section 112 is provided by a battery 136.

CA 02224199 1997-12-09
W O 97/01314 PCT/AU~.-'Q~


In addition, section 112 further includes a command recognition
module 142 which also receives the signals generated by microphone 116.
Module 142 is set up to recognise a plurality of oral commands received
from the user via the microphone 116. These commands are used to
5 control the operation of the section 112.
For this purpose, the module 142 includes a memory 143 (shown in
Fig. 3) which contains a list of acceptable commands. These commands
may include, for example, the following:
VOLUME UP
VOLUME DOWN
CONVtl~ I tR A
CONVERTER B
BATTERY
The module 142 further includes a microprocessor 144, a speech
recognition circuit 146 and a demultiplexer 148. The electrical signals from
microphone 116 are monitored and converted into digital form by speech
recognition circuit 146. The microprocessor 144 continuously monitors the
signals from the circuit 146 and compares them with a list of commands
from memory 143. When a set of signals is recognized as a command by
microprocessor 144, the microprocessor issues an appropriate command
for controlling the operation of section 112. For example, when the user
utters the commands VOLUME UP or VOLUME DOWN, microprocessor 144
issues a corresponding control signal to the amplifier 120 on line 150 to
raise or lower its amplification.
If the command CONVERTER A or CONVERTER B is received and
recognized, the microprocessor 144 issues a control signal on line 152 to
electronic switch 128 to select the appropriate converter 124 or 126.
For the battery check function, a feedback is required to the user.
For this purpose, section 112 includes a battery monitor 154, an oscillator
156, a control gate 158 enabled by a control line 160, and a mixer 162.

CA 02224199 1997-12-09
WO 97/01314 PCT/AU~ 0'~3


The monitor 154 generates an output indicative of the status of the battery'
136 (i.e., whether the battery output is above or below a certain threshold,
or by using other criteria indicative of the status of the battery). This
output is used to control gate 158. An oscillating signal of a particular
frequency is generated by oscillator 156 and fed to gate 158.
When the BATTERY command is received and recognized, the
microprocessor 144 generates an output signal for a preselected time
period on line 160 to gate 158. For the period of time that the control
signal is on line 160, the gate 158 allows the output of oscillator 156 to
propagate to mixer 162, if the monitor 154 indicates that the battery is _~*
getting weak or non-operational. As long as the battery 136 is operational
or its output is found acceptable by the monitor 154, gate 158 is disabled
regardless of the status of line 160. If the battery is found unacceptable,
the mixer receives the output of oscillator 156 and superimposes this signal
on the signals from the microphone 116. The user hears this superimposed
signal and recognizes from its amplitude, pitch, or other characteristic
whether the battery 136 is still operational, or requires replacement.
Alternatively, the monitor 154 may be used to control the oscillator output
directly, for example, by changing its frequency or output amplitude.
Preferably, the commands are stored in memory 143 during a
training period, during which the user is asked to voice various commands.
Since the voice characteristics of various users are unique or distinctive,
the command recognizing module 140 is able to recognize and respond to
commands from the user, while similar words from other persons during
incidental conversations are ignored. Alternatively, the commands can be
seiected to be specific words, syllables and/or numbers which are not
normally used in conversation. To increase the security of the system, a
special command may be assigned to 'wake up' the module 140. Unless
this 'wake up' command is received first, the module 140 ignores all
signals from the microphone 116.

CA 02224199 1997-12-09
. W O97/01314 PCT/AU3G~ C~


The embodiment of Fig. 4 pertains to a more advanced device 210
having an external section 212. In this device 210, the signals from a
microphone 216 are fed to an A/D converter 270 and the output of the
converter 270 is fed to a digital signal processor 272. The signal processor
5 272 includes programming for performing several functions listed in Fig. 5.
These functions include the two conversions, conversion 224, and
conversion 226, as discussed with respect to Figs 1 and 2.
The digital signal processor 272 further includes a command
recognition function 240 for recognizing commands by the user a s
10 described above, as well as a battery check 254 and an oscillator function
256. The battery check 254 checks the battery 236, and if necessary,
enables the oscillator 256. The output of the oscillator is fed to a mixer
262. Thus it can be seen that the embodiment of Figs. 4 and 5 is similar
to the embodiment of Figs. 2 and 3 except that it is based on a more
15 sophisticated digital signal processor.
Referring now to Fig. 6, relevant elements of another embodiment of
the invention for a cochlear implant system are shown. The system
includes a speech module 310, a microphone 312, a speech processor 314
and a microprocessor 316. The module 310 is coupled to a stimulation
20 delivery means 318.
Briefly, the microphone 312 detects ambient sounds and generates
corresponding electrical signals. Under the control of the microprocessor
316, these signals are processed by the speech processor 314 which
generates processed signals called "tokens" in accordance with a
25 predetermined algorithm. The processed signals are then provided to the
stimulation delivery system 318, as described more fully below in Figs. 8
and 9.
Power for the module is provided by a battery and power supply
circuitry 336. In the case of a totally implanted device the battery is
30 implanted and is rechargeable by means of a transcutaneous link. In the

CA 02224199 1997-12-09
W O 97/01314 PCT/AU95J~ 3


case of a system which is not totally implantable, as shown in Fig. 8, the
battery is housed in the external unit.
The elements described so far as well known in the art. Typically,
the speech processor 314 performs such functions as anti-aliasing filtering,
5 analog-to-digital conversion, feature extraction and so on. A cochlear
implant system is described for example, in U.S. Patent No. 4,532,930,
which is incorporated herein by reference.
Importantly, the system further includes one or more of the following
elements: an ambient sensor 320, a command handset 323, a command
decoder 324, an analog-to-digital converter 326, a clock 328, a message
source 330 and a summer 303. The message source 330 shown in Fig. 6
consists of message RAM 306 and a speech and tome synthesizer 304 for
recording and generating speech signals.
The additional components (some of which are optional) are used to
provide various information to the patient which was not directly available
to him before. The simplest such information is that provided by the clock
328.
Although this clock may be a separate timing device, preferably it is
derived from the same clock that is also used to provide the basic clock
signals for the microprocessor 316. In the present invention, the clock 328
is also used to provide the patient with an indication of the current time.
The clock 328 makes available to the microprocessor 316 the time when
requested, either on demand or periodically, by the microprocessor. The
time check may be perceived by the user as, for example, "beeps".
With reference to Fig. 6, a beep may be generated on the hour by
the clock flagging the microprocessor at that time. The microprocessor
330 then requests the message source to generate a tone by means of
speech synthesizer 304. The tone is fed via connection 302 to the
summer 303 where it is mixed with the audio signal from the microphone
312. The combined audio signal is processed by speech processor 314

CA 02224l99 l997-l2-09

. W O 97/01314 PCT/AU~ lQ3


and delivered to theuser who perceives both the normal hearing information
and the time-check tone as a superimposed beep. Alternatively, beeps may
be generated according to a grandfather-clock-like scheme with a particular
sequence of tones sounding on the quarter hour or other time interval.
In an alternative embodiment of this time-check facility, the memory
source 330 may be used to generate a plurality of word messages rather
than tones, with each message corresponding to a particular time. For
example, one such message may be the spoken words "IT IS ONE PM".
the words "IT IS ...PM" would be stored in the message RAM 306. When
it is ONE PM, as indicated by the clock 328, the microprocessor 316, using
for example a lockup table retrieves the message an insert a speech
synthesiser derived word for the hour to produce the string of words 'IT IS
ONE PM", the spoken message is then transmitted via connection 302 to
the summer 303 and processed and delivered to the user.
However, a more efficient mode is to store and synthesize tokens of
post-processed data rather than pre-processed audio signals. This
embodiment is depicted in Fig. 7. In this embodiment, the message source
330A consists of a token RAM 310A and a token synthesizer 308A. The
token RAM 31 OA is used to store various tokens. The tokens are
generated by the speech processor 314 an correspond to the messages
stored in RAM 310. The token synthesizer 308A is used for generating
tokens corresponding to parts of simple, often repetitively structured
phrases, e.g., those of a talking clock. Moreover, the summer 303 of Fig.
6 is omitted and a level adjustment-and-interleaving circuit 332 is provided
for combining tokens corresponding to external speech with tokens from
the message source 330A.
Thus, for the time-check function, the messages from source 330A
correspond to the appropriate spoken time-check messages however they
consist of signals which can be conveyed directly to the stimulation
delivery module 318. When the timing signals from clock 328 match a

CA 02224199 1997-12-09
W O 97/01314 PCT/AU~5/~-~C~


preselected event, the microprocessor instructs the message source 330A
to issue the appropriate message token either from the token RAM 31 OA or
token synthesizer 308A and to send the same to the interleaving circuit
332. This circuit interleaves the tokens from the message source 330A
5 with the tokens from the speech processor 314 and sends the combined
processed signals for stimulation by delivery system 318. The interleaving
module superimposes the information derived from the message source
330A with that from the speech processor 314 so that the user can
continue to partake in a conversation or listen to the radio, etc. while also
10 hearing the private message, without loss of continuity. The combined
signals are then applied to the nerve of the patient.
Of course, it is preferable that the patient be provided with a control
means to either activate or deactivate the clock feature, or customize it for
his own specific needs. In one embodiment, the command handset 323 is
15 provided for this purpose. It generates a signal, for example a radio-
frequency transmission, which is detected by the command decoder 324
and converted to a digital form that consists of a microprocessor
instruction. The command handset 323 may include of one or more keys,
depending on the range of the patient's required command repertoire. The
20 simplest command may be an on/off command. For this purpose the
command handset 323 is provided with a simple switch ~not shown) which
is activated by the patient to turn the timing feature in or off. For more
complicated commands, such as for example, requesting a message at a
particular time, or to set an alarm clock, the command handset is provided
25 with a keypad and a display screen as discussed below.
Another function to be performed by the device is to store and
selectively retrieve various messages and data such as reminder notes,
telephone numbers, addresses and so on. This information may be entered
via the remote control keypad and stored into message source 330 or
30 330A after appropriate conversion by the token synthesizer. The patent

CA 02224199 1997-12-09
' W O 97/01314 PCT/AU9Ç'~03


may then retrieve and "hear" this information when demanded by means of '
the command handset 323.
As an example of the use of the control handset 323 to store the
user's messages, suppose that it is desired to store the phone number of a
5 friend. The user enters a command "Record Message" by means of the
control handset 323. With refelence to Fig. 7, this command is
transmitted by the command handset 323 to the command decoder 324.
The command decoder 324 decodes the command and informs the
microprocessor 316 that subsequent microphone input is to be recorded.
10 The microprocessor buffers the tokens received from the speech processor
314 and passes them to the message source 330A with an instruction or
the memorandum tokens to be recorded.
Once the user has finished saying the telephone number, he sends
the command "End Message" by means of the control handset 323. The
command decoder 324 then flags the microprocessor 316 that a command
has been received and acting on the command the microprocessor 316
terminates the recording. The microprocessor 316 then has the message
source 330A issue the message "Message Recorded, Enter Message's
Prompt". The user then types in a short phrase or mnemonic that he
wishes to retrieve the phone number by, for example, "Peter's Phone
Number" and then the instruction "Prompt Ends". Once this has been done
the user may recall the phone number at a later time b typing "Recall
Message" and then selecting the message's prompt by means of the
display screen of the command handset 323.
Messages and commands may also be entered by the patient (or
another person) via microphone 312. Of course for this function, the
device must differentiate between commands/data from the patient and
normal speech. This may be accomplished by activating a key on the
command handset 323 prior to the command/data. Alternatively, the
command decoder 324 may be used to recognise data received from the

. CA 02224199 1997-12-09
- W O 97/01314 PCT/A~,.'XS0


microphone 310 via connection 301 (Fig . 6) rather than the command
handset 323. If a certain code word/phrase from the microphone is
recognized, the command recognition unit flags the microprocessor that
following sounds contain data to be processed and stored in the message
source 330, 330A.
Alternatively, the command decoder 324 may incorporate a speech
recognition algorithm to recognize the wearer's voice, thereby further
differentiating between ambient speech and commands and preventing
inadvertent programming by unauthorised persons. For this purpose, the
command decoder 324 receives the electrical signals from microphone 312 '
via connection 319 and transmits recognized commands to microprocessor
316 via a bus 324A.
As an example of the use of the speech recognition system to store
the user's messages, suppose that it is desired to store the phone number
1 ~ of a friend. The user utters the command "Record Message". With
reference to Fig. 7, this utterance is transduced by microphone 312 and
conveyed by means of connection 319 to the command decoder 324. The
command decoder 324 recognises the command and informs the
microprocessor 316 that subsequent microphone input is to be recorded.
The microprocessor 316 buffers the tokens received from the speech
processor 314 and passes them to the message source 330A with an
instruction for the memorandum tokens to be recorded.
Once the user has finished saying the telephone number he makes
the utterance "End Message". The command decoder 324 then flags the
2~ microprocessor that a command has been received and acting on the
command the microprocessor 316 terminates the recording. The
microprocessor 316 then has the message source issue the message
"Message Recorded, Enter Message's Promptn. The user then enters a
phrase that he wishes to retrieve the phone number by, for example
"Peter's Phone Number" and then the instruction "Prompt Ends". Once

CA 02224199 1997-12-09
W O97/01314 PCT/AU9~'~C1-~


this has been done the user may recall the phone number at a later time by
uttering "Recall Message". The message source will then read through the
list of message prompts until the user utters the command "Select" at
which point the selected message will be recalled.
Other information may be transmitted in this manner to the patient
as well. For example, the sensor 320 may be provided, which may be, for
instance, a temperature sensor arranged and constructed to sense the
subcutaneous temperature of the patient. To invoke thus function, the
patient may request a temperature reading either by spoken word, or
through the command handset 323. The sensor 320 generates an analog
signal indicative of temperature and this signal is fed to the analog/digital
converter 326. The resulting digital data is logged by the microprocessor
316.
The microprocessor 316 then requests an appropriate message from
the message source 330A and the necessity tokens are conveyed to the
level adjustment and interleaving nit 332 and thence to the stimulation and
delivery module 318 which delivers stimulation to the patient. (In the
embodiment of Fig. 6, appropriate messages are provided to summer 303).
Of course, other information may be sensed as well using an
appropriate sensor in the place of sensor 318. For example, the sensing of
the patient's blood pressure, or pulse rate may be facilitated. Moreover,
other types of sensors may also be used for measuring parameters not
directly related to the user's physiological condition such as an odometer
for measuring walking or jogging distances.
The module 310 may also generate internal diagnostic reports. For
instance a low battery level alarm can be implemented by any circuitry that
provides a digital signal when the battery falls below a set threshold and
delivering this signal to the microprocessor.
Alternatively, a convenient way of implementing such a facility
using the system already depicted in Fig. 7 is to have the microprocessor

CA 02224l99 l997-l2-09
- WO 97/01314 PCT/AU9-J~Ct~3

16

316 periodically request of the analog-to-digital converter 326, a power
supply reading from power supply 336. If the battery reading is below a
bottom limit, the microprocessor 316 will direct a "low battery" message
to be conveyed from the message source 330A to the user.
Optionally, the patient may request a status report by depressing
certain keys on the control handset 323, or by uttering certain command
words. In response, the microprocessor 316 checks the status of its
systems, including for example statistical information on error rates,
volume levels, battery level, etc and provides a report to the patient by
means of the message source 330A.
Referring now to Fig. 8, an embodiment is shown consisting of an
external portion 340, and an internal or implanted portion 354. The
external portion 340 includes a wearable speech processor housing 342
containing all the elements of the module 310 and command handset 323
of Fig. 6. External portion 340 also includes a microphone 344, and an
inductive transmit coil 352. The microphone 344 performs the same
function as microphone 312 and can be implemented as a so called behind-
the-ear microphone.
In this embodiment, housing 342 includes a message screen 348 an
a plurality of keys 350 provide the functionality of the command handset
323 in Fig. 6. The patient can enter various information or commands on
the keys 350 and monitor and confirm the data entered from the keys 350
on screen 348. The screen 348 may display other information from the
cochlear implant as well. The housing 342 is connected by cable 351 to
the transmit coil 352.
The implanted portion 354 of the device includes a receiver housing
356. Included in the housing 356 is a receiver coil 358. A cable 360
extends from housing 356 into the middle ear of the patient terminating in
cochlear electrode array 362 disposed adjacent to the basilar membrane

CA 02224199 1997-12-09

W O 97/01314 P ~/AU9''~

: 17

364, in the usual manner. The transmit and receive coils 352, 358 are
arranged to provide inductive coupling therebetween.
In summary, in the embodiment of Fig. 8, the patient can transmit
commands through buttons 350 and receive information either visually on
5 screen 348 or, according to the present invention, as an aural perception
through the cochlear electrode array 362.
The embodiment of Fig. 9 is different in that it shows a completely
implanted cochlear device 370. The device 370 includes an internal
housing 372 including a microphone 374 and an RF coil 376. Cable 360
extends from housing 372 and terminates with an array of electrodes 362
as described above.
For communication from the outside world, the device further
includes a remote controller 378 which corresponds to the command
handset 323 of Figs. 6 or 7. The controller 378 includes an RF coil 380 for
communication by RF signals with the implant 372. The remote controller
378 also includes a screen 348 and keys 350. In this embodiment, the
communication between the patient and the cochlear implant device 370 is
accomplished by RF or similar means (eg, radar, ultrasound, etc.~. In this
embodiment, the module 310 is disposed in the housing 372, and the
command handset 323 is implemented by the remote controller 378.
Of course, both embodiments of Figs. 8 and 9 may be implemented
using either the arrangement of Fig. 6 or Fig. 7.
INDUSTRIAL APPI ICABILITY
The apparatus of the invention may be used to control the operation
of a cochlear implant.

Representative Drawing
A single figure which represents the drawing illustrating the invention.
Administrative Status

For a clearer understanding of the status of the application/patent presented on this page, the site Disclaimer , as well as the definitions for Patent , Administrative Status , Maintenance Fee  and Payment History  should be consulted.

Administrative Status

Title Date
Forecasted Issue Date Unavailable
(86) PCT Filing Date 1996-06-28
(87) PCT Publication Date 1997-01-16
(85) National Entry 1997-12-09
Dead Application 2000-06-28

Abandonment History

Abandonment Date Reason Reinstatement Date
1999-06-28 FAILURE TO PAY APPLICATION MAINTENANCE FEE
1999-07-20 FAILURE TO RESPOND TO OFFICE LETTER

Payment History

Fee Type Anniversary Year Due Date Amount Paid Paid Date
Application Fee $300.00 1997-12-09
Maintenance Fee - Application - New Act 2 1998-06-29 $100.00 1997-12-09
Owners on Record

Note: Records showing the ownership history in alphabetical order.

Current Owners on Record
SINGLE, PETER
DALY, CHRISTOPHER NEWTON
MACAULAY, BRUCE
Past Owners on Record
None
Past Owners that do not appear in the "Owners on Record" listing will appear in other documentation within the application.
Documents

To view selected files, please enter reCAPTCHA code :



To view images, click a link in the Document Description column. To download the documents, select one or more checkboxes in the first column and then click the "Download Selected in PDF format (Zip Archive)" or the "Download Selected as Single PDF" button.

List of published and non-published patent-specific documents on the CPD .

If you have any difficulty accessing content, you can call the Client Service Centre at 1-866-997-1936 or send them an e-mail at CIPO Client Service Centre.


Document
Description 
Date
(yyyy-mm-dd) 
Number of pages   Size of Image (KB) 
Claims 1997-12-09 5 159
Drawings 1997-12-09 8 154
Abstract 1997-12-09 1 50
Description 1997-12-09 17 735
Cover Page 1998-03-27 2 71
Representative Drawing 1998-03-27 1 7
PCT 1997-12-09 42 1,502
Correspondence 1998-03-10 1 31
Assignment 1998-12-08 3 136
Correspondence 1999-04-20 1 2
Assignment 1997-12-09 3 112