Note : Les descriptions sont présentées dans la langue officielle dans laquelle elles ont été soumises.
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
PERSONAL COMMUNICATOR AUTHENTICATION
RELATED APPLICATIONS
This application is a 119(e) of US provisional applications 60/115,231, filed
January 8,
1999, 60/122,687, filed March 3, 1999, 60/143,220, filed July, 9, 1999,
60/145,342, filed July
23, 1999 and an application titled "Card for Interaction with a Computer",
filed September 14,
199 and having attorney docket 100/01300. This application is also a
continuation-in-part of
PCT applications PCT/IL99/00470, filed August 27, 1999 PCT application
PCT/IL99/00506,
filed September 16, 1999, A PCT application titled "Computer Communications",
filed
October 1, 1999 (attorney docket 100/01190) and a PCT application titled "Card
for
l0 Interaction with A Computer", file October 4, 1999 (attorney docket
100/01189) all filed in the
Israel receiving office by applicant Comsense Technologies Ltd. and
designating the US. The
disclosures of aII of these applications are incorporated herein by reference.
FIELD OF INVENTION
The present invention relates generally to method of interaction with a
computer and
15 especially to methods that use acoustic signals for such communications.
BACKGROUND OF THE INVENTION
Computer network components that communicate using RF radiation, wires or IR
radiation are well known. In addition, some home appliances are controlled
using an ultrasonic
remote control. Other types of dedicated ultrasonic acoustic links are also
known.
20 However, such dedicated communication mechanisms require that the computer
network components have installed thereon specialized communication hardware.
Installing
such hardware on an existing computer may be expensive and/or problematic.
Further, some
electronic and/or computer embedded devices, for example cellular telephones
may be
"sealed" products, to which it is impossible to add internal components.
z5 PCT publications W096/10880, W094/17498, W093/21720 and W093/11619, the
disclosures of which are incorporated herein by reference, describe an
electronic device which
transmits coded information to a microphone of a telephone using a DTMF-like
encoding
scheme. A WWW page addressed "http://www.encotone.com/htmUte~ defhtml",
available
on February 1,1999 and predated, suggests using such a device to transmit
audible DTMF-like
so tones to a personal computer using the computer's sound card.
Two way communications using audible DTMF-like tones, between a smart card and
a
telephone communication system is described in US patent 5,583,933, the
disclosure of which
is Incorporated herein by reference.
SUMMARY OF THE INVENTION
1
CA 02350761 2001-05-15
WO 00/29920 PC'f/IB99/02110
One object of some preferred embodiments of the invention is to simplify
interaction
between electronic devices by removing a common requirement of installing
dedicated
communication hardware on the devices. Some suitable electronic devices
include: computers
(e.g., desktop and laptop), televisions, watches, PDAs (Personal Digital
Assistant), organizers,
electronic toys, electronic games, voice-responsive appliances, wireless
communication
devices, answering machines and desktop telephones. As used herein the term
"electronic
device" is used to encompass a broad range of electronics-including devices.
In some of the
embodiments described below, a particular type of electronic device is singled
out, for
example a computer or a toy, as some of the below-described embodiments are
more useful for
1o some types of electronic devices, than for other types of electronic
devices. However, such
examples are not meant to limit the scope of the invention.
An object of some preferred embodiments of the invention is allowing
electronic
devices to communicate using an input and/or output channel, preferably an
acoustic channel,
but possibly a visual channel, which was designed for communication with human
users and
not for communication with electronic devices. In other cases, the
communication channel is
not originally intended for communication with outside components at all, for
example, a
diskette drive.
An object of some preferred embodiments of the invention is to allow a smart
card to
be read by and written to using standard computer hardware without requiring
an installation
of specialized hardware. This is especially useful for electronic wallets and
Internet commerce,
where the cost of installing dedicated hardware may prevent wide acceptance of
these
commercial methods. Additionally, using a smart card can provide methods of
solving the
security and accountability issues entailed in electronic commerce.
An aspect of some preferred embodiments of the invention relates to a method
of
authentication, in which a computer or other device authenticates a person by
setting up a
communication with the person's personal communicator. In a preferred
embodiment of the
invention, the computer listens to the response of the personal communicator
to the connection
set-up, to determine that the communicator is actually present near the
computer. Alternatively
or additionally, the computer transmits an audio signal to the communicator
and Listens to hear
3o that the signal arrived. In a preferred embodiment of the invention, this
authentication does not
require installation of special hardware on the computer.
An aspect of some preferred embodiments of the invention relates to
communicating
with a computer using a sound card installed on the computer. In some computer
configurations the installation is permanent, for example as part of the
motherboard chip-set.
2
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
In a prefenred embodiment of the invention, a device, preferably a smart card,
transmits
information to the sound card's microphone and receives information from the
computer using
the sound card's (or the computer's) loudspeaker. Preferably, the transmission
uses non-audible
acoustic frequencies, for example ultrasonic or infrasonic frequencies. It
should be noted that
standard music cards are designed for music generation, and specifically for
audible audio
frequencies, such as between 20 Hz and 16 kHz, however, they have a limited
reception and
transmission ability in the near-ultrasonic (e.g., between 16 kHz and 50 kHz)
and infrasonic
(e.g., 0.01 Hz Eo 20 or 40 Hz) frequency ranges. The definition of audible
frequencies will
usually depend on the user and this, may, in some embodiments, impact on the
selection of
~o frequencies for use. Possibly, a personalization software for selecting the
frequencies will be
provided. Also, in some applications, the higher end of the audible range may
be used, for
example 14 kHz - 16 kHz, as the sensitivity to these frequencies is quite low,
even in those
individuals that can detect them.
Ultrasonic communication has several advantages over audio communication:
1s (a) smaller transducers can be used;
(b) transmission is more efficient;
(c) lower noise levels are typical;
(d) resonant frequencies that have wavelengths on the order of a size of a
credit card
can be used; and
20 (e) higher data rates can be achieved.
In a preferred embodiment of the invention, the ultrasonic frequencies used
are low
ultrasonic frequencies or high audible frequencies, for example between 15 kHz
and 24 kHz,
more preferably between 17 kHz and 20 kHz and, in some preferred embodiments,
between 21
and 23 kHz. Often, these frequencies can be transmitted and/or received using
standard audio
25 components. For this reason, lower frequencies may be preferred over higher
frequencies, even
though the lower frequencies typically afford a lower data rate and are more
easily disrupted.
These particular frequencies are suggested because they match industry
standards for sampling
in audio cards (e.g., "SoundBlaster"). If other sampling frequendes are
available, the preferred
frequency may ad,~usted accordingly. Preferably, a minimum frequency used is
selected so that
30 it is inaudible to a human. In some cases, the frequency selection may
depend on the age of the
human.
A benefit of ultrasound over RF transmission is that the range of the
ultrasonic
transmission can easily be controlled by varying its amplitude. Typically,
ultrasonic
transmissions do not pass through walls, potentially providing increased
security by limiting
3
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
eavesdropping and inference from outside the room. In addition, ultrasonic
transmissions do
not usually interfere with the operation of electronic equipment, even when
used at a high
power setting. Thus, ultrasonic communication is better suited for people with
pacemakers and
for hospital settings. Another advantage of acoustic transmission is a reduced
perceived and
actual health danger to the user.
An aspect of some preferred embodiments of the invention relates to
communication
between electronic devices using acoustics. Alternatively or additionally to
electronic devices
communicating using RF; varying magnetic fields; IR; and visible light,
electronic devices
may communicate using acoustics, in accordance with preferred embodiments of
the invention.
1o In some cases, one communication direction is acoustic and the other is non-
acoustic, for
example RF or 1R, for example when communicating with a set-top box in
accordance with a
preferred embodiment of the invention (one way acoustic from the TV and the
other way 1R, in
the same manner as with an 1R remote control). In a preferred embodiment of
the invention,
the acoustic waves used for communications are incorporated in sounds used for
regular
operation of the device which generates the sounds, for example by modulating
beeps.
Alternatively or additionally, the sounds are inaudible, for example being
ultrasonic,
infrasonic, of a low amplitude and/or causing only small changes in amplitude
and/or
frequency of an existing sounded signal.
It is noted that many electronic devices include a microphone and/or a
speaker. In a
2o preferred embodiment of the invention, the microphone andlor speaker are
used to
communicate with the device. In one example, an acoustic smart card (or an
"electronic wallet"
card) communicates with such a device using sound and/or ultrasound. Such a
smart card may
transmit information stored thereon. Possibly, the information is encrypted,
for example, using
RSA or DSA encryption.
In a preferred embodiment of the invention, a smart card may be "swiped" at
many
existing computers and electronic devices, possibly requiring a simple
software installation,
but no hardware installation (assuming some acoustic hardware exists). Such
simple swiping
should ease acceptance of the card by Internet browsing home shoppers. In some
cases, the
swiping software may be downloaded as a Java Applet or as a script in a
different network
3o programming language.
In some embodiments other types of electronic devices communicate. For
example, a
cellular telephone and a PDA, each of which includes a microphone and a
speaker, can
communicate. Another example is prog~racnming a cellular telephone with names
and numbers
stored in a PDA or for the cellular telephone to interrogate the PDA regarding
a particular
4
CA 02350761 2001-05-15
WO 00/29920 PC"T/IB99/02110
telephone number. Alternatively or additionally, a network may be formed of a
plurality of
such devices, possibly, with one device forwarding messages from a first
device to a second
device. Alternatively or additionally, peripherals may be connected to a
computer using an
acoustic connection, without requiring wiring or special hardware. In some
embodiments, a
single acoustic transducer (microphone or speaker} may be controllable to act
as both a
receiver and a transmitter, by suitably programming the electronic device.
Many computers are sold with a Sound-Blaster Compatible sound subsystem,
stereo
speakers and a microphone. Some computers are provided with other types of
sound systems,
which types also support the application of preferred embodiments of the
invention, possibly
to with a variation in frequencies to account for different circuit or
sampling characteristics.
Typically, this sound system is designed for generating music and other
audible sounds. In
addition, many computers include an internal speaker and a modem speaker. Some
computers
use USB speakers that are connected directly to the USB (Universal Serial
Bus).
It should be appreciated that in some embodiments of the invention the sound
communication is directed at the device for its use, control and/or processing
and is not meant
for mere passing through the device. For example, a telephone may interpret
computer-
information encoding signals, rather than transmitting them on through the
telephone network,
as is done in the art. In a preferred embodiment of the invention, a wireless
telephone is
realized using ultrasonic communication between a base station and the hand
set. In a preferred
2o embodiment of the invention, the base station is embodied in a computer,
which
communicates with the telephone. Possibly, the wireless communication uses the
same
loudspeaker and/or microphone as used for communication with a person using
the telephone
and/or the computer. Additionally or alternatively, the handset is used for
Internet telephony,
via the computer without a cradle or other spedal connection between the
computer and the
telephone.
An aspect of some preferred embodiments of the invention relates to
interfacing a
device (possibly a toy) with a computer system without installing spedal or
dedicated
hardware on the computer. Such interfacing may use EM-coupling into cables
attached to the
computer, detection of RF signals from a computer or direct input into a mouse
or a keyboard.
3o In one preferred embodiment, the loudspeakers, already installed on a
computer, are used to
interrogate an identiffcation device, using ultrasound. Preferably, the
computer's microphone is
used to detect a response from the interrogated device. In some embodiments,
especially for
toys, the interrogation may comprise audible sounds. Thus, in a preferred
embodiment of the
invention, cheap and/or simple communication between a device and another
device or a
5
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
computer is feasible, since no special computer hardware is required. In
addition, it becomes
simpler to interface an input device with a computer program that responds to
that input
device. Additionally or alternatively, ultrasonic communications may be used
to download a
program and or music file to a toy or other devices. Possibly, the program
and/or music file are
directly downloaded from an Internet as sound files, possibly reducing or
obviating the need
for a dedicated toy (or device) programming software interface. Possibly, the
toy and/or device
generate sounds in response, which sounds are transmitted back through the
Internet.
In a preferred embodiment of the invention, the acoustic waves used for
communication or, possibly, another set of acoustic waves, may be used to
determine the
relative position and/or orientation of electronic devices. In a preferred
embodiment of the
invention, a touch screen is emulated by interrogating a transponder on a
pointing implement,
using built-in speakers of an electronic device, to detect the position,
orientation and/or motion
of the implement, thereby identifying a location which is "touched" or pointed
to. In a
preferred embodiment of the invention, the transponder is embodied using a
speaker and a
~s microphone of the pointing implement, for example if the implement is a
cellular telephone.
For example, one or more of the following sound generators may be available in
a
personal computer: built-in speaker, modem speaker and sounds generated by
mechanical
devices, such as a hard disk drive or a diskette drive. These sound generators
may also be used
for transmitting information.
An aspect of some preferred embodiments of the invention relates to visual
communication between devices, using built in hardware. In one example a video
camera,
which is provided with many computers, can be used to accept visual signaling
from a second
device. Such visual signaling may be temporal, for example by flashing a
screen or a LED.
Alternatively or additionally, the signaling uses a spatial code, for example,
by the remote
camera identifying visual spatial patterns on a screen, for example using OCR
techniques.
Possibly, the frequency of flashes is higher than perceived by a human
observer, in order to
reduce distraction. It is noted that communication between a screen and a
video camera
enables a wide bandwidth and/or enhanced enror correction, due to the large
number of
transmission and reception pixels available. Alternatively or additionally, an
existing 1R port is
3o used as a source, which source is detectable by many CCD cameras.
An aspect of some preferred embodiments of the invention relates to
communicating
with a device using RF, rather than acoustics. In a preferred embodiment of
the invention, the
RF generated by a computer speaker, rather than the generated sounds, is
detected by a second
device. In an exemplary embodiment, a smart-card detects the RF generated by a
telephone
6
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
loudspeaker, rather than sounds. Alternatively or additionally, a device may
induce electric
fields in a microphone by transmitting RF fields at ultrasonic or sonic
frequencies.
Alternatively or additionally, a computer can produce measurable and encodable
electromagnetic waves by transmitting information on a plurality of data buses
simultaneously,
so that a stronger signal is detected outside the computer.
An aspect of some preferred embodiments of the invention relates to detecting
the
simultaneous generation of RF and acoustic pulses to determine a distance
between objects. If
the two pulses are generated simultaneously, the delay between their detection
is dependent on
the distance between the objects. The two pulses may be generated by a single
device, such as
1o a computer speaker or they may be generated by separate devices, such as a
computer speaker
and a BlueTooth RF link. In an exemplary application, a computer speaker
generates the two
pulses simultaneously and a microphone on a smart card detects two pulses, one
corresponding
to the RF and one corresponding to the acoustics. Possibly, two sensors are
provided on the
card, one for each modality, however, a combined sensor, such as a
piezoelectric microphone
is preferred. The processing may be on the smart card. Alternatively, the
acquired signals may
be forwarded to a computer for processing. One exemplary method of determining
the delay is
by autocorrelation of the received signal. The pulses used may be temporally
symmetric or
asymmetric.
An aspect of some preferred embodiments of the invention relates to using a
computer
microphone to acquire ambient sounds, then analyzing these sounds using a
computer, and
then using the analysis to determine events occun;~ing in its neighborhood.
Optionally, these
sounds are transmitted to remote location, either as sound files or as data
files for basic and/or
further analysis. In a preferred embodiment of the invention, electronic
devices are designed
and/or programmed to generate sounds (possibly in the ultrasonic range), which
sounds
z5 represent their current state or particular events. Thus, by eavesdropping
on these sounds it is
possible to determine the status of electronic devices. In one example, a
malfunctioning fax
machine will generate one hum and/or an arriving fax on an operating fax
machine will
generate a different hum or sound pattern. A computer near the fax machine can
determine the
status and events and transmit this information, possibly using a computer
network, to a user
of the information. In some cases, the existing sounds generated by a fax
(beeping, printing
noises etc.) can be identified by the computer, without need for special
programming of the fax
machine to generate novel sounds.
An aspect of some preferred embodiments of the invention relates to
interrogating an
electronic device using an acoustic channel. Such interrogation should not
adversely affect the
7
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
operation of the devices. In one example, the device is a network component,
such as a hub. In
another example, the device is a computer. In a preferred embodiment of the
invention, the
acoustic channel is controlled by the computer (analysis of incoming
information, generation
of outgoing transmissions, and possibly execution of certain software) without
interfering with
the work of a person using that computer, for example word processing work.
An aspect of some preferred embodiments of the invention relates to
communicating
with a speaker and/or a microphone using non-airborne transmission of the
sounds. In an
exemplary embodiment of the invention, sounds are transmitted over electrical
cabling in a
home, for example between two wall sockets. In another exemplary embodiment,
the casing of
1o a device and/or cables attached thereto are used to propagate sonic or
ultrasonic signals to a
microphone or from a loudspeaker.
An aspect of some preferred embodiments of the invention relates to a thin-
client
architecture in which a thin client is displays information and/or transmits
input to a controller
of the thin client using ultrasonic waves. An advantage of such an
architecture is that the
15 controller may be any suitable electronic device which has a speaker, with
some suitabie
software modifications or with a suitable hardware attachment. In an exemplary
application, a
user can use a watch like instrument to display the status and/or control a
home automation
system. Alternatively or additionally, the watch can sound radio transmissions
(or other
messages) which are forwarded by ultrasound to the watch, for example by a
computer with a
2o radio card or by a digital radio. Possibly, the instrument includes one or
more inputs which can
be forwarded to the controller, again, preferably by ultrasound. These inputs
may be mapped to
the controller's controls or they may interact with suitable software at the
controller. Although
software execution on the instrument is possible in some embodiments, it is
not preferred.
Alternatively or additionally, although acoustic transmission is preferred, in
some prefenred
25 embodiments of the invention RF or other transmission methods are used.
There is thus provided in accordance with a preferred embodiment of the
invention, a
method of communicating with an electronic device, comprising:
providing a computer having an audible sound receiving and generating sub-
system
including a microphone;
3o transmitting from a source at least one ultrasonic acoustic signal, encoded
with
information to the computer: and
receiving said at least one signal by said microphone, to be detected by said
computer.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of communicating with an electronic device. comprising:
8
CA 02350761 2001-05-15
WO 00/29920 PCT/1B99/02110
providing a computer having an audible sound receiving and generating sub-
system
including a microphone and a loudspeaker;
transmitting from a source at least one first acoustic signal, encoded with
information
to the computer;
receiving said at least one signal by said microphone, to be detected by said
computer;
and
transmitting to said source, using said loudspeaker, at least a second
acoustic signal,
encoded with information, in response with said detected signal. Preferably,
at least one of said
at least one first signal and at least a second signal comprise an ultrasonic
signal.
1o There is also provided in accordance with a preferred embodiment of the
invention, a
method of communicating with an electronic device, comprising:
providing an electronic device having a sound receiving and generating sub-
system
including a microphone and a loudspeaker;
transmitting from a source at least one ultrasonic acoustic signal, encoded
with
information, to the electronic device;
receiving said at least one signal by said microphone, to be detected by said
electronic
device; and
transmitting to said source, using said loudspeaker, at least a second
ultrasonic acoustic
signal, encoded with information, in response with said detected signal.
Preferably, said
2o electronic device comprises a computer.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of communicating with an electronic device, comprising:
providing a telephone having a sound receiving and generating sub-system
including a
microphone;
transmitting from a source at least one acoustic signal, encoded with
infonmation to the
telephone; and
receiving said at least one signal by said micxophone, to be used to control
said
telephone. Preferably, said acoustic signal comprises an ultrasonic signal.
There is also provided in accordance with a preferred embodiment of the
invention, a
3o method of communicating with an electronic device, comprising:
providing a computer having a sound receiving and generating sub-system
including a
microphone;
transmitting from a source at least one acoustic signal, encoded with
information to the
computer; and
9
CA 02350761 2001-05-15
WO 00/Z9920 PCT/1B99/02110
receiving said at least one signal by said microphone; and
fonrvarding an indication of said information to a remote computer, over an
Internet.
Preferably, said indication comprises a sound file. AItennatively, said
indication comprises a
data file.
In a prefen:ed embodiment of the invention, said acoustic signal comprises an
ultrasonic signal.
In a preferred embodiment of the invention, said computer comprises a PDA,
personal
digital assistant. Alternatively, said computer comprises a portable computer.
Alternatively,
said computer comprises a desk-top computer.
1o In a preferred embodiment of the invention, the method comprises processing
said at
least one sound by said computer. Preferably, processing comprises extracting
said encoded
information. Alternatively or additionally, said processing comprises
determining a distance
between said microphone and said source. Alternatively or additionally, said
processing
comprises determining movement of said microphone relative to said source.
Preferably, said
movement comprises angular movement. Alternatively or additionally, said
movement
comprises translation.
In a preferred embodiment of the invention, said processing comprises
determining a
spatial position of said microphone relative to said source. Preferably, said
spatial position is a
one-dimensional spatial position. Alternatively, said spatial position is a
two-dimensional
2o spatial position. Alternatively, said spatial position is a three-
dimensional spatial position.
In a preferred embodiment of the invention, said processing comprises
emulating a
touch screen using said received at least one sound. Alternatively or
additionally, said
processing comprises emulating a pointing device using said received at least
one sound.
In a preferred embodiment of the invention, the method comprises controlling
at least
one action of a toy, responsive to said received at least one sound.
In a preferred embodiment of the invention, said electronic device comprises a
wireless
communication device. Alternatively, said device comprises a toy.
In a prefenred embodiment of the invention, said electronic device comprises a
computer peripheral. Preferably, said peripheral comprises a printer.
3o In a preferred embodiment of the invention, said information comprises
programming
information. Alternatively or additionally, said information comprises music.
In a preferred embodiment of the invention, said source comprises a toy.
Preferably,
said information comprises stored player input.
In a preferred embodiment of the invention, said source comprises a smart
card.
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
Alternatively, said source comprises a wireless communication device.
Alternatively, said
source comprises a computer. Alternatively, said source comprises a computer
peripheral.
In a preferred embodiment of the invention, said information comprises
personal
information.
In a preferred embodiment of the invention, the method comprises togging into
a
computer system responsive to said at least transmitted signal.
In a preferred embodiment of the invention, the method comprises transmitting
at least
a second acoustical signal responsive to said received at least one signal.
In a preferred embodiment of the invention, said acoustic signal comprises
human
l0 audible sound. Preferably, said sound has a main frequency over lOkHz.
Alternatively, said sound has a main frequency which is infra-sonic.
In a preferred embodiment of the invention, said information is encoded using
below
human-threshold amplitude signals. Alternatively or additionally, said
information is encoded
using below human-threshold amplitude variations.
In a preferred embodiment of the invention, said sound is generated at a
frequency
outside a normal operating frequency for said sound subsystem. Alternatively
or additionally,
said sound subsystem is designed for generating musical sounds.
In a preferred embodiment of the invention, said sound subsystem comprises a
sound
card. Preferably, said sound card comprises a SoundBlaster compatible sound
card.
2o In a preferred embodiment of the invention, said sound sub-system is
designed for
audible sound communication with a human operator.
In a preferred embodiment of the invention, said ultrasonic signal has a main
frequency
below ?0, 60 or 50 kHz. Alternatively or additionally, said ultrasonic signal
has a main
frequency below 35kHz. Alternatively or additionally, said ultrasonic signal
has a main
frequency below 25kHz. Alternatively or additionally, said ultrasonic signal
has a main
frequency of about 2lkHz. Alternatively or additionally, said ultrasonic
signal has a main
frequency of about 20kHz. Alternatively or additionally, said ultrasonic
signal has a main
frequency of about l9kHz. Alternatively or additionally, said ultrasonic
signal has a main
frequency of below l8kHz.
3o There is also provided in accordance with a preferred embodiment of the
invention, a
method of creating a smart card terminal, comprising:
providing a general purpose computer having a general-purpose sound sub-
system; and
loading a smart-card terminal software on said computer,
wherein said software controls said sound system to receive acoustic waves
from a
11
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
smart card and transmit acoustic waves to the smart card. Preferably, said
software analyses
said received acoustic waves to determine information encoded by said acoustic
waves.
Alternatively or additionally, said software retransmits said acoustic waves
to a remote
computer which analyses said received acoustic waves to determine information
encoded by
said acoustic waves. Alternatively or additionally, loading a smart-card
terminal software
comprises downloading the software over an Internet. Alternatively or
additionally, said
acoustic waves comprise ultrasonic waves. Alternatively or additionally, said
smart-card
comprises a memory for storing a monetary balance. Alternatively or
additionally, said
software encrypts information encoded by said transmitted acoustic waves.
Alternatively or
to additionally, said smart card comprises a memory for storing identification
information for a
card owner. Alternatively or additionally, said smart card comprises a
processor for analyzing
information received from said computer and for generating a response to said
computer.
There is also provided in accordance with a preferred embodiment of the
invention, a
computer system comprises:
a processor;
a sound sub-system, designed for generating music, comprising:
a speaker which generates acoustic waves; and
a microphone which detects acoustic waves;
a memory; and
2o a software installed in said memory, wherein said software analyses
acoustic waves
received by said microphone to recognize information encoded by said acoustic
waves and
wherein said software uses said speaker to transmit information encoding
acoustic waves
responsive to said recognized information. Preferably, said acoustic waves
comprise ultrasonic
acoustic waves.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of attaching a peripheral to a computer, comprising:
providing a general purpose computer including a sound generating and
receiving
subsystem;
analyzing, at said computer, sounds received by said subsystem to detect
acoustic
3o transmissions from said peripheral; and
transmitting, from said computer and using said subsystem, information to said
peripheral using encoded sound transmissions.
There is also provided in accordance with a preferred embodiment of the
invention,
method of communicating with a computer, comprising:
12
CA 02350761 2001-05-15
wo oon9~o rc~r~rB99iom i o
generating by a computer an electromagnetic field by driving a computer
component
not designed for field generation in a manner which generates a parasitic
electromagnetic field,
wherein said field is encoded with information by said generation; and
receiving said encoded feld by an electronic device. Preferably, said
electronic device
receives said wave using an RF antenna. Alternatively or additionally, said
electronic device
receives said wave using a microphone. Alternatively or additionally, said
computer
component comprises a speaker. Alternatively or additionally, said
electromagnetic field has a
main AC frequency of between 10 kHz and 100 kHz.
There is also provided in accordance with a preferred embodiment of the
invention, a
to method of detecting electromagnetic radiation by a computer comprising:
generating an electro magnetic field which encodes information;
sampling a microphone channel associated with said computer to detect
artifacts
caused by said field; and
decoding said information by said computer. Preferably, said associated
computer is
i s physically connected to said microphone channel. Alternatively, said
associated computer is
connected to said microphone channel by a computer network connection.
In a preferred embodiment of the invention, said electromagnetic field is a
side-effect
of driving a speaker. Preferably, said electromagnetic field is a side-effect
of driving a speaker.
In a preferred embodiment of the invention, said electromagnetic field has a
main AC
2o frequency of between 10 kHz and 100 kHz.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of emulating a microphone using a speaker, comprising:
providing a computer having a speaker channel and a microphone channel;
coupling a computer speaker to the microphone channel; and
25 receiving signals for said microphone channel via said speaker. Preferably,
coupling
comprises coupling using a coupler.
There is also provided in accordance with a preferred embodiment of the
invention, a
coupler for an audio channel, comprising:
a first connector for selectively driving a speaker or receiving input from a
microphone;
3o a second connector for sending signals to a microphone channel;
a third connector for receiving speaker-driving signals from a speaker
channel; and
circuitry for selectively driving said speaker or receiving signals from said
microphone,
using said first connector. Preferably, said circuitry receives switching
instructions via said
speaker channel.
13
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
There is also provided in accordance with a preferred embodiment of the
invention, a
method of determining a status of an electronic device, comprising:
receiving information encoding acoustic signals generated by said device; and
analyzing said signals to determine an operational status associated with said
device
s responsive to said information. Preferably, said status comprises a status
of said device.
Alternatively or additionally, said status comprises a status of a second
device attached by
computer communications with said device. Alternatively or additionally, said
status
comprises a status of a network that said device is part of. Alternatively or
additionally, said
analyzing comprises analyzing on a computer separate from a circuitry used for
acquiring said
to signals. Alternatively or additionally, said signals are generated by said
device responsive to an
inten;ogation by a second device which performs said receiving. Preferably,
said interrogation
does not interrupt other activities of said device.
Alternatively, said signals are generated by said device independent of an
interrogation
by a second device.
is In a preferred embodiment of the invention, said signals are sonic.
Alternatively, said
signals are ultrasonic.
In a preferred embodiment of the invention, the method comprises programming
an
existing device to generate said signals using an existing speaker which, when
the device was
designed, was not designated for communication with a second device.
Preferably, said
2o programming comprises software programming in which only memory storage
locations are
modified. Alternatively or additionally, said programming comprises hardware
programming
in which electronic circuitry of the device is modified.
In a preferred embodiment of the invention, said electronic device comprises a
computer. Alternatively, said electronic device comprises a network hub.
Alternatively, said
25 electronic device comprises a network switch. Alternatively, said
electronic device comprises a
network muter.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of accessing a single user computer by a second user, without
interrupting the
activities of the first user, comprising:
3o transmitting an acoustically encoded command by the second user to the
computer;
receiving said command by the computer; and
executing the command by the computer. Preferably, said command is
ultrasonically
encoded. Alternatively or additionally, said receiving comprises receiving
using a microphone
connected to a sound card of said computer, which sound card Ls designed for
audio
14
CA 02350761 2001-05-15
WO 00/29920 PC'T/1B99/02110
applications.
There is also provided in accordance with a preferred embodiment of the
invention, a
computer networking method comprising:
providing first, second and third computers; and
transmitting a message encoding data from the first computer to the third
computer via
the second computer by acoustic transmission between the computers.
Preferably, said acoustic
transmissions utilize sound cards designed specifically for processing audible
sounds.
Alternatively or additionally, said acoustic transmissions utilize are
ultrasonic having a
frequency of less than 50 kHz.
There is also provided in accordance with a preferred embodiment of the
invention, a
wireless peripheral for an electronic device, comprising:
a microphone for receiving ultrasonic acoustic transmissions having a
frequency of less
than 70 kHz from an electronic device;
circuitry for processing said transmission; and
a display for displaying a result of said processing. Preferably, said
peripheral
comprises an input element and a speaker for transmitting sound to said
electronic device
responsive to input from said input element.
In a preferred embodiment of the invention, said peripheral comprises a
printing engine
for printing a result of said processing. Alternatively or additionally, said
processing comprises
2o merely of converting the signals from an acoustic encoding format to a
format suitable for said
display. Alternatively, said processing comprises processing the information
encoded by said
transmissions.
In a preferred embodiment of the invention, said electronic device comprises a
computer. Alternatively or additionally, said electronic device comprises a
radio. Alternatively
or additionally, said pedpheraI comprises a speaker for said electronic
device. Alternatively or
additionally, said peripheral comprises a time display which presents a time
signal generated
by said electronic device. Alternatively or additionally, said peripheral
comprises a status
display which presents a status signal generated by said electronic device.
There is also provided in accordance with a preferred embodiment of the
invention, a
3o wireless peripheral for an electronic device, comprising:
a speaker for transmitting ultrasonic acoustic transmissions having a
frequency of less
than 70 kHz from an electronic device; and
circuitry for generating said transmissions; and
an input element for receiving input to be encoded by said transmissions.
Preferably,
CA 02350761 2001-05-15
WO 00/29920 PGT/IB99/02110
the peripheral comprises a microphone for receiving ultrasonic transmissions
from said
electronic device. Alternatively or additionally, said input element comprises
a bar-code
reader. Alternatively or additionally, said input element comprises a smart
card reader.
Alternatively or additionally, said input element comprises a pointing device.
Alternatively or
additionally, said input element comprises a keyboard.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of communicating with a computer, comprising:
providing a computer having a data line attached to at least one particular
peripheral;
sending a data transmission to the computer by injecting a signal into said
data line
to using an electromagnetic coupler; and
identifying by said computer the source of said data transmission.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of communicating with a computer, comprising:
providing a computer having a data line attached to at least one particular
peripheral;
generating by said computer a data transmission directed to a different
peripheral; and
receiving said data transmission from the computer by eavesdropping on said
data line
using an electromagnetic coupler.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of injecting data into a computer from an uncoupled peripheral,
comprising:
2o transmitting said data from the uncoupled peripheral to a tap; and
physically activating a peripheral coupled to said computer, by said tap.
Preferably,
physically activating comprises activating keys in a keyboard. Alternatively,
physically
activating comprises activating vibrating a mouse.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of communicating with a computer, comprising:
generating by a computer a data transmission;
controlling, by said computer, a component not designated for data
transndssion, to
effect a transmission of said data; and
receiving said data transmission from the computer by a second device.
Preferably, said
computer controls an activation of a mechanical component of said computer to
transmit said
data by modulation of mechanical sounds generated by said computer.
Alternatively or
additionally, said computer controls an activation of a status I.EDs of said
computer to
transmit said data by modulation of illumination of said LEDs. Alternatively
or additionally,
said computer controls an activation of an electrical component of said
computer to transmit
16
CA 02350761 2001-05-15
wo oon99zo rc~rn899iom i o
said data by modulation of parasitic RF signals generated by said computer.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of transmitting data over a computer network, comprising:
providing a sound file at a Fast location;
transmitting said sound file to a second location via said computer network;
and
transmitting said sound file as acoustic sounds to a processor at a third
location.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of transmitting data over a computer network, comprising:
encoding data as acoustic sounds at a first location;
to transmitting said sound file to a second location as acoustic sounds; and
transmitting said acoustic sounds as a sound file to a third location, via
said network.
In a preferred embodiment of the invention, said network comprises an
Internet.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of analyzing acoustic signals, comprising:
15 receiving said signals using a microphone which microphone converts the
signals into
analog electrical signals;
driving at least one digital data lead of an integrated circuit using said
analog signals;
and
processing said signals using said integrated circuit. Preferably, the method
comprises
2o amplifying said electrical signals prior to said driving.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of determining a time of flight of a pulse between two electronic
devices, comprising:
simultaneously generating an acoustic pulse and an electromagnetic pulse using
a
speaker of a first electronic device;
25 detecting, using a single detector associated with a second electronic
device, both the
acoustic pulse and the electromagnetic pulse; and
determining a time of flight of said acoustic pulse the two devices based on a
delay
between the reception of the two pulses.
There is also provided in accordance with a preferred embodiment of the
invention, a
3o method of acoustic communication, comprising:
estimating an echo duration for an acoustic band; and
transmitting data using the acoustic band, wherein between data elements a
period of
silence is provided, having a duration responsive to said echo duration.
Preferably, the data
elements are encoded using individual frequencies in an FSK encoding protocol.
Alternatively
17
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
or additionally, estimating comprises estimating based on an expected
communication
geometry. Alternatively, estimating comprises estimating a duration based on
at Least one
acoustic calibration generated adjacent to said data transmission.
There is thus provided in accordance with a preferred embodiment of the
invention, a
s method of communicating with an electronic device, comprising:
providing a computer having an sound receiving and generating sub-system
including a
microphone;
providing a personal communicator which utilizes a communication network;
initiating a connection by said computer, over said communications network, to
said
personal communicator; and
identifying said personal communicator responsive to an audio response of said
personal communicator to said connection initiation. Preferably, initiating a
connection
comprises directly accessing said communication networks from said computer
using
dedicated hardware. Preferably, said hardware comprises a dialer card.
In a preferred embodiment of the invention, initiating a connection comprises
accessing
a non-computer data network other than said communication network directly
from said
computer using dedicated hardware and utilizing a link between said non-
computer network
and said communications network. Alternatively, initiating a connection
comprises requesting
a second computer to create such a connection, which request is made over a
computer
2o network.
In a preferred embodiment of the invention, said initiation by said computer
causes said
personal communicator to generate a distinct audio response. Preferably, the
method comprises
requesting, by said computer a distinctive audio response.
In a preferred embodiment of the invention, the method comprises transmitting
data
signals to said personal communicator to be acoustically sounded and received
by said
computer.
There is also provided in accordance with a preferred embodiment of the
invention, a
method of authentication, comprising:
providing a computer having an sound receiving and generating sub-system
including a
microphone;
providing a personal communicator which utilizes a communication network;
opening a connection, over said communications network, between said computer
and
said personal communicator; and
transmitting authentication signals over a closed loop including both an audio
18
CA 02350761 2001-05-15
WO 00/Z9920 PCT/IB99/02110
transmission section between the computer and the personal communicator and a
section over
the communications network. Preferably, said computer initiates opening said
connection.
Alternatively, said personal communicator initiates opening said connection.
In a preferred embodiment of the invention, said authentication signals
comprise sound
s waves generated by said computer and transmitted by audio to said personal
communicator.
Alternatively or additionally, said authentication signals comprise sound
waves
generated by a remote computer and transmitted by said communication network
to said
personal communicator. Preferably, said remote communicator initiates said
connection.
Preferably, the method comprises said remote computer causing said personal
communicator
to to generate a sound and detecting said sound by said computer as an
indication of a request for
authentication.
In a preferred embodiment of the invention, said authentication signals
comprise at
least mostly sonic frequencies. Preferably, said signals are encoded using a
DTMF-like
encoding scheme.
15 Alternatively or additionally, said authentication signals comprise
ultrasonic
frequencies.
In a preferred embodiment of the invention, said personal communicator
comprises a
cellular telephone. Preferably, said personal communicator comprises a
programmable cellular
telephone. Preferably, said cellular telephone comprises a JAVA programmable
cellular
2o telephone.
In a preferred embodiment of the invention, said personal communicator
comprises a
beeper. Alternatively, said personal communicator comprises a wireless
telephone.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be more clearly understood with reference to the following
detailed
25 descriptions of non-limiting preferred embodiments of the invention in
which:
Fig. 1 is a schematic illustration of a computer and an electronic device that
are
operative to communicate using sound waves, in accordance with a preferred
embodiment of
the invention;
Fig. 2 is a schematic illustration of two communicating electronic devices, in
3o accordance with a preferred embodiment of the invention;
Fig. 3 is a schematic illustration of a smart card communicating with a
computer, in
accordance with a preferred embodiment of the invention;
Fig. 4 is a schematic illustration of a smart-card reader in accordance with a
preferred
embodiment of the invention;
19
CA 02350761 2001-05-15
WO 00/29920 PCT/1B99/02110
Fig. 5 is a schematic illustration of a method of tapping into a computer,
without
requiring complicated installation of hardware, in accordance with a preferred
embodiment of
the invention;
Fig. 6 is a schematic illustration of an unobtrusive computer checkup in
accordance
with a preferred embodiment of the invention; and
Fig. 7 is a schematic illustration of a computer communication setup using
acoustics, in
accordance with a preferred embodiment of the invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
Fig. 1 is a schematic illustration of a computer 20 and an electronic device
30, which
1o are operative to communicate using sound waves, in accordance with a
preferred embodiment
of the invention. Most computers currently on sale include a sound system 24,
usually a sound
card, connected to at least one microphone 26 and at least one speaker 28.
Many electronic
devices include a microphone 34 and a speaker 36. In a preferred embodiment of
the invention,
computer 20 and electronic device 30 communicate using these standard
components, which
is are usually not designed for computer communication but for human
communication. In some
cases, the electronic device (or the computer) may include a jack to which one
or more
speakers and one or more microphones may be connected. Preferably, such
connected acoustic
elements are positioned on a difficult to obstruct portion of the device,
preferably at positions
where the elements have a wide field of view.
2o In one preferred embodiment of the invention, a standard sound card, such
as the
popular "Sound-Blaster" is used to generate sonic and/or ultrasonic signals to
(and to receive
them from) an electronic device, a toy and/or another object. The acoustic
signal may be
audible or inaudible, for example having mainly ultrasonic or infrasonic
frequencies.
Preferably, frequencies of about 22kHz and 24kHz and 32 kHz are used, since a
standard
25 sound card provides these sampling rates (and/or their multiples, e.g., 44
kHz and 48kHz). As
used herein the term "main frequency" is used to describe the frequency band
in which most of
the energy of the information carrying signal is concentrated. In some cases,
the information
carrying portion of the signal is not at the main frequency generated by the
card, for example
when an ultrasonic signal is overlaid on a different audible sound.
3o In some preferred embodiments of the invention, a sound card is adapted to
work in the
near ultrasonic range, for example by increasing its sampling frequency.
Generally, the
microphone and loudspeaker used for a computer system can support low
frequency ultrasound
with suffident fidelity without adaptation. In some cases however, a special
ultrasound-
sensitive microphone or ultrasound-effective speaker may be used. In other
cases, the
CA 02350761 2001-05-15
wo oon~2o pcTns99io2> >o
sensitivity of a particular microphone and/or loudspeaker maybe determined
prior to or during
communication with an electronic device. In one example, if a device having
known
characteristics transmits an equally powerful signal at several frequencies,
the frequency
sensitivity (and/or directional sensitively) of a microphone may be
determined. In a similar
manner, a computer may generate these sounds and the signals detected by the
device analyzed
to determine output characteristics of the particular loudspeaker used. In
addition, a self
calibration procedure may be performed by listening to the computer's output
using the
computer's microphone. In some cases, both the device and the computer sound
systems can
be calibrated by combining self testing and cross-testing.
1o In some cases, the microphone and/or the sound card are sensitive enough to
receive,
from the object, an RF signal associated with generating the acoustic signals,
even if an
acoustic signal is not sent (e.g., no loudspeaker is present). Alternatively
or additionally, the
object may detect RF signals generated by the speaker or sound card while
generating the
ultrasound. These RF signals are generally less affected by lack of line of
sight than ultrasonic
signals. In an exemplary embodiment, a device for communication with a
telephone handset
(or other devices where the speaker and microphone are displaced), can be made
small, by
allowing the detection of sounds from the telephone to be emulated by the
detection of RF
fields from the telephone speaker. Thus, a smart-card can be made small and
placed against the
telephone microphone and still receive signals from the telephone loudspeaker.
Alternatively
2o or additionally, the device may transmit RF fields to generate an
electrical signals at the
telephone microphone. These transmitted and received signals may be ultrasonic
or they may
be sonic, for example DTMF or DTMF-like signals as known in the art.
In a preferred embodiment of the invention, such an acoustic communication may
be
used to program a toy and/or retrieve information from a toy, for example
replacing an RF link
for this purpose as described in US patent number 5,752,880, the disclosure of
whfch is
incorporated herein by reference. In a particular embodiment, music may be
downloaded from
the Internet, directly to the toy, for example by modulating an ultrasonic
signal to carry MP3
sound files. Alternatively or additionally, such a link may be used for real-
time communication
with the toy.
3o Some embodiments of the invention do not require that the electronic device
communicate with a computer. Fig. 2 is a schematic lllustration of two
communicating
electronic devices 30 and 30'. In one example, a PDA communicates with a
printer. In another,
an organizer communicates with a satellite telephone. Possibly, such
communication is used to
exchange data files and/or to share capabilities, such as modem connections.
In some cases a
21
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
port adapter may be required to be plugged into a port, for example a sonic-to-
parallel adapter,
which converts between acoustic signals and parallel port signals.
A computer network, in accordance with a preferred embodiment of the
invention,
utilizes sound waves transmitted between computers for communication, using
existing
hardware, such as an audio card, loudspeakers and a microphone. Preferably,
the sound waves
are ultrasound waves. In a preferred embodiment of the invention, such a
computer network is
used to connect a PDA or a portable computer to a different computer, for
example for data
transfer or for sharing peripherals, such as a modem, a printer or a storage
device. Thus, an
existing PDA (which includes a loudspeaker and a microphone) can use a modem
of a desk-
1o top computer, without requiring additional hardware in the PDA, possibly
requiring only a
small software change. This software change may be in application software on
the PDA or in
the operating system software (or both), depending on the implementation. In
another example
an acoustic-enabled smart-card (such as that described below), can print, or
backup
information using a standard desktop computer. Alternatively or additionally,
such a network
may be used in a small office, for example for file or printer sharing.
In a preferred embodiment of the invention, a standard communication
protocol/language is defined, so that many types of devices can communicate
and/or share
resources using the standard language. Alternatively, an existing networking
language may be
used.
zo In a preferred embodiment of the invention, sonic and/or ultrasonic
communication is
used for paying a toll or a fee (human, package or vehicle), utilizing a
reactive component,
possibly a passive transponder, on the tolled item. In another example, such
communication is
used to pay a transportation fee, for example on a subway or a bus.
Alternatively or
additionally, an acoustic mechanism as described herein is used to open
vehicle barriers, for
example at entrances to apartment complexes or to open garage doors.
Alternatively or
additionally, the acoustic mechanism is used for automatic refueling/billing
systems, possibly
transmitting billing and/or mileage information to a pump receiver,
controlling the fuel flow
and/or verifying the fuel type. Possibly, a car dashboard speaker, a car horn,
an alarm speaker,
a car radio speaker or a dedicated speaker, is used to sound the required
sonic and/or ultrasonic
3o signals. In some cases, as noted above, it is the RF signals generated by
the speaker which are
detected. In a preferred embodiment of the invention, a car radio speaker is
made to generate
the required sounds by transmitting an electromagnetic wave to the radio or to
its loudspeaker,
from a specialized electronic device.
22
CA 02350761 2001-05-15
wo oon99zo Pc°rnB~io2> >o
Alternatively or additionally, to using a computer, in a preferred embodiment
of the
invention, a set-top box, of a cable TV system, for example, is used to
transmit and/or receive
acoustic signals. Preferably, a microphone is connected to the set-top box.
Alternatively or
additionally, the transmission back to the set-top box uses an IR signal,
which is detectable by
the set-top box. In one example, the set-top box includes software that
analyzes signals. Such
signals may comprise responses of electronic devices and/or toys to sounds
generated by the
television or by the set-top box. Alternatively or additionally, the set-top
box adds sounds (or
ultrasonic waves) to a video and/or audio stream decompressed by the set-top
box.
Alternatively or additionally, the set-top box adds temporal and/or spatial
optical modulations
1o to a video stream, for an optically-sensitive electronic device to detect.
In a preferred embodiment of the invention, the detection of a signal by an
electronic
device (or a computer) comprises a binary detection of the signal, e.g., an
on/off state.
Additionally or alternatively, more complex signal detection and analysis
techniques may be
implemented, for example, detection of signal amplitude, frequency, frequency
spectrum,
t5 Doppler shift, change in amplitude and/or duration, detection of a number
of repetitions, voice
and/or other pattern recognition in the sound. Various information encoding
protocols may be
used, including AM, FM, PSK, QPSK and/or pulse length encoding. The
transmitted signal
may include one or more of information about the sending device's activities,
location,
environment, nearby devices, locally sensed information, logic state,
readiness, requests for
2o information and/or answers to such requests.
Such signal detection and/or analysis may also be performed on a computer that
is in
communication with the electronic device. The physical detection circuit is
preferably located
on the device. Additionally or alternatively, the detection circuit is also
located on the
computer.
25 In a preferred embodiment of the invention, ~ microphone 34 (or microphone
26)
comprises a directional microphone, for example a stereophonic microphone or a
microphone
in which the frequency response is spatially non-uniform, to aid in
determining the direction of
the sound source or to reduce noise.
PCT application PCT/IL98/00450, titled °The Control of Toys and
Devices by
3o Sounds", filed September 16, 1998, in the Israeli receiving once, the
disclosure of which is
incorporated herein by reference, describes sound actuated toys. In
particular, the application
describes various sound makers that generate sounds inadvertently as a result
of motion, for
example beads in a box or noise form a crinkle material. Such a sound maker is
connected to
and/or mounted on a toy, so that when the toy moves a signal will be generated
for another toy
23
CA 02350761 2001-05-15
wo oon~o Pc~rns99ioz i i o
or device to acquire. This PCT application also describes detecting the
direction and/or
position of a sound, using directional microphones and/or a stereophonic
microphone
including two or more microphone elements. Additionally or alternatively, a
relative distance
is determined based on amplitude of the sound.
Israel application 127,569, filed December 14, 1998, titled "Interactive
Toys", the
disclosure of which is incorporated herein by reference, describes various
toys and electronic
devices which interact using sound waves. These applications contain
information useful in the
design and use of acoustically controlled devices, and which may be applied
towards some
preferred embodiments of the invention.
1o Fig. 3 is a schematic illustration of a smart card 40 that communicates
with a computer.
Although a smart card is a special case of an electronic device, it is noted
that typical smart
cards do not include an acoustic input/output channel, especially not an
ultrasonic one, in the
low ultrasonic frequencies.
In a preferred embodiment of the invention, smart card 40 comprises an
acoustic
t5 element 42, a processor 44 that controls the acoustic element and a memory
46 for storing
information. Such a smart card may use a single piezoelectric transducer
(possibly a film layer)
for both transmission and reception.
As many electronic devices include a speaker and/or a microphone, such a card
may
communicate with any such device that has suitable software. Due to the
decreasing size of
20 electronics, in some cases, a smart card may be emulated using a PDA or
other electronic
means (or vice-versa), with regard to both size and functionality.
Additionally or alternatively,
such smart card functionality may be exhibited by a cellular telephone or a
lap top computer. A
benefit of a lap top computer and of a PDA is their convenient user-interface.
A benefit of a
cellular telephone is the possibility of real-time and/or off line
communication with a central
25 location.
A particular desirable use for such a smart card is for authentication, e.g.,
using a
digital signature method, of e-commerce transactions. In such an application,
the card may be
used to supply encrypted or signed information, to a vendor, over the Internet
or over the
telephone, by transmitting sound wave to the computer from the sound card.
These sound
3o waves can forwarded to the vendor or a verifier as sound files or as data
files. The smart card
may generate the information responsive to information presented by the
computer, either
acoustically to the smart card or using a human to enter data into the sound
file.
A software protection method in accordance with a preferred embodiment of the
Invention comprises a passive ID tag which responds to an interrogation. In
one example, such
24
CA 02350761 2001-05-15
WO 00/29920 PCT/1B99/02110
a tag is attached to the case of a software CD, such that the software will
operate only if the
computer on which it runs can interrogate the CD for a particular code, using
ultrasonic or
sonic signals. Alternatively or additionally, the ID tag may be attached to
the CD itself and/or
attached to (or integrated with) an implement used for interacting with the
software, for
example a toy implement. Alternatively or additionally, the tag may be
permanently attached
(such that removal will damage it) to the case and/or monitor and/or other
internal or external
element of the computer. Alternatively or additionally, the ID tag is plugged
in as a pass-
through hasp, which possibly does not interact with the data lines which pass
through it at all,
but may use power from the power lines. Rather, the authentication of the
software uses
1o acoustic communication between the hasp and the microphone and/or speaker.
Alternatively to
protecting software, such a method may be used to protect an easily stolen
device, such as a
PDA or a laptop.computer, which can use their internal speakers and/or
microphones to detect
the proximity of a required ID tag.
An authentication system in accordance with a preferred embodiment of the
invention
preferably uses a personal communicator for authentication and/or for logging
in to a computer
or other device which requires authentication, such as an electronic
turnstile. In a preferred
embodiment of the invention, a user may be authenticated by the computer
dialing a user's
personal communicator (for example a beeper, a cellular telephone, wireless
telephone or a
satellite telephone) and then listening for a ring or other response of the
personal
2o communicator. In a local cellular network, the computer may dial the
extension number of the
user. Preferably, the personal communicator is programmed to generate a
distinctive ring, at
least for calls originating from the computer. Alternatively or additionally,
the computer can
request a distinctive ring, for example requesting such a ring from a
telephone company,
beeper service provider or from a PBX.
It should be noted that different types of personal communicators use
different types of
communication networks. For example, analog beeper networks may include a
human go-
between, cellular beeper networks include local cells, telephone networks
include telephone
interchanges and integrated LAN-telephony networks use a same network for both
voice and
data communications.
3o Alternatively or additionally, a user calls up the computer, for example
using a pre-
assigned number or a number presented at the computer (or the computer calls
the user) and
the computer performs authentication by transmitting a certain sound to the
personal
communicator and listening for that sound using the computer's room
microphone. Preferably,
the sounds are sonic. Possibly, DTNIF tones. Alternatively or additionally,
the sounds include
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
ultrasonic frequencies, for example using frequencies as described herein. In
a preferred
embodiment of the invention, the computer uses the detected sound to determine
attributes of
the personal communicator, for example its distance from the computer.
Alternatively or
additionally, when the user's communicator indicates an incoming call, or
responsive to a
request from the computer, the user places the personal communicator (e.g.,
its sound I/O
portions) in a location closer to the computer's microphone and/or speaker.
Alternatively or
additionally, authentication signals are transmitted by audio means to the
personal
communicator, to be transmitted back to the computer over a communications
network of the
personal communicator.
Alternatively or additionally to providing a telephone connection, a personal
communicator may respond to an ambient room sound (for example an ultrasonic
wave or a
DTMF tone from a computer) with an ID code. Alternatively or additionally, a
user may enter
a code into a computer by dialing the code on his personal communicator and
allowing the
computer to receive the DTMF tones using the computer's microphone.
Alternatively, the
computer may detect a distinctive ring of a personal communication device, as
an indication
that a remote computer is about to start an authentication sequence using that
device.
Alternatively, a request to perform an authentication process may arrive at
said computer over
a computer network or by a user request at an input device of said computer.
Some types of personal communicators, for example Java-programmable cellular
2o telephones, are easy to reprogram. In a preferred embodiment of the
invention, such a
telephone is reprogrammed to be an ID card. Possibly, such reprogramming
(e.g., downloading
a new program from a cellular provider or other service provider, directly
into the cellular
telephone) is done in response to the challenge, or by a user keying in a
code, when he expects
such a challenge. Emulation of a smart card or )D card by a cellular telephone
or other
programmable electronic device is described elsewhere in this application.
However, a benefit
of a cellular telephone is that at least some of the logic can be at a remote
computer which
communicates with the cellular telephone.
Possibly, the cellular telephone serves only as an input and output device for
that
remote computer. Thus, a personal communicator can be used to set up a direct
link between
3o two computers. Such a link may be used for authentication of the personal
communicator
holder. Such links are typically more difficult to compromise than computer
network links.
The personal communicator may be passive in the link. Alternatively, the
personal
communicator may be active, for example, performing some of the data
processing and/or
encryption. Optionally, data Is transmitted both through the personal
communicator and
26
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
through a computer network, for example, one of the channels containing an
encryption key
for the other channel. Alternatively or additionally, the data being
transmitted to the personal
communicator may be transmitted as electronic data packets, which are
translated into sounds
for the IocaI computer.
In a preferred embodiment of the invention, several layers of authentication
are
provided. For example, a cellular telephone transmits its hard-wired 1D, using
sound waves.
Alternatively or additionally, a cellular telephone may digitally sign a
message that passes
through it using the ID. A user may also be required to type a code, which is
overheard by the
computer and/or a remote code may be provided from a third computer, over the
cellular
1o network. Thus, a user is required to have the right cellular telephone,
know a code and/or
response and have a support of a third party.
In some cases, a personal communicator may include a call-forwarding function
in
which a call to the communicator is forwarded to a different communicator from
the one to
which the call was placed. In a preferred embodiment of the invention, the
personal
~ 5 communicator transmits (by audio) a hard-wired ID code of the communicator
to prove that it
is the one dialed. In some communicators, such a transmission cannot be
tampered with. In
caller ID systems, the personal communicator may be required to dial back the
computer
(manually or automatically), and the communicator is identified using the
caller ID function or
by transmission of information from the personal communicator. Alternatively
or additionally,
2o a call-back mechanism is used, far example one in which a user calls up a
computer and that
computer calls back and assists in authentication only if a correct source
telephone number
was provided. Alternatively or additionally, the computer can call only such
communication
devices that do not include a call forwarding function. Alternatively or
additionally, the
computer can check with a service provider's Internet page or other on-line
database to
25 confirm that a call forwarding function is not active. Such a connection
from the computer can
also be used for requesting a distinctive ring.
In a preferred embodiment of the invention, the computer includes a modem, an
NR
card, a dialer card, or other communication hardware for directly contacting
the personal
communicator. Alternatively or additionally, the computer can contact a second
computer, for
3o example via an Internet and that other computer will do the contacting
and/or the
authentication with the personal communicator. In one example, the local
computer serves
only for acoustic UO. In one example, an SMS message is sent by Internet from
the computer
to a cellular phone and the arrival of the message and/or its play back by the
cellular telephone
holder comprise the identitlcation.
27
CA 02350761 2001-05-15
WO 00/29920 PtrTIIB99l02110
The above methodology has been described for authentication. One particular
type of
authentication is for money transfer. Many types of money transfer methods are
known in the
art and can be adapted to the present invention. In particular, smart cards
for storing electronic
money and transferring the money to a computer using various computer
communications
methods are described herein. In a preferred embodiment of the invention, by
using a real-time
communicator device, the storage may be remote. In a preferred embodiment of
the invention,
money tokens which lose their value in a short time (e.g., a few second) may
be transmitted
from an account location, by audio, through the cellular telephone to the
target computer (e.g.,
an acoustic-enabled cash register). This target computer can then transfer the
tokens, by
to computer network back to the account location for redemption. In some
implementations, the
token can be redeemed even without sending it back to the account location,
for example if the
target computer is the issuer or by using a central banker.
Although the above authentication methods have been described using sound
waves, in
a blue-tooth enabled computer, these might be practiced using a blue-tooth
enabled personal
communicator. However, this implementation is less preferred as it imposes
additional
limitations on the personal communicator and on the computer.
In a preferred embodiment of the invention, an authentication method uses
interrogation of an ID-tag instead of a personal communicator. Possibly, the
1D-tag is a smart-
card. In some embodiments of the invention, such a tag is interrogated
directly using RF, in
others, using sound and/or ultrasound (depending on the tag constnrction).
Preferably, the tag responds with acoustic signals, possibly ultrasonic
signals.
Optionally, the tag uses the energy of the interrogation signal to generate
the response signal.
Alternatively or additionally, the tag is interrogated using a tag-specific
code. In a preferred
embodiment of the invention, such a tag is used for computer log-on
authentication, for
example, when a wearer approaches a computer, the computer automatically logs
on to that
user. Alternatively or additionally, the computer may require the proximity of
the 1D card in
addition to standard log-on procedures. Alternatively or additionally, the
computer may
periodically interrogate the m card, to insure that the card wearer is still
nearby. Alternatively
or additionally, the computer may interrogate the card for user specific
information, for
3o example a voice ID or personal information. The computer can thus query the
user for a voice
response and compare the response (voice print and/or contents) to confirm the
card wearer is
a designated card wearer.
28
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
In some preferred embodiments of the invention, the card uses speech input. In
others,
the card detects a response to a query by the absence, quality, number and/or
other features of
sounds, so no real speech recognition or matching is required.
A user may wear two cards, one for general authorization and one including
personal
information. Thus, a computer may interrogate both cards.
Fig. 4 is a schematic illustration of a smart-card docking station 110 in
accordance with
a preferred embodiment of the invention. A smart card 112 is inserted into the
reader 110. A
portion 114 of the reader is configured to communicate with the smart card,
for example using
RF, magnetic fields, ultrasound, IR and/or any other communication protocols.
Possibly, a
1o plurality of such areas 114 are provided, each for a different physical
protocol. These
communications with the card are preferably transformed, using an acoustic
transducer 116,
into acoustic communications to be transmitted to- and/or received by- a
remote computer or
other electronic device, using the methods as described herein. Thus, an owner
of a smart card
can easily interact with a standard computer without installing a dedicated
reader on the
computer. Rather, the smart card owner will carry around a miniature adapter
110 that can
communicate with a computer in a wireless manner. Alternatively, a smart card
may be
constructed to have an ultrasonic communication protocol, such that swiping
can be performed
without requiring a docking station 110.
Alternatively or additionally, docking station 110 is designed specifically
for magnetic
cards, such as common credit cards. Station 110 preferably includes a
sensitive magnetic field
detector in area 114, so that when a card is inserted into the docking
station, the magnetic strip
is read. Consequently, it becomes possible to swipe a standard magnetic card
at many existing
electronic devices, without requiring special hardware to be connected. A
dedicated station
may be made very thin, for example less than 10 mm or even less than 5 mm.
Preferably the
docking station has a closed configuration, but an open docking station,
comprising a sensor
and a contra to hold the card against the sensor is also envisioned. Although
card swiping is a
one-way communication process, in some cases two way communication may be
desirable, for
example for a user to collect information regarding purchases for example
amounts, times,
type and authentication confirmation. In some embodiments, this information
may be
3o accumulated by the station 110, as described below.
Alternatively or additionally, station 110 may be adapted to attach to a port
of a PDA,
cellular telephone, "organizer" or other portable electronic devices. Such a
station converts
electronic signals at the port to sonic and/or ultrasonic acoustic signals
that can be recognized
by a computer.
29
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
A dedicated station may be manufactured for each device and smart card type,
Alternatively, a single station may be constructed for multiple device types
and include an
auto-sensing circuit for detecting the logic of the output port. One example
of such a detection
is by "transmitting" a known signal from the device and determining the
setting which allows
the station to detect that signal. Another example of automatic detection is
by automatically
recognizing characteristics of the device, such as transmission amplitude or
geometry.
Alternatively, station 110 may include a switch or other user interface for
manually selecting
between different types of electronic devices.
It should be noted that although acoustic communication is preferred for at
least one
to communication direction (computer to smart-card or smart-card computer) one
or both of the
communication directions may utilize other technologies, temporarily or on a
permanent basis.
For example, the card may use the IRDA IR communications standard or the
Bluetooth RF
communications standard. Alternatively, one of the directions may be manual,
for example a
device displaying to a user what he should enter into the other device.
i5 In some embodiments of the invention, station 110 may enhance the
functionality of a
device or a magnetic card, possibly elevating its functionality to that of a
smart card, or
enhancing the functionality of a less versatile smart card. For example,
station I10 may
provide authentication of vendor, by decoding an encrypted signal transnutted
by the vendor
(which a magnetic card is unable to read and/or process). In another example,
station 110 may
2o comprise a memory for tracking the use of a magnetic card. In another
example, station 100
may provide positioning capabilities.
In a preferred embodiment of the invention, spatial angles between a sound
source and
a plurality of microphones are determined by analyzing phase differences at
the microphones.
Alternatively or additionally, other methods known in the art may be used for
positioning. In a
25 preferred embodiment of the invention, a relative location of a pulsing
sound source and a
plurality of microphones is determined by solving time of flight equations.
Thus, the relative
location of an electronic device and/or a computer, relative to another
electronic device or
smart card, may be determined and used to control the operation and/or
cooperation of one of
the above electronic devices.
30 In a preferred embodiment of the invention, four microphones are used to
determine a
three-dimensional position. For a source at r=(x0,y0,zp) and a plurality "i"
of microphones at
Mi=(xi,yi,z~, the distances between the source and the microphones are Di=IIr-
MIII~ The
acoustic velocity, "c", may be known, for example based on a known velocity in
air.
Alternatively, It may be determined by measuring the time of flight between a
sound source
CA 02350761 2001-05-15
wo oon9~o Pc~r~s~io2~ io
and a microphone having ffxed and known relative locations. A difference
between distances
is preferably defined as dD(i j)=Di-Dj=c*dt(i j), where dt(i j) is defined as
a difference
between time of arrival at microphone i and time of arrival at microphone j.
For N
microphones there are N-1 independent differences dD. In an optimal
configuration, the four
microphones located at vertexes of a tetrahedron may be used to determine the
location of a
source. From practical considerations, such an arrangement may not be
possible. Preferably,
more than four microphones are used, so that a higher resistance to noise
and/or a higher
localization precision may be achieved. In a preferred embodiment of the
invention, the three
dimensional position is determined by numerically or analytically solving
three equations of
1 o the form:
dD=c*dt(i j)=jar-MiII-IIr-MjII. where (i j) is preferably selected to be
(1,2), (2,3) and
(3.4). However any other independent three pairs of microphones may be used.
In some cases
it is useful if one of the electronic devices operates as a transponder, which
receives signals
and sends back a signal indicative of the received signal andlor its time of
flight.
In some embodiments of the invention, the above positioning method may be
applied
using passive tags on the object whose position is to be detected. In a
preferred embodiment of
the invention, such tags are powered by the computer speaker, using an RF
field generated by
the speaker. Alternatively, other RF-generating computer components may be
used. this
powering may be used to allow the tags to be responsive. Alternatively, this
powering may be
used for other uses. Alternatively, the powering may be by using a standard
smart-cart RF-
coupling peripheral.
Position determination may be based on transponding signals which impinge on
objects. Alternatively, an object may transmit a signal which encodes the time
of arrival of the
interrogating signal. Thus, the accuracy of positioning can be higher than the
frequency of the
interrogation signal, assuming the object has a clock with a higher resolution
than the
frequency of the interrogation signal.
A touch screen in accordance with a preferred embodiment of the invention
utilizes
acoustic transmission to detect the location of a touch implement, such as a
pen. In a preferred
embodiment of the invention, the position of the pen is determined using one
or more
3o microphones and/or speakers mounted on the pen, which transmit and/or
receive signals from
a computer and/or other speaker and/or microphone controller. Possibly, a
three-dimensional
position of the touch implement is determined using four acoustic elements,
such as two
microphones and two speakers. It is noted that a computer typically includes a
modem speaker,
an internal speaker and/or optionally a keyboard speaker, as well as sound-
card speakers.
31
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
Lately, however, the internal speaker is not provided in standard
installations. In addition,
some computers include an ultrasonic pointing device or other ultrasonic
ports. In a preferred
embodiment of the invention, the smart card can communicate using this
ultrasonic
communication port.
A more basic type of position detection may be based on detecting an
interruption by
an object of an ultrasonic beam between a speaker and a microphone.
Alternatively or additionally to position detection using a responsive object,
a radar-
type position or distance detection may be used, in which a microphone of a
computer detects
the reflection of ultrasonic waves from an object, which waves are generated
by a computer
1o speaker. By detecting only relative differences between reflections from
different objects, the
relative distances of the objects can be determined without knowing the exact
location of the
sound source.
In some preferred embodiments of the invention, the microphone detects both an
acoustic pulse and an electromagnetic pulse generated as a side effect of
producing the
acoustic pulse. As the electromagnetic pulse is substantially simultaneous it
may be used as a
clock or as a reference time for determining the time of flight of the
acoustic pulse.
Additionally, since a transponder microphone may detect both kinds of pulses,
it is possible to
determine the component times of flight to a transponder and not just the sum
time of flight,
using a retransmission of the detected signals by the transponder.
2o In a preferred embodiment of the invention, location methods utilize a
calibration
process, in which the located implement is placed at one or more known
location, so that it is
possible to correct for the location of the speakers) and the microphone(s)/
Alternatively or
additionally, the calibration procedure is used to correct for propagation
times (of the acoustic
waves and/or of electronic signals which generate sounds) and/or for
reflections, wavelength
dependent attenuation and/or broadband attenuation.
A different type of touch screen, in accordance with a preferred embodiment of
the
invention, detects the location of a touch implement based on the detection
and position
determination (2D or 3D) of sounds generated when the touch implement touches
the "touch
sensitive" surface. This surface may be coated with a sound generating
material, such as
3o crinkle-paper, to provide a distinctive sound.
In a preferred embodiment of the invention, for example as described above, an
interrogated object receives the ultrasound signal and sends it back to a
microphone of the
computer. In a preferred embodiment of the invention, the computer analyses
the time of flight
and/or other attributes of the transmission and determines a distance from,
position to, velocity
32
CA 02350761 2001-05-15
WO 00/29920 PCT/1B99/02110
of motion and/or other spatial attributes of the object. In some cases, a
plurality of sources or
receivers may be placed on the object, to assist in determining angular motion
of the object.
Alternatively or additionally, Doppler analysis of the response may be used to
detect changes
in distance. Alternatively or additionally, changes in distance are detected
by comparing two
consecutive measured distances. The plurality of sources may be
differentiated, for example.
by timing of signal generation, frequency band used and/or encoding of the
transmitted signal.
In a preferred embodiment of the invention, the object responds immediately to
the
interrogation signal. Alternatively, the object delays its response to an
interrogation signal, for
example for a few miIiiseconds. Alternatively or additionally, the object
transmits at a different
to frequency from the received frequency, for example at 24kHz in response to
a 20kHz query.
Alternatively or additionally, the signal transmitted by the object is
received by a transducer
which then transmits the signal to the computer, for example acoustically or
using
electromagnetic coupling. Alternatively or additionally, the object may
respond with an
identification code. Alternatively or additionally, the object modulates its
transmission with an
envelope, which envelope preferable serves as an identification code and/or
for transmission of
information regarding a status of the object, for example a position of an arm
of a toy. In some
cases, the object relays information from a more remote object. In the case of
identification.
the object may send an ID code even without prompting from the computer, for
example
periodically or by a user pressing a button on the object (or by flexing the
object).
In a preferred embodiment of the invention, the object amplifies the signal it
receives
using a discharge of a coil through a transistor, where the transistor serves
as a variable resistor
and/or as a wave-form controller.
In some preferred embodiments of the invention, the generated sounds are
transmitted
indirectly via an existing network. One example of a suitable network is a
telephone network,
preferably a digital network, with the sounds being forwarded from one
telephone to another.
Another example of a suitable network is an intercom system. Another example
of a suitable
network is a LAN or an Internet. Additionally, as described below, the
ultrasonic waves may
be transmitted (as acoustics, not electromagnetic) over wiring, such as
electrical wiring or over
pipes, such as water and gas pipes.
In a preferred embodiment of the invention, a wireless telephone system uses
handsets
which communicate with base stations, for example computers or telephones,
using ultrasonic
communication, as described herein. In a preferred embodiment of the
invention, an office
telephone or computer network can serve as a local cellular network for
communication, by
keeping track of which base-stations are in communication with which handsets
and by
33
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
providing the ability for a base station to locate handsets and for a handset
to change base
stations.
In many situations, there will be more than one active smart card (or other
electronic
device using ultrasonic waves for communication) in a region at a single time.
In a preferred
embodiment of the invention, the different devices coordinate so that they do
not both transmit
at a same time. In one example, a central computer assigns time, frequency or
coding (CDMA)
slots. In another example, an ALOHA algorithm is used to avoid collisions.
Some embodiments of the present invention contemplate other methods of
communication with a computer (or other devices) without installing hardware.
Fig. 5 is a
to schematic block diagram of a communications tap 102 for a computer 100, in
accordance with
a preferred embodiment of the invention. In the configuration of Fig. 5, a tap
is preferably
placed on communication line to an existing peripheral I04. Thus, a user may
not be required
to even access a back part of a computer, let alone a computer's internal
workings. An
electronic device 106, a toy and/or a smart-card preferably send and/or
receive signals from tap
I02. Additionally or alternatively, device 106 may use one tap for receiving
and one for
sending. Possibly, a device uses taps only for one direction of communication.
In a preferred embodiment of the invention, the tap is placed on a cable to a
printer, a
network cable, a camera cable and/or a SCSI connection. Additionally or
alternatively, the tap
is placed on a serial cable, for example a mouse cable. Additionally or
alternatively, the tap is
2o placed on a modem line, for example on a telephone line or by plugging the
tap into another
telephone socket, to be received by the modem. Additionally or alternatively,
the tap is placed
on a game controller line. Additionally or alternatively, the tap is placed on
a loudspeaker line.
This type of tap can detect signals that cannot be reproduced by the
loudspeaker, for example
very high frequencies, for example higher than 50 kHz. Additionally or
alternatively, the tap is
placed on a microphone line, possibly using the microphone line and/or the
microphone itself
as a sonic, ultrasonic or non-acoustic antenna (e.g., RF). Additionally or
alternatively, the tap
is placed on a display cable line.
In a preferred embodiment of the invention, the tap includes an electro-
magnetic
coupler, which can induce signals in a cable that passes through or near the
tap. Additionally
or alternatively, the tap can detect signals in the line and transmit them to
device 106. In a
preferred embodiment of the invention, the signals are at a different crier
frequency and/or
signal frequency than the usual signals passed along the line. Additionally or
alternatively, the
signals travel in an opposite direction (input signals on an output line, such
as a printer or
output signals on an input line, such as a mouse). Additionally or
alternatively, the signals
34
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
encode information which information is detected and removed from the data
stream in the
computer. Additionally or alternatively, the signals are asynchronic on a
synchronic line.
Additionally or alternatively, the signals are transmitted only when no signal
is expected by the
computer and/or the peripheral.
In an alternative embodiment of the invention, a piezoelectric actuator (or
other
vibrating element) is connected to a mouse (or a microphone). The actuator
causes the mouse
to shake at an amplitude of one or two screen pixels (or less) and the shaking
is detected by
software in the computer as signals from the toy. A return signal may be
transmitted to a tap
associated with the actuator, along the serial cable, with the signal
preferably being coded to be
1o recognized by the tap and/or ignored by the mouse.
In an alternative embodiment of the invention, device I06 sends signals to
computer
102 using a tap which actuates keys on a keyboard attached to computer 100.
Such actuation
may be, for example, mechanical or magnetic (e.g., on magnetic switched
keyboards).
Preferably the key used is a shift key. Additionally or alternatively, signals
from the computer
are detected by detecting illumination of LEDs on the keyboard, for example a
"Num Lock"
LED.
Alternatively or additionally, the tap detects illumination of other LEDs on a
computer,
for example power, sleep, CD-ROM and/or hard disk LEDs. Alternatively or
additionally, the
tap detects information transmitted via noise or vibration generated by
activation and/or
modulation of the activity of mechanical components of the computer, for
example diskette
drives, disk drives and CD-ROM drives. Alternatively or additionally, the tap
detects an
electromagnetic signal generated by power surges to the devices, for example a
CD-ROM
when it is powered or variations in RF amplitude and/or frequency of the CPU,
for example
those caused by entering a sleep mode.
In a preferred embodiment of the invention, a tap "learns" the electromagnetic
and/or
acoustic profile of a particular computer or portion thereof and learns the
effects of various
commands on this profile. When a computer desires to communicate with a tap,
it preferably
modifies the profile using those commands which are determined to have the
greatest, most
noticeable and/or fastest effect on the profile.
so Additionally or alternatively, device 106 utilizes a transducer which plugs
into a
parallel port, a serial port and/or is optically coupled or placed near an 1R
port. Preferably, the
transducer is a pass-through transducer, through which a printer and/or other
peripherals may
communicate normally with a computer. This transducer can then transmit the
signals by wired
or wireless methods to a remote device.
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
In a preferred embodiment of the invention, the tap and/or transducer can
automatically
detect which type of cable is tapped/port is connected to. Such a tap
preferably includes a
microprocessor or an integrated circuit to analyze signals on the cable,
rather than solely a
transducer for coupling signals to and from the cable. Preferably, such
detection is by
s analyzing amplitude, frequency and/or synchronization of signals passing
through the lines.
Additionally or alternatively, the computer detects which line is tapped, by
detecting particular
inferences on that line. Alternatively or additionally, software on the
computer sends test
signals along the lines, to be detected by the tap. Possibly, the tap can
detect the signals even
without being programmed with the type of line on which the signals are
transmitted.
to Alternatively, when a tap is used, a configuration program is run so that a
user can define to
the tap and/or the computer what is being tapped.
In a preferred embodiment of the invention, a smart card directly taps the
computer, for
example using a RF antenna embedded in the smart card to detect signals being
transmitted
over data lines, e.g., to a peripheral or another computer or for the use of
the smart card.
15 In an exemplary embodiment of a device using tapping, a pass-through hasp
is
provided, which is connected to a port. In a preferred embodiment of the
invention, the hasp
uses power from the power lines but does not interact with data flowing
through the port.
Authentication of software using the hasp preferably utilizes acoustic
communication between
the hasp and the computer's microphone and/or speaker. Alternatively, the hasp
may interact
2o with signals that flow through the port, which signals are not suitable for
use as data, for
example the signals using a wrong protocol, having an incorrect CRC, being
asynchronous in a
synchronous connection or having an incorrect frequency. Such a hasp may also
be used to
protect an easily stolen device, such as a PDA or a laptop computer, which can
use their
internal speakers and/or microphones to detect the proximity of a required ID
tag. If the 1D tag
25 is not detected the device can fail to work, work incorrectly or it can
report that it is stolen.
In a preferred embodiment of the invention, suitable software is installed on
computer
100. Preferably, the software is self installing. Preferably, the computer is
not used for any
other use white device I06 is communicating with it. Additionally or
alternatively, the
software can differentiate between "regular" signals and signals related to
the tap. In one
3o example, a provided keyboard driver may detected special codes and/or data
sequences on the
keyboard line and remove them from the received data, passing only the rest of
the received
data to an operating system of computer 100. Additionally or alternatively, a
provided mouse
driver may detect spurious and/or small mouse movements, and recognize them as
being tap-
related signals, as described above. Additionally or alternatively, a printer
driver can recognize
36
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
data on the cable as not coming from the printer but from a tap. Additionally
or alternatively,
data sent to the tap is preferably sent as data which will be rejected or
ignored by the
peripheral, for example having incorrect parity settings or other intentional
errors.
Alternatively or additionally to using a tap for communication with a toy,
such a tap may be
used to attach a peripheral to computer 100. As indicated above, the tap may
include a
processing element so that the signals coupled to the cables do not interfere
with the normal
operation of the cable, for example being transmitted when there are no others
signals on the
cable. Alternatively, such processing may be performed by a device which uses
the tap.
In a preferred embodiment of the invention, the signal received on the
computer is used
1o to modify an executing program and/or to generate commands to other
electronic device,
preferably using sounds generated by the computer but possibly using a
dedicated connection.
In an exemplary application, a computer game in which a computer display
responds to
external sounds, such as bowling pins falling, is provided.
The acoustic communication may also be used to communicate between an input
device and a computer program, for example between a wireless keyboard or
mouse and a
computer. In another example, a light-pen transmits to the play-station a
signal responsive to
pixel intensities which are detected by a photo-detector thereon.
Alternatively or additionally, a
synchronization signal is transmitted from a computer and/or a set-top box to
the pen, to
synchronize the pixel detection with the TV raster scan. These transmissions
may be additional
2o to- or alternative to- transmission of position and/or orientation.
Alternatively or additionally,
the input device transmits the status of controls thereon. Alternatively or
additionally, the
transmission is used to transmit information to be displayed on an output
device or an output
portion of the input device, for example to light up lights thereon and/or
drive text and/or
graphics displays thereon.
Fig. 6 is a schematic illustration of an unobtrusive computer checkup in
accordance
with a preferred embodiment of the invention. A user 142 is using a computer
140. A user 146
wishes to interrogate computer 140, for example to analyze a networking
problem. In a
preferred embodiment of the invention, a smart card 144 (or other electronic
device) can
communicate with computer 140 using an acoustical- or a tap- channel as
described above,
without interfering with the activities of user 142. Alternatively or
additionally, smart card 144
may be used to interrogate an interface-less device, such as a hub 148. One
advantage of
acoustical communication for these uses is that they do not generate a
considerable amount of
RF interference and do not require major (if any) changes in a (significant)
install base of
hardware. In a preferred embodiment of the invention, hardware devices, such
as hub 148 and
37
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
computer 140 continuously "hum" their status, in RF or in acoustics, so that
the status can be
discerned by eavesdropping on the hum, without needing to interrogate the
hardware.
A card such as card 144 may also be used to give privileges to it's owner in
the form of
better service (e.g., priority at a file server, speed of connection to the
Internet) and/or alleviate
s various security restrictions. For example, a manager can come to his
employee desk, activates
his card and previously unreachable files become available. It is noted that
this process of
changing the behavior of a computer does not require logging on to the
computer (although
such log-on is possible}. Rather, the computer recognizes the manager even
while it remains
logged on to the other user.
In a preferred embodiment of the invention, when the card or other device is
used for
logging-on, a hysteresis-type logic is used, in which logging on requires a
high quality definite
signal, while logging-off (possibly automatic log-off) is delayed until there
is substantially no
contact with the card. The lack of contact can be detected by the Lack of
detection of a periodic
signal generated by the card. Thus, once logging on is achieved, maintaining
the contact does
~ 5 not require a high quality connection.
Fig. 7 is a schematic illustration of a computer communication setup using
acoustics, in
accordance with a preferred embodiment of the invention. A computer I52
includes a
microphone 156 that is used for detecting activity sounds of other electronic
and/or mechanical
devices. The activity sounds may comprise natural sounds, for example a page
sorter being
2o used in a photocopier. Alternatively or additionally, they may comprises
indicator sounds, for
example a beep generated by a fax machine 150 when a fax comes in. Fax machine
150 may
be connected to a computer (as shown) or it may be unconnected. Alternatively
or additionally,
they may comprise artificial sounds, for example a special information
carrying sound
generated specifically for the benefit of computer 152.
25 In a preferred embodiment of the invention, a computer 152 transmits
indications of the
sensed activities to a remote computer, such as computer 154. Thus, a user at
computer 154
can be informed of a fax coming in or of an unanswered telephone call even if
he is in a
different room and the fax machine is not connected to a standard computer
network.
Alternatively or additionally, the analysis of sounds detected by microphone
156 can be
30 used to determine other occurrences at computer 152. In one example,
microphone 156 can be
used to log the habits of a user, including, telephone conversations, numbers
dialed (by
detecting the DTMF sounds), sounds of papers being shuffled, breathing sounds,
snoring of a
sleeping user, average number of rings until a call is answered, and typing
habits. Alternatively
38
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
or additionally, microphone 156 can be used to detect an occupancy of a room
or glass
breakage, possibly serving as a burglar alarm.
Alternatively or additionally, the microphone may be used to detect
electromagnetic
impulses generated by operating devices. Typically, each device has a
different
electromagnetic signature. Different signatures may be generated when the
device is switched
on or off, when the device is operated and/or for different modes of
operation. Thus, a
computer-microphone combination can be used to detect the operation of
devices, such as
photocopies, door chimes and computers. In a preferred embodiment of the
invention, a video
input card is used to analyze higher frequencies of electromagnetic radiation
than those
detectable by a microphone-sound card combination. It can thus be appreciated
that noise
signals which are usually rejected by signal processing algorithms may be
analyzed to detect
important information of activities in the vicinity of the microphone.
In an exemplary device which communicates with a computer using ultrasound,
input/output filtration circuits are provided. These filtration circuits
preferably comprise op
~5 amplifiers with filters for specific frequencies for input and output,
dependent on the
communication protocol used. If non-audible frequencies are used, the filters
should preferably
decrease or block power at audible frequencies, to reduce annoyance of a user.
The communication protocol is preferably a digital binary code in which the
bits are
transmitted using Frequency Modulation, Pulse Width Modulation, On-Off Keying
and/or any
combination of the above. Error correction codes, for example parity, Gray or
Hamming codes,
as known in the art may be used. It should be noted that the range of
available frequencies may
be limited if ultrasonic frequencies are used, due to degraded capabilities of
the computer
sound card.
In a reception process, the signals received by the device are convert them to
data bits,
either by time domain analysis or by Fourier analysis. Thereafter, error
checking is preferably
performed. The received information may be decrypted (if necessary).
Alternatively or
additionally, the received information may be encrypted, verified and/or
signed, in order to be
stored in local memory. The local memory may comprise ROM, RAM, EPROM, EPROM
and/or other types of memory as known in the art. Information to be
transmitted may be
encrypted before transmission.
The software on the computer receives a detected signal, filters it, and opens
the
protocol. Preferably, the software reduces noise using llR band pass and/or
low pass filters.
The received and filtered signal is then demodulated, into data bits, for
example, by
time domain analysis or by Fourier analysis. Data transmission errors are
preferably corrected.
39
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
The data may then be locally analyzed and/or transmitted to a remote location,
for example a
seller's computer. In some embodiments, this software is written in an
Internet Language, such
as Java or ActiveX.
In a preferred embodiment of the invention, the acoustical detection uses the
maximum
resolution and/or sensitivity afforded by the microphone, i.e., going below
the noise threshold
as defined for audio uses. Alternatively or additionally, repeating and/or
periodic ambient
sounds are detected and removed or disregarded from the input signal. In a
preferred
embodiment of the invention, ambient sounds are characterized as such during a
calibration
step which may be performed periodically.
1o In some cases one or more of the following problems may be encountered,
including:
echoes, interference (acoustic or electromagnetic), and, at higher frequencies
(>10 kHz),
problems of directionality and weak reception. In addition, many microphones
and speakers
behave badly or in an unstable manner at these frequencies. It is noted, that
by detecting RF
rather than acoustic signals, acoustic interference is reduced and/or the
reception may be less
sensitive to range and directionality. In a preferred embodiment of the
invention, the received
sound signals are processed using known signal processing techniques, such as
filtration,
equalization and echo cancellation. Preferred modulation methods used include
PWM, FSK,
QPSK and on-off keying. Preferred frequency band types include a single band,
a wide band
spread-spectrum and frequency hopping bands. Preferred protocols utilize one
or more of start-
2o stop synchronization bits, and constant and/or variable length messages.
Possibly the device
and/or the computer include logic for determining the exact frequency used for
transmission,
for example to correct for frequency hopping, for frequency shifts caused by
inaccurate
manufacture and/or for environmental effects. Error detection methods may be
used, for
example, CRC (preferably 32 bit), Parity, Checksum, Blowfish, Hamming Codes,
Retransmit/
BCD Codes and Gray codes.
In a preferred embodiment of the invention, periods of silence are provided
between
data bits in protocols other than on-off keying. In one example, an FSK
protocol is provided
with silence between the frequency pulses. Preferably, the duration of the
silence is sufficient
so that echoes (or other artifacts) from the orlgInal pulse do not overlap
with a next pulse.
3o This period may be fixed, for example based on an expected geometry of the
electronic devices
and where they are used. Alternatively, the protocol may be adapted based on
the instant echo
situation. Alternatively or additionally, the pulse duration may be modified
to overcome noise,
echo and/or other transmission problems. In a preferred embodiment of the
invention, a few
calibration pulses are first sent to determine a desired silence and/or pulse
duration. Possibly,
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
different such durations are used for the two communication directions.
A feature of some embodiments of the invention is that a device can
communicate with
another device or computer over medium distances, such as 0.3-20 meters, more
preferably, 2-
IO or about 7 meters.
Several variations on the reception at the computer (or other electronic
device) may be
practiced according to some preferred embodiments of the invention, including:
(a) using a
regular microphone and sound card; (b) using a regular sound card but with a
special
microphone (e.g., one that can be tuned to specific, even ultrasonic,
frequencies); (c) using a
speaker that can also be a microphone (one possibility is described in detail
below); (d) using a
1o microphone/receiver that connects to a dedicated channel such as an RS232
or parallel port,
and that can optionally obtain power from the port; and (e) using a built in
dedicated hardware
port that can be implemented on the computer board.
Several variations on the transmission from a computer (or other electronic
device) can
also be practiced, including: (a) using one or two speakers, powered
alternatively or possibly
powered together, for example to increase the total power, to aid in noise
cancellation and/or
to aid in detecting echoes; (b) using an acoustic transducer connected to a
standard port or
possibly tapping the computer, as described above; thus, there may be no need
for a sound card
in the computer; and (c) as suggested above, at small distances there appears
to be an overlap
between acoustic and electromagnetic signals both with regard to transmission
and with regard
2o to reception. Thus, possibly some of the signals are transmitted and/or
detected using RF
antenna, or acoustic signal generation is detected using an acoustic antenna
(or RF antenna)
that detects the RF signature of the transmission. Alternatively or
additionally, the RF is used
as a backup for the acoustic channel.
In some cases, for example if the receiver has a reduced computing capacity,
the
incoming audio stream is sampled at lower than the carrier frequency. However,
a side effect
of such sub-sampling, especially when there are no anti-abasing filters, is
that there may be
confusion between audible and ultrasonic sounds. Thus, more complex processing
may be
required to assure that the data transmission is acceptable. In one example,
synchronous
detection or a more robust error detection method is used. Alternatively or
additionally, a
3o specialized waveform with unique time/spectrum characterlstkx is used, for
example one that
repeats itself at both I and 4 kHz after the down-sampling. Thus, it can be
better differentiated
from the background.
In many cases, a speaker is available for a computer but a microphone is not.
In a
preferred embodiment of the invention, a speaker is used as a microphone.
Preferably, the
4I
CA 02350761 2001-05-15
WO o0/29920 PCT/1B99/02110
speaker is connected to the microphone port and/or line in port of a sound
card, possibly
through an adapting unit. Apparently, many speakers can operate as a
microphone if they are
not connected to a power source. Preferably, an adapting unit is provided, for
example to serve
for buffering, switching (between microphone and speaker functions) and/or for
amplitude
protection. In some embodiments the adapting unit periodically checks for an
incoming signal
from outside the speaker or for a signal from the speaker channel.
Alternatively or additionally,
the computer may generate a special signal via the speaker channel or possibly
an audible
signal to indicate that a mode switching is desired. In one embodiment, the
speaker is
connected in parallel to both microphone and loudspeaker channels, with
electronic protection
1o for the microphone so that the power to the speaker does not harm the
channel.
Alternatively or additionally, some microphone types may be used as both a
microphone and a speaker, if they are suitably driven. Possibly, a coupler is
provided for
driving the microphone using the speaker channel and/or for automatically
switching the
microphone between modes based an the detection of an incoming signal or
possibly
periodically.
In some embodiments, the coupling device can split the frequencies between the
microphone and speaker functions, allowing a single element to operate
simultaneously as a
speaker and a microphone. For example, low frequencies are used for the
speaker and high
frequencies are used for the microphone. When a high frequency is detected by
the coupler, it
2o is passed to the microphone channel, when a low frequency is detected it is
sounded on the
speaker.
Another aspect of the invention relates to transmitting acoustic signals on
solid cables,
rather than in the air. Such cables can include computer, communication and
telephone cables,
as well as electric power cables, for example inside a house. In a preferred
embodiment of the
invention, the transmission along these cables is conducted to a micxophone of
the device, to
which it is directed, where the transmission is analyzed. Alternatively or
additionally,
transmission is via the box of the device and into the cable. Alternatively or
additionally, a
dedicated coupler to the cable is provided for one or both of the transmission
and reception.
It is noted that a standard house is filled with this infrastructure in the
form of power
3o supply, water pipes, telephone lines, and cables. The ultrasonic
receiver/transmitter device is
simple low-cost and can be very small. The method can be used to achieve
communication for
low cost appliances, or to achieve a higher bandwidth of information. The
method permits
multiple appliances talking together, broadcast of information and a network
of smart
appliances. It can be used to communicate also between computers, televisions
and/or VCRs.
42
CA 02350761 2001-05-15
WO 00/29920 PCT/IB99/02110
Every device can have its own id-number and a computer can control the
operation of these
devices. For some devices a dedicated controller is required, which receives
the acoustic signal
and, responsive to it, controls the device. Exemplary uses include ordering
shutting off or
lighting lights at certain time (by computer control) or from outside of home
(by telephone or
network to the computer) and ordering the VCR and/or television to cooperate
in recording a
specific TV program, again preferably under computer control.
In a preferred embodiment of the invention, a reader-type input device can
read
external static (as opposed to sound waves and temporal patterns) information,
which
information can be forwarded to an associated computer or another device. Such
an input
1o device may also be integrated with a smart-card. A simplest example is a
wireless bar-code
reader that reads bar codes and transmits them acoustically to a computer,
preferably using
methods as described herein. Preferably, the bar-code reading capability is
embodied in a smart
card, so that a multifunction device is provided. Alternatively, a miniature
device, such a ring,
is manufactured, for convenience or a user. Such a device may be useful during
purchasing, to
allow a user to review large and/or personalized information regarding a
product. Another
example is a magnetic strip reader which transmits read magnetic strips to the
computer. In the
case of a magnetic strip reader, a single magnetic sensor (or line sensor) may
be sufficient,
with the computer processing the detected signals to correct for non-constant
motion of the
sensor over the magnetic material.
2o In one exemplary use, when the input device reads a tag, such a code or a
description of
a device, an associated computer switches to a WWW page which displays details
associated
with the read information. The computer may be a hand-held computer or PDA.
Alternatively,
the computer is a standing or store provided computer. Alternatively, the
computer is on
another side of a telephone line, which acoustic signals are transmitted over
the telephone line
z5 to the computer, to cause certain speech to be transmitted back.
Alternatively or additionally,
such tags may be used for technical support (e.g., each home device or
component has such a
code and there is a help file or scripts associated with the code).
Alternatively or additionally,
such tags may be used for customer relations, for example to provide
information to an
interested user. In some types of products, the computer and/or the tag reader
can control the
3o pmduct using information read for the tag. An exemplary situation is a
computer device, on
which a tag reader or a same or second computer can execute a diagnostic
program responsive
to the read tag.
An exemplary device consists of an acoustical transmitter, a tag-reading
element, and
some control logic. The type of tag reading element used depends on the type
of tag, for
43
CA 02350761 2001-05-15
WO OO/Z99Z0 PCT/IB99/02110
example, if it is optical or magnetic. The tag itself may include bar codes,
other optical coding
or even text. In a magnetic example, the tag may comprise magnetic ink.
Preferably; but not
essentially, the tags are of a type that can be printed using standard
printers and/or inks. Thus,
tags can be printed all over a book, magazine or other printed products.
Alternatively or
additionally, RF transponder tags as known in the art may be used. In some
embodiments, the
read information is deciphered by the reader. In other embodiments, partially
or completely
unanalyzed information is transmitted to the computer for analysis.
Although an acoustic transmission of the tag information is preferred, RF
transmission
may also be practiced.
In the above description, a large number of permutations and possible
embodiments
have been described. This type of description is utilized for the ease of
describing the many
different possible embodiments of the invention. It is appreciated by the
inventors that same of
the described combinations may be known in the art. This is not to be
construed as an
admission of equivalence of the different embodiments described. Moreover,
even such
combinations which may be known may find patentable utility from their
application in
particular situations.
The present invention has been described in terms of preferred, non-limiting
embodiments thereof. It should be understood that features described with
respect to one
embodiment may be used with other embodiments and that not all embodiments of
the
2o invention have all of the features shown in a particular figure. In
particular, the scope of the
claimed invention is not limited by the preferred embodiments but by the
following claims.
Section titles, where they appear, are not to be construed in limiting subject
matter described
therein, rather section titles are meant only as an aid in browsing this
specification. When used
in the following claims, the terms "comprises". "comprising", "includes",
"including" or the
2s like means "including but not limited to".
44
