CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
MOTION SENSOR AND ANALYSIS
CROSS-REFERENCE TO RELATED PATENT APPLICATIONS
[0001] This application claims priority U.S. provisional application serial
no. 61/830,604,
filed June 3, 2013, entitled "Motion Sensor and Analysis," and U.S.
provisional application
serial no. 62/002,773, filed May 23, 2014, entitled "Throw Monitoring and
Analysis," each of
which is hereby incorporated herein by reference in its entirety.
BACKGROUND OF THE DISCLOSURE
[0002] Existing technology for monitoring movement, including a throwing
motion, may
require either an expensive 3-D motion capture/video analysis system, or for
an athlete to
wear bulky devices in a laboratory that can impede on performance. Some of the
bulkier
systems can be external (video capture) devices. This technology is not
suitable for real-time
or on-field monitoring. In addition, existing methods for counting throws or
pitches are
manual, e.g., clickers, and can require close monitoring by a coaching staff
Due to the
restrictive nature of placing rigid electronics on a throwing arm, there do
not appear to be any
throwing-specific products on the market.
SUMMARY OF THE DISCLOSURE
[0003] In view of the foregoing, systems, apparatus and methods are
provided for
monitoring the performance of an individual using a conformal sensor device.
In some
implementations, the system can be disposed into conformal electronics that
can be coupled
to or disposed on a portion of the individual. The system can include a
storage module to
allow for data to be reviewed and analyzed. In some implementations, the
system can also
include an indicator. In some implementations, the indicator can be used to
display real time
analysis of impacts made by the system.
[0004] The example systems, methods, and apparatus according to the
principles
described herein provide better performance than large and bulky devices for
looking at body
motion.
1
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0005] In an example, the portion of the individual can be a head, a foot,
a chest, an
abdomen, a shoulder, a torso, a thigh, or an arm.
[0006] An example system for monitoring performance of an individual using
a
conformal sensor device is disclosed. The conformal sensor device mounted to a
first portion
of the individual. The example system includes at least one memory for storing
processor
executable instructions, a processing unit for accessing the at least one
memory and executing
the processor executable instructions, and an analyzer. The processor
executable instructions
include a communication module to receive data indicative of at least one
measurement of at
least one sensor component of a first conformal sensor device. The first
conformal sensor
device includes at least one sensor component. The at least one sensor
component is
configured to obtain at least one measurement of at least one of: (a)
acceleration data
representative of an acceleration proximate to the portion of the individual,
and (b) force data
representative of a force applied to the individual. The first conformal
sensor device
substantially conforms to a surface of the first portion of the individual to
provide a degree of
conformal contact, and the data indicative of the at least one measurement
includes data
indicative of the degree of the conformal contact. The analyzer is configured
to quantify a
parameter indicative of at least one of (i) an imparted energy and (ii) a head-
injury-criterion
(HIC), based on the at least one measurement of the at least one sensor
component and the
degree of the conformal contact. A comparison of the parameter to a preset
performance
threshold value provides an indication of the performance of the individual.
[0007] In an example, the first portion of the individual is at least one
of a calf, a knee, a
thigh, a head, a foot, a chest, an abdomen, a shoulder, and an arm.
[0008] The at least one sensor component can be an accelerometer or a
gyroscope.
[0009] The at least one sensor component can be configured to further
obtain at least one
measurement of physiological data for the individual.
[0010] In an example, the analyzer determines a period of time that the
individual
performs reduced physical activity if the indication of the performance of the
individual is
below the preset performance threshold value.
2
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0011] In an example, the preset performance threshold value is determined
using data
indicative of a prior performance of the individual and/or data indicative of
a prior
performance of a plurality of different individuals.
[0012] In another example, the preset performance threshold value is
determined using at
least one measurement from a second sensor component that substantially
conforms to a
surface of a second portion of the individual.
[0013] The first conformal sensor device can further include a flexible
and/or stretchable
substrate, where the at least one sensor component is disposed on the flexible
and/or
stretchable substrate, and where the at least one sensor component is coupled
to at least one
stretchable interconnect. The flexible and/or stretchable substrate can
include a fabric, an
elastomer, paper, or a piece of equipment. The at least one stretchable
interconnect can be
electrically conductive or non-conductive.
[0014] The example system can include at least one indicator to display the
indication of
the performance of the individual. The at least one indicator ca be a liquid
crystal display, an
electrophoretic display, or an indicator light.
[0015] In an example, the at least one indicator is an indicator light, and
where the
indicator light appears different if the indication of the performance of the
individual is below
the preset performance threshold value than if the indication of the
performance of the
individual meets or exceeds the preset performance threshold value. The
appearance of the
indicator light may be detectable by the human eye or by an image sensor of a
smartphone, a
tablet computer, a slate computer, an electronic gaming system, and/or an
electronic reader.
[0016] In an example, the first conformal sensor device can include at
least one
stretchable interconnect to electrically couple the at least one sensor
component to at least
one other component of the first conformal sensor device. The at least one
other component
can be at least one of: a battery, a transmitter, a transceiver, an amplifier,
a processing unit, a
charger regulator for a battery, a radio-frequency component, a memory, and an
analog
sensing block.
3
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0017] The example communication module can include a near-field
communication
(NFC)-enabled component to receive the data indicative of the at least one
measurement.
[0018] In an example, a communication module can be configured to implement
a
communication protocol based on Bluetooth0 technology, Wi-Fi, Wi-Max, IEEE
802.11
technology, a radio frequency (RF) communication, an infrared data association
(IrDA)
compatible protocol, or a shared wireless access protocol (SWAP).
[0019] The example system can further include at least one memory to store
the data
indicative of the at least one measurement and/or the parameter.
[0020] In another aspect, an example system is disclosed for assessing the
performance of
an individual using conformal sensor devices. The example system can include a
data
receiver to receive data indicative of measurements of at least one of a first
conformal sensor
device and a second conformal sensor device, each of the first conformal
sensor device and
the second conformal sensor device being disposed at and substantially
conforming to a
respective portion of the individual. Each of the first and conformal sensor
devices can
include at least one sensor component to obtain at least one measurement. The
at least one
measurement can be of at least one of: (a) acceleration data representative of
an acceleration
proximate to the portion of the individual, and (b) force data representative
of a force applied
to the individual. The data indicative of the at least one measurement
includes data indicative
of a degree of a conformal contact between the respective conformal sensor
device and the
respective portion of the individual. The example system also includes an
analyzer to
quantify a parameter indicative of at least one of (i) an imparted energy and
(ii) a head-injury-
criterion (HIC), based on the at least one measurement from each of the first
conformal
sensor device and the second conformal sensor device. A comparison of the
parameter
determined based on the at least one measurement from the first conformal
sensor device to
the parameter determined based on the at least one measurement from the second
conformal
sensor device provides an indication of the performance of the individual.
[0021] In an example, each of the first conformal sensor device and the
second conformal
sensor device can be disposed at and substantially conforming to each calf,
each knee, each
thigh, each foot, each hip, each arm, or each shoulder of the individual.
4
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0022] The at least one sensor component can be an accelerometer or a
gyroscope.
[0023] In an example, the individual may be classified as exhibiting
reduced performance
if the parameter determined based on the at least one measurement from the
first conformal
sensor device is different from the parameter determined based on the at least
one
measurement from the second conformal sensor device.
[0024] In this example, the analyzer may further be configured to determine
a period of
time that the individual performs reduced physical activity if the individual
is classified as
exhibiting reduced performance.
[0025] In an example, at least one of the first conformal sensor device and
the second
conformal sensor device can further include a flexible and/or stretchable
substrate, where the
at least one sensor component is disposed on the flexible and/or stretchable
substrate, and
where the at least one sensor component is coupled to at least one stretchable
interconnect.
[0026] In an example, the at least one stretchable interconnect can be
electrically
conductive or non-conductive.
[0027] The data receiver of the example system may further include a near-
field
communication (NFC)-enabled component.
[0028] In an example, the data receiver can be configured to implement a
communication
protocol based on Bluetooth0 technology, Wi-Fi, Wi-Max, IEEE 802.11
technology, a radio
frequency (RF) communication, an infrared data association (IrDA) compatible
protocol, or a
shared wireless access protocol (SWAP).
[0029] In an example, the system can further include at least one memory to
store the
parameter and/or the data indicative of the measurements of at least one of
the first conformal
sensor device and the second conformal sensor device.
[0030] In another aspect, an example system is disclosed for monitoring
performance of
an individual using a conformal sensor device mounted to a portion of an arm
of the
individual. The example system includes at least one memory for storing
processor
executable instructions, a processing unit for accessing the at least one
memory and executing
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
the processor executable instructions, and an analyzer. The processor
executable instructions
include a communication module to receive data indicative of at least one
measurement of at
least one sensor component of a conformal sensor device. The conformal sensor
device
includes at least one sensor component to obtain at least one measurement of
data
representative of an acceleration of the portion of the arm. The conformal
sensor device
substantially conforms to a surface of the portion of the arm to provide a
degree of conformal
contact. The data indicative of the at least one measurement includes data
indicative of the
degree of the conformal contact. The analyzer is configured to quantify a
parameter
indicative of an energy or the acceleration of the portion of the arm, based
on the at least one
measurement of the at least one sensor component and the degree of the
conformal contact.
A comparison of the parameter to a preset performance threshold value provides
an
indication of the performance of the individual.
[0031] The at least one sensor component can be an accelerometer or a
gyroscope.
[0032] In an example, the at least one sensor component furthers obtain at
least one
measurement of physiological data for the individual.
[0033] In an example, the analyzer determines a period of time that the
individual
performs reduced physical activity if the indication of the performance of the
individual is
below the preset performance threshold value.
[0034] The example system can further include a storage device coupled to
the
communication module, where the storage device is configured to store data
indicative of a
count of a number of times that the indication of the performance of the
individual exceeds
the predetermined threshold value of imparted energy.
[0035] In an example, the system further includes a transmission module to
transmit the
data indicative of a count of a number of times that the indication of the
performance of the
individual exceeds the predetermined threshold value of imparted energy.
[0036] The transmission module can be a wireless transmission module.
6
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0037] In an example, the sensor component can further include at least one
of an
accelerometer and a gyroscope, and where the parameter indicative of the
energy or the
acceleration of the portion of the arm is computed based on the at least one
measurement
from the accelerometer and/or the gyroscope.
[0038] In an example, the system can be configured such that the processor
executes
processor executable instructions to compare the parameter to a preset
performance threshold
value, thereby determining the indication of the performance of the
individual.
[0039] In an example, the system can be configured such that the processor
executes
processor-executable instructions to increment a first cumulative number of
counts for each
comparison wherein the parameter exceeds the preset performance threshold
value.
[0040] In another aspect, an example system is disclosed for monitoring
performance of
an individual using a conformal sensor device mounted to a first portion of
the individual.
The example system includes at least one memory for storing processor
executable
instructions, a processing unit for accessing the at least one memory and
executing the
processor executable instructions, and an analyzer. The processor executable
instructions
include a communication module to receive data indicative of at least one
measurement of at
least one sensor component of a first conformal sensor device. The first
conformal sensor
device includes at least one sensor component to obtain at least one
measurement of at least
one of: (a) acceleration data representative of an acceleration proximate to
the portion of the
individual, and (b) physiological data representative of a physiological
condition of the
individual. The first conformal sensor device substantially conforms to a
surface of the first
portion of the individual to provide a degree of conformal contact. The data
indicative of the
at least one measurement includes data indicative of the degree of the
conformal contact. The
analyzer can be configured to quantify, based on the at least one measurement
of the at least
one sensor component and the degree of the conformal contact, a performance
parameter
indicative of at least one of: a throw count, a pattern matching, a symmetry,
a movement
magnitude, a grip intensity, a kinetic link, and a readiness to return to
play. A comparison of
the parameter to a preset performance threshold value provides an indication
of the
performance of the individual.
7
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0041] In an example, the first portion of the individual is at least one
of a calf, a knee, a
thigh, a head, a foot, a chest, an abdomen, a shoulder, and an arm.
[0042] The at least one sensor component can be an accelerometer or a
gyroscope.
[0043] In an example, the system can be configured such that the at least
one sensor
component furthers obtain at least one measurement of physiological data for
the individual.
[0044] The first conformal sensor device can further include at least one
communication
interface to transmit the data indicative of the at least one measurement
and/or the indication
of the performance of the individual.
[0045] In an example, the preset performance threshold value is determined
using data
indicative of a prior performance of the individual and/or data indicative of
a prior
performance of a plurality of different individuals.
[0046] In another example, the preset performance threshold value is
determined using at
least one measurement from a second sensor component that substantially
conforms to a
surface of a second portion of the individual.
[0047] In an example, the first conformal sensor device can further include
a flexible
and/or stretchable substrate, where the at least one sensor component is
disposed on the
flexible and/or stretchable substrate, and where the at least one sensor
component is coupled
to at least one stretchable interconnect.
[0048] The flexible and/or stretchable substrate can include a fabric, an
elastomer, paper,
or a piece of equipment.
[0049] The at least one stretchable interconnect can be electrically
conductive or non-
conductive.
[0050] In an example, the first conformal sensor device can further include
at least one
stretchable interconnect to electrically couple the at least one sensor
component to at least
one other component of the first conformal sensor device. The at least one
other component
can be at least one of: a battery, a transmitter, a transceiver, an amplifier,
a processing unit, a
8
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
charger regulator for a battery, a radio-frequency component, a memory, and an
analog
sensing block.
BRIEF DESCRIPTION OF THE DRAWINGS
[0051] The skilled artisan will understand that the figures, described
herein, are for
illustration purposes only. It is to be understood that in some instances
various aspects of the
described implementations may be shown exaggerated or enlarged to facilitate
an
understanding of the described implementations. In the drawings, like
reference characters
generally refer to like features, functionally similar and/or structurally
similar elements
throughout the various drawings. The drawings are not necessarily to scale,
emphasis instead
being placed upon illustrating the principles of the teachings. The drawings
are not intended
to limit the scope of the present teachings in any way. The system, apparatus
and method may
be better understood from the following illustrative description with
reference to the
following drawings in which:
[0052] FIGs. 1A-1D show block diagrams of example devices for monitoring
the
performance of an individual, according to the principles herein.
[0053] FIGs. 2A-2C show block diagrams of example devices for monitoring
the
performance of an individual and displaying data indicative of the performance
metric,
according to the principles herein.
[0054] FIG. 3 shows a flow chart of an example method for monitoring the
performance
of an individual, according to the principles herein.
[0055] FIG. 4 shows a general architecture for a computer system, according
to the
principles herein.
[0056] FIG. 5 shows an example system for monitoring performance, according
to the
principles herein.
[0057] FIGs. 6A and 6B an example system for monitoring performance based
on grip
intensity, according to the principles herein.
9
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0058] FIG. 7 shows an example system for monitoring performance based on
pattern
matching, according to the principles herein.
[0059] FIG. 8 shows an example system for monitoring performance, according
to the
principles herein.
[0060] FIG. 9 shows an example system for monitoring performance, according
to the
principles herein.
[0061] FIG. 10 shows an example conformal sensor device mounted on the
skin,
according to the principles herein.
[0062] FIG. 11 shows example data, according to the principles herein.
[0063] FIG. 12 shows example data collected during throwing activity,
according to the
principles herein.
[0064] FIG. 13 shows a block diagram of an example architecture of an
example
conformal sensor system, according to the principles herein.
[0065] FIG. 14 shows non-limiting examples components of an example
conformal
motion sensor platform, according to the principles herein.
[0066] FIG. 15 shows an example architecture of an example conformal sensor
system,
according to the principles herein.
[0067] FIGs. 16A and 16B show example implementations of a conformal sensor
system,
according to the principles herein.
[0068] FIG. 16C shows an example implementation of a conformal sensor
device coupled
to a body part with a degree of conformal contact, according to the principles
herein.
[0069] FIG. 17A shows examples of placement of the example conformal sensor
system
on a human body, according to the principles herein.
[0070] FIG. 17B shows example images of a conformal sensor system disposed
on a
body part, according to the principles herein.
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0071] FIGs. 18 and 19 show different examples of a communication protocol,
according
to the principles herein.
[0072] FIG. 20 shows an example of use of an example conformal sensor
system for
quantifying a measure of performance as a muscle activity tracker, according
to the principles
herein.
[0073] FIG. 21 shows an example of use of the example conformal sensor
systems for
quantifying a measure of performance as a strength training program tracker
and/or a
personal coach, according to the principles herein.
[0074] FIG. 22 shows an example of use of the example conformal sensor
systems for
quantifying a measure of performance for strength training feedback, according
to the
principles herein.
[0075] FIGs. 23A, 23B and 23C show an example of use of the example
conformal
sensor systems for quantifying a measure of performance for user feedback,
according to the
principles herein.
[0076] FIGs. 24A and 24B show an example of use of the example conformal
sensor
systems for determining a user's readiness to return to normal activity,
according to the
principles herein.
[0077] FIG. 25 shows an example of use of the example conformal sensor
systems for
use for sleep tracking, according to the principles herein.
DETAILED DESCRIPTION
[0078] It should be appreciated that all combinations of the concepts
discussed in greater
detail below (provided such concepts are not mutually inconsistent) are
contemplated as
being part of the inventive subject matter disclosed herein. It also should be
appreciated that
terminology explicitly employed herein that also may appear in any disclosure
incorporated
by reference should be accorded a meaning most consistent with the particular
concepts
disclosed herein.
11
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0079] Following below are more detailed descriptions of various concepts
related to, and
embodiments of, inventive methods, apparatus and systems for quantifying the
performance
of an individual using measurement data obtained using a conformal sensor
device.
According to a non-limiting example, the performance of the individual may be
quantified
using a parameter referred to as a "throw count," which serves as a measure of
a performance
of the individual in a throwing motion and/or a hitting (including licking) an
object. It should
be appreciated that various concepts introduced above and discussed in greater
detail below
may be implemented in any of numerous ways, as the disclosed concepts are not
limited to
any particular manner of implementation. Examples of specific implementations
and
applications are provided primarily for illustrative purposes.
[0080] As used herein, the term "includes" means includes but is not
limited to, the term
"including" means including but not limited to. The term "based on" means
based at least in
part on.
[0081] Example systems, methods and apparatus are described for quantifying
the
performance of an individual using a conformal sensor device mounted to a
portion of the
individual. The conformal sensor device is configured to substantially conform
to the portion
of the individual according to a degree of conformal contact. An example
system includes at
least one memory for storing processor executable instructions and a
processing unit for
accessing the at least one memory and executing the processor executable
instructions. The
processor executable instructions include a communication module to receive
data indicative
of measurements of a sensor component of the conformal sensor device. The
sensor
component can be configured to measure acceleration data representative of an
acceleration
proximate to the portion of the individual, and/or force data representative
of a force applied
to the individual. The measurement data includes data indicative of the degree
of the
conformal contact. The processor executable instructions also include an
analyzer to quantify
a parameter indicative of at least one of (i) an imparted energy and (ii) a
head-injury-criterion
(HIC), based at least in part on the sensor component measurement and data
indicative of the
degree of the conformal contact. A comparison of the parameter to a preset
performance
threshold value provides an indication of the performance of the individual.
12
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0082] In a non-limiting example, the preset performance threshold value
can be
determined based on measurements data from a conformal sensor component
disposed on a
different portion of the individual. For example, the preset performance
threshold value can
be determined based on measurements from a conformal sensor component disposed
on a
second arm to compare to measurements from a first arm, disposed proximate to
a second
knee to compare to measurements from a first knee, disposed on a second leg to
compare to
measurements from a first leg, or disposed on a second shoulder to compare to
measurements
from a first shoulder. In a non-limiting example, the preset performance
threshold value can
be determined based on measurements from a plurality of other individuals.
[0083] The data imparted energy can be computed as an area under a curve
from
acceleration measurement data or force measurement data, such as but not
limited to a force
versus distance curve. The head-injury-criterion (HIC) can be used to provide
a measure of
the likelihood that an impact results in a head injury. As a non-limiting
example, the head-
injury-criterion (HIC) can be computed using the expression:
. 142 -
HIC = {[aqµdti (i2
.,111 nvx
where ti and t2 indicate the time interval (in seconds) during which the HIC
approaches a
maximum value, and a(t) is acceleration. The time interval can be restricted
to a specific
value, such as but not limited to between about 3 milliseconds and 36
milliseconds.
[0084] In various examples described herein, the individual's performance
can be
quantified based on the measurement data such as, but not limited to, peak
acceleration data
and/or force data. In some examples, the imparted energy can be computed based
on the
integral of a time variation of a liner and/or acceleration in motion of the
body part.
Accordingly, the imparted energy calculation can take into account the
magnitude and
duration of motion of the body part.
[0085] According to the principles described herein, the measurement data
and/or the
indication of the performance of the individual may be displayed using a
display or other
indicator of the system, stored to a memory of the system, and/or transmitted
to an external
computing device and/or the cloud. In an example, the system may include a
data receiver
13
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
that is configured to receive data transmitted by the sensor component to
provide the
measurement data. In example, the data receiver can be a component of a device
that is
integral with the conformal sensor device.
[0086] In an example, the system can include at least one indicator to
display the
indication of the performance of the individual. The indicator may be a liquid
crystal display,
an electrophoretic display, or an indicator light. The example system can be
configured such
that indicator light appears different if the indication of the performance of
the individual is
below the preset performance threshold value than if the indication of the
performance of the
individual meets or exceeds the preset performance threshold value. The
example system can
be configured such that the appearance of the indicator light is detectable by
the human eye
or outside the detectable range of the human eye but detectable by use of an
image sensor of
computing device. Non-limiting examples of a computing device applicable to
any of the
example systems, apparatus or methods according to the principles herein
include a
smartphone (such as but not limited to an iphone0, an AndroidTM phone, or a
Blackberry ), a
tablet computer, a laptop, a slate computer, an electronic gaming system (such
as but not
limited to an XBOX , a Playstation , or a Wii8), an electronic reader (an e-
reader), and/or
other electronic reader or hand-held or wearable computing device.
[0087] An example system, apparatus and method according to the principles
herein
provide a device for monitoring the performance of the individual as a
cumulative throw
count of throws (including hits or kicks) that have above a value of imparted
energy above a
predetermined threshold value of imparted energy.
[0088] For any of the example systems, methods, and apparatus herein, the
conformal
sensor device may be disposed on or otherwise coupled to a body part of the
individual. In
various example implementations, at least one conformal sensor device can be
disposed on or
otherwise coupled to a portion of a calf, a knee, a thigh, a head, a foot, the
chest, the
abdomen, the shoulder, and/or an arm of the individual. The individual may be
a human
subject or a non-human animal (such as but not limited to a dog, a horse, or a
camel). In a
non-human animal, the conformal sensor device may be disposed on or otherwise
coupled to
the haunch.
14
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[0089] An example system, apparatus and method according to the principles
herein
provide a device for monitoring the performance of an individual using at
least two
conformal sensor devices, each mounted to different portions of the
individual. Each
conformal sensor device is configured to substantially conform to the
respective portion of
the individual according to a respective degree of conformal contact. An
example system
includes at least one memory for storing processor executable instructions and
a processing
unit for accessing the at least one memory and executing the processor
executable
instructions. The processor executable instructions include a communication
module to
receive data indicative of measurements of a sensor component of each of the
conformal
sensor devices. Each sensor component can be configured to measure
acceleration data
representative of an acceleration proximate to the portion of the individual,
and/or force data
representative of a force applied to the individual. The measurement data
includes data
indicative of the degree of the conformal contact. The processor executable
instructions also
include an analyzer to quantify a parameter indicative of at least one of (i)
an imparted energy
and (ii) a head-injury-criterion (HIC), based on the measurement from each of
the conformal
sensor devices. A comparison of the parameter determined based on the
measurements from
each of the conformal sensor devices provides an indication of the performance
of the
individual.
[0090] As a non-limiting example, each of the conformal sensor devices can
be disposed
at and substantially conforming to each calf, each knee, each thigh, each
foot, each hip, each
arm, or each shoulder of the individual. In such an example, the comparison
can be used to
provide an indication of the symmetry of the individual prior to, during,
and/or after
rehabilitation or physical therapy.
[0091] In addition to specific high-energy impact events to the body, the
example the
systems, methods, and apparatus described herein use an analysis of data
indicative of body
motion, as non-limiting examples, for such applications as training and/or
clinical purposes.
[0092] Data gathered based on sensing the motion of the body or part of the
body, along
with data gathered based on sensing other physiological measures of the body,
can be
analyzed to provide useful information related to range of motion, types of
motion, and
changes in the motion. When this sensing is performed using thin, conformal,
and wearable
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
sensors and measurement devices including such sensors, these measures and
metrics can be
unimpeded by the size, weight or placement of the measurement devices.
[0093] Example systems, methods, and apparatus according to the principles
described
herein provide a thin and conformal electronic measurement system capable of
measuring
body motion or body part for a variety of applications, including
rehabilitation, physical
therapy, athletic training, and athlete monitoring. Additionally, the example
systems,
methods, and apparatus can be used for athlete assessment, performance
monitoring, training,
and performance improvement.
[0094] An example device for motion detection can include an accelerometer
(such as but
not limited to a 3-axis accelerometer. The example device may include a 3-axis
gyroscope.
The example device can be disposed on a body part, and data collected based on
the motion
of the body part is analyzed, and the energy under the motion vs. time curve
can be
determined as an indicator of energy or impulse of a motion.
[0095] The conformal sensor device combines motion sensing in the form of a
3D
accelerometer and/or a 3-axis gyro to provide motion paths for a variety of
applications. As a
non-limiting example, the form of the devices can be either small surface-
mount technology
packages or unpackaged devices combined to form a very thin patch-based
system. As a
non-limiting example, the patch can be about 2 mm or less in thickness. The
example patch
can be attached adhesively to the body part similar to that of a band-aid or
other bandage.
[0096] As a non-limiting example, the device architecture can include one
or more
sensors, power & power circuitry, wireless communication, and a
microprocessor. These
example devices can implement a variety of techniques to thin, embed and
interconnect these
die or package-based components.
[0097] FIGs 1A-1D show non-limiting examples of possible device
configurations. The
example device of FIG lA includes a data receiver 101 disposed on a substrate
100. The data
receiver 101 can be configured to conform to a portion of the object to which
it and the
substrate are coupled. The data receiver 101 can include one or more of any
sensor
component according to the principles of any of the examples and/or figures
described herein.
In this example, data receiver 101 includes at least one accelerometer 103
(such as but not
16
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
limited to a triaxial accelerometer) and at least one other component 104. As
a non-limiting
example, the at least one other component 104 can be a gyroscope, hydration
sensor,
temperature sensor, an electromyography (EMG) component, a battery (including
a
rechargeable battery, a transmitter, a transceiver, an amplifier, a processing
unit, a charger
regulator for a battery, a radio-frequency component, a memory, and an analog
sensing block,
electrodes, a flash memory, a communication component (such as but not limited
to
Bluetooth Low-Energy radio) and/or other sensor component.
[0098] The at least one accelerometer 103 can be used to measure data
indicative of a
motion of a portion of the individual. The example device of FIG. lA also
includes an
analyzer 102. The analyzer 102 can be configured to quantify the data
indicative of motion
and/or physiological data, or analysis of such data indicative of motion
and/or physiological
data according to the principles described herein. In one example, the
analyzer 102 can be
disposed on the substrate 100 with the data receiver 101, and in another
example, the
analyzer 102 is disposed proximate to the substrate 100 and data receiver 101.
[0099] In the example implementation of the device in FIG. 1A, the analyzer
102 can be
configured to quantify the data indicative of the motion by calculating an
energy imparted
and/or HIC value for the motion.
[00100] FIG. 1B shows another example device according to the principles
disclosed
herein that includes a substrate 100, data receiver 101, an analyzer 102, and
a storage module
107. The storage module 107 can be configured to save data from the data
receiver 101
and/or the analyzer 102. In some implementations the storage device 107 is any
type of non-
volatile memory. For example, the storage device 107 can include flash memory,
solid state
drives, removable memory cards, or any combination thereof. In certain
examples, the
storage device 107 is removable from the device. In some implementations, the
storage
device 107 is local to the device while in other examples it is remote. For
example, the
storage device 107 can be internal memory of a smartphone. In this example,
the device may
communicate with the phone via an application executing on the smartphone. In
some
implementations, the sensor data can be stored on the storage device 107 for
processing at a
later time. In some examples, the storage device 107 can include space to
store processor-
executable instructions that are executed to analyze the data from the data
receiver 101. In
17
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
other examples, the memory of the storage device 107 can be used to store the
measured data
indicative of motion and/or physiological data, or analysis of such data
indicative of motion
and/or physiological data according to the principles described herein.
[00101] FIG. 1C shows an example device according to the principles disclosed
herein that
includes a substrate 100, a data receiver 101, an analyzer 102, and a
transmission module
106. The transmission module 106 can be configured to transmit data from the
data receiver
101, the analyzer 102, or stored in the storage device 107 to an external
device. In one
example, the transmission module 106 can be a wireless transmission module.
For example,
the transmission module 106 can transmit data to an external device via
wireless networks,
radio frequency communication protocols, Bluetooth, near-field communication,
and/or
optically using infrared or non-infrared LEDs.
[00102] FIG. 1D shows an example system that includes a substrate 100, a data
receiver
101, an analyzer 102 and a processor 107. The data receiver 101 can receive
data related to
sensor measurement from a conformal sensor device. In an example, the
conformal sensor
device can be a flexible sensor. The processor 107 can be configured to
execute processor-
executable instructions stored in a storage device 107 and/or within the
processor 107 to
analyze data indicative of motion and/or physiological data, or analysis of
such data
indicative of motion and/or physiological data according to the principles
described herein. In
some implementations, the data can be directly received from the data receiver
101 or
retrieved from the storage device 107. In one example, the processor can be a
component of
the analyzer 102 and/or disposed proximate to the data receiver 101. In
another example, the
processor 107 can be external to the device, such as in an external device
that downloads and
analyzes data retrieved from the device. The processor 107 can execute
processor-executable
instructions that quantify the data received by the data receiver 101 in terms
of imparted
energy.
[00103] In another example, the processor 107 can categorize the quantitative
measure of
the performance of the individual relative to at least one predetermined
threshold. For
example, the device may indicate that a football or baseball player is to be
benched or a
worker may not report back to work if the analyzed data does not meet a
performance
threshold value. In another example, multiple differing predetermined
thresholds may be
18
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
used to monitor the performance level of an individual. In some examples, the
processor 107
can maintain counts for each of the bins created by the differing
predetermined thresholds
and increment the counts when the quantitative measure of the performance of
the individual
corresponds to a specific bin. In some examples, the processor 107 can
maintain counts for
each of the bins created by the predetermined threshold and increment the
counts when a
performance metric is registered that corresponds to a specific bin. The
processor 107 may
transmit the cumulative counts for each bin to an external device via the
transmission module
106. Non-limiting example categories include satisfactory, in need of further
training,
needing to be benched for the remained of the game, unsatisfactory, or any
other type of
classification.
[00104] FIGs. 2A-2C show non-limiting examples of possible device
configurations
including a display for displaying the data or analysis results. The examples
of FIGs. 2A-2C
include a substrate 200, a flexible sensor 201, a analyzer 202, and an
indicator 203. In
different examples the device can include a processor 205, to execute the
processor-
executable instructions described herein; and a storage device 204 for storing
processor-
executable instructions and/or data from the analyzer 202 and/or flexible
sensor 201. The
example devices of FIGs 2A-2C also include an indicator 203 for displaying
and/or transmit
data indicative of motion, physiological data, or analysis of such data
indicative of motion,
physiological data according to the principles described herein, and/or user
information.
[00105] In one example, the indicator 203 can include a liquid crystal
display, or an
electrophoretic display (such as e-ink), and/or a plurality of indicator
lights. For example, the
indicator 203 can include a series of LEDs. In some implementations, the LEDs
range in
color, such as from green to red. In this example, if performance does not
meet a pre-
determined threshold measure, a red indicator light can be activated and if
the performance
meets the pre-determined threshold measure, the green indicator light can be
activated. In yet
another example, the intensity of the LED indicator lights can be correlated
to the magnitude
of the quantified measure of performance of the individual or the bin counts
(e.g., as a
measure of throw count). For example, the LEDs can glow with a low intensity
for
quantified performance below a threshold and with a high intensity for
quantified
performance above the threshold.
19
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[00106] In another example, the LEDs of the indicator 203 may be configured to
blink at a
specific rate to indicate the level of the quantified performance of the
individual. For
example, the indicator may blink slowly for a quantified performance over a
first threshold
but below a second threshold and blink at a fast rate for a quantified
performance above the
second threshold. In yet another example, the indicator 203 may blink using a
signaling
code, such as but not limited to Morse code, to transmit the measurement data
and/or data
indicative of performance level. In some implementations, as described above,
the signaling
of the indicator 203 is detectable to the human eye and in other
implementations it is not
detectable by the human eye and can only be detected by an image sensor. The
indicator 203
emitting light outside the viable spectrum of the human eye (e.g. infrared) or
too dim to be
detected are examples of indication methods indictable to the human eye. In
some examples,
the image sensor used to detect the signals outside the viewing capabilities
of a human eye
can be the image sensor of a computing device, such as but not limited to a
smartphone, a
tablet computer, a slate computer, a gaming system, and/or an electronic
reader.
[00107] FIG. 3 show a flow chart illustrating a non-limiting example method of
quantifying the performance of an individual, according to the principles
described herein.
[00108] In block 301, a processing unit receives data indicative of at least
one
measurement of a sensor component of a conformal sensor device coupled to a
portion of the
individual. In an example, the at least one measurement can be acceleration
data
representative of an acceleration proximate to the portion of the individual
and/or force data
representative of a force applied to the individual.
[00109] The conformal sensor device is configured to substantially conform to
the surface
of the portion of the individual to provide a degree of conformal contact. The
data indicative
of the at least one measurement can include data indicative of the degree of
the conformal
contact
[00110] In block 302, the processing unit quantifies a parameter indicative of
at least one
of (i) an imparted energy and (ii) a head-injury-criterion (HIC), based on the
at least one
measurement and the degree of the conformal contact between the conformal
sensor device
and the portion of the individual. In some examples, the processing unit may
only quantify
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
performance levels that have a value of imparted energy above a predetermined
threshold
value. As described above, in some examples, quantified performance
corresponding to an
imparted energy value above a first predetermined threshold may be further
categorized
responsive to if the imparted energy value corresponds to a performance level
that exceeds a
second or third predetermined threshold.
[00111] In block 303, the processing unit compares the parameter to a preset
performance
threshold value to provide an indication of the performance of the individual.
[00112] In block 304, the device displays, transmits, and/or or stores an
indication of the
indication of the performance of the individual. As indicated in FIG. 3, each
of 304a, 304b,
and 304c can be performed alone or in any combination. In one example, the
indicator 203
can be used to display the indication of the performance of the individual to
a user or to
external monitor. For example, the device may include a display that displays
a graph of
performance data over time to a user. In another example, the transmitter 106
can be used to
transmit, wirelessly or wired, the data indicative of the performance of the
individual. In
such an example, the data can be downloaded from the device and analyzed by
implementing
processor-executable instructions (e.g., via a computer application). In yet
another example,
the indication of the performance of the individual can be stored either
locally to the device
or on a separate device, such as but not limited to the hard-drive of a
laptop.
[00113] While the description herein refers to three different predetermined
thresholds, it
is understood that the system can be configured to assess performance levels
based on many
more specified threshold levels according to the principles of the examples
described herein.
[00114] FIG. 4 shows the general architecture of an illustrative computer
system 400 that
may be employed to implement any of the computer systems discussed herein. The
computer
system 400 of FIG. 4 includes one or more processors 420 communicatively
coupled to
memory 425, one or more communications interfaces 405, and one or more output
devices
410 (e.g., one or more display units) and one or more input devices 415.
[00115] In the computer system 400 of FIG. 4, the memory 425 may include any
computer-readable storage media, and may store computer instructions such as
processor-
executable instructions for implementing the various functionalities described
herein for
21
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
respective systems, as well as any data relating thereto, generated thereby,
or received via the
communications interface(s) or input device(s). The processor(s) 420 shown in
FIG. 4 may be
used to execute instructions stored in the memory 425 and, in so doing, also
may read from or
write to the memory various information processed and or generated pursuant to
execution of
the instructions.
[00116] The processor 420 of the computer system 400 shown in FIG. 4 also may
be
communicatively coupled to or control the communications interface(s) 405 to
transmit or
receive various information pursuant to execution of instructions. For
example, the
communications interface(s) 405 may be coupled to a wired or wireless network,
bus, or
other communication means and may therefore allow the computer system 400 to
transmit
information to and/or receive information from other devices (e.g., other
computer systems).
While not shown explicitly in the system of FIG. 4, one or more communications
interfaces
facilitate information flow between the components of the system 100. In some
implementations, the communications interface(s) may be configured (e.g., via
various
hardware components or software components) to provide a website as an access
portal to at
least some aspects of the computer system 400.
[00117] The output devices 410 of the computer system 400 shown in FIG. 4 may
be
provided, for example, to allow various information to be viewed or otherwise
perceived in
connection with execution of the instructions. The input device(s) 415 may be
provided, for
example, to allow a user to make manual adjustments, make selections, enter
data or various
other information, or interact in any of a variety of manners with the
processor during
execution of the instructions.
[00118] According the principles disclosed herein, both the communication
module and
the analyzer can be disposed in the same device, such as, but not limited to,
stand alone
physical quantification device, a device incorporated into clothing, or a
device incorporated
into protective equipment. In another example, the communication module may be
integrated
with the conformal sensor device. In this example, the conformal sensor device
may
communicate with the analyzer wirelessly, using LEDs, or any other
communication means.
In some examples, the analyzer may be disposed proximate to the communication
module or
22
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
the analyzer can be a component of a monitoring device to which the
measurement data
collected by the communication module is transferred.
[00119] In an example, the communication module can include a near-field
communication (NFC)-enabled component.
[00120] In a non-limiting example, the systems, methods and apparatus
described herein
for providing an indication of the performance of the individual may be
integrated with a
conformal sensor device that provides the measurement data. In this example,
the conformal
sensor device may communicate with the analyzer wirelessly or using an
indicator. Non-
limiting examples of indicators include LEDs or any other communication means.
[00121] In a non-limiting example, the conformal sensor device includes one or
more
electronic components for obtaining the measurement data. The electronic
components
include a sensor component (such as but not limited to an accelerometer or a
gyroscope).
The electronics of the conformal sensor device can be disposed on a flexible
and/or
stretchable substrate and coupled to one another by stretchable interconnects.
The stretchable
interconnect may be electrically conductive or electrically non-conductive.
According to the
principles herein, the flexible and/or stretchable substrate can include one
more of a variety
of polymers or polymeric composites, including polyimides, polyesters, a
silicone or siloxane
(e.g., polydimethylsiloxane (PDMS)), a photo-pattemable silicone, a SU8 or
other epoxy-
based polymer, a polydioxanone (PDS), a polystyrene, a parylene, a parylene-N,
an ultrahigh
molecular weight polyethylene, a polyether ketone, a polyurethane, a polyactic
acid, a
polyglycolic acid, a polytetrafluoroethylene, a polyamic acid, a polymethyl
acrylate, or any
other flexible materials, including compressible aerogel-like materials, and
amorphous
semiconductor or dielectric materials. In some examples described herein, the
flexible
electronics can include non-flexible electronics disposed on or between
flexible and/or
stretchable substrate layers, such as but not limited to discrete electronic
device islands
interconnected using the stretchable interconnects. In some examples, the one
or more
electronic components can be encapsulated in a flexible polymer.
[00122] In various non-limiting examples, the stretchable interconnect can be
configured
as a serpentine interconnect, a zig-zag interconnect, a rippled interconnects,
a buckled
23
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
interconnect, a helical interconnect, a boustrophedonic interconnect, a
meander-shaped
interconnect, or any other configuration that facilitates stretchability.
[00123] In an example, the stretchable interconnect can be formed form an
electrically
conductive material.
[00124] In any of the examples described herein, the electrically conductive
material (such
as but not limited to the material of the electrical interconnect and/or the
electrical contact)
can be, but is not limited to, a metal, a metal alloy, a conductive polymer,
or other conductive
material. In an example, the metal or metal alloy of the coating may include
but is not
limited to aluminum, stainless steel, or a transition metal, and any
applicable metal alloy,
including alloys with carbon. Non-limiting examples of the transition metal
include copper,
silver, gold, platinum, zinc, nickel, titanium, chromium, or palladium, or any
combination
thereof In other non-limiting examples, suitable conductive materials may
include a
semiconductor-based conductive material, including a silicon-based conductive
material,
indium tin oxide or other transparent conductive oxide, or Group III-IV
conductor (including
GaAs). The semiconductor-based conductive material may be doped.
[00125] In any of the example structures described herein, the stretchable
interconnects
can have a thickness of about 0.1 gm, about 0.3 gm, about 0.5 gm, about 0.8
gm, about 1
gm, about 1.5 gm, about 2 gm, about 5 gm, about 9 gm, about 12 gm, about 25
gm, about 50
gm, about 75 gm, about 100 gm, or greater.
[00126] In an example system, apparatus and method, the interconnects can be
formed
from a non-conductive material and can be used to provide some mechanical
stability and/or
mechanical stretchability between components of the conformal electronics
(e.g., between
device components). As a non-limiting example, the non-conductive material can
be formed
based on a polyimide.
[00127] In any of the example devices according to the principles described
herein, the
non-conductive material (such as but not limited to the material of a
stretchable interconnect)
can be formed from any material having elastic properties. For example, the
non-conductive
material can be formed from a polymer or polymeric material. Non-limiting
examples of
applicable polymers or polymeric materials include, but are not limited to, a
polyimide, a
24
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
polyethylene terephthalate (PET), a silicone, or a polyeurethane. Other non-
limiting
examples of applicable polymers or polymeric materials include plastics,
elastomers,
thermoplastic elastomers, elastoplastics, thermostats, thermoplastics,
acrylates, acetal
polymers, biodegradable polymers, cellulosic polymers, fluoropolymers, nylons,
polyacrylonitrile polymers, polyamide-imide polymers, polyarylates,
polybenzimidazole,
polybutylene, polycarbonate, polyesters, polyetherimide, polyethylene,
polyethylene
copolymers and modified polyethylenes, polyketones, poly(methyl methacrylate,
polymethylpentene, polyphenylene oxides and polyphenylene sulfides,
polyphthalamide,
polypropylene, polyurethanes, styrenic resins, sulphone based resins, vinyl-
based resins, or
any combinations of these materials. In an example, a polymer or polymeric
material herein
can be a DYMAXO polymer (Dymax Corporation, Torrington, CT).or other UV
curable
polymer, or a silicone such as but not limited to ECOFLEXO (BASF, Florham
Park, NJ).
[00128] In any example herein, the non-conductive material can have a
thickness of about
0.1 gm, about 0.3 gm, about 0.5 gm, about 0.8 gm, about 1 gm, about 1.5 gm,
about 2 gm or
greater. In other examples herein, the non-conductive material can have a
thickness of about
gm, about 20 gm, about 25 gm, about 50 gm, about 75 gm, about 100 gm, about
125 gm,
about 150 gm, about 200 gm or greater.
[00129] In the various examples described herein, the conformal sensor device
includes at
least one sensor component, such as but not limited to an accelerometer and/or
a gyroscope.
In one example, the data receiver can be configured to detect acceleration,
change in
orientation, vibration, g-forces and/or falling. In some examples, the
accelerometer and/or
gyroscope can be fabricated based on commercially available, including
"commercial off-the-
shelf' or "COTS" electronic devices that are configured to be disposed in a
low form factor
conformal system The accelerometers may include piezoelectric or capacitive
components
to convert mechanical motion into an electrical signal. A piezoelectric
accelerometer may
exploit properties of piezoceramic materials or single crystals for converting
mechanical
motion into an electrical signal. Capacitive accelerometers can employ a
silicon micro-
machined sensing element, such but not limited to a micro-electrical-
mechanical system, or
MEMS, sensor component. A gyroscope can be used to facilitate the
determination of
refined location and magnitude detection. As a non-limiting example, a
gyroscope can be
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
used for determining the tilt or inclination of the body part to which it is
coupled. As another
example, the gyroscope can be used to provide a measure of the rotational
velocity or
rotational acceleration of the body part (such as an arm in a throwing motion,
including a
hitting or kicking motion). For example, the tilt or inclination can be
computed based on
integrating the output (i.e., measurement) of the gyroscope.
[00130] In some examples, the system can be used to monitor the performance of
an
individual during athletic activities, such as but not limited to contact
sports, noncontact
sports, team sports and individual sports. Non-limiting examples of such
athletic activity can
include tackles in American football, and the throw of a baseball player or an
American
football player. This can occur during games, athletic events, training and
related activities.
Other examples of performance monitoring can be during construction work (or
other
industrial work), military activity, occupation therapy, and/or physical
therapy.
[00131] In any example herein, the indication of the individual's performance
may be
quantified based on a computed imparted energy and/or a HIC, and data
indicative of a
physiological condition of the individual, such as but not limited to a blood
pressure, a heart
rate, an electrical measurement of the individual's tissue, or a measurement
of a device
proximate to the individual's body (including an accelerometer, a gyro, a
pressure sensor, or
other contact sensor).
[00132] An example conformal sensor device can include electronics for
performing at
least one of an accelerometry measurements and electronics for performing at
least one other
measurement. In various examples, the at least one other measurement can be,
but is not
limited to, a muscle activation measurement, a heart rate measurement, an
electrical activity
measurement, a temperature measurement, a hydration level measurement, a
neural activity
measurement, a conductance measurement, an environmental measurement, and/or a
pressure
measurement. In various examples, the conformal sensor device can be
configured to
perform any combination of two or more different types of measurements.
[00133] The example systems, methods, and apparatus described herein including
the
conformal sensor system can be configured to monitor the body motion and/or
muscle
activity, and to gather measured data values indicative of the monitoring. The
monitoring can
26
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
be performed in real-time, at different time intervals, and/or when requested.
In addition, the
example systems, methods, and apparatus described herein can be configured to
store the
measured data values to a memory of the system and/or communicate (transmit)
the
measured data values to an external memory or other storage device, a network,
and/or an
off-board computing device. In any example herein, the external storage device
can be a
server, including a server in a data center.
[00134] This example systems, methods, and apparatus can be used to provide
ultra-thin
and conformal electrodes that, when combined with motion and activity
measurements,
facilitate monitoring and diagnosis of subjects. In combination with
pharmaceuticals, this
information can be used to monitor and/or determine subject issues including
compliance and
effects.
[00135] The example conformal sensor system can be configured to provide a
variety of
sensing modalities. The example conformal sensor system can be configured with
sub-
systems such as telemetry, power, power management, processing as well as
construction and
materials. A wide variety of multi-modal sensing systems that share similar
design and
deployment can be fabricated based on the example conformal electronics.
[00136] According to the principles disclosed herein, the example conformal
sensor device
can include a storage device. The storage device can be configured to store
the data indicative
of the quantified performance and/or the measurement data. The storage device
can be, but
id not limited to, a flash memory, solid state drives, removable memory cards,
or any
combination thereof
[00137] In another example, the system for quantifying performance of an
individual can
include a transmission module. The transmission module can be configured to
transmit the
data indicative of the quantified performance and/or the measurement data to
an external
device. For example, the transmission module can transmit the data indicative
of the
quantified performance and/or the measurement data to a computing device such
as but not
limited to a smartphone (such as but not limited to an iphone0, an AndroidTM
phone, or a
Blackberry ), a tablet computer, a slate computer, an electronic gaming system
(such as but
not limited to an XBOX , a Playstation , or a Wii8), and/or an electronic
reader. The
27
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
analyzer may be processor-executable instructions implemented on the computing
device. In
another example, the transmission module can transmit data using a
communication protocol
based on Bluetooth0 technology, Wi-Fi, Wi-Max, IEEE 802.11 technology, a radio
frequency (RF) communication, an infrared data association (IrDA) compatible
protocol, or a
shared wireless access protocol (SWAP).
[00138] In one example, the processor-executable instructions can include
instructions to
cause the processor to maintain a cumulative total of the number of detected
performance
events, such as but not limited to the number of throws, kicks, swings, and/or
footfalls, during
an activity. In some implementations, the cumulative total can be subdivided
responsive to a
number of performance threshold values, such as but not limited to first,
second, and third
performance threshold values. As a non-limiting example, a performance
threshold can be
set based on a preset amount of imparted energy and/or level of HIC. For
example,
performance thresholds can be preset for differing levels of imparted energy
of a baseball
player's or football player's arm for a throw, a football or soccer player's
foot for a kick, a
baseball player's or golfer's arm for swings, and/or a runner's or horse's
footfalls.
[00139] In some examples, the processor-executable instructions can include
instructions
to cause the processor to maintain counts for each of a number of bins created
by differing
predetermined thresholds (including performance threshold values). A bin count
can be
increment when the quantitative measure of the performance of the individual
corresponds to
a specific bin. In some examples, the processor-executable instructions can
include
instructions to cause the processor to maintain counts for each of the bins
created by the
predetermined threshold and increment the counts when a performance measure is
registered
corresponding to a specific bin. For example, a first bin may include the
quantitative
measure of the performance for a specific imparted energy above a first
threshold but below a
second threshold, a second bin may include the quantitative measure of the
performance with
an imparted energy value above the second threshold but below a third
threshold, and a third
bin may include any quantitative measures of the performance with an imparted
energy value
above the third threshold. The processor-executable instructions can include
instructions to
cause the processor to transmit the cumulative counts for each bin to an
external device via a
transmission module. The counts for each bin can be reset at predetermined
intervals. For
28
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
example, processor-executable instructions can include instructions to cause
the processor to
track the number of counts for each bin an athlete registers over a time
period, and the counts
from the bins may be used as an overall rating of the performance of the
individual. In
another example, the cumulative count of a bin, such as but not limited to a
bin indicative of
poorer performance, may be used to indicate a physical condition of the
individual. For
example, the cumulative count in the bin indicative of poorer performance may
be used to
indicate that an individual, such as but not limited to a football player or a
baseball player,
should be benched within a certain period of time. Based on bin counts
indicative of throw
counts for a baseball player or football player that has a conformal sensor
device disposed on
an arm, the baseball player's performance level may be categorized. Non-
limiting example
categories include satisfactory, in need of further training, needing to be
benched for the
remained of the game, unsatisfactory, or any other type of classification.
[00140] According to the principles described herein, the cumulative totals
can be gathered
over specific periods of time such a construction worker's shift, a specific
duration of time, a
game, a season, and/or a career. In some examples, the processor-executable
instructions
cause the processor to calculate a head injury criterion (HIC). The HIC and
imparted energy
can be used as a measure of the likelihood that an impact can cause a head
injury.
[00141] In some example implementations, the processor-executable instructions
can
cause the processor to perform a linear interpolation of the received data to
generate data for
the data points that are not measured by the data receiver. For example, the
processor-
executable instructions can cause the processor to perform a curve fit based
on a pre-
determined waveform to generate the non-measured data. In one example, the
waveform can
be determined based on a priori knowledge of candidate waveforms or a curve
fit based on a
set of known standards of the performance of low-g accelerometers for
different applied
forces. For example, low-g accelerometer may have a dynamic range capable of
detecting up
to only about lOg forces. The device may be subjected to forces outside the
device's dynamic
range during the course of an activity. In some example implementations, prior
knowledge of
candidate waveform shapes can be used to recreate a standard waveform for
analysis by the
hit count monitor.
29
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[00142] In various examples described herein, the performance quantification
device can
be configured to include an indicator. The indicator can be used to directly
display or transmit
count and/or data indicative of performance. In one example, the indicator
provides a human
readable interface, such as a screen that displays the collected data. This
sequence of
displayed values can be triggered but not limited to a specific action or
sequence related to
obtaining the displayed values such as a reset or power off and power on
sequence.
[00143] In another human readable example, the indicator may include LEDs that
blink or
glow at a specific color to indicate the level of performance of the
individual. In this
example, the indicator can be used to blink (turn on and off) a detectable
sequence of light
flashes that corresponds to the performance level above a predetermined
threshold. A
sequence of on and off flashes can be counted to give a specific number. As a
non-limiting
example, the sequence <on>, <off>, <on>, <off>, <on>, <off>, could correspond
to 3
instances of quantified performance above the threshold. For double-digits
(above 9
instances of quantified performance) the numbers might be indicated thusly:
<on>, <off>,
<pause>, <on>, <off>, <on>, <off> would correspond to 12 instances of
quantified
performance using decimal notation. While a useful duration of the <on> pulses
could be in
the range of 10-400 milliseconds, any observable duration can be used. The
<pause> should
be perceptibly different from than the <on> signal (including being longer or
shorter) to
indicate the separation of numbers. This sequence of displayed values can be
triggered but
not limited to a specific action or sequence related to obtaining the
displayed values such as a
reset or power off and power on sequence.
[00144] Start and end sequences may be used to bracket the signal values such
as a rapid
pulsing or specific numerical values. Another numerical sequence can be used
to provide a
unique ID for a wearable unit including the conformal sensor device.
[00145] The framework for the display of pulses can also be programmable and
set up via
a computer connection (wireless or wired) to tailor the sequence for specific
needs. While
multiple values can be communicated using longer flashing sequences, this may
be less
desirable due to issues of time, and complexity of interpretation. An encoding
akin to a
human readable Morse code-like sequence or pulse width modulation can provide
more
information but also may require significant training and transcription.
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[00146] In yet another example, the indicator can be configured to provide a
non-human
readable indicator in addition to, or in place of, the human readable
indicator. For example, a
smartphone application (or other similar application of processor-executable
instructions on a
computing device) can be used to read or otherwise quantify an output of an
indicator using a
camera or other means. For example, where the indicator provides an indication
or transmits
information using LEDs, the camera or other imaging component of a smartphone
or other
computing device may be used to monitor the output of the indicator. Examples
of non-
human readable interfaces using an LED include blinking the LED at a rate that
cannot be
perceived by the human eye, LEDs that emit electromagnetic radiation outside
of the visual
spectrum such as infrared or ultraviolet, and/or LEDs that glow with low
luminosity such that
they cannot be perceived by a human.
[00147] Non-limiting examples of computing devices herein include smartphones,
tablets,
slates, e-readers, or other portable devices, of any dimensional form factor
(including mini),
that can be used for collecting data (such as, but not limited to, a count
and/or measures of
performance) and/or for computing or other analysis based on the data (such as
but not
limited to computing the count, calculating imparted energy, and/or
determining whether a
measure of performance is above or below a threshold). Other devices can be
used for
collecting the data and/or for the computing or other analysis based on the
data, including
computers or other computing devices. The computing devices can be networked
to facilitate
greater accessibility of the collected data and/or the analyzed data, or to
make it generally
accessible.
[00148] In another non-limiting example, the performance monitor can include a
reader
application including a computing device (such as but not limited to a
smartphone-, tablet-, or
slate-based application), that reads the LED display from an indicator,
calculates tiered
counts from tiered indications of the performance indicator, and logs the data
to the memory
of the performance monitor. In a non-limiting example, the tiered indication
may be a green
light indication for performance quantified as reaching a first performance
threshold, a
yellow light indication for performance quantified as reaching a second
performance
threshold, and red light indication for performance quantified as reaching a
third threshold, or
any combination thereof. The application can be configured to display the
counts, or indicate
31
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
a recommendation for future activity. In an example where the individual is an
athlete, the
performance monitor may provide an indication of the recommended remaining
hits for a
player for that specific game, for the season, for the career, etc. The
example system and
apparatus can be configured to send data and performance reports to selected
recipients (with
appropriate consent) such as but not limited to parents, trainers, coaches,
and medical
professionals. The data can also be aggregated over time to provide statistics
for individual
players, groups of players, entire teams or for an entire league. Such data
can be used to
provide information indicative of trends in game play, effects of rule
changes, coaching
differences, differences in game strategy, and more.
[00149] In any example provided herein where the subject is an individual, it
is
contemplated that the system, method or apparatus has obtained the consent of
the individual,
where applicable, to transmit such information or other report to a recipient
that is not the
individual prior to performing the transmission.
[00150] Wearable electronics devices can be used to sense information
regarding
particular motion events (including other physiological measures). Such motion
indicator
devices, including units that are thin and conformal to the body, can provide
this information
to users and others (with appropriate consent) in a variety of ways. Some non-
limiting
examples include wireless communication, status displays, haptic and tactile
devices, and
optical communication. In the case of a motion indicator, such as that
described in U.S.
Patent Application No. 12/972,073, 12/976,607, 12/976,814, 12/976,833, and/or
13/416,386,
each of which is incorporated herein by reference in its entirety including
drawings, the
wearable electronics device described herein can be used to register and store
numbers of
instances of quantified performance above a threshold, or other physiological
data, onboard.
[00151] As a non-limiting example of a smart lighting devices that may be
applicable to a
hit count monitor according to the principles described herein, U.S. Patent
6,448,967, titled
"Universal Lighting Network Methods and Systems," which is incorporated herein
by
reference in its entirety including drawings, describe a device that is
capable of providing
illumination, and detecting stimuli with sensors and/or sending signals. The
smart lighting
devices and smart lighting networks may be used for communication purposes.
32
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[00152] As a non-limiting example, the example systems, methods, and apparatus
described herein can be configured to count pitches and throws, and to analyze
and quantify
data indicative of the complementary metrics around the throwing motion.
Example systems,
methods, and apparatus described herein can be implemented to collect and/or
analyze data
that can be used to determine, as non-limiting examples, the number of throws
in a given
session, the arm movement during a throw, and estimate throw data including
peak velocity
and/or values of velocity of a ball or other thrown or struck object, and
throw plane.
[00153] Any example system, method or apparatus according to the principles
described
herein can be used to monitor and or analyze data from a body part performing
a similar
motion using an object (including a baseball glove or mitt, a racket, a hockey
stick), to strike
or to catch another object (including a ball or a puck).
[00154] Any example system, method or apparatus herein applied to quantify or
analyze a
throwing motion also can be applied to quantify or analyze a striking motion
using an object.
[00155] As a non-limiting example, an output of the example systems, methods,
and
apparatus according to the principles described herein can be a value or
designation
indicating a measure of throw velocity, throw quality, throw plane, proper
throw form, or
other measure of throw.
[00156] FIG. 5 shows an example of use of measurements from a conformal sensor
device
for monitoring performance. In an example, the conformal sensor device can be
disposed
proximate to, attached to, or otherwise coupled to, the muscle(s) of interest
during specific,
repeated or repetitious exercise. The example of FIG. 5 shows the example
conformal sensor
system on an individual's body part, such as but not limited to a baseball
pitcher's arm. The
individual's muscle activity and/or motion is tracked during a warm up period
to assess
quality of muscle activation and readiness or during the pitching performance
in a game. A
user, such as but not limited to a coach, a trainer, or an athlete can (with
appropriate consent)
use analysis of the measurement data to assess quality of muscular activity to
find ideal levels
of performance based on EMG frequency and amplitude. After a period of
pitching, data
from measurements can be used to generate a performance indicator to quantify
whether
there's a decrease in the quality of muscle response, which can be used for
determining
33
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
fatigue levels and exhaustion. This information facilitates users, e.g.,
coaching staff, to
determine the correct time that a pitcher should be removed from the game and
replaced,
preventing or reducing the risk of injury. The example systems can also be
used to indicate
when a different pitcher is warmed up and ready to play. In this example, the
three different
trend lines on the example graph can be used to represent three different
players during a
single game. This example implementation can be applied to any athletic sport
or other
physical activity.
[00157] As a non-limiting example, the electronics for muscle activation
monitoring can
be configured to perform electromyography (EMG) measurements. The electronics
for EMG
can be implemented to provide a measure of muscle response or electrical
activity in response
to a stimulation of the muscle. As a non-limiting example, the EMG
measurements can be
used to detect neuromuscular abnormalities.
[00158] For the EMG measurements, electrodes coupled to the example conformal
motion
sensors can be disposed proximate to the skin and/or muscle, and the
electrical activity is
detected or otherwise quantified by the electrodes. The EMG can be performed
to measure
the electrical activity of muscle during rest, or during muscle activity,
including a slight
contraction and/or a forceful contraction. As non-limiting examples, muscle
activity,
including muscle contraction, can be caused by, for example, by lifting or
bending a body
part or other object. Muscle tissue may not produce electrical signals during
rest, however, a
brief period of activity can be observed when a discrete electrical
stimulation is applied using
an electrode disposed proximate to the skin and/or muscle. The conformal
sensors can be
configured to measure, via the electrodes, an action potential. In an example,
the action
potential is the electrical potential generated when muscle cells are
electrically or
neurologically stimulated or otherwise activated. As muscle is contracted more
forcefully,
more and more muscle fibers are activated, producing varying action
potentials. Analysis of
the magnitude and/or shape of the waveform(s) of the action potentials
measured can be used
to provide information about the body part and/or the muscle, including the
number of
muscle fibers involved. In an example, the analysis of the magnitude and/or
shape of the
waveforms measured using the conformal sensors can be used to provide an
indication of the
ability of the body part and/or the muscle to respond, e.g., to movement
and/or to stimuli.
34
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
Analysis of spectral or frequency content of such signals can be further used
to provide an
indication of muscle activation and/or body motion, and associated forces.
This data or any
other data described herein can be further filtered and/or compressed to
reduce the amount of
information to be stored.
[00159] In an example, data indicative of the conformal sensor measurements,
including
the measured action potentials, can be stored to a memory of the conformal
sensor system
and/or communicated (transmitted), e.g., to an external memory or other
storage device, a
network, and/or an off-board computing device.
[00160] In an example, the conformal sensor system can include one or more
processing
units that are configured to analyze the data indicative of the conformal
sensor measurements,
including the measured action potentials.
[00161] In a non-limiting example, the conformal sensor system may include
electronics
and be coupled to recording and stimulating electrodes for performing a nerve
conduction
study (NCS) measurement. The NCS measurement can be used to provide data
indicative of
the amount and speed of conduction of an electrical impulse through a nerve.
Analysis of a
NCS measurement can be used to determine nerve damage and destruction. In a
NCS
measurement, a recording electrode can be coupled to a body part or other
object proximate
to the nerve (or nerve bundle) of interest, and a stimulating electrode can be
disposed at a
known distance away from the recording electrode. The conformal sensor system
can be
configured to apply a mild and brief electrical stimulation to stimulate a
nerve (or nerve
bundle) of interest via the stimulating electrode(s). Measurement of the
response of the nerve
(or nerve bundle) of interest can be made via the recording electrode(s). The
stimulation of
the nerve (or nerve bundle) of interest and/or the detected response can be
stored to a memory
of the conformal sensor system and/or communicated (transmitted), e.g., to an
external
memory or other storage device, a network, and/or an off-board computing
device.
[00162] FIGs. 6A and 6B show an example of use of the example systems for
monitoring
performance based on grip intensity. In this example, muscle activity level
measurement can
be analyzed to provide an indication of ideal grip intensity. An assessment of
the amount of
muscle activity in the forearm can be used as an indicator of user grip
pressure. The indicator
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
of user grip can be compared data to provide an indication of the desired
motion patterns for
the user. FIG. 6A shows an example of the phases of a tennis serve. In this
example, the data
from the accelerometer measurements of the example conformal motion system can
be used
to determine the phases of the motion, and the data from the EMG measurements
of the
example conformal sensor system can be used to indicate grip pressure at each
phase. After
the serve, the example system can be configured to display to the athlete
views showing
where grip pressure should be adjusted based on analysis of the measured data.
The example
feedback can also be used to alert a user, in real time, on demand or at
different time
intervals, audibly or by a changing color on display screen, when the user's
grip pressure
deviates from the optimal range. FIG. 6B shows an example graphic display,
where the
user's grip intensity at each hit is compared to an optimal range. Such
feedback may be
provided in real-time to allow user adjustments to grip intensity to be made.
[00163] FIG. 7 shows an example of use of the example systems for monitoring
performance based on pattern matching. The pattern matching can be performed
for an
individual or in a professional setting. The analysis of data measured using,
e.g., an
accelerometer of the example conformal sensor device, can be used to provide
corrective
movement patterns via pattern matching with ideal or desired motion patterns.
FIG. 7 shows
an example breakdown of each phase of a golf swing, including takeaway,
backswing,
downswing, acceleration, and follow-through. The example system can be
configured to
display an indicator, including a color display, to indicate the result of
performance for each
phase. For example, a red color can be used to indicate motion deviating from
the desired
pattern, green can indicate good or acceptable motion, and yellow can be used
to indicate
small deviation from ideal. In the example of FIG. 7, based on analysis of
accelerometer and
muscle data, the takeaway is indicated as red, indicating pressure on grip is
too strong (e.g.,
ideal intensity is set at a level of 30 while user intensity is measured at
45). In this example,
the backswing, downswing are indicated as green (ideal or acceptable);
acceleration is
indicated a yellow (indicating club acceleration is measured as too low, and
suggesting a 10%
increase in acceleration); the follow-through is indicated as a red (e.g., due
to club stopped
before complete follow-through).
36
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[00164] FIG. 8 shows an example of use of the example systems for monitoring
performance. The example conformal sensor device can be placed on working
muscles
during an activity. The example shows conformal sensor devices placed on
portions of an
individual (such as a baseball batter) on various muscles along the arm
including wrist,
forearm, and/or shoulder. The sensor components can be used to detect
measurements
indicative of kinetic link, by measuring the order in which muscles or muscle
groups are
being fired during motion. The analysis of the kinetic liffl( results can be
used to assist in
determining desired movement patterns to improve movement speed and accuracy.
In an
example, the example conformal sensor device can include an accelerometer and
two or more
EMG sensors. The example conformal sensor device can be used to detect the
order in which
muscles are being fired and provide feedback on differences between the
desired (ideal)
patterns and the pattern being performed by the individual (such as an
athlete). In an
example activity involved in a baseball swing, the feedback can be provided in
a graph output
to assist the individual (in this case, an athlete) to analyze and make
adjustments for the next
swing.
[00165] In an example, a similar analysis can be performed to determine a
kinetic link for
a kick by placement of the conformal sensor devices on various portions of a
leg.
[00166] In another example, a similar analysis can be performed to determine a
kinetic
link for swinging an object (such as but not limited to a golf club, a hockey
stick, or a
baseball bat) by placement of the conformal sensor devices on various portions
of a torso
and/or the arms.
[00167] FIG. 9 shows an example of use of the example conformal sensor device
for
monitoring performance for balance and/or symmetry determination. The example
system
can be configured to include an accelerometer and/or an EMG component. For
example, the
system can be used for an individual having a lack of symmetry naturally or an
injury (e.g.,
an athlete having a strained right calf). In an example, motion sensors can be
applied to or
disposed proximate to body parts to determine a baseline of the abnormality.
For example,
for an individual having a strained right calf, the measurements of the right
and left calves
can be analyzed to compare the right calf performance against the left calf
performance
(relative measure). In an example, the conformal sensor device can be disposed
on the
37
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
individual during rehabilitation activities, to provide measurements for
determining how the
muscle and movement activity on the injured leg during rehabilitation compares
to baseline.
EMG data can be used to detect relative improvements to determine
rehabilitation status of
injured leg. Performance and accompanying motion can be tracked over time to
determine
rate of improvement.
[00168] FIG. 10 shows an example conformal sensor device 1001 mounted on the
skin, on
a baseball pitcher's right forearm. Example conformal sensor device 1001
exhibits a degree
of conformal contact with the skin, and follows the contours of the arm.
[00169] FIG. 11 shows example data, showing the x-y-z acceleration, collected
during a
single throw, at four distances (short, medium, moderate, long). As shown in
FIG. 11, the
data can be collected using an example conformal sensor device, e.g., coupled
to or worn on a
body part.
[00170] FIG. 12 shows example data collected during throwing activity, showing
the
feasibility of capturing number of throws over a series of throw sessions.
Each circle on the
graph represents a single throw.
[00171] In a non-limiting example implementation, a system herein can be
configured for
monitoring performance as a wearable rehabilitation monitor.
[00172] For example, patches can be applied to the right and left calves of an
athlete that
has a strained right calf. The data collected from the patch at the left calf
can be used as a
baseline, and compared to the data collected from the patch at the abnormally
performing
right calf as a relative measure.
[00173] In a non-limiting example, a motion-sensing patch can be disposed on a
portion of
a leg during rehabilitation activity to monitor the muscle and movement
activity using both a
baseline sensor on one leg and on the other. In an example, the analysis can
include looking
for relative improvements. The analysis can provide a quantitative measure to
determine how
close the injured and healthy legs are to each other in performance and
motion. The specific
dimension of the metric used for the measurements are canceled out where the
analysis is
performed to provide a relative measure of improvement or performance change.
38
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[00174] Non-limiting example measurement data collection and analysis include:
measuring cadence/gait (e.g., using accelerometer), measuring muscle
activation (e.g., using
electromyography (EMG)), observing patterns of motion (e.g., using time
sequence) and
pattern of activation, and/or computing a measure of symmetry (with a
determined range of
acceptable tolerance). Output can be a measure or other indication of
readiness-the measure
or indication can be classified as indicating, e.g., continue rehabilitation,
or return to play, or
return to work, etc.
[00175] In many occupations, including athletics, at some point, an individual
is injured.
Using the example systems, methods, and apparatus according to the principles
described
herein, measured changes can be mapped to give a rate of change (improvement
trend)) and
provide an estimated time of return to active duty or return to play or return
to full function.
These metrics of motion, speed, acceleration, can be also used to provide an
envelope
(bounds) of change and improvement.
[00176] A method for provide baseline motion and tracking changes or
improvements is
also provided according to the example systems, methods, and apparatus
described herein.
[00177] It is sometimes the case that an individual does not notice an injury
with the injury
during athletic activity or other occupation. Example systems, methods, and
apparatus
according to the principles described herein provide a platform to
independently assess
motion and behavior.
[00178] Toe strike, or motion cadence, or gait, can be used to track change
and
improvement (or decline) in progress during rehabilitation, training, and/or
in real-time
during a game.
[00179] Data indicative of the time sequence of motion of portions of the
individual and
patterns of muscle activation can be used to calculate a notion of symmetry
and comparison.
This becomes an issue of readiness which can be presented as a value or
percentage.
[00180] As a non-limiting example, an output of the example systems, methods,
and
apparatus according to the principles described herein can be a value or
designation
indicating a measure of readiness for an activity. In this example, readiness
can be defined
39
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
by symmetry. As non-limiting example, pattern, magnitude and other signal
processing
means can be used.
[00181] In an example implementation, a baseline can be computed based on
measurements from a first conformal sensor device and used to determine
"symmetry."
Comparison of the measurements from the first conformal sensor device to
measurements
from a second conformal sensor device disposed at a different portion of the
individual. A
measure of baseline activation levels (magnitude) can be used to determine the
individual's
strength. A measure of baseline accelerations (magnitudes) can be used to
determine the
individual's gait.
[00182] In an example implementation, the systems can be implemented for site-
specific
motion modeling.
[00183] The example systems, methods, and apparatus according to the
principles
described herein re provide better performance than large and bulky devices
for looking at
body motion. Some of the bulkier systems can be external (video capture)
devices that are
used for gait and body motion analysis.
[00184] In an example implementation, the systems can be configured for motion
pattern
matching. An athlete or other individual can be caused to follow a template of
"idealized"
motion. The example systems and methods can include one or more display
devices to
display this information in numerical or graphic form. Analysis of data
gathered while the
athlete or other individual follows this template of "idealized" motion can be
used to provide
an assessment that assists the trainer or other user to improve training and
motion.
[00185] The trainer, user, athlete or other individual can get feedback from
the example
systems, methods, or apparatus described herein of data indicating the
analysis of actual
motion of the athlete or other individual. Based on this feedback, the athlete
or other
individual may change behavior or otherwise monitor performance.
[00186] In an example implementation, the systems can be configured for
monitoring
performance of a golf or baseball player. A graphic presentation on the
display device can be
in the form of plotted data, numerical data or a visualization of stance and
body
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
configuration. For the purposes of training, the visual can be exaggerated to
give a better feel
for the changes.
[00187] In an example implementation, the systems can be configured to provide
a
wearable performance assessment and improvement.
[00188] In an example implementation, the systems can be configured for aiding
in
evaluating the performance of multiple athletic during scouting activity. The
evaluation is
based on actual data from an individual, to strength, speed, dexterity,
agility etc. The
example systems, methods and apparatus described herein can be used to deploy
conformal
sensor devices to capture real-world performance data
[00189] In an example implementation, the systems can be configured for media
applications, including real-time broadcast of in-game performance parameters.
[00190] In an example implementation, the systems can be configured for sensor
meshing
of EMG and accelerometer data.
[00191] Many individuals who require physical therapy quit the training and
exercise
before they are ready. The danger is that they could be headed for another
problem if the
training and physical therapy is not completed. The example systems, methods
and apparatus
described herein can be implemented to assist an individual by providing a
detailed
assessment as to whether or not the individuals are favoring one limb over
another or in the
range of motion is not at full range yet.
[00192] In a non-limiting example, data collection through these devices can
be
aggregated and used across a number of individuals to establish standards of
motion and
movement range.
[00193] In all examples described herein, the data is collected and analyzed
with the
consent (where applicable) of the individuals involved.
[00194] As a non-limiting example, an injury can be muscle strain, post-
surgery, other
injury all of which can have a "gold standard." For example, an ACL injury
versus a TKI
41
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
injury, each can have its own "gold standard" as to what is considered
acceptable range of
motion and/or physiological change to be considered rehabilitated or not.
[00195] As a non-limiting example, the systems, methods and apparatus
described herein
can be made interactive. Example systems, methods and apparatus described
herein can be
configured to provide an analysis to answer the question "Are you symmetric?"
regarding an
individual.
[00196] In an example implementation, the systems can be configured to analyze
data
from measurements from the conformal sensor devices for training purposes to
assess an
athlete's motion. Data associated with the "templates" of ideal motion can be
used for the
comparison described hereinabove.
[00197] As a non-limiting example, the systems, methods and apparatus
described herein
can be used to determine how much better an individual is getting
physiologically.
According to the example systems, methods and apparatus described herein, a
performance
metric and data indicative of testing suites can be developed and stored and
used for
performance comparison. For example, The testing suites can be developed based
on data
collected in the performance of such idealized motion as the Football's
Combine, which
includes the desired motion and/or physiological data for an individual
performing a 40 yard
dash plus a 225 pound lift. The example systems, methods and apparatus can
include a
quantified comparison of the athlete's performance metric as compared to the
data indicative
of the Football's Combine testing suite.
[00198] As a non-limiting example, the systems, methods and apparatus
described herein
can be used to quantify the performance of an individual as compared to an
idealized testing
suites to determine which individuals are the "Paper Tigers", that is an
individual that
performs very strongly in a certain set of circumstances (such as in the
weight room) but does
not perform well in the field of play.
[00199] As a non-limiting example, the systems, methods and apparatus
described herein
can be used to provide media-based performance assessment for dispensing to an
audience or
other viewer of an event. For example, the throw count or other performance
metrics for
various players can be displayed or otherwise provided. Comparison between
players, over
42
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
the course of a season, can be derived using the example systems, methods and
apparatus
described herein. Syndicated data can be derived from and/or fed to a data
stream (such as
but not limited to game "stats").
[00200] In all examples described herein, the data is collected and analyzed
with the
consent (where applicable) of the individuals involved.
[00201] In an example implementation, the systems, methods and apparatus
described
herein can be worn during daily activity. Data analysis can be performed in
real-time, at any
point in time while the conformal sensor device is being worn, or data can be
analyzed later
after the conformal sensor device is removed. The data can be analyzed in
aggregate.
[00202] The example, the systems, methods and apparatus described herein can
be applied
to analyze an individual's performance in such sports as tennis, golf,
baseball, hockey,
archery, fencing, weightlifting, swimming, gymnastics, horse racing (including
thoroughbred
racing), and track and fields (including running).
[00203] The example, the systems, methods and apparatus described herein can
be applied
to physical therapy, rehabilitation, athletic training, military and first
responder training and
assessment. For example, the systems, methods and apparatus described herein
can be
implemented for monitoring adherence to and/or improvement in physical
therapy,
rehabilitation, athletic training, military or first responder training. In
another example, the
systems, methods and apparatus described herein can be implemented for
monitoring
adherence to and/or improvement in clinical settings to treat, e.g., nervous
system diseases
including, but not limited to tremor analysis for those suffering from
Parkinson's and the like.
[00204] The conformal sensor devices described herein can be attached to the
body as a
sticker or incorporated into form-fitting apparel including, but not limited
to gloves, shirts,
cuffs, pants, sporting apparel, shoes, socks, under garments, etc.
[00205] The example conformal sensor devices described herein include
stretchable and/or
flexible electronics having ultrathin form factors. These form factors are
thin enough to be
about as thin, or thinner, than a band-aid or even a temporary tattoo.
43
CA 02914494 2015-12-03
WO 2014/197443
PCT/US2014/040633
[00206] The example conformal sensor devices described herein can be
configured for
seamless tightly-coupled sensing that is transparent to the user individual
and does not
change, inhibit body movements or provide any indication that it is being
worn. The close
coupling provides proximate sensing that gives higher fidelity sensing and
data than devices
attached to or hanging from the body. The example conformal sensor devices
described
herein can be configured as ultra-light weight (about lOg or less), ultrathin
(about 2mm or
less), tightly coupled devices providing high capability for measurement and
excellent data.
[00207] As a non-limiting example, the systems, methods and apparatus
described herein
can provide for communication of data and or the results of analysis of data
to computing
devices, including smartphones, tablets, slates, electronic books, laptops, or
other computing
devices, to facilitate external monitoring capabilities. The communication of
data and or the
results of analysis of data can tie the conformal sensor device into a variety
of monitoring,
diagnosis and even therapy delivery systems.
[00208] In an example implementation, throwing data, e.g., in sports, can be
used for
analyzing performance efficiency, monitoring fatigue, preventing injury, and
calculating
other athlete statistics. Example systems methods and apparatus herein can be
worn in the
field (e.g., on-field practice or game environments), and during sports
activity, without
impeding a subject's natural motion.
[00209] The example systems, methods, and apparatus herein facilitate the
monitoring of
both number of throws and throwing mechanics, using conformal electronics that
are thin,
stretchable, flexible, and directly coupled to the skin. In this way, the
athletes' arm is
uninhibited during practices and games, while the seamless conformal sensor
devices
facilitate complete, real-time monitoring of throws.
[00210] The example systems, methods, and apparatus herein provide conformal
sensor
devices having novel form factor (conformal, stretchable, and flexible) that
also facilitate the
collection of numerous throwing metrics using a single device.
[00211] The example conformal sensor devices herein include one or more sensor
components, such as but not limited to triaxial accelerometers and/or
gyroscopes, that can be
implemented to measure the body mechanics during the throwing action and over
a series of
44
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
throwing sessions. The example conformal sensor devices facilitate flexible
placement
methods, and therefore so can be placed on any portion of the body, including
the hand, wrist,
forearm, upper arm, shoulder, or any other applicable body part. In other
examples, the
conformal sensor devices can be placed on any object coupled to or held by a
body part
(including a racket, baseball glove or mitt, or a hockey stick).
[00212] According to the principles described herein, the combination of the
use of the
example conformal sensor electronic devices and selective location on a body
part can yield
data indicative of a number of metrics, including: throw count, throw
mechanics, throw type,
throw efficiency, throw plane, peak arm acceleration, variability, and
degradation over time,
arm velocity, variability over time, power output, muscle activation, ball (or
other object)
velocity, ball (or other object) release time, and ball (or other object)
release point.
[00213] The example conformal sensor devices according to the principles
described
herein are of very low mass/weight, and can be seamlessly worn on various
parts of the body
and individually optimized to collect data indicative of the metrics for each
player.
[00214] In sports, such as but not limited to baseball, football,
basketball, soccer, or
hockey, the performance of the player (including pitchers and quarterbacks) is
an important
parameter to evaluate. These players can be very valuable to a team,
especially if they
perform at an elite level. People, such as but not limited to coaches,
managers, trainers, and
athletes, can be concerned about performance, throw count, throw mechanics,
and injury
prevention. According to the principles described herein, conformal sensor
devices are
provided that can be implemented to provide these metrics, in real-world the
environment,
such as during practices and games.
[00215] As a non-limiting example, fatigue awareness can be important to in
sports with
the increasing prevalence of "Tommy John" surgeries (or ulnar collateral
ligament (UCL)
reconstruction) in the elbow. According to an example system, method and
apparatus herein,
by measuring throw mechanics and count, customized insight can be provided to
quantify a
measure or performance of a player.
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[00216] As a non-limiting example, algorithms and associated methods are
provided to
quantify, e.g., the number of pitches a player may require to warm up, or the
number of
throws before a change in performance is seen over the course of a game or a
season.
[00217] For example, data collected on a subject (such as but not limited to
an athlete) can
be transmitted wirelessly to a smart device or the cloud for visualization and
analysis, using
custom-developed algorithms and associated methods.
[00218] The example systems, methods and apparatus herein can be applied to
subjects
such as but not limited to quarterbacks, baseball pitchers, fast-pitch
softball pitchers,
basketball payers, or hockey players. The subject can be of any age, such as
but not limited
to players of ages about 6 years to about 17 years, including players on elite
teams (from high
school to professional).
[00219] In non-limiting example implementation, an example conformal sensor
device can
be applied to a baseball pitcher prior to a game, e.g., to his or her forearm.
The example
conformal sensor device may either be coupled to the skin using a thin-film
adhesive or be
applied to the athlete's shirt using a fixation method. As well, the example
conformal sensor
device may be integrated onto an accessory garment/apparel, like an arm sleeve
or wrap. As
the pitcher starts to warm up, the coach or trainer can monitor the throws
using a computing
device coupled to the example conformal sensor device, e.g., a tablet or other
smart device.
The example conformal sensor device can be configured to stream data either
continuously,
at regular time intervals, or intermittently, including after each inning or
after each game, to
the computing device for analysis. The coach/trainer may make corrections,
changes, or
recommendations to the pitcher during or after the game to improve performance
or prevent
injury.
[00220] In a non-limiting example implementation, the example conformal sensor
device
can be used to quantify consistency of movement, e.g., of a golf swing,
baseball swing,
basketball free-throw, soccer kick, etc.
[00221] In a non-limiting example implementation, the example conformal sensor
device
can be used for movement tracking, including the acceleration of a body part
(e.g., a leg kick
in swimming, football or soccer, an arm in throwing, etc.)
46
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[00222] In a non-limiting example implementation, the example conformal sensor
device
can be used for movement counting, including repetition counting (of e.g.,
pitches, lifting,
number of punches thrown/landed in a boxing match, or other activity.
[00223] FIG. 13 shows a block diagram of an example system-level architecture
1300 of
an example conformal sensor system according to the principles herein. The
example system
includes a memory 1302, a microcontroller 1304 (including at least one
processing unit), a
communications component 1306 (including an antenna 1308), a power supply 1310
(i.e., a
battery unit), a charge regulator 1312 coupled with an energy harvester 1314,
and a
sensor/transducer component 1316. In a non-limiting example, the
sensor/transducer
component 1316 includes motion sensor platform electronics for performing at
least one of
an accelerometry measurements and a muscle activation measurement. In some
examples,
the example conformal sensor system may include at least one other type of
sensor
component. In the example of FIG. 13, the communications component 1306 can
include
Bluetooth0 communication or other wireless communication protocols and
standards, at least
one low-power micro-controller unit for controlling the recording at least one
of an
accelerometry measurement and a muscle activation measurement, and any other
data
associated with any at least one other physiological parameter measured. In an
example,
there can be a respective micro-controller 1304 for controlling each different
type of sensor
component for performing a measurement.
[00224] FIG. 14 shows non-limiting examples components of an example motion
sensor
platform 1400. In the example of FIG. 14, the motion sensor platform
incorporates an
onboard battery unit 1402 (e.g., supplying about 2.7V), a coupled with a
memory 1404 (e.g.,
a 32 Mbyte flash memory), and a communication component 1406 (e.g., a
BluetoothO/BTLE
communication unit) coupled with an output regulator 1408, and an antenna
1409. The
battery unit 1402 may be coupled to at least one other component 1412, the at
least one other
component 1412 being an energy harvester, a battery charger, and/or a
regulator. The motion
sensor platform may be coupled with a resonator 1414 (such as but not limited
to a 13.56
MHz resonator) and full-wave rectifier 1416. The motion sensor platform 1400
includes an
integrated circuit component 1418 that includes a microcontroller, a
BluetoothO/BTLE stack
on-chip, and firmware including instructions for the implementation of the
conformal sensor
47
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
system. The platform includes a first sensor component 1420 and a second
sensor component
1422. In an example, the first sensor component 1420 can be configured to
include a 3-axis
accelerometer, at least 3 sensitivity settings, and a digital output. In an
example, the second
sensor component 1422 can be configured to include EMG sensing, EMG
electrodes, and a
digital output. The example conformal motion sensor platform can include a low-
power
micro-controller unit for accelerometry and a low-power micro-controller for
electrophysiological recordings. In some examples, the functions of a given
component of
the system, such as but not limited to the accelerometry, EMG, or other
physiological
measuring component, may be divided across one or more microcontrollers. The
lines leading
from the energy harvester/battery charger/regulator to the other components
highlight
modular design where different sensors (such as but not limited to EMG, EEG,
EKG
electrodes) can be used with similar set of microcontrollers, communications,
and/or memory
modules.
[00225] FIG. 15 shows an example schematic drawing of the mechanical layout
and
system-level architecture of an example conformal sensor system configured as
a
rechargeable patch. The example conformal sensor system electronics technology
can be
designed and implemented with various mechanical and electrical layouts for
multifunctional
platforms. The devices including the conformal electronics technology
integrate stretchable
form factors using designs embedded in polymeric layers. These can be
formulated to protect
the circuits from strain and to achieve mechanical flexibility in an ultra-
thin cross-section.
For example, the device can be configured with thicknesses on the order of
about 1 mm on
average. In other examples, the patch can be configured with thinner or
thicker cross-
sectional dimensions. The device architecture can include a reusable module
containing
surface-mount technology (SMT) components, including accelerometer 1502,
wireless
communication 1504, microcontroller 1506, antenna 1508 (such as but not
limited to a
stretchable monopole antenna), and conformal electrode arrays 1510 and 1512
for sensing,
e.g., EMG, EEG and EKG signals, and an electrode connector 1513. T. The
conformal
electrode arrays can be disposable 1510 and 1512. The example device can also
include a
power supply 1514 (such as but not limited to a LiPo Battery of power 2mA-Hr
or 10 mA-
Hr), a regulator 1516, a power transfer coil (such as but not limited to a
0.125 oz Cu coil with
1.5/2 mil trace/space ratio), a voltage controller 1520 and a memory 1522.
48
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[00226] As shown in the example of FIG. 15, the components of the example
conformal
sensor system are configured as device islands interconnected by stretchable
interconnects
1524. The components of the example conformal sensor system may be sensor
components
or other components, including electrodes, electrode connectors, or any other
example
component according to the principles described herein. Stretchable
interconnects 1524 can
be electrically conductive to facilitate electrical communication between the
components, or
electrically non-conductive to assist in maintaining a desired overall form
factor or relative
aspect ratio of the overall conformation of the conformal sensor device during
or after being
subjected to deformation forces, such as but not limited to extension,
compressive and/or
torsional forces. The example of FIG. 15 also shows the differing shapes and
aspect ratios of
the island bases 1526 that the components of the example conformal sensor
system can be
disposed on, or otherwise coupled to, to provide the device islands.
[00227] FIG. 16A shows an example implementation of a conformal sensor system
formed
as a conformal patch with sub-components. The example conformal sensor system
includes
disposable electrodes 1602, a re-usable connector 1604, and a rechargeable
conformal sensor
unit 1606 formed as a conformal patch. The example rechargeable conformal
sensor unit can
be configured to include at least one other component 1608 such as but not
limited to a
battery, a microprocessor, a memory, wireless communication, and/or passive
circuitry. As a
non-limiting example, the average thickness of the reusable patch can be about
1 mm thick
and the lateral dimensions can be about 2 cm by about 10 cm. In other
examples, the patch
can be configured to have other dimensions, form factors, and/or aspect ratios
(e.g., thinner,
thicker, wider, narrower, or many other variations).
[00228] FIG. 16B shows another example implementation of a conformal sensor
system
formed as a conformal sensor patch with sub-components. The example conformal
sensor
system includes example EMG electrodes 1642 disposed on an ultrathin sticker
1644 and
example conformal sensor system disposed on a skin adhesive 1646. The example
EMG
electrodes are coupled to the example conformal sensor system via an electrode
connector
1648. The example rechargeable conformal sensor unit can be configured to
include at least
one of a battery, a microprocessor, a memory, wireless communication, and
passive circuitry.
In this example, the average thickness of the reusable patch can be about 1 mm
thick and the
49
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
dimensions can be about 2 cm by about 10 cm. In other examples, the patch can
be
configured to have other dimensions, form factors, and/or aspect ratios (e.g.,
thinner, thicker,
wider, narrower, or many other variations).
[00229] FIG. 16C shows an example implementation of a conformal sensor system
1662
that is disposed on a body part or other object. In this example, the body
part is a forearm.
The conformal sensor system 1662 can include at least one accelerometry
component and any
other sensor component described herein. As described in greater detail below,
the
conformal sensor patch can be used to provide continuous feedback on muscle
activity, body
part motion (based on acceleration and/or force applied measurement), and/or
electrophysiological measurements.
[00230] FIG. 17A shows examples of placement of the example conformal sensor
systems.
As shown in the example of FIG. 17A, the conformal sensor systems can be
placed at various
locations on the body. In various example implementations, the conformal
sensor systems
can be placed at various locations on the body to measure the signal to noise
ratio associated
with each sensor/location combination. The results of analysis of the data
obtained from the
measurements at each placement position can be used to determine an optimal
location for
obtaining a desirable signal to noise ratio.
[00231] FIG. 17B shows example images of a human torso and neck showing
different
anatomical locations where the example conformal sensor system 1702 can be
disposed for
measurements. In other examples, the example conformal sensor systems can be
disposed
proximate to the muscles of the arms.
[00232] The example conformal electronics technology herein can be designed
and
implemented with various mechanical and electrical layouts for multifunctional
platforms.
The example devices including the conformal electronics technology can be
integrated with
various stretchable form factors using designs embedded in polymeric layers.
These can be
formulated to protect the circuits from strain and to achieve mechanical
flexibility with ultra-
thin profiles, such as but not limited to thicknesses of about 1 mm on
average. In other
examples, the patch can be configured with thinner or thicker cross-sectional
dimensions.
The example device architecture can include a reusable module containing
surface-mount
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
technology (SMT) components, including accelerometer, wireless communication,
microcontroller, antenna, coupled with disposable conformal electrode arrays
for sensing
EMG or other electrical measurements (such as but not limited to NCS,
electroencephalogram (EEG) and electrocardiogram (EKG) signals).
[00233] Processor-executable instructions development (including software,
algorithms,
firmware) can be configured to be specific for each platform using predicate
algorithms as the
basis of the signal processing. Filters and sampling rates can be tuned and
tested on rigid
evaluation boards and then implemented with flexible designs. The example
conformal
sensor systems and conformal electrodes according to the principles described
herein can be
used, based on implementation of the processor-executable instructions, for
monitoring, e.g.,
body motion and/or muscle activity at various locations on the body, and/or
analysis of data
indicative of measurements from the monitoring
[00234] Non-limiting examples of sensor component measurements that can be
made
according to the principles described herein are as follows.
1. Precision and reproducibility of sensor measurement output can be
determined
based on;
a. Body motion ¨ X, Y, Z axis acceleration waveform in G's
b. Muscle motion ¨ muscle motion ON/OFF and ON-to-ON time
2. Optimal placement for each sensor can be determined for maximum signal
detection.
3. Optimal co-
location placement for two or more of the sensors can be
determined in a similar manner.
The example conformal sensor systems and conformal electrodes according to the
principles
described herein can be used to measure body motion and/or muscle activity,
heart rate,
electrical activity, temperature, hydration level, neural activity,
conductance, and/or pressure,
with acceptable precision. Acceptable precision can be defined as
operationalized as a high
correlation (such as but not limited to r? 0.8) of these sensors with standard
reference
measurements of:
Accelerometry Such as but
not limited to Shimmer30 base
module (http://www.shimmersensing.com/)
51
CA 02914494 2015-12-03
WO 2014/197443
PCT/US2014/040633
or similar or an external image-based body
monitoring
Electromyogram Grass P511AC
Amplifier (Grass Technologies, West
Warwick, RI, USA)', or similar
Electrocardiogram MAC 3500 12 Lead ECG Analysis System
(GE Healthcare,
AZ, USA)1, or similar
(1) An optimal placement on the body for each conformal sensor system can be
determined to yield high-quality, precise and reliable measurement.
(2) There can be at least one placement on the body in which the example
conformal sensor systems and conformal electrodes can be placed to yield
precise and
reliable measurements.
Non-limiting examples of types of measurements that can be made are as
follows.
= Standard reference measurements can be taken while conformal sensor
system
is mounted on a portion of a subject. Each condition can be repeated to
generate
reproducibility data.
= Body and Muscle Motion:
o Subjects can be measured on standard references (3 axis
accelerometer
and/or EMG) while wearing the example conformal sensor system. The
example conformal sensor system can be placed in selected body placement
locations, including; inside wrist, calf, front left shoulder, rear left
shoulder,
left neck below the ear and forehead (e.g., as shown in FIGs. 17A ¨ 17B).
Subjects can be measured for a period of time while performing a sequence of
activities/movements, e.g., sit down, walk, hand movements, athletic activity,
physical therapy movements, or any other movement described below.
= All example conformal sensor system and reference measurements can be
analyzed to provide information indicative of the desired performance of the
individual, including the physical condition of the subject, the efficacy of a
treatment
1
Burns et al. Cord ?roc IEEE Eng Med Biel Soc. 20102010:3759.-62. doi:
10.110911EMBS.2010.5627535. SHIMMER: an extensible
ph/if:ire for playsielegit..%al signal capture.
52
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
or therapy being performed on the subject, the subject's readiness for
physical activity
or exertion, or proper physical condition for a sport or other exercise.
[00235] Example system, methods and apparatus are provided herein can be used
to
estimate the sensitivity, specificity and positive and negative predictive
values of algorithm
from the conformal sensor systems to predict, for example but not limited to
selected metrics
of the efficacy of a treatment or therapy being performed on the subject. The
feasibility or
acceptability of subjects wearing the conformal sensor systems can be
monitored. Subjects
can be monitored while wearing the conformal sensor systems disposed on a body
part or
other object for a period of time (e.g., time on the order of minutes, an
hour, or a number of
hours, while at rest or while carrying out a series of motions, activities
and/or tasks
[00236] FIGs. 18 and 19 shows different examples of the communication protocol
that can
be applied to an example conformal sensor system 1802 described herein. In the
example of
FIG. 18, a signal from the example conformal sensor system 1802 can be
transmitted to an
external memory or other storage device, a network, and/or an off-board
computing device.
The signal can include an amount of data indicative of one or more
measurements performed
by the example conformal sensor system and/or analysis results from an
analysis of the data.
In the example of FIG. 18, the example conformal sensor system is configured
to use, e.g., a
Bluetooth0 low energy (BLTE) communications link 1804 for on-body or on-object
transmission to a BluetoothO/BLTE- enabled device 1806. In an example
implementation,
small amounts of data to be transferred at low data rates, including current
peak
accelerometry measure (e.g., g value) with timestamp (or other metadata)
and/or EMG
activity (either turned ON or OFF) with timestamp (or other metadata). Non-
limiting
examples of the other metatada includes location (e.g., using GPS), ambient
air temperature,
wind speed, or other environmental or weather condition. In another example
accelerometer
data can be used to determine values of energy over time. In other examples,
data
representative of physiological parameters or other measures can be
transferred with
timestamp or other metadata. FIG. 19 shows an example implementation where the
signal is
transmitted with the example conformal sensor system 1902 couples to a
charging platform
1904 at a designated location1905. The example conformal sensor system 1902
includes a
power transfer coil 1906 to facilitate a charging with a charging coil and
field 1908.
Bluetooth0 low energy (BLTE) communications link 1910 for on-body or on-object
53
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
transmission to a BluetoothO/BLTE- enabled device 1912. The signal can be
transmitted to
an external memory or other storage device, a network, and/or an off-board
computing
device. In the example of FIG. 19, the example conformal sensor system 1902 is
configured
to use, e.g., Bluetooth0 enhanced data rate (BT EDR) transmissions, at much
higher data
rates than BTLE, to transmit the data signal. For example, the data signal can
include raw
accelerometery data (X, Y, Z) with timestamp and/or EMG filtered waveform with
timestamp. In an example, the conformal sensor system can be maintain disposed
on or
otherwise coupled to a charging platform while performing the BT EDR
transmissions, based
on the high power requirements.
[00237] FIG. 20 shows an example of use of the example conformal sensor
systems for
quantifying a measure of performance as a muscle activity tracker. Muscle
activity and
motion as an indicator of activity level. The example conformal sensor system
can be placed
on working muscles of a subject. In this non-limiting example, the conformal
sensor system
2002 can be disposed on a portion of the thigh as shown in FIG. 20, or on any
other body part
whose performance is to be quantified. Measurements of the example conformal
sensor
system can be used to indicate activity level and effort of the subject. As
shown in FIG. 20,
the example conformal sensor system can be disposed on a subject's body part
involved in
the motion (such as but not limited to a runner's quadriceps). The example
conformal sensor
system can be coupled to a display to show output graphs showing, e.g., a
runner's pace or
gait (through accelerometer measurements) and quadricep activity (through EMG
measurements). In this example, data indicative of the accelerometer and the
EMG
measurements may be used to indicate the athlete's activity level through an
accurate
estimator of distance walked/ran, amount of effort made. Analysis of the data
can be used in
sports to track athletes' activity levels on and off the field/courts, and
also on medical
circumstances where the patient's activity level is determined as a monitor,
e.g., of recovery
from heart surgery, diabetes patients, patients in need of losing weigh, etc.
In another
example analysis, a combination of the data indicative of the accelerometer
and the EMG
measurements can be used to provide information for an effort chart, where the
runner can
view calculated effort over a single run or multiple runs. This can be used to
evaluate and
improve performance over time. In some examples, two or more such conformal
sensor
systems can be mounted on or otherwise coupled to portions of the body or
other object to
54
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
provide measurements that can be analyzed to determine body/object kinematics
and
dynamics.
[00238] FIG. 21 shows an example of use of the example conformal sensor
systems for
quantifying a measure of performance as a strength training program tracker
and/or a
personal coach. The example conformal sensor can be disposed on or otherwise
coupled to
any body part being monitored. In this non-limiting example, the conformal
sensor system
can be disposed on a portion of the thigh 2102, a torso 2104, or an upper arm
2106, as shown
in FIG. 21, or on any other body part whose performance is to be quantified.
The measures
of muscle activity can be used as means to provide baseline activation levels
of the subject's
strength, e.g., through measures of magnitude of motion. A measurement using
an EMG
component can be used for detection of different muscle activities. For
example, in an
example implementation, it is possible to detect differences in the amount of
effort being put
on a muscle and/or muscle group when a subject is performing a similar
muscular activity,
e.g., pulling weight, or running on a treadmill).
[00239] FIG. 21 shows five non-limiting example application screens (on
example
displays) for various phases of an example strength training, to show the
various examples of
performance measures (set performance, work summary, and track performance
over time)
that can be quantified according to the principles described herein. The
example application
screens can be used by, e.g., athlete or trainer to track quantity of weight,
repetitions, and sets
against performance. The display of the example application screens, based on
analysis of
measures of the example conformal sensor system, can replace paper charts
typically kept for
strength training program tracking.
[00240] In FIG. 21, the example step 1 shows an example of a display coupled
to the
example conformal sensor system for user selection from a selection of icons,
the muscle and
exercise associated with the conformal sensor placement on the subject's body.
In example
step 2, a graphic representation on the display can be used to provide
feedback of body part
alignment during exercise or other activity, e.g., in real-time or at
different or regular time
intervals, or at the subject's demand. On the example graph, a value of "0" is
used as an
indicator of perfect alignment or alignment within a specified range from
perfect alignment.
The subject shifts out of axis alignment to the left or to the right, can be
indicated on the
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
display by the straightness of a line. The example in FIG. 21 also shows on
the display the
subject's bias to the right, and out of alignment, at the peak of the exercise
by over 20%. In
this example, the user can take the feedback and adjust exercise form and
weight based on
inspection of the display or from recommendations displayed on the display. In
the example
of step 3, the subject is shown on the display a view of his/her weight lift
set performance
over a series of repetitions. This example shows analysis results indicating
improved
alignment with reduced weight, where the user improves his/her performance
during sets
with lower weights. In the example of step 4, the display can be configured to
show a
graphic of a summary view of the subject's repetitions and sets. This example
shows a
summary information indicative of quantity of repetitions, type of weight
used, number of
sets, and alignment factor for each repetition. As a non-limiting example, the
alignment can
be quantified as a percentage based. For example, a value of less than about
10% from
perfect alignment may be categorized as "GOOD", a value of greater than about
10% from
perfect alignment may be categorized as "FAIR", and a value of greater than
about 20% from
perfect alignment may be categorized as "POOR".
[00241] In the example of step 5, the display can be configured to show a view
of subject's
performance over time by percentage. The analysis (including calculations) can
be based on
data indicative of alignment, quality of movement, weight based on percentile
norms for age,
height, weight. An algorithm and associated method can be developed using
accelerometer
and EMG data in addition to values indicative of norms (such as but not
limited to example
published norms).
[00242] FIG. 22 shows an example of use of the example conformal sensor
systems for
quantifying a measure of performance for strength training feedback. In this
non-limiting
example, the conformal sensor system can be disposed on a portion of an upper
arm, a lower
arm, and/or a shoulder. In this example, a display is configured to provide
user interface
screens shown within a software application for motion and/or muscle activity.
The system
can be configured to provide indications of results to a user. For example,
the user may be
displayed a green screen when the performance measure indicates that the
muscle activity
and/or motion are ideal. The system can be configured to change a screen to
red and/or sends
an auditory feedback to the user, where the performance measure quantfied
based on the
56
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
conformal sensor measurements indicates incorrect user motion and/or muscle
activity is
detected.
[00243] FIGs. 23A, 23B and 23C show an example of use of the example conformal
sensor systems for quantifying a measure of performance for user feedback. The
feedback
can be provided in real-time, at different time intervals, and/or at user
demand. In FIG. 23A,
the system is configured to provide an audible feedback to the user through
smart device in
recommendations, tips, motivational statements, as well as tones, music,
and/or beeps. In this
non-limiting example, the conformal sensor system 2302 can be disposed on a
portion of an
upper arm, or any other body part. In FIG. 23B, the system is configured to
provide haptic
feedback (including vibrations and/or pulses) to the user, felt in the area of
the body coupled
to the conformal sensor system, and/or on a computing device. One or more
miniature
actuators can be incorporated into the sensor electronics to provide the
haptic feedback. In
FIG. 23C, the system is configured to provide visual feedback, such as
displayed on
conformal sensor system or on a computing device. Non-limiting examples of
visual
feedback include blinking LEDs, sequence array of LEDs, and/or colored LEDs.
The
example LEDs can be incorporated into conformal sensor electronics.
[00244] Table I lists various non-limiting example of the differing types of
performance
that can be quantified based on at least one measurement of a sensor component
of a
conformal sensor device according to the principles described herein. In the
different
example implementations, the sensor component can include at least one of an
accelerometer
and an EMG component.
TABLE I
Example Description of Example Implementation To Acceler EMG
Performance Determine Example Performance ometer
Pattern Corrective movement patterns via pattern matching x
Matching with desired motion patterns
57
CA 02914494 2015-12-03
WO 2014/197443
PCT/US2014/040633
Baseline Muscle activity and motion as means to baseline x x
Symmetry symmetry (diagnosis of possible need to balance
flexor/extensor symmetry ¨ prevention of
musculoskeletal injuries caused by imbalances).
Muscles fired during a motion (e.g. walking) are
utilized in different ways depending on the stage of
the walking. Flexor muscles and extensor muscles
perform at their best when there is balance in the
range and exert of muscle activity. An unbalanced
flexor/extensor ratio may result in stress being put on
tendons and ligaments, and may result in injuries ¨
this unbalanced muscle activity ratio can be detected
by the sensors and corrected through stretch, and
strengthening exercises.
Muscle Muscle activity and motion as an indicator of activity x x
activity level. Patient's activity level (e.g., patients in need of
tracking losing weight, etc.)
Sleep Muscle activity and motion as an indicator of quality x x
tracking of sleep. Motion may detect respiratory rhythms,
amount of movement in bed and how many times the
person wakes up/stands up to go to the bathroom, or
get water. Muscle activity may indicate relaxation
level and indicate bruxism. Delayed feedback may be
used to assist individuals to implement new sleeping
habits to maximize rest and recovery. Other example
measures can be used for analysis, including skin
conductivity and respiratory rate sensing
Fatigue Muscle activity evolution through the length of X
indicator physical exerts ¨ detection of desired zones of
performance and zones indicating risk of muscular
injuries and of ligament/tendon injuries. Indicators
of decrease in the quality of muscle response are
indicators of higher risk for injuries, especially in the
joints, due to stress put on the ligaments and tendons
due to lack of quality on the muscle activity.
Differences in EMG frequency and amplitude are
indicators of muscle conditions throughout a period
of time ¨ it's possible to determine fatigue levels and
exhaustion. This is a very powerful indicator for
possible causes of injuries ¨ and may assist on injury
prevention.
58
CA 02914494 2015-12-03
WO 2014/197443
PCT/US2014/040633
Dynamic Measure of muscle tension during dynamic stretching x x
stretching ¨ regulation of beneficial levels of stretching ¨
optimizing injury prevention or reduction. Dynamic
stretching utilizes momentum as the main benefit for
the implementation of stretch ¨ many times dynamic
stretching is mistaken for warming-up. The EMG
sensors and accelerometers data can be combined to
provide data indicating differences between warm-
ups and dynamic stretching. Moreover, the system
may detect desired ranges and motion patterns for
each athlete based on muscle response and activity ¨
maximizing the quality of stretching, and minimizing
injuries.
Pattern Reproducibility of an individual's form/movement or x
Matching compare with desired motion pattern
Individual
Pattern Confirming user movement patterns with those of x
Matching professionals (such as but not limited to swing in
Professional golf/putting, face-off in hockey, swing and pitch in
baseball, punt in football, corner kicks in soccer,
etc.). This example allows a user to compare his/her
movement or performance with, e.g., an athlete or
other famous person, with user/athlete/person
consent. The comparison can be performed based on
captured movement patterns of the specified athlete
or other famous person.
Balance/ Movement/strength comparison between opposite x x
Symmetry limbs and muscle groups
Movement Motion as means to baseline accelerations and overall x x
magnitude gait/movement (magnitude). Crossing data from
EMG and accelerometers it is possible to determine
movement acceleration and gait to determine desired
zones of performance for specific sport moves,
desired ranges of motion
Strength Muscle activity as means to baseline activation levels x
training of strength (magnitude). EMG sensors detect
different muscle activity ¨ it is possible to detect
differences in the amount of effort being put on a
muscle/muscle group when performing a similar
muscular activity (e.g. pulling weight, or running on
a treadmill).
59
CA 02914494 2015-12-03
WO 2014/197443
PCT/US2014/040633
Grip intensity Muscle activity level measurement for desired grip x
intensity. Assessment of amount of muscle activity
in the forearm indicating grip pressure ¨ data is
compared to motion patterns. Reaction time testing.
This data is beneficial for monitoring performance in
sports utilizing racquets, bats, clubs. In an example,
the feedback can be provided in real time, on user
demand, or at different time intervals, for adjustments
to be made. Such tool may assist on putting
consistency, quality and speed of a golf swing, and
the ability to perform small adjustments on the bat
trajectory in baseball, among other uses. The activity
can be performed using equipment such as but not
limited to, golf club, baseball bat, tennis racquet,
basket ball, etc
Muscle Muscle activity / quality of muscle activation ¨ x
performance improvement of muscle readiness for faster muscular
response time. It's possible to assess the quality of
muscular activity and to find desired levels of
performance for faster muscle response and reaction
times. This may assist athletes to determine
beneficial stretching and warm up exercises, or even
self-regulatory techniques prior to specific sport tasks
(like pitching, face-offs, defending as a goalie...).
The system may provide feedback to athletes when
they need to adjust muscle conditions to improve
performance.
Muscle Muscle activity and motion as an indicator of activity x x
activity level. Accelerometer and EMG may be used to
tracking indicate the athlete's activity level (accurate
estimator of distance walked/ran, amount of effort
made...) this can be used in sports to track athletes'
activity levels on and off the field/courts, and also on
medical circumstances where it is beneficial to
determine the patient's activity level (e.g. recovery
from heart surgery, diabetes patients, patients in need
of losing weight...)
CA 02914494 2015-12-03
WO 2014/197443
PCT/US2014/040633
Kinetic liffl( Detection of
kinetic liffl( - the order in which muscles x x
or muscle groups are being fired ¨ assisting on
desired patterns to improve movement speed and
accuracy. Accelerometer and two or more EMG
sensors can be used to detect the order in which
muscles are being fired and provide feedback on
differences between desired patterns and the pattern
being performed by the athlete. In quick motions
(like a golf swing or a pitch) the feedback is provided
with a minimum delay, in order to assist the athlete to
analyze and make adjustments in the next movement
they are performing ¨ feedback can be on time for
motions that allow so (like golf putting, or a draw,
anchoring and release in competitive archery).
Pattern relearning movement patterns for people who have x
Matching undergone surgeries and amputations
Readiness to Muscle activity and motion as an indicator of x x
return to play readiness for return to work, play or other post injury.
Possible to baseline user motion (activation,
acceleration and range) and muscle activity to utilize
as a point of comparison throughout rehabilitation. A
baseline measure can be used. Patients who are
recovering from an injury/surgery are assessed for the
quality of the movement they are able to perform at
different stages of their recovery ¨ desired patterns
for each stage are displayed and the patient tries to
conform to the desired pattern. Moreover, the quality
of the muscle activation is analyzed to determine if
the movement being performed has balance of
efforts, and is within a healthy range, preventing
future injuries and accelerating recovery.
Movement Motion as means to baseline accelerations and overall x x
magnitude gait (magnitude). Crossing data from EMG and
accelerometers it is possible to determine movement
acceleration and gait ¨ it is possible to determine
desired ranges of motion during recovery after
surgeries/injuries.
Muscle Muscle activity and motion as an indicator of activity x x
activity level. Patient's activity level (e.g. recovery from
tracking heart surgery, diabetes patients)
61
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
Symmetry Athlete has a strained right calf; applies patches to x x
right and left calves, baselines abnormal right calf
performance against left (relative measure); Put on a
motion patch on leg during rehab activity to see how
the muscle and movement activity using both a
baseline sensor on one leg and on the other. Look for
relative improvements. The quantitative measure is
used to determine how close the injured and healthy
legs are in performance and motion. Dimension of
the metric does not matter, just relative improvement
or change.
The non-limiting example implementations of Table I can be implemented using
any of the
systems, apparatus and methods described herein.
[00245] FIGs. 24A and 24B show an example of use of the example conformal
sensor
systems for a performance measure that determines a user's readiness to return
to normal
activity (such as work or playing sports). For example, the measures of the
muscle activity
and motion can be analyzed to provide an indicator of readiness for return to
work, play or
other post injury. In an example, it is possible to determine a baseline for
the user motion
(e.g., from measures of activation, acceleration, and/or activity range) and
muscle activity, to
utilize as a point of comparison throughout rehabilitation. In this non-
limiting example, the
conformal sensor system can be disposed on a portion of an upper arm. The
example of FIG.
24A shows an example display of an assessment of the subject's muscle activity
post injury.
The display can be provided in real-time, on demand, or at different time
intervals. The
quality of movement can be assessed as a percentage of a desired (ideal) value
(e.g., set at
100%). The display can be configured to display color-coded images of certain
muscle
groups visualizing the ratio between extensor and flexor muscles. In the
example of FIG.
24A, the subject's movement can be analyzed to determine if the movement being
performed
has balance of efforts, and is within a healthy range. Such analysis can be
used to reduce or
prevent future injuries and accelerate recovery. FIG. 24B shows an example
display of a
series of four repetitions, where analysis of the measurements indicate
declining
performance. The indication of declining performance can be used to indicate
lack of
endurance. For example, the display of provides an indication that, after a
number of
repetitions, the extensor muscle is compensating, thereby indicating declining
performance.
62
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
[00246] FIG. 25 shows an example of use of the example conformal sensor
systems for
use for performance measure that operates for sleep tracking. In this example,
the
measurements of muscle activity and/or motion can be used to provide an
indicator of quality
of sleep. Example conformal sensor system 2502 can be disposed on or otherwise
coupled to
the thoracic diaphragm, to measure respiratory rhythms and movement. In an
example,
analysis of the muscle activity can be used as an indicator of a subject's
relaxation level and
bruxism. Analysis of data from measurements using the accelerometer and EMG
can be
combined to provide an indication of the user's quality of sleep, including in
a feedback, to
assist a user in implementing new sleeping habits to maximize rest and
recovery.
[00247] In an example implementation, the conformal sensor system can be
configured to
maintain a low-power status at a time that no measurement is being performed.
In an
example, the conformal sensor system can be configured with a low-power on-
board energy
supplying component (e.g., a low-power battery). In an example, the conformal
sensor
system can be configured with no on-board energy component, and energy may be
acquired
through inductive coupling or other form of energy harvesting. In these
example
implementations, the sensor component(s) may be maintained substantially
dormant, in a
low-power state, or in an OFF state, until a triggering event occurs. For
example, the
triggering event can be that the body part or object, to which the system is
coupled of
disposed on, undergoes motion (or where applicable, muscle activity) above a
specified
threshold range of values or degree. Examples of such motion could be movement
of an arm
or other body part, such as but not limited to a bicep or quadriceps movement
during physical
exertion, a fall (e.g., for a geriatric patient), or a body tremor, e.g., due
to an epileptic
incident, a Palsy, or Parkinson's. Other examples of such motion could be
movement of the
object, e.g., a golf club swing, movement of a ball, etc. In another example,
the conformal
sensor system may include a near-field component (NFC), and the triggering
event may be
registered using the NFC component. In other examples, the triggering event
may be a sound
or other vibration, a change in light level (e.g., a LED) or a magnetic field,
temperature (e.g.,
change in external heat level or blood rushing to an area), or an EEG, a
chemical or a
physiological measure (e.g., environment pollen or pollution level, or blood
glucose level).
In an example, the triggering event may be initiated at regular time
intervals. The system can
be configured such that occurrence of the triggering event causes triggering
of the micro-
63
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
controller; the micro-controller then be configured to cause activation of the
accelerometer
and/or the EMG component, or other sensor component, of the conformal sensor
system to
take a measurement.
[00248] In an example implementation, the conformal sensor system may include
one or
more components for administering or delivering an emollient, a pharmaceutical
drug or
other drug, a biologic material, or other therapeutic material. In an example,
the components
for administering or delivery may include a nanoparticle, a nanotube, or a
microscale
component. In an example, the emollient, pharmaceutical drug or other drug,
biologic
material, or other therapeutic material may be included as a coating on a
portion of the
conformal sensor system that is proximate to the body part. On occurrence of a
triggering
event (such as any triggering event described hereinabove), the conformal
sensor system can
be configured to trigger the delivery or administering of the emollient, drug,
biologic
material, or other therapeutic material. The occurrence of the triggering
event can be a
measurement of the accelerometer and/or the EMG or other sensor component. On
the
triggering event, the micro-controller can be configured to cause activation
of the one or
more components for the administering or delivery. The delivery or
administering may be
transdermally. In some examples, the amount of material delivered or
administered may be
calibrated, correlated or otherwise modified based on the magnitude of the
triggering event,
e.g., where triggering event is based on magnitude of muscle movement, a fall,
or other
quantifiable triggering event. In some examples, the system can be configured
to heat a
portion of the body part, e.g., by passing a current through a resistive
element, a metal, or
other element, that is proximate to the portion of the body part. Such heating
may assist in
more expedient deliver or administering of the emollient, drug, biologic
material, or other
therapeutic material to the body part, e.g., transdermally.
[00249] In an example implementation, the conformal sensor system may include
one or
more components for administering or delivering insulin, insulin-based or
synthetic insulin-
related material. In an example, the insulin, insulin-based or synthetic
insulin-related
material may be included as a coating on a portion of the conformal sensor
system that is
proximate to the body part. On occurrence of a triggering event (such as any
triggering event
described hereinabove), the conformal sensor system can be configured to
trigger the delivery
64
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
or administering of the insulin, insulin-based or synthetic insulin-related
material. The
occurrence of the triggering event can be a measurement of the accelerometer
and/or the
EMG or other sensor component. On the triggering event, the micro-controller
can be
configured to cause activation of the one or more components for the
administering or
delivery of the insulin, insulin-based or synthetic insulin-related material.
The delivery or
administering may be transdermally. the amount of material delivered or
administered may
be calibrated, correlated or otherwise modified based on the magnitude of the
triggering
event, (e.g., blood glucose level).
[00250] Examples of the subject matter and the operations described herein can
be
implemented in digital electronic circuitry, or in computer software,
firmware, or hardware,
including the structures disclosed in this specification and their structural
equivalents, or in
combinations of one or more of them. Examples of the subject matter described
herein can
be implemented as one or more computer programs, i.e., one or more modules of
computer
program instructions, encoded on computer storage medium for execution by, or
to control
the operation of, data processing apparatus. The program instructions can be
encoded on an
artificially generated propagated signal, e.g., a machine-generated
electrical, optical, or
electromagnetic signal, that is generated to encode information for
transmission to suitable
receiver apparatus for execution by a data processing apparatus. A computer
storage medium
can be, or be included in, a computer-readable storage device, a computer-
readable storage
substrate, a random or serial access memory array or device, or a combination
of one or more
of them. Moreover, while a computer storage medium is not a propagated signal,
a computer
storage medium can be a source or destination of computer program instructions
encoded in
an artificially generated propagated signal. The computer storage medium can
also be, or be
included in, one or more separate physical components or media (e.g., multiple
CDs, disks, or
other storage devices).
[00251] The operations described in this specification can be implemented as
operations
performed by a data processing apparatus on data stored on one or more
computer-readable
storage devices or received from other sources.
[00252] The term "data processing apparatus" or "computing device" encompasses
all
kinds of apparatus, devices, and machines for processing data, including by
way of example a
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
programmable processor, a computer, a system on a chip, or multiple ones, or
combinations,
of the foregoing. The apparatus can include special purpose logic circuitry,
e.g., an FPGA
(field programmable gate array) or an ASIC (application specific integrated
circuit). The
apparatus can also include, in addition to hardware, code that creates an
execution
environment for the computer program in question, e.g., code that constitutes
processor
firmware, a protocol stack, a database management system, an operating system,
a cross-
platform runtime environment, a virtual machine, or a combination of one or
more of them.
[00253] A computer program (also known as a program, software, software
application,
script, application or code) can be written in any form of programming
language, including
compiled or interpreted languages, declarative or procedural languages, and it
can be
deployed in any form, including as a stand alone program or as a module,
component,
subroutine, object, or other unit suitable for use in a computing environment.
A computer
program may, but need not, correspond to a file in a file system. A program
can be stored in a
portion of a file that holds other programs or data (e.g., one or more scripts
stored in a
markup language document), in a single file dedicated to the program in
question, or in
multiple coordinated files (e.g., files that store one or more modules, sub
programs, or
portions of code). A computer program can be deployed to be executed on one
computer or
on multiple computers that are located at one site or distributed across
multiple sites and
interconnected by a communication network.
[00254] The processes and logic flows described in this specification can be
performed by
one or more programmable processors executing one or more computer programs to
perform
actions by operating on input data and generating output. The processes and
logic flows can
also be performed by, and apparatuses can also be implemented as, special
purpose logic
circuitry, e.g., an FPGA (field programmable gate array) or an ASIC
(application specific
integrated circuit).
[00255] Processors suitable for the execution of a computer program include,
by way of
example, both general and special purpose microprocessors, and any one or more
processors
of any kind of digital computer. Generally, a processor receives instructions
and data from a
read only memory or a random access memory or both. The essential elements of
a computer
are a processor for performing actions in accordance with instructions and one
or more
66
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
memory devices for storing instructions and data. Generally, a computer can
include, or be
operatively coupled to receive data from or transfer data to, or both, one or
more mass storage
devices for storing data, e.g., magnetic, magneto optical disks, or optical
disks. However, a
computer need not have such devices. Moreover, a computer can be embedded in
another
device, e.g., a mobile telephone, a personal digital assistant (PDA), a mobile
audio or video
player, a game console, a Global Positioning System (GPS) receiver, or a
portable storage
device (e.g., a universal serial bus (USB) flash drive), for example. Devices
suitable for
storing computer program instructions and data include all forms of non
volatile memory,
media and memory devices, including by way of example semiconductor memory
devices,
e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal
hard disks
or removable disks; magneto optical disks; and CD ROM and DVD-ROM disks. The
processor and the memory can be supplemented by, or incorporated in, special
purpose logic
circuitry.
[00256] To provide for interaction with a user, examples of the subject matter
described
herein can be implemented on a computer having a display device, e.g., a CRT
(cathode ray
tube), plasma, or LCD (liquid crystal display) monitor, for displaying
information to the user
and a keyboard and a pointing device, e.g., a mouse, touch screen or a
trackball, by which the
user can provide input to the computer. Other kinds of devices can be used to
provide for
interaction with a user as well; for example, feedback provided to the user
can be any form of
sensory feedback, e.g., visual feedback, auditory feedback, or tactile
feedback; and input
from the user can be received in any form, including acoustic, speech, or
tactile input. In
addition, a computer can interact with a user by sending documents to and
receiving
documents from a device that is used by the user; for example, by sending web
pages to a
web browser on a user's client device in response to requests received from
the web browser.
[00257] Examples of the subject matter described herein can be implemented in
a
computing system that includes a back end component, e.g., as a data server,
or that includes
a middleware component, e.g., an application server, or that includes a front
end component,
e.g., a client computer having a graphical user interface or a Web browser
through which a
user can interact with an implementation of the subject matter described in
this specification,
or any combination of one or more such back end, middleware, or front end
components. The
67
CA 02914494 2015-12-03
WO 2014/197443 PCT/US2014/040633
components of the system can be interconnected by any form or medium of
digital data
communication, e.g., a communication network. Examples of communication
networks
include a local area network ("LAN") and a wide area network ("WAN"), an inter-
network
(e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer
networks).
[00258] The computing system such as system 400 or system 100 can include
clients and
servers. A client and server are generally remote from each other and
typically interact
through a communication network. The relationship of client and server arises
by virtue of
computer programs running on the respective computers and having a client-
server
relationship to each other. In some examples, a server transmits data to a
client device (e.g.,
for purposes of displaying data to and receiving user input from a user
interacting with the
client device). Data generated at the client device (e.g., a result of the
user interaction) can be
received from the client device at the server.
[00259] While this specification contains many specific implementation
details, these
should not be construed as limitations on the scope of any inventions or of
what may be
claimed, but rather as descriptions of features specific to particular
embodiments of the
systems and methods described herein. Certain features that are described in
this specification
in the context of separate embodiments can also be implemented in combination
in a single
embodiment. Conversely, various features that are described in the context of
a single
embodiment can also be implemented in multiple embodiments separately or in
any suitable
subcombination. Moreover, although features may be described above as acting
in certain
combinations and even initially claimed as such, one or more features from a
claimed
combination can in some cases be excised from the combination, and the claimed
combination may be directed to a subcombination or variation of a
subcombination.
[00260] Similarly, while operations are depicted in the drawings in a
particular order, this
should not be understood as requiring that such operations be performed in the
particular
order shown or in sequential order, or that all illustrated operations be
performed, to achieve
desirable results. In some cases, the actions recited in the claims can be
performed in a
different order and still achieve desirable results. In addition, the
processes depicted in the
accompanying figures do not necessarily require the particular order shown, or
sequential
order, to achieve desirable results.
68
CA 02914494 2015-12-03
WO 2014/197443
PCT/US2014/040633
[00261] In certain circumstances, multitasking and parallel processing may be
advantageous. Moreover, the separation of various system components in the
embodiments
described above should not be understood as requiring such separation in all
embodiments,
and it should be understood that the described program components and systems
can
generally be integrated together in a single software product or packaged into
multiple
software products.
69
