Note: Descriptions are shown in the official language in which they were submitted.
HOCKEY PRACTICE SYSTEM
FIELD
[0001] The present invention relates generally to sports training, and
more
particularly to a hockey practice system.
BACKGROUND
[0002] Playing hockey, whether ice hockey or field hockey, offers a range
of
physical and social benefits. Hockey is a high-intensity sport that involves
constant movement, which contributes to cardiovascular fitness. The fast-paced
nature of the game helps to improve heart health and endurance. In addition to
the cardiovascular benefits, playing hockey develops strength in the lower
body
for skating and the upper body for stick handling and shooting. Regular play
helps develop muscle strength and overall body conditioning. Another benefit
of
hockey includes coordination and balance. Skating and maneuvering on the ice
or field demand a high level of coordination and balance. Moreover, the sport
involves a combination of aerobic and anaerobic activities, promoting overall
fitness. For example, short bursts of intense activity during sprints and
gameplay
contribute to anaerobic conditioning. Another benefit provided by hockey play
is
flexibility. The constant movement and varied actions in hockey help improve
flexibility, especially in the hips, knees, and ankles. Yet another benefit of
playing
hockey includes improved reflexes. Hockey requires quick decision-making and
rapid responses to the movements of the puck or ball and other players. Thus,
hockey helps enhance reflexes and hand-eye coordination.
[0003] In addition to the aforementioned physical benefits, the sport of
hockey
also provides multiple social benefits. Hockey is a team sport that emphasizes
the importance of working together towards a common objective. Players learn
to communicate, coordinate, and support each other on and off the ice or
field.
These factors contribute to the development of teamwork skills. Moreover,
participating in hockey can also serve to develop leadership skills. Players
often
1
Date Recue/Date Received 2023-12-08
take on leadership roles, such as team captain or alternate captain. Players
learn to respect opponents, referees, and teammates, contributing to a
positive
sporting culture. Furthermore, the sport of hockey can help develop
communication skills. Effective communication is essential on the hockey rink.
Players need to convey strategies, call for passes, and coordinate plays.
Players
learn to respect opponents, referees, and teammates, contributing to a
positive
sporting culture. Moreover, being part of a hockey team can help develop
discipline and time management skills. Regular practice schedules and the
commitment to team activities teach players discipline and time management
skills. For young players, balancing sports with other responsibilities can
develop
into a valuable life skill. Thus, playing hockey offers a holistic approach to
physical fitness while promoting essential social skills that can positively
impact
various aspects of life.
SUMMARY
[0004] In one embodiment, there is provided a computer-implemented method
for
hockey practice, comprising: recording a plurality of video frames from an
image
capturing device that is configured to obtain a downward viewpoint of an area
in
front of a user; performing an object tracking process on a hockey workpiece;
rendering, on a user-facing electronic display, a video sequence that includes
the
plurality of video frames; providing one or more augmented reality elements
overlaid on the rendering of the video sequence; computing one or more
performance metrics based on a travel path of the hockey workpiece; and
displaying the one or more computed performance metrics on the user-facing
electronic display.
[0005] In another embodiment, there is provided an apparatus, comprising:
an
electronic computing device comprising: a user-facing electronic display; a
memory having stored thereon a hockey performance assessment module; a
network interface which enables the electronic computing device to connect to,
and exchange data with, at least one second electronic computing device; and a
2
Date Recue/Date Received 2023-12-08
processor communicatively coupled to the display, the memory, and the network
interface, and which executes program code of the hockey performance
assessment module, which enables the electronic computing device to: record a
plurality of video frames from an image capturing device that is configured to
obtain a downward viewpoint of an area in front of a user; perform an object
tracking process on a hockey workpiece; render, on the user-facing electronic
display, a video sequence that includes the plurality of video frames; provide
one
or more augmented reality elements overlaid on the rendering of the plurality
of
video frames; compute one or more performance metrics based on a travel path
of the hockey workpiece; and display the one or more computed performance
metrics on the user-facing electronic display.
[0006] In yet another embodiment, there is provided a computer program
product
comprising a non-transitory computer readable medium having program
instructions that when executed by a processor of an electronic computing
device
comprising a user-facing display, configure the electronic computing device to
perform functions comprising: recording a plurality of video frames from an
image
capturing device that is configured to obtain a downward viewpoint of an area
in
front of a user; performing an object tracking process on a hockey workpiece;
rendering, on the user-facing electronic display, a video sequence that
includes
the plurality of video frames; providing one or more augmented reality
elements
overlaid on the rendering of the plurality of video frames; computing one or
more
performance metrics based on a travel path of the hockey workpiece; and
displaying the one or more computed performance metrics on the user-facing
electronic display.
BRIEF DESCRIPTION OF THE DRAWINGS
[0007] The structure, operation, and advantages of the present invention
will
become further apparent upon consideration of the following description taken
in
conjunction with the accompanying figures (FIGs). The figures are intended to
be illustrative, not limiting.
3
Date Recue/Date Received 2023-12-08
[0008] Certain elements in some of the figures may be omitted, or
illustrated not-
to-scale, for illustrative clarity. The cross-sectional views may be in the
form of
"slices", or "near-sighted" cross-sectional views, omitting certain background
lines which would otherwise be visible in a "true" cross-sectional view, for
illustrative clarity.
[0009] Often, similar elements may be referred to by similar numbers in
various
figures (FIGs) of the drawing, in which case typically the last two
significant digits
may be the same, the most significant digit being the number of the drawing
figure (FIG). Furthermore, for clarity, some reference numbers may be omitted
in
certain drawings.
[0010] FIG. 1 shows an exemplary usage of an embodiment of the present
invention.
[0011] FIG. 2 shows an exemplary user interface showing augmented reality
elements in accordance with disclosed embodiments.
[0012] FIG. 3 shows another exemplary user interface showing augmented
reality
elements in accordance with disclosed embodiments.
[0013] FIG. 4 illustrates an example of overlap in accordance with
embodiments
of the present invention.
[0014] FIG. 5 shows another exemplary user interface showing augmented
reality
elements in accordance with disclosed embodiments.
[0015] FIG. 6 shows another exemplary user interface including user-
facing
video.
4
Date Recue/Date Received 2023-12-08
[0016] FIG. 7A shows a side view of an electronic computing device and
bracket
in accordance with disclosed embodiments.
[0017] FIG. 7B shows a back view of the electronic computing device and
bracket
of FIG. 7A.
[0018] FIG. 8 shows a perspective view of an angled bracket in accordance
with
disclosed embodiments.
[0019] FIG. 9 shows a side view of an angled bracket in accordance with
disclosed embodiments.
[0020] FIG. 10A shows a side view of an electronic computing device and
angled
bracket in accordance with disclosed embodiments.
[0021] FIG. 10B shows a back view of the electronic computing device and
angled bracket of FIG. 10A.
[0022] FIG. 11 shows another exemplary user interface including user-
facing
video.
[0023] FIG. 12 is a block diagram for a system in accordance with
disclosed
embodiments.
[0024] FIG. 13 is a performance metrics visualization in accordance with
disclosed embodiments.
[0025] FIG. 14 is a flowchart indicating process steps for embodiments of
the
present invention.
Date Recue/Date Received 2023-12-08
DETAILED DESCRIPTION
[0026] Becoming an effective hockey player requires a combination of
various
skills. The physical skills include mastery of basic skating techniques,
including
forward and backward skating, quick starts, stops, and tight turns.
Additionally,
strength, endurance, speed, and balance, are valuable assets for both
offensive
and defensive players. Mental skills such as decision making, focus, and
concentration also contribute to being a successful hockey player. Beyond the
aforementioned skills, there are a wide variety of technical skills that need
to be
developed to thrive in the sport of hockey. Accurate and powerful shooting
involves mastering various shot types, including wrist shots, slap shots, and
snap
shots. Moreover, the ability to control the puck with the stick, including
dekes,
fakes, and quick maneuvers, is critical for offensive players.
[0027] Disclosed embodiments provide techniques for developing and
improving
technical hockey skills. An electronic computing device that includes one or
more image acquisition devices is mounted in front of a user (hockey player).
The electronic computing device includes a user-facing display that includes
one
or more augmented reality elements. During use, the user manipulates a hockey
workpiece, such as a hockey puck, hockey ball, or other suitable workpiece in
a
way to interact with the one or more augmented reality elements. A variety of
exercises and drills are provided for users to develop stick handling and
shooting
techniques, which can translate to improved gameplay for the user.
[0028] The descriptions throughout this disclosure contain
simplifications,
generalizations and omissions of detail and is not intended as a comprehensive
description of the claimed subject matter but, rather, is intended to provide
a brief
overview of some of the functionality associated therewith. Other systems,
methods, functionality, features, and advantages of the claimed subject matter
will be or will become apparent to one with skill in the art upon examination
of the
figures and the remaining detailed written description. The above as well as
6
Date Recue/Date Received 2023-12-08
additional objectives, features, and advantages of the present disclosure will
become apparent in the following detailed description.
[0029] Each of the above and below described features and functions of
the
various different aspects, which are presented as operations performed by the
processor(s) of the communication/electronic devices are also described as
features and functions provided by a plurality of corresponding methods and
computer program products, within the various different embodiments presented
herein. In the embodiments presented as computer program products, the
computer program product includes a non-transitory computer readable storage
device having program instructions or code stored thereon, which enables the
electronic device and/or host electronic device to complete the functionality
of
one or more disclosed processes when the program instructions or code are
processed by at least one processor of the corresponding
electronic/communication device, such as is described herein.
[0030] In the following description, specific example embodiments in
which the
disclosure may be practiced are described in sufficient detail to enable those
skilled in the art to practice the disclosed embodiments. For example,
specific
details such as specific method orders, structures, elements, and connections
have been presented herein. However, it is to be understood that the specific
details presented need not be utilized to practice embodiments of the present
disclosure. It is also to be understood that other embodiments may be utilized
and that logical, architectural, programmatic, mechanical, electrical and
other
changes may be made without departing from the general scope of the
disclosure. The following detailed description is, therefore, not to be taken
in a
limiting sense, and the scope of the present disclosure is defined by the
appended claims and equivalents thereof.
[0031] References within the specification to "one embodiment," "an
embodiment," "embodiments", or "one or more embodiments" are intended to
7
Date Recue/Date Received 2023-12-08
indicate that a particular feature, structure, or characteristic described in
connection with the embodiment is included in at least one implementation
(embodiment) of the present disclosure. The appearance of such phrases in
various places within the specification are not necessarily all referring to
the
same embodiment, nor are separate or alternative embodiments mutually
exclusive of other embodiments. Further, various features are described which
may be exhibited by some embodiments and not by others. Similarly, various
aspects are described which may be aspects for some embodiments but not for
other embodiments.
[0032] The terminology used herein is for the purpose of describing
particular
embodiments only and is not intended to be limiting of the disclosure. As used
herein, the singular forms "a", "an", and "the" are intended to include the
plural
forms as well, unless the context clearly indicates otherwise. It will be
further
understood that the terms "comprises" and/or "comprising," when used in this
specification, specify the presence of stated features, integers, steps,
operations,
elements, and/or components, but do not preclude the presence or addition of
one or more other features, integers, steps, operations, elements, components,
and/or groups thereof. Moreover, the use of the terms first, second, etc. do
not
denote any order or importance, but rather the terms first, second, etc. are
used
to distinguish one element (e.g., a person or a device) from another.
[0033] It is understood that the use of specific component, device and/or
parameter names and/or corresponding acronyms thereof, such as those of the
executing utility, logic, and/or firmware described herein, are for example
only
and not meant to imply any limitations on the described embodiments. The
embodiments may thus be described with different nomenclature and/or
terminology utilized to describe the components, devices, parameters, methods
and/or functions herein, without limitation. References to any specific
protocol or
proprietary name in describing one or more elements, features or concepts of
the
embodiments are provided solely as examples of one implementation, and such
8
Date Recue/Date Received 2023-12-08
references do not limit the extension of the claimed embodiments to
embodiments in which different element, feature, protocol, or concept names
are
utilized. Thus, each term utilized herein is to be provided its broadest
interpretation given the context in which that term is utilized.
[0034] Within the descriptions of the different views of the figures, the
use of the
same reference numerals and/or symbols in different drawings indicates similar
or identical items, and similar elements can be provided similar names and
reference numerals throughout the figure(s). The specific identifiers/names
and
reference numerals assigned to the elements are provided solely to aid in the
description and are not meant to imply any limitations (structural or
functional or
otherwise) on the described embodiments.
[0035] FIG. 1 shows an exemplary usage of an embodiment of the present
invention. Diagram 100 includes an electronic computing device 130 that is
secured to a stand 120. During use, a user 102 positions himself/herself in
front
of the electronic computing device 130 as shown in FIG. 1. The user 102 holds
a
hockey stick 104, and uses it to move a hockey workpiece 106. In one or more
embodiments, the hockey workpiece can include a hockey puck, hockey ball, or
other suitable hockey workpiece.
[0036] The stand 120 can include a base 142 that rests on a floor/ground
surface
167. An elongated portion 143 extends from the base 142 to an adjustable
portion 146. The adjustable portion 146 can include one or more spring-loaded
moveably linked supports to enable positioning of the electronic computing
device 130 at a height, indicated by reference 169 above the floor/ground
surface
167. In one or more embodiments, the height indicated by reference 169 can
range from one meter to two meters. The preferred setting depends on the
height of the user 102. In one or more embodiments, the electronic computing
device 130 can include a tablet computer such as an android tablet computer,
iPadO, or the like. One or more embodiments can include a stand. A bracket
9
Date Recue/Date Received 2023-12-08
148 can be attached to the stand 120, where the stand 120 and bracket 148 are
configured and disposed to hold the electronic computing device at a height
ranging from 1 meter to two meters above a floor surface.
[0037] FIG. 2 is an exemplary user interface showing augmented reality
elements
in accordance with disclosed embodiments. Electronic computing device 200
can comprise a tablet computer in one or more embodiments. The electronic
computing device 200 includes electronic display 201. In one or more
embodiments, electronic display 201 comprises a touchscreen, enabling user
interface functionality. In one or more embodiments, the touchscreen includes
a
capacitive touchscreen, resistive touchscreen, infrared (IR) touchscreen, or
other
suitable touchscreen type. In one or more embodiments, the electronic display
comprises a liquid crystal display (LCD), organic light-emitting diode (OLED)
display, AMOLED (Active-Matrix Organic Light-Emitting Diode), or other
suitable
display type.
[0038] Augmented Reality (AR) is a technology that overlays digital
information,
such as images, videos, or 3D models, onto the real-world environment in real-
time. Disclosed embodiments provide real-time interaction by superimposing
digital information onto the user's view of the real world, which includes a
hockey
practice area, hockey stick, and/or hockey workpiece. Disclosed embodiments
track the hockey workpiece to enable the hockey workpiece to interact with one
or more augmented reality elements, such as targets, virtual lines, virtual
goal
nets, and so on. In embodiments, a target defines an area in which the hockey
workpiece (e.g., puck or ball) is intended to pass through as part of a hockey
exercise or drill. Disclosed embodiments utilize object tracking for tracking
a
hockey workpiece with computer vision techniques and/or machine learning.
This can include a series of steps to detect and follow the position of a
hockey
workpiece (e.g., puck or ball) across consecutive frames in a video or image
sequence. The steps can include detecting the hockey workpiece in the initial
frame of the video. The detection can be done using object detection
algorithms,
Date Recue/Date Received 2023-12-08
which identify regions of interest (ROI) in the image that likely contain the
hockey
workpiece. One or more embodiments may utilize an object detection algorithm
including, but not limited to, YOLO (You Only Look Once), SSD (Single Shot
Multibox Detector), and Faster R-CNN (Region-based Convolutional Neural
Network). The steps may further include a feature extraction process. Once the
hockey workpiece is detected, features such as color, texture, or shape are
extracted from the detected region. These features help uniquely identify the
hockey workpiece in subsequent frames. One or more embodiments may further
utilize a tracking algorithm. The tracking algorithm may be initialized by
using the
detected features to create a "track" for the hockey workpiece. The
initialization
may involve creating a bounding box around the hockey workpiece and/or
extracting key points. In one or more embodiments, a motion prediction process
is used to enable more accurate tracking. The motion prediction process can
include estimating the direction and speed of the ball based on its previous
positions. In one or more embodiments, Kalman filters and/or Particle Filters
are
used in the motion prediction process. In one or more embodiments, a computer
vision framework, such as OpenCV is used for providing tools and functions for
implementation of hockey workpiece tracking using various algorithms.
[0039] The electronic computing device 200 can include an image capturing
device (camera) that is configured to acquire still images and/or video. In
embodiments, the image capturing device can be configured to obtain images
from a downward viewpoint of an area in front of a user. As shown in FIG. 2,
this
includes the hockey stick 242, and hockey workpiece 244 of the user. For
example, referring again to FIG. 1, the hockey stick 104 of FIG. 1, and hockey
workpiece 106 of FIG. 1 can be represented by hockey stick 242 and hockey
workpiece 244 of FIG. 2. One or more augmented reality targets may be
synthesized and rendered on the display 201. As shown in FIG. 2, four
augmented reality targets are shown, indicated as 204, 206, 208, and 210. In
one exemplary use of disclosed embodiments, a user manipulates the hockey
workpiece with his/her hockey stick to move the hockey workpiece such that the
11
Date Recue/Date Received 2023-12-08
hockey workpiece overlaps with one or more targets during the course of travel
of the hockey workpiece. In embodiments, a performance metric, such as a
score, is computed and rendered on the display 201, such as score 234,
indicating a current score of 6. In one or more embodiments, an objective of a
hockey drill is to "clear" all the targets as quickly as possible, by
manipulating the
hockey workpiece (e.g., puck, ball, etc.) such that the rendering of the
hockey
workpiece on display 201 overlaps with the rendering of an augmented reality
target. In one or more embodiments, when the hockey workpiece overlaps with
the augmented reality target, the augmented reality target is removed from the
screen, and the score is incremented accordingly. Additionally, in one or more
embodiments, an elapsed time for clearing the targets is rendered as shown at
reference 232. In one or more embodiments, a bonus is added to the score
when all targets are cleared within a predetermined time interval. As an
example, a bonus of 10 points may be added to the final score when all
augmented reality targets are cleared within 30 seconds. As a user continues
to
practice using disclosed embodiments, his/her stick-handling techniques can
improve. The electronic computing device can further include a user-facing
camera (front-facing camera) 202. In one or more embodiments, the user-facing
camera 202 can acquire images and/or video of the user as he/she performs
hockey practice drills, such as the aforementioned target clearing drill.
[0040] In one or more embodiments, the one or more augmented reality
elements
includes at least one target. In one or more embodiments, performing an object
tracking process on a hockey workpiece comprises performing an object tracking
process on a hockey puck. In one or more embodiments, performing an object
tracking process on a hockey workpiece comprises performing an object tracking
process on a ball.
[0041] FIG. 3 shows another exemplary user interface showing augmented
reality
elements in accordance with disclosed embodiments. Electronic computing
device 300 can comprise a tablet computer in one or more embodiments.
12
Date Recue/Date Received 2023-12-08
Electronic computing device 300 can be similar to electronic computing device
200 of FIG. 2. Continuing from the example shown in FIG. 2, a hockey
workpiece 344 is set in motion along path 343 by hockey stick 342, which is
manipulated by a user (e.g., 102 of FIG. 1). As can be seen in FIG. 3, the
path
343 indicates that the hockey workpiece 344 (e.g., a hockey puck) moves such
that it overlaps with augmented reality target 308 during the travel of the
hockey
workpiece. In response to the hockey workpiece 344 overlapping the augmented
reality target 308, the processor within the electronic computing device 300
removes the augmented reality target from the electronic display 301, and
increments the score 334 accordingly. The elapsed time 332 also continues to
increment as the user performs the target clearing drill. Additional augmented
reality targets 310, 304, and 306 remain to be cleared. In one or more
embodiments, as augmented reality targets are cleared, new augmented reality
targets can be rendered to allow the target clearing hockey practice drill to
continue. In one or more embodiments, the new augmented reality targets can
be rendered in a random, or semi-random location. In one or more
embodiments, the rendering of a new augmented reality target in a semi-random
location can include rendering a new augmented reality target in an opposite
half
of the display from the augmented reality target that was just cleared.
[0042] One or more embodiments can include: determining that at least one
image of the hockey workpiece is overlapping with a region defined by the at
least one target; modifying a performance metric based on the overlapping; and
presenting the performance metric on the user-facing electronic display. One
or
more embodiments can include providing multiple targets, and further include:
determining that at least one image of the hockey workpiece is overlapping
with a
corresponding region defined by each of the multiple targets; modifying a
performance metric based on the overlapping;
[0043] recording an elapsed time for each region to undergo an
overlapping
condition; and
13
Date Recue/Date Received 2023-12-08
[0044] presenting the performance metric and the elapsed time on the user-
facing electronic display.
[0045] FIG. 4 illustrates an example 400 of overlap in accordance with
embodiments of the present invention. As shown in the example 400, an
augmented reality target 405 is shown. A boundary region 402 is computed for
the augmented reality target 405. In one or more embodiments, the boundary
region is computed as the smallest circle that circumscribes the augmented
reality target. This technique accommodates non-standard shapes of augmented
reality targets, such as a "star" shape, a team logo, and/or other non-
standard
shapes. A hockey workpiece boundary region 404 is computed for a hockey
workpiece 408. When a hockey workpiece is positioned such that overlap exists
between the hockey workpiece boundary region 404 and the augmented reality
target boundary region 402, an overlap region 412 is formed, that includes an
area that is part of both the hockey workpiece boundary region 404 and the
augmented reality target boundary region 402. When the overlap region 412
exists, disclosed embodiments register a target-clearing event, and perform a
target clearing process. The target clearing process can include adjusting a
performance metric such as a score, clearing (removing) the augmented reality
target 405, and/or rendering a new augmented reality target in a new location
on
the display of the electronic computing device. In one or more embodiments,
the
score is adjusted as a function of the area of the overlap region 412. As an
example, when the maximum size of overlap region 412 is less than half the
area
defined by hockey workpiece boundary region 404, one point may be awarded.
Similarly, if the maximum size of overlap region 412 is greater than or equal
to
half of the area defined by hockey workpiece boundary region 404, two points
may be awarded. In this way, disclosed embodiments can promote accurate
placement of a hockey workpiece, and update the score based on the accuracy
of the placement.
14
Date Recue/Date Received 2023-12-08
[0046] FIG. 5 shows another exemplary user interface showing augmented
reality
elements in accordance with disclosed embodiments. Electronic computing
device 500 can comprise a tablet computer in one or more embodiments.
Electronic computing device 500 can be similar to electronic computing device
200 of FIG. 2. FIG. 5 illustrates a speed-measuring application of disclosed
embodiments. A user (e.g., 102 of FIG. 1) manipulates his/her hockey stick 542
to shoot the hockey workpiece (e.g., puck or ball) along a path 543 such that
it
crosses two augmented reality lines, indicated as augmented reality line 551
and
augmented reality line 553. These lines are generated by a processor within
electronic computing device 500. Disclosed embodiments determine the elapsed
time for the hockey workpiece to traverse augmented reality line 551 and
augmented reality line 553. As shown in FIG. 5, the hockey workpiece contacts
augmented reality line 551 at position 541, and a time of contact with
augmented
reality line 551 is recorded. Similarly, the hockey workpiece contacts
augmented
reality line 553 at position 544, and a time of contact with augmented reality
line
553 is recorded. A difference between the two times is computed. Based on the
time difference, and an estimated distance between the two augmented reality
lines 551 and 553, an estimated hockey workpiece speed is computed and
rendered as shown at 557. Shot speed is an important aspect of hockey, and
shot speed can significantly impact a player's effectiveness. A faster shot is
harder for goaltenders to react to, increasing the likelihood of scoring.
Players
with powerful and quick shots can capitalize on scoring opportunities even in
tight
spaces. Moreover, a high-speed shot increases the chances of generating
rebounds off the goaltender's pads or creating opportunities for teammates to
deflect the puck into the net. Disclosed embodiments provide a feature that
allows users to develop their shot speed. In one or more embodiments, a
history
of the most recent shot speeds is displayed, as shown at 557 where the three
most recent shot speeds are displayed.
[0047] One or more embodiments can include determining a hockey workpiece
speed between two augmented reality elements from the one or more
Date Recue/Date Received 2023-12-08
augmented reality elements; and presenting a hockey workpiece speed on the
user-facing electronic display. One or more embodiments can include: recording
hockey workpiece speed values corresponding to multiple shots; and presenting
a hockey workpiece speed history on the user-facing electronic display. In one
or
more embodiments, a calibration procedure is performed prior to utilizing the
speed-measuring function. The calibration procedure can include placing a
meter stick on the floor surface, and then adjusting the position of the
augmented
reality line 551 and augmented reality line 553, such that the distance D
between
the two lines is one meter. In this way, a speed in miles per hour, kilometers
per
hour, or other suitable unit can be computed based on the time required for
the
hockey workpiece to traverse both augmented reality line 551 and augmented
reality line 553.
[0048] FIG. 6 shows another exemplary user interface including user-
facing
video. Electronic computing device 600 can comprise a tablet computer in one
or more embodiments. Electronic computing device 300 can be similar to
electronic computing device 200 of FIG. 2. FIG. 6 also shows a portion of a
bracket 620 that may be used in one or more embodiments to clamp or squeeze
the electronic computing device 600 to secure it to a stand (e.g., 120 of FIG.
1),
as shown in FIG. 1.
[0049] The electronic computing device can further include a user-facing
camera
(front-facing camera) 602. In one or more embodiments, the user-facing camera
602 can acquire images and/or video of the user as he/she performs hockey
practice drills, such as the aforementioned target clearing drill, and render
the
user-facing view 661 in a region of the electronic display 601. In this
embodiment, the user (e.g., 102 of FIG. 1) can view himself/herself in a
straight-
on view as shown in view 661, where an image of the user 662, hockey stick
663, and hockey workpiece 664 are shown. Additionally, the hockey stick is
also
visible in a top-down view as shown at 642, along with hockey workpiece 644.
Moreover, multiple augmented reality targets, indicated as 608 and 610 are
16
Date Recue/Date Received 2023-12-08
shown. A performance metric such as a score, indicated as 634 may also be
shown, along with an elapsed time indicated as 632. Accordingly, disclosed
embodiments enable a user to view his/her stick and hockey workpiece from
multiple angles simultaneously. Viewing multiple video angles to analyze
sports
techniques provides several benefits for athletes and coaches. Multiple angles
provide a more comprehensive view of an athlete's performance. Different
perspectives help capture nuances and details that may be missed when
analyzing from a single viewpoint. Furthermore, multi-angle video analysis
enables a thorough examination of biomechanics. Coaches and athletes can
assess body positioning, joint angles, and movement patterns from various
perspectives, helping to identify areas for improvement. Moreover, viewing
from
different angles makes it easier to identify errors or inconsistencies in
technique.
Whether it's foot placement, hand positioning, or body alignment, coaches can
pinpoint issues and work with athletes on corrective measures. Thus, disclosed
embodiments provide powerful tools for enabling hockey players to improve
their
skills.
[0050] FIG. 7A shows a side view of an assembly 700 including an
electronic
computing device and bracket in accordance with disclosed embodiments.
Electronic computing device 701 is secured by bracket 720, which clamps a top
and bottom edge of the electronic computing device 701. Electronic computing
device 701 can comprise a tablet computer in one or more embodiments.
Electronic computing device 701 can be similar to electronic computing device
200 of FIG. 2. A mounting rod 722 is affixed to bracket 720 at one end of the
mounting rod 722, and can be affixed to a stand at the other end, to enable
mounting of the electronic computing device 701 on a stand, similar to as
shown
in FIG. 1. FIG. 7B shows a back view of the assembly 700 including electronic
computing device 701 and bracket of FIG. 7A, as viewed from the direction
indicated by arrow A in FIG. 7A. In FIG. 7A and FIG. 7B, a rear-facing camera
715 is visible. In one or more embodiments, the rear-facing camera 715 is used
for acquiring downward images of an area in front of a user. In one or more
17
Date Recue/Date Received 2023-12-08
embodiments, the electronic computing device comprises a tablet computer,
where the tablet computer includes a front-facing camera and a rear-facing
camera.
[0051] FIG. 8 shows a perspective view of an angled bracket 800 in
accordance
with disclosed embodiments. The angled bracket can include a straight portion
810. Attached at one end of the straight portion 810 is a hooked portion 814.
The hooked portion 814 is configured and disposed to hook over the edge of an
electronic computing device such as a tablet computer. Attached at a second
end of the straight portion 810 is an angled portion 818. In one or more
embodiments, the angled portion 818 includes a reflective (mirrored) surface
823. In one or more embodiments, the angled portion 818 is positioned with
respect to the rear-facing camera (715 of FIG. 7B), such that the rear facing-
camera (715 of FIG. 7B) obtains images/video of a downward viewpoint of an
area in front of a user. For a user practicing hockey, this can include the
area
within a few feet in front of the user where his/her hockey stick can reach
while
being held by the user.
[0052] FIG. 9 shows a side view of an angled bracket in accordance with
disclosed embodiments. Electronic computing device 901 has an angled bracket
905 installed thereon. Electronic computing device 901 can comprise a tablet
computer in one or more embodiments. Electronic computing device 901 can be
similar to electronic computing device 200 of FIG. 2. In one or more
embodiments, angled bracket 905 can be similar to angled bracket 800 of FIG.
8.
Electronic computing device 901 includes rear-facing camera 915, which
acquires downward-facing images of floor (or ground) surface 927. In one or
more embodiments, the stand further comprises an angled bracket disposed
within a field of view (FOV) of the rear-facing camera, and where the angled
bracket comprises a mirrored surface, such that the rear-facing camera
acquires
the downward viewpoint.
18
Date Recue/Date Received 2023-12-08
[0053] As indicated by line R, the mirrored surface of angled bracket 905
(as
shown at 823 in FIG. 8) enables the rear-facing camera of the electronic
computing device to acquire downward-facing images. Thus, disclosed
embodiments enable an off-the-shelf tablet computer to be used as the
electronic
computing device to implement one or more features described herein. Using
off-the-shelf (OTS) computers for product design can offer several benefits.
Off-
the-shelf computers are generally more cost-effective than custom-built
solutions.
This is because they are produced in larger quantities, benefiting from
economies of scale. Furthermore, OTS computers are readily available from
various manufacturers and suppliers. This means faster procurement and
deployment times compared to custom-built solutions, which may take longer to
design, manufacture, and assemble. Moreover, designing and building custom
computers can be time-consuming. Off-the-shelf solutions save time as they are
pre-assembled and configured, ready for use upon purchase. The angled
bracket 905 enables effective use of an off-the-shelf tablet computer in
disclosed
embodiments. Moreover, application development kits (ADKs) for popular tablet
computers such as iOS devices and android devices enable one or more
applications (apps) to be developed for performing the augmented reality
functions, performance metric computation functions, video acquisition
functions,
and/or other functions of disclosed embodiments.
[0054] FIG. 10A shows a side view of an assembly 1000 including an
electronic
computing device and angled bracket in accordance with disclosed
embodiments. Electronic computing device 1001 is secured by bracket 1020,
which clamps a top and bottom edge of the electronic computing device 1001.
Electronic computing device 1001 can comprise a tablet computer in one or more
embodiments. Electronic computing device 1001 can be similar to electronic
computing device 200 of FIG. 2. Amounting rod 1022 is affixed to bracket 1020
at one end of the mounting rod 1022, and can be affixed to a stand at the
other
end, to enable mounting of the electronic computing device 1001 on a stand,
similar to as shown in FIG. 1. Angled bracket 1005 is also shown in FIG. 10A.
In
19
Date Recue/Date Received 2023-12-08
one or more embodiments, angled bracket 1005 can be similar to angled bracket
800 of FIG. 8.
[0055] FIG. 10B shows a back view of the assembly 1000 including
electronic
computing device 1001 and bracket of FIG. 10A, as viewed from the direction
indicated by arrow A in FIG. 10A. As shown in FIG. 10B, the angled bracket
1005 is positioned such that the angled portion 1034 (similar to 818 of FIG.
8) is
disposed in a line of sight for the rear-facing camera 1015, enabling the rear-
facing camera 1015 to acquire images of a downward viewpoint of an area in
front of a user. Additionally, a user-facing (front-facing) camera 1017 may be
used to simultaneously acquire and present user-facing video in an inset
window,
along with the downward viewpoint, such as shown in FIG. 6. In one or more
embodiments, the electronic computing device comprises a tablet computer,
where the tablet computer includes a front-facing camera and a rear-facing
camera. In FIG. 10A, a rear-facing camera 1015 is visible. In one or more
embodiments, the rear-facing camera 1015 is used for acquiring downward
images of an area in front of a user.
[0056] FIG. 11 shows another exemplary user interface including user-
facing
video. Electronic computing device 1100 can comprise a tablet computer in one
or more embodiments. Electronic computing device 1100 can be similar to
electronic computing device 200 of FIG. 2. The electronic computing device can
further include a user-facing camera (front-facing camera) 1102. In one or
more
embodiments, the user-facing camera 1102 can acquire images and/or video of
the user as he/she performs hockey practice drills, such as the aforementioned
target clearing drill, and render the user-facing view 1161 in a region of the
electronic display 1101. In embodiments, a performance metric, such as a score
or hockey workpiece speed, is computed and rendered on the display 1101, such
as score 1134, indicating a current score of 6. Additionally, in one or more
embodiments, an elapsed time for performing an exercise or practice drill is
rendered as shown at reference 1132.
Date Recue/Date Received 2023-12-08
[0057] FIG. 11 also shows a portion of a bracket 1120 that may be used in
one or
more embodiments to clamp or squeeze the electronic computing device 1100 to
secure it to a stand (e.g., 120 of FIG. 1), as shown in FIG. 1. Additionally,
in FIG.
11, a portion of angled bracket 1105 is also visible. In one or more
embodiments,
angled bracket 1105 can be similar to angled bracket 800 of FIG. 8.
Additionally,
in FIG. 11, adjustable clamp 1172 and adjustable clamp 1174 may be used to
secure electronic computing device 1100 to a stand (such as depicted in FIG.
1).
In one or more embodiments, the adjustable clamps 1172 and 1174 included
threaded bolts and wing nuts to enable adjustability to accommodate a variety
of
different sized of electronic computing devices that have a tablet computer
form
factor.
[0058] FIG. 12 is a block diagram for a system 1200 in accordance with
disclosed
embodiments. System 1200 includes electronic computing device 1201.
Electronic computing device 1201 can comprise a tablet computer in one or more
embodiments. Electronic computing device 1201 can be similar to electronic
computing device 200 of FIG. 2.
[0059] In embodiments, the electronic computing device 1201 is
implemented as
a computer comprising a processor 1204, and memory 1206 coupled to the
processor 1204. The memory 1206 may be a non-transitory computer readable
storage medium. Memory 1206 may include RAM, ROM, flash, EEPROM, or
other suitable storage technology. The memory 1206 contains instructions, that
when executed by processor 1204, enable implementation of one or more
features of disclosed embodiments. In one or more embodiments, the memory
1206 contains hockey performance assessment module 1207. The hockey
performance assessment module 1207 can include functions and/or instructions
for rendering augmented reality targets, computing performance metrics,
displaying performance metrics, and/or other features of disclosed
embodiments.
21
Date Recue/Date Received 2023-12-08
[0060] The electronic computing device 1201 may further include a user-
facing
image acquisition system 1208. The user-facing image acquisition system 1208
may include one or more cameras, image sensors, lenses, image signal
processors (ISPs), and/or other components for acquiring user-facing images,
such as those depicted at 661 in FIG. 6. The electronic computing device 1201
may further include a downward-facing image acquisition system 1210. The
downward-facing image acquisition system 1210 may include one or more
cameras, image sensors, lenses, image signal processors (ISPs), and/or other
components for acquiring images obtained from a downward viewpoint of an
area in front of a user, such as depicted in 201 of FIG. 2. The electronic
computing device 1201 may perform image manipulation such as flipping,
rotation, and/or scaling to present images to the user in the desired
orientation.
The electronic computing device 1201 may further include an electronic display
1220. In one or more embodiments, electronic display 1220 comprises a
touchscreen, enabling user interface functionality. In one or more
embodiments,
electronic display 1220 can be similar to electronic display 201 of FIG. 2.
[0061] Electronic computing device 1201 can further include user interface
1222.
In one or more embodiments, user interface 1222 may be implemented via
touchscreen functionality of electronic display 1220. The user interface 1222
can
enable features such as calibration, entering of user preferences and other
customizations, selection of games and/or practice drills, and/or other
features
and/or functions. Electronic device 1201 can further include network interface
1228 to enable the electronic computing device to connect to, and exchange
data
with, at least one second electronic computing device, such as a server.
Network
interface 1228 can include one or more interfaces to enable wired and/or
wireless communication. In one or more embodiments, network interface 1228
can support wired communication such as via Ethernet. In one or more
embodiments, network interface 1228 can support wireless communication such
as via VVi-Fi, Bluetooth0, infrared, and/or other suitable wireless
technology. The
network interface 1228 can enable communication to additional electronic
22
Date Recue/Date Received 2023-12-08
computing devices via network 1235. Network 1235 can include one or more of
a local area network (LAN), wide area network (WAN), and/or other types of
networks. In embodiments, network 1235 may include the Internet.
[0062] One or more embodiments may include a business system 1260. The
business system 1260 may include one or more computers to support various
business functions and services to manage financial transactions, user
accounts,
and subscription services for disclosed embodiments. These functions can
include user registration functions that allow users to create accounts,
providing
necessary information. The functions can further include profile management
functions that enable users to establish and/or update personal details,
payment
information, and preferences. The functions can further include payment
processing functions that integrate with payment gateways to securely process
financial transactions. Disclosed embodiments can support various payment
methods, including credit/debit cards, digital wallets, and other electronic
payment options. The functions can include user notification functions. This
can
include sending automated emails for billing-related events, such as payment
receipts, upcoming renewals, and account updates, as well as periodic reports
and user summaries highlighting user practice schedules and progress in
performing various hockey practice drills and/or other practice activities.
[0063] One or more embodiments may include a video server system 1240.
The
video server system 1240 may include one or more computers to support various
video functions. The video server system 1240 can provide functions for
ingesting video content from various sources, such as cameras from one or more
electronic computing devices such as 200 of FIG. 2. In one or more
embodiments, the video server system 1240 records and stores the incoming
video data. The video server system 1240 can perform storage and archiving
functions. One or more embodiments can perform metadata tagging on one or
more videos. The metadata can include date, time, location, and keywords. This
helps in categorizing and searching for specific content. The keywords can
23
Date Recue/Date Received 2023-12-08
include a user identifier, a name of a hockey drill, a performance metric, and
so
on. In one or more embodiments, users may have the option to record and save
videos of their practice drills for viewing at a later time. The videos may
include
multi-angle videos such as depicted in FIG. 6 and FIG. 11. This feature can be
a
valuable tool for athletes and/or coaching staff to review performance and
identify
suggestions for improvements.
[0064] One or more embodiments may include a player analytics system
1250.
The player analytics system 1250 may include one or more computers to support
various sports biomechanics analysis functions. The player analytics system
1250 can provide functions such as computation of body kinematics parameters.
This can include calculating joint angles and/or limb positions. This
information
helps in assessing the athlete's technique and form during various movements.
The player analytics system 1250 can provide functions such as stick-handling
analysis. The stick-handling analysis can include image analysis to assess the
hockey players swing path, angle of attack, and body positioning when taking a
shot. This aids in optimizing technique and power generation. The player
analytics system 1250 may further include functions for side-by-side
comparisons. This enables coaches and athletes to compare different
performances or techniques side by side. This visual comparison aids in
identifying changes and improvements over time. By leveraging computerized
image analysis in sports biomechanics, coaches and athletes gain valuable
insights into stick-handling movement patterns and mechanics. This information
enables targeted interventions and training strategies to enhance performance,
reduce the risk of injuries, and optimize overall athletic efficiency, thereby
enabling improved hockey playing skills, taking the sport to the next level.
[0065] FIG. 13 is a performance metrics visualization in accordance with
disclosed embodiments. Graph 1300 includes a horizontal axis 1302, and a
vertical axis 1304. In one or more embodiments, the horizontal axis 1302
represents time. The time can be units of hours, days, weeks, months, or other
24
Date Recue/Date Received 2023-12-08
suitable time unit. In one or more embodiments, the vertical axis represents a
performance metric. The performance metric can include a score, a completion
time, a hockey workpiece speed, and/or other suitable metric. In one or more
embodiments, the performance metric can be a combined metric that is a
function of multiple individual metrics, such as being a function of
completion
time and score, for example. A trend curve 1310 indicates change in the
performance metric over time. In one or more embodiments, the performance
metrics visualization may be computed by the processor of the electronic
computing device used for the image acquisition (e.g., device 130 of FIG. 1).
This feature can enable a user to observe his/her progress over time.
[0066] FIG. 14 is a flowchart 1400 indicating process steps for
embodiments of
the present invention. At block 1450, video frames are recorded with a
downward viewpoint. This can include using an angled bracket as previously
described and shown in FIG. 8. At block 1452, an object tracking process is
performed on a hockey workpiece. In one or more embodiments, the hockey
workpiece includes a puck or a ball. In embodiments, the puck is one inch
thick
and three inches in diameter. At block 1456, one or more augmented reality
elements are provided. In one or more embodiments, the augmented reality
elements can include targets. The targets can include shapes, symbols, and/or
icons that may be part of a game or practice drill. The augmented reality
elements can include one or more lines, a virtual goal net, and/or other
elements
suitable for development of games and/or practice drills that promote hockey
skills. At block 1458 a performance metric is computed based on a travel path
of
the hockey workpiece. The performance metric can include determining overlap,
at block 1462. Alternatively, or additionally, the performance metric can
include
determining a workpiece speed, and block 1464. The flowchart 1400 continues
with displaying the performance metric at block 1470. The performance metric
can be displayed in alphanumeric format, such as shown at 634 of FIG. 6. The
performance metric can be displayed in a graphical format, such as shown in
FIG. 13. In one or more embodiments, one or more of the process steps shown
Date Recue/Date Received 2023-12-08
in FIG. 14 may be omitted, performed in a different order, or performed
concurrently.
[0067] One or more embodiments can include a computer-implemented method
for hockey practice, comprising: recording a plurality of video frames from an
image capturing device that is configured to obtain a downward viewpoint of an
area in front of a user, where the downward viewpoint enables capturing images
of a hockey workpiece; performing an object tracking process on the hockey
workpiece; rendering, on a user-facing electronic display, a video sequence
that
includes the plurality of video frames; providing one or more augmented
reality
elements overlaid on the rendering of the plurality of video frames; and
computing one or more performance metrics based on a travel path of the
hockey workpiece; and displaying the one or more computed performance
metrics on the user-facing electronic display.
[0068] As can now be appreciated, disclosed embodiments provide an
augmented-reality based hockey practice system. Practicing stick-handling
drills
is crucial for improving as a hockey player, as it enhances a player's ability
to
control the puck, make precise movements, and navigate by opponents
effectively. Stick-handling drills enhance a player's feel for the puck,
improving
their ability to control it with finesse. Furthermore, stick-handling drills
improve
hand-eye coordination, allowing players to track the puck while executing
precise
movements. Stick-handling drills promote the development of multi-directional
skills, allowing players to move the puck effectively in any direction.
Moreover,
players can learn to vary their stick-handling speed, adding unpredictability
to
their play. Advanced stick-handling drills teach players deceptive moves,
making
it harder for defenders to anticipate their next move.
[0069] Disclosed embodiments provide techniques for practicing a variety
of skills
and drills for improved hockey play. One or more embodiments can utilize an
off-
the-shelf tablet computer. In one or more embodiments, specialized software,
26
Date Recue/Date Received 2023-12-08
such as an application ("app") executing on the off-the-shelf tablet computer
provides a user interface, performs image acquisition, and implements training
exercises and/or games that can allow a user to practice important hockey
skills.
Disclosed embodiments may be utilized on ice, a gym floor, a carpet, or any
other suitable surface. Disclosed embodiments provide additional hockey
practice opportunities in a fun and interactive environment. Disclosed
embodiments can employ a subscription-based model, or a pay-at-once model.
Some embodiments may include additional services that are performed via
servers, such as depicted at 1240, 1250, and 1260 of FIG. 12. Disclosed
embodiments can provide additional analysis of player performance and
progress tracking. Other embodiments may include fun games in an arcade
format, enabling the introduction of the exciting game of hockey to a wide
audience.
[0070] In the above-described methods, one or more of the method
processes
may be embodied in a computer readable device containing computer readable
code such that operations are performed when the computer readable code is
executed on a computing device. In some implementations, certain operations of
the methods may be combined, performed simultaneously, in a different order,
or
omitted, without deviating from the scope of the disclosure. Further,
additional
operations may be performed, including operations described in other methods.
Thus, while the method operations are described and illustrated in a
particular
sequence, use of a specific sequence or operations is not meant to imply any
limitations on the disclosure. Changes may be made with regards to the
sequence of operations without departing from the spirit or scope of the
present
disclosure. Use of a particular sequence is therefore, not to be taken in a
limiting
sense, and the scope of the present disclosure is defined only by the appended
claims.
[0071] Aspects of the present disclosure are described above with
reference to
flowchart illustrations and/or block diagrams of methods, apparatus (systems)
27
Date Recue/Date Received 2023-12-08
and computer program products according to embodiments of the disclosure. It
will be understood that each block of the flowchart illustrations and/or block
diagrams, and combinations of blocks in the flowchart illustrations and/or
block
diagrams, can be implemented by computer program instructions. Computer
program code for carrying out operations for aspects of the present disclosure
may be written in any combination of one or more programming languages,
including an object-oriented programming language, without limitation. These
computer program instructions may be provided to a processor of a general-
purpose computer, special-purpose computer, or other programmable data
processing apparatus to produce a machine that performs the method for
implementing the functions/acts specified in the flowchart and/or block
diagram
block or blocks. The methods are implemented when the instructions are
executed via the processor of the computer or other programmable data
processing apparatus.
[0072] As will be further appreciated, the processes in embodiments of the
present disclosure may be implemented using any combination of software,
firmware, or hardware. Accordingly, aspects of the present disclosure may take
the form of an entirely hardware embodiment or an embodiment combining
software (including firmware, resident software, micro-code, etc.) and
hardware
aspects that may all generally be referred to herein as a "circuit," "module,"
or
"system." Furthermore, aspects of the present disclosure may take the form of
a
computer program product embodied in one or more computer readable storage
device(s) having computer readable program code embodied thereon. Any
combination of one or more computer readable storage device(s) may be
utilized.
The computer readable storage device may be, for example, but not limited to,
an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor
system, apparatus, or device, or any suitable combination of the foregoing.
More
specific examples (a non-exhaustive list) of the computer readable storage
device can include the following: a portable computer diskette, a hard disk, a
random-access memory (RAM), a read-only memory (ROM), an erasable
28
Date Recue/Date Received 2023-12-08
programmable read-only memory (EPROM or Flash memory), a portable
compact disc read-only memory (CD-ROM), an optical storage device, a
magnetic storage device, or any suitable combination of the foregoing. In the
context of this document, a computer readable storage device may be any
tangible medium that can contain or store a program for use by or in
connection
with an instruction execution system, apparatus, or device.
[0073] Where utilized herein, the terms "tangible" and "non-transitory"
are
intended to describe a computer-readable storage medium (or "memory")
excluding propagating electromagnetic signals, but are not intended to
otherwise
limit the type of physical computer-readable storage device that is
encompassed
by the phrase "computer-readable medium" or memory. For instance, the terms
"non-transitory computer readable medium" or "tangible memory" are intended to
encompass types of storage devices that do not necessarily store information
permanently, including, for example, RAM. Program instructions and data stored
on a tangible computer-accessible storage medium in non-transitory form may
afterwards be transmitted by transmission media or signals such as electrical,
electromagnetic, or digital signals, which may be conveyed via a communication
medium such as a network and/or a wireless link.
[0074] The description of the present disclosure has been presented for
purposes
of illustration and description, but is not intended to be exhaustive or
limited to
the disclosure in the form disclosed. Many modifications and variations will
be
apparent to those of ordinary skill in the art without departing from the
scope of
the disclosure. The described embodiments were chosen and described in order
to best explain the principles of the disclosure and the practical
application, and
to enable others of ordinary skill in the art to understand the disclosure for
various embodiments with various modifications as are suited to the particular
use contemplated.
29
Date Recue/Date Received 2023-12-08
[0075] As used herein, the term "or" is inclusive unless otherwise
explicitly noted.
Thus, the phrase "at least one of A, B, or C" is satisfied by any element from
the
set {A, B, Cl or any combination thereof, including multiples of any element.
[0076] While the disclosure has been described with reference to example
embodiments, it will be understood by those skilled in the art that various
changes may be made and equivalents may be substituted for elements thereof
without departing from the scope of the disclosure. In addition, many
modifications may be made to adapt a particular system, device, or component
thereof to the teachings of the disclosure without departing from the scope
thereof. Therefore, it is intended that the disclosure not be limited to the
particular
embodiments disclosed for carrying out this disclosure, but that the
disclosure
will include all embodiments falling within the scope of the appended claims.
Date Recue/Date Received 2023-12-08
